상세정보

This timely and accessible guide on the conduct of evaluation studies explores how we apply research methods in evaluating social programs, illustrating its points with reference to a variety of fields, including education, social services, and criminal justice. Offers practical advice on understanding the reasons for the study, identifying key questions to be answered, and planning and implementing the overall design of the study, including measurement, qualitative methods of inquiry, data collection, analysis, reporting, and dissemination. Stresses that understanding the underlying theory of the program is essential to developing the most appropriate evaluation, and emphasizes the need to take ethical considerations into account all along the course of the study. Covers meta-analysis, cost-benefit analysis and includes a non-technical discussion of the logic of data analysis. Includes references to further sources on measurement, existing longitudinal data sets, statistics, and qualitative analysis. For professionals in psychology, sociology, public health, public policy/affairs, education, and criminal justice.

정보제공 :

CONTENTS

Preface = ⅸ

Chapter 1 Setting the Scene = 1

 Domain of Evaluation = 3

 Definition of Evaluation = 4

 What Is Evaluated? An Excursus on Terminology = 6

 Outcome and Process Evaluation = 8

 Contributions of Evaluation = 10

 History of Evaluation = 10

 Comparison between Evaluation and Other Research = 15

 Summary = 18

Chapter 2 Purposes of Evaluation = 20

 Who Wants Evaluation? = 20

 Overt and Covert Purpases = 21

 Conditions Unfarvorable for Evaluation = 24

 Evaluation for Decision Marking = 25

 Evaluation as Organizational Learning = 26

 Intended Uses for Evaluation = 28

 Formative and Summative Evaluation = 31

 Formative-Summative and Process-Outcome : Different Constructs = 32

 Compatibility of Purposes = 33

 How Evaluations Are Commissioned = 34

 Inside versus Outside Evaluation = 37

 Level in the Structure = 39

 Whose Use Shall Be Served? = 41

 Summary = 44

Chapter 3 Understanding the Program = 46

 Why Program Knowledge Pays = 46

 Characterizing the Program = 48

 Getting to Know the Program = 50

 What Is the Program Trying to Achieve? = 51

 How the Program Works : Surfacing the Program's Theories of Change = 55

 Program Theory and Implementation Theory = 57

 Organizing Evaluation to Investigate Program Theories = 58

 Building Program Theory = 61

 Using Theories of Change as a Guide to Evaluation = 62

 Comparing Program Theory to Actual Developments = 66

 Advantages of Explicating Theories of Change = 67

 Critiques of Program Theory = 69

 Summary = 70

Capter 4 Planning the Evaluation = 72

 The Right Time to Evaluate = 73

 Types of Evaluation Questions = 74

 Additional Decisions in the Planning Period = 76

 How to Decide Which Questions to Pursue = 77

 Specifying the Questions = 81

 Quantitive or Qualitative Study = 82

 Design of the Evaluation = 87

 One Study or a Fleet of Studies? = 89

 Designs for Different Types of Programs = 90

 Some Practical Plans = 91

 Ethical Issues = 92

 Summary = 112

Chapter 5 Roles for the Evaluator = 97

 Types of Participative Roles = 99

 Reasons for Alternative Evaluator Roles = 100

 Implementing a Participatory Evaluation = 103

 Balance of Pros and Cons = 105

 Additional Limitations to Participatory Apporaches = 108

 Ethical Issues = 109

 Summary = 112

Chapter 6 Developing Measures = 114

 Measurement = 115

 Program Outcomes = 117

 Choices among Measures = 123

 Unanticipated Consequences = 126

 Interim Markers of Progress = 127

 Program Processes = 130

 Program Inputs, Resources, and Environment = 132

 Multiple Measures = 136

 How Many Measures Are Enough? = 137

 Measurement of Variables = 137

 Developing New Measures = 139

 Desirable Characteristics of Measures in Evaluation = 144

 Summary = 150

Chapter 7 Collecting Data = 152

 Sources of Data = 152

 Sampling = 163

 Interviewing = 166

 Conding Responses = 168

 Existing Statistical Data = 170

 Ethical Issues in Collecting Data = 175

 Summary = 178

Chapter 8 Design of the Evaluation = 180

 Designing the Process Evaluation = 181

 Designing the Outcome Evaluation = 182

 Important Concepts = 184

 Designs = 188

 Informal Designs = 188

 Formal Designs = 191

 Summary = 213

Chapter 9 The Randomized Experiment = 215

 Random Assignment = 215

 Planned Variations = 221

 Procedures for Random Assigment = 223

 Coping with Difficulties That Arise = 226

 Conditions That Make Randomized Experiments Problematic = 228

 Criticisma of the Randomized Experiment = 229

 Summary = 233

Chapter 10 Extensions of Good Design = 235

 Replication = 235

 Mata-Analysis = 236

 Cost-Benefit and Cost-Effectivness Analysis = 244

 Summary = 250

Chapter 11 Qualitative Methods = 252

 Design of Qualitative Evaluations = 253

 Collecting Data = 256

 Fieldwork and Analysis = 263

 Qualitative Evaluation and Program Theory = 265

 Ethical Issues = 266

 Combining Qualiative and Quantitative Approaches = 267

 Summary = 269

Chapter 12 Analyzing and Interpreting the Data = 271

 Introduction = 271

 Analytic Tasks in Evaluation = 272

 General Stategies of Analysis = 283

 An Example of Program Theory as a Guide Analysis = 288

 Books on Analytic Methods = 290

 Ethical Issues = 292

 Summary = 292

Chapter 13 Writing the Report and Disseminating Results = 294

 Reporting = 295

 Dissemination = 305

 Utilization of Evaluation Results = 310

Chapter14 Evaluating with Integrity = 320

 Know the Program = 321

 Maintain High Technical Quality and Relevance = 321

 Use Balance and Judgment = 323

 Consider Use from the Start = 324

 Behave Ethically throughout the Study = 325

 Survive and Reap Rewards = 325

Glossary = 327

References = 340

Index = 365