Social Experiments in Practice: The What, Why, When, Where, and How of Experimental Design and Analysis
Social Experiments in Practice: The What, Why, When, Where, and How of Experimental Design and Analysis
New Directions for Evaluation, Number 152
Peck, Laura R.
John Wiley & Sons Inc
03/2017
144
Mole
Inglês
9781119348887
200
Descrição não disponível.
EDITOR S NOTES. SOCIAL EXPERIMENTS IN PRACTICE: INTRODUCTION, FRAMING, AND CONTEXT 9 Laura Peck, Issue Editor, and Naomi Goldstein New approaches to designing and conducting experimental evaluations can improve their utility by enhancing the generalizability of their findings as well as allowing them to determine which specific aspects of a program or policy produce impacts. 1. On the Why of Social Experiments: Some Lessons on Overcoming Barriers from 45 Years of Social Experiments 19 Howard Rolston The history of social policy experiments has demonstrated their utility and value and produced methods for overcoming practical barriers to their application. 2. On the When of Social Experiments: The Tension Between Program Refinement and Abandonment 33 Diana Epstein, Jacob Alex Klerman This chapter considers how to proceed when a process analysis shows that a program does not satisfy the intermediate steps of its own logic model or when an impact analysis does not show clear evidence of impact: when to further refine the program model and when to abandon the program model. 3. On the Where of Social Experiments: The Nature and Extent of the Generalizability Problem 47 Stephen H. Bell, Elizabeth A. Stuart This chapter describes research strategies for investigating how much nonrepresentative site selection biases affect findings produced by rigorous evaluations of social programs. 4. On the Where of Social Experiments: Selecting More Representative Samples to Inform Policy 61 Robert B. Olsen, Larry L. Orr This chapter describes how social experiments can evaluate interventions or programs in samples that are more representative of the population of interest from a policy perspective. 5. On the How of Social Experiments: Using Implementation Research to Get Inside the Black Box 73 Lawrence M. Mead Implementation research describes the actual character of evaluated programs, analyzes why local sites vary in performance, and helps identify additional programs that might be promising. 6. On the How of Social Experiments: Analytic Strategies for Getting Inside the Black Box 85 Laura R. Peck Analysis of postrandom assignment (endogenous) events or experiences in experimental evaluation data is becoming increasingly widespread. This chapter highlights some analytic strategies for revealing mediators of program impacts. 7. On the How of Social Experiments: Experimental Designs for Getting Inside the Black Box 97 Stephen H. Bell, Laura R. Peck This chapter discusses several experimental evaluation designs that randomize individuals including multiarmed, multistage, and factorial designs to permit estimating impacts for specific policy design features or program elements within a larger examination of an overall program. 8. Program and Policy Evaluations in Practice: Highlights from the Federal Perspective 109 Rebecca Maynard, Naomi Goldstein, Demetra Smith Nightingale From the vantage point of federal agencies that commission a large share of domestic program evaluations, this chapter explores the conditions under which particular methodological strategies are and are not helpful in advancing the job of policy analysts, policymakers, and program administrators. INDEX 137
Este título pertence ao(s) assunto(s) indicados(s). Para ver outros títulos clique no assunto desejado.
introduction; experiments; social; practice; utility; experimental; generalizability; approaches; evaluations; new; years; lessons; barriers; history; diana; program; abandonment; tension; analysis; jacob; alex; considers
EDITOR S NOTES. SOCIAL EXPERIMENTS IN PRACTICE: INTRODUCTION, FRAMING, AND CONTEXT 9 Laura Peck, Issue Editor, and Naomi Goldstein New approaches to designing and conducting experimental evaluations can improve their utility by enhancing the generalizability of their findings as well as allowing them to determine which specific aspects of a program or policy produce impacts. 1. On the Why of Social Experiments: Some Lessons on Overcoming Barriers from 45 Years of Social Experiments 19 Howard Rolston The history of social policy experiments has demonstrated their utility and value and produced methods for overcoming practical barriers to their application. 2. On the When of Social Experiments: The Tension Between Program Refinement and Abandonment 33 Diana Epstein, Jacob Alex Klerman This chapter considers how to proceed when a process analysis shows that a program does not satisfy the intermediate steps of its own logic model or when an impact analysis does not show clear evidence of impact: when to further refine the program model and when to abandon the program model. 3. On the Where of Social Experiments: The Nature and Extent of the Generalizability Problem 47 Stephen H. Bell, Elizabeth A. Stuart This chapter describes research strategies for investigating how much nonrepresentative site selection biases affect findings produced by rigorous evaluations of social programs. 4. On the Where of Social Experiments: Selecting More Representative Samples to Inform Policy 61 Robert B. Olsen, Larry L. Orr This chapter describes how social experiments can evaluate interventions or programs in samples that are more representative of the population of interest from a policy perspective. 5. On the How of Social Experiments: Using Implementation Research to Get Inside the Black Box 73 Lawrence M. Mead Implementation research describes the actual character of evaluated programs, analyzes why local sites vary in performance, and helps identify additional programs that might be promising. 6. On the How of Social Experiments: Analytic Strategies for Getting Inside the Black Box 85 Laura R. Peck Analysis of postrandom assignment (endogenous) events or experiences in experimental evaluation data is becoming increasingly widespread. This chapter highlights some analytic strategies for revealing mediators of program impacts. 7. On the How of Social Experiments: Experimental Designs for Getting Inside the Black Box 97 Stephen H. Bell, Laura R. Peck This chapter discusses several experimental evaluation designs that randomize individuals including multiarmed, multistage, and factorial designs to permit estimating impacts for specific policy design features or program elements within a larger examination of an overall program. 8. Program and Policy Evaluations in Practice: Highlights from the Federal Perspective 109 Rebecca Maynard, Naomi Goldstein, Demetra Smith Nightingale From the vantage point of federal agencies that commission a large share of domestic program evaluations, this chapter explores the conditions under which particular methodological strategies are and are not helpful in advancing the job of policy analysts, policymakers, and program administrators. INDEX 137
Este título pertence ao(s) assunto(s) indicados(s). Para ver outros títulos clique no assunto desejado.
