The DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
From Proof of Concept to Scalable Policies: Challenges and Solutions, with an Application
Open accessAbstract
The promise of randomized controlled trials is that evidence gathered through the evaluation of a specific program helps us—possibly after several rounds of fine-tuning and multiple replications in different contexts—to inform policy. However, critics have pointed out that a potential constraint in this agenda is that results from small “proof-of-concept” studies run by nongovernment organizations may not apply to policies that can be implemented by governments on a large scale. After discussing the potential issues, this paper describes the journey from the original concept to the design and evaluation of scalable policy. We do so by evaluating a series of strategies that aim to integrate the nongovernment organization Pratham’s “Teaching at the Right Level” methodology into elementary schools in India. The methodology consists of reorganizing instruction based on children’s actual learning levels, rather than on a prescribed syllabus, and has previously been shown to be very effective when properly implemented. We present evidence from randomized controlled trials involving some designs that failed to produce impacts within the regular schooling system but still helped shape subsequent versions of the program. As a result of this process, two versions of the programs were developed that successfully raised children’s learning levels using scalable models in government schools. We use this example to draw general lessons about using randomized control trials to design scalable policies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Identification and estimation of local average treatment effects
Imbens, G. W., & Angrist, J. D. (1994) · Econometrica · doi:10.2307/2951620 · Cited by 4,101
Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities
Miguel, E., & Kremer, M. (2004) · Econometrica · doi:10.1111/j.1468-0262.2004.00481.x · Cited by 2,268
Insecticide-treated bed nets and curtains for preventing malaria
Lengeler, C. (2004) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000363.pub2 · Cited by 1,700
Angrist, J. D., & Pischke, J.-S. (2010) · Journal of Economic Perspectives · doi:10.1257/jep.24.2.3 · Cited by 1,566
Remedying Education: Evidence from Two Randomized Experiments in India
Banerjee, A. V., Cole, S., Duflo, E., & Linden, L. (2007) · The Quarterly Journal of Economics · doi:10.1162/qjec.122.3.1235 · Cited by 1,398
Self-citationActive Labour Market Policy Evaluations: A Meta‐Analysis
Card, D., Kluve, J., & Weber, A. (2010) · The Economic Journal · doi:10.1111/j.1468-0297.2010.02387.x · Cited by 1,298
Instruments, Randomization, and Learning about Development
Deaton, A. (2010) · Journal of Economic Literature · doi:10.1257/jel.48.2.424 · Cited by 1,286
Duflo, E., Dupas, P., & Kremer, M. (2011) · American Economic Review · doi:10.1257/aer.101.5.1739 · Cited by 1,080
Self-citationSix Randomized Evaluations of Microcredit: Introduction and Further Steps
Banerjee, A., Karlan, D., & Zinman, J. (2015) · American Economic Journal: Applied Economics · doi:10.1257/app.20140287 · Cited by 988
Self-citationDuflo, E., & Saez, E. (2003) · The Quarterly Journal of Economics · doi:10.1162/00335530360698432 · Cited by 986
Self-citationIncentives Work: Getting Teachers to Come to School
Duflo, E., Hanna, R., & Ryan, S. P. (2012) · American Economic Review · doi:10.1257/aer.102.4.1241 · Cited by 928
Self-citationHeckman, J. J., Lochner, L., & Taber, C. (1998) · Review of Economic Dynamics · doi:10.1006/redy.1997.0008 · Cited by 819
Free Distribution or Cost-Sharing? Evidence from a Randomized Malaria Prevention Experiment*
Cohen, J., & Dupas, P. (2010) · Quarterly Journal of Economics · doi:10.1162/qjec.2010.125.1.1 · Cited by 762
Crépon, B., Duflo, E., Gurgand, M., Rathelot, R., & Zamora, P. (2013) · The Quarterly Journal of Economics · doi:10.1093/qje/qjt001 · Cited by 558
Self-citationAnswers and Questions about Class Size: A Statewide Experiment
Finn, J. D., & Achilles, C. M. (1990) · American Educational Research Journal · doi:10.2307/1162936 · Cited by 546
Building State Capacity: Evidence from Biometric Smartcards in India
Muralidharan, K., Niehaus, P., & Sukhtankar, S. (2016) · American Economic Review · doi:10.1257/aer.20141346 · Cited by 480
Interventions to improve water quality for preventing diarrhoea
Clasen, T. F., Alexander, K. T., Sinclair, D., Boisson, S., Peletz, R., Chang, H. H., Majorin, F., & Cairncross, S. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd004794.pub3 · Cited by 478
Many Children Left Behind? Textbooks and Test Scores in Kenya
Glewwe, P., Kremer, M., & Moulin, S. (2009) · American Economic Journal: Applied Economics · doi:10.1257/app.1.1.112 · Cited by 461
Putting a Band-Aid on a Corpse: Incentives for Nurses in the Indian Public Health Care System
Banerjee, A. V., Duflo, E., & Glennerster, R. (2008) · Journal of the European Economic Association · doi:10.1162/jeea.2008.6.2-3.487 · Cited by 429
Self-citationSite Selection Bias in Program Evaluation *
Allcott, H. (2015) · The Quarterly Journal of Economics · doi:10.1093/qje/qjv015 · Cited by 426
Short-Run Subsidies and Long-Run Adoption of New Health Products: Evidence From a Field Experiment
(2014) · Econometrica · doi:10.3982/ecta9508 · Cited by 422
McEwan, P. J. (2015) · Review of Educational Research · doi:10.3102/0034654314553127 · Cited by 413
Attanasio, O. P., Meghir, C., & Santiago, A. (2012) · The Review of Economic Studies · doi:10.1093/restud/rdr015 · Cited by 403
Duflo, E., Dupas, P., & Kremer, M. (2015) · Journal of Public Economics · doi:10.1016/j.jpubeco.2014.11.008 · Cited by 398
Self-citationTaylor-Robinson, D. C., Maayan, N., Soares-Weiser, K., Donegan, S., & Garner, P. (2015) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd000371.pub6 · Cited by 392
Pitfalls of Participatory Programs: Evidence from a Randomized Evaluation in Education in India
Banerjee, A. V., Banerji, R., Duflo, E., Glennerster, R., & Khemani, S. (2010) · American Economic Journal: Economic Policy · doi:10.1257/pol.2.1.1 · Cited by 362
Self-citationThe Aggregate Effect of School Choice: Evidence from a Two-Stage Experiment in India *
Muralidharan, K., & Sundararaman, V. (2015) · The Quarterly Journal of Economics · doi:10.1093/qje/qjv013 · Cited by 320
Estimation in Parallel Randomized Experiments
Rubin, D. B. (1981) · Journal of Educational Statistics · doi:10.3102/10769986006004377 · Cited by 269
Tarozzi, A., Mahajan, A., Blackburn, B., Kopf, D., Krishnan, L., & Yoong, J. (2014) · American Economic Review · doi:10.1257/aer.104.7.1909 · Cited by 250
Selective Trials: A Principal-Agent Approach to Randomized Controlled Experiments
Chassang, S., Miquel, G. P. I., & Snowberg, E. (2012) · American Economic Review · doi:10.1257/aer.102.4.1279 · Cited by 159
Learning from Experiments when Context Matters
Pritchett, L. H., & Sandefur, J. (2015) · American Economic Review · doi:10.1257/aer.p20151016 · Cited by 147
Financial Structure and Economic Welfare: Applied General Equilibrium Development Economics
Townsend, R. M. (2010) · Annual Review of Economics · doi:10.1146/annurev.economics.102308.124427 · Cited by 25
Cited by
Tax Compliance and Enforcement
Slemrod, J. (2019) · Journal of Economic Literature · doi:10.1257/jel.20181437 · Cited by 563
Experimental evidence on learning using low-tech when school is out
Angrist, N., Bergman, P., & Matsheng, M. (2022) · Nature Human Behaviour · doi:10.1038/s41562-022-01381-z · Cited by 105
Dobrolyubova, E. (2021) · NISPAcee Journal of Public Administration and Policy · doi:10.2478/nispa-2021-0003 · Cited by 72
Iacovone, L., Maloney, W., & McKenzie, D. (2022) · The Review of Economic Studies · doi:10.1093/restud/rdab005 · Cited by 71
Martínez-Inda, B., Esparza, I., Moler, J. A., Jiménez-Moreno, N., & Ancín-Azpilicueta, C. (2023) · Journal of Environmental Management · doi:10.1016/j.jenvman.2022.116460 · Cited by 41
Metadata
- Authors
- Banerjee, A., Banerji, R., Berry, J., Duflo, E., Kannan, H., Mukerji, S., Shotland, M., & Walton, M.
- Venue
- Journal of Economic Perspectives
- Publisher
- American Economic Association
- Published
- 2017-11-01
- Volume
- 31
- Issue
- 4
- Pages
- 73-102
- ISSN
- 0895-3309 (ISSN-L)
- OpenAlex
- W2554266731
- Cited by
- 344
- References
- 32
- FWCI
- 22.49
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.