Identifying Effective Education Interventions in Sub-Saharan Africa: A Meta-Analysis of Impact Evaluations
The DOI matches its Crossref record; 112 of the 112 references it cites were found in a registry or an index.
Abstract
In this article, I identify educational interventions with an impact on student learning in Sub-Saharan Africa. After a systematic literature search, I conducted a meta-analysis synthesizing 56 articles containing 66 separate experiments and quasi-experiments and 83 treatment arms. I evaluated 12 types of education interventions such as the provision of school supplies, the use of teacher incentives, and school-based management programs. I examine each intervention type, present analytics on relative effectiveness, and explore why certain interventions seem to be more effective. A key finding is that programs that alter teacher pedagogy or classroom instructional techniques had an effect size approximately 0.30 standard deviations greater than all other types of programs combined. Limited evidence further suggests that pedagogical programs that employed adaptive instruction or teacher coaching were particularly effective. Given that the literature in the field is still nascent overall, these results advocate for further research into these pedagogical interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Bias in meta-analysis detected by a simple, graphical test
Egger, M., Smith, G. D., Schneider, M., & Minder, C. (1997) · BMJ · doi:10.1136/bmj.315.7109.629 · Cited by 56,722
The Cochrane Collaboration's tool for assessing risk of bias in randomised trials
Higgins, J. P. T., Altman, D. G., Gotzsche, P. C., Juni, P., Moher, D., Oxman, A. D., Savovic, J., Schulz, K. F., Weeks, L., Sterne, J. A. C., et al. (2011) · BMJ · doi:10.1136/bmj.d5928 · Cited by 33,817
Borenstein, M., Hedges, L. V., Higgins, J. P. T., & Rothstein, H. R. (2021) · doi:10.1002/9781119558378 · Cited by 9,799
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2009) · doi:10.1515/9781400829828 · Cited by 9,467
(2000) · Cited by 9,198
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2008) · doi:10.2307/j.ctvcm4j72 · Cited by 5,051
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Meta-analysis in social research
(1982) · Evaluation and Program Planning · doi:10.1016/0149-7189(82)90011-8 · Cited by 3,853
(2009) · US Department of Education · Cited by 3,654
(1986) · Journal of Economic Literature · Cited by 2,705
Worms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities
Miguel, E., & Kremer, M. (2004) · Econometrica · doi:10.1111/j.1468-0262.2004.00481.x · Cited by 2,268
Hattie, J. (2012) · doi:10.4324/9780203181522 · Cited by 2,155
Robust variance estimation in meta‐regression with dependent effect size estimates
Hedges, L. V., Tipton, E., & Johnson, M. C. (2010) · Research Synthesis Methods · doi:10.1002/jrsm.5 · Cited by 2,086
A Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.2307/1164923 · Cited by 2,064 · cited 2×
“Following Orwin (1983), I also calculated a “fail-safe N” and estimated that I would need to find 302 studies with no effect at all in order for the average effect size (d = 0.181) to be driven down to 0.03 standard deviations, which education economists in this field consider practically…”
MethodInfluentialConditional Cash Transfers: Reducing Present and Future Poverty
Fiszbein, A., & Schady, N. R. (2009) · World Bank, Washington, DC eBooks · doi:10.1596/978-0-8213-7352-1 · Cited by 1,849
Assessing the Effects of School Resources on Student Performance: An Update
Hanushek, E. A. (1997) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737019002141 · Cited by 1,612
Angrist, J. D., & Pischke, J.-S. (2010) · Journal of Economic Perspectives · doi:10.1257/jep.24.2.3 · Cited by 1,566
Remedying Education: Evidence from Two Randomized Experiments in India
Banerjee, A. V., Cole, S., Duflo, E., & Linden, L. (2007) · The Quarterly Journal of Economics · doi:10.1162/qjec.122.3.1235 · Cited by 1,398
Instruments, Randomization, and Learning about Development
Deaton, A. (2010) · Journal of Economic Literature · doi:10.1257/jel.48.2.424 · Cited by 1,286
Duflo, E., Dupas, P., & Kremer, M. (2011) · American Economic Review · doi:10.1257/aer.101.5.1739 · Cited by 1,080
(2018) · Perspectives in Education · doi:10.18820/2519593x/pie · Cited by 1,001
Resources, Instruction, and Research
Cohen, D. K., Raudenbush, S. W., & Ball, D. L. (2003) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737025002119 · Cited by 983
The Role Of Education Quality For Economic Growth
Hanushek, E. A., & Woessmann, L. (2007) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-4122 · Cited by 975
Empirical Benchmarks for Interpreting Effect Sizes in Research
Hill, C. J., Bloom, H. S., Black, A. R., & Lipsey, M. W. (2008) · Child Development Perspectives · doi:10.1111/j.1750-8606.2008.00061.x · Cited by 950
Heyneman, S. P., & Loxley, W. A. (1983) · American Journal of Sociology · doi:10.1086/227799 · Cited by 857
Cash or Condition? Evidence from a Cash Transfer Experiment
Baird, S., McIntosh, C., & Ozler, B. (2011) · The Quarterly Journal of Economics · doi:10.1093/qje/qjr032 · Cited by 834
Hedges, L. V., Laine, R. D., & Greenwald, R. (1994) · Educational Researcher · doi:10.3102/0013189x023003005 · Cited by 819
Small sample adjustments for robust variance estimation with meta-regression.
Tipton, E. (2015) · Psychological Methods · doi:10.1037/met0000011 · Cited by 810 · cited 5×
“In addition, I used small-sample corrections throughout my analysis, as many of the intervention areas contained a limited number of students (Tipton, 2015).”
BackgroundMethodInfluentialThe Impact of Differential Expenditures on School Performance
Hanushek, E. A. (1989) · Educational Researcher · doi:10.2307/1176650 · Cited by 774
INTERPRETING RECENT RESEARCH ON SCHOOLING IN DEVELOPING COUNTRIES
Hanushek, E. A. (1995) · The World Bank Research Observer · doi:10.1093/wbro/10.2.227 · Cited by 623
Effect Sizes in Cluster-Randomized Designs
Hedges, L. V. (2007) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998606298043 · Cited by 567
Incentives to Learn: (596142012-001)
Kremer, M., Miguel, E., Thornton, R., & Ozier, O. (2005) · PsycEXTRA Dataset · doi:10.1037/e596142012-001 · Cited by 523
Meta-Analysis of Research on Class Size and Achievement
Glass, G. V., & Smith, M. L. (1979) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737001001002 · Cited by 517
School Inputs and Educational Outcomes in South Africa
Case, A., & Deaton, A. (1999) · The Quarterly Journal of Economics · doi:10.1162/003355399556124 · Cited by 506
Glewwe, P., Hanushek, E., Humpage, S., & Ravina, R. (2011) · National Bureau of Economic Research · doi:10.3386/w17554 · Cited by 500
The Challenge of Education and Learning in the Developing World
Kremer, M., Brannen, C., & Glennerster, R. (2013) · Science · doi:10.1126/science.1235350 · Cited by 493
Methods for Integrative Reviews
Jackson, G. B. (1980) · Review of Educational Research · doi:10.2307/1170440 · Cited by 484
Many Children Left Behind? Textbooks and Test Scores in Kenya
Glewwe, P., Kremer, M., & Moulin, S. (2009) · American Economic Journal: Applied Economics · doi:10.1257/app.1.1.112 · Cited by 461
Accumulating Evidence: Procedures for Resolving Contradictions among Different Research Studies
Light, R., & Smith, P. (1971) · Harvard Educational Review · doi:10.17763/haer.41.4.437714870334w144 · Cited by 445
McEwan, P. J. (2015) · Review of Educational Research · doi:10.3102/0034654314553127 · Cited by 413
The Determinants of Scholastic Achievement-An Appraisal of Some Recent Evidence
Bowles, S., & Levin, H. M. (1968) · The Journal of Human Resources · doi:10.2307/144645 · Cited by 336
Chapter 16 Schools, Teachers, and Education Outcomes in Developing Countries
Glewwe, P., & Kremer, M. (2006) · Handbook of the Economics of Education · doi:10.1016/s1574-0692(06)02016-2 · Cited by 323
Information, Role Models and Perceived Returns to Education Experimental Evidence from Madagascar
Nguyen, T. H. T. (2013) · Cited by 314
Is There an Intrahousehold ‘Flypaper Effect’? Evidence from a School Feeding Programme
Jacoby, H. G. (2002) · The Economic Journal · doi:10.1111/1468-0297.0j679 · Cited by 300
Randomized Evaluations of Educational Programs in Developing Countries: Some Lessons
Kremer, M. (2003) · American Economic Review · doi:10.1257/000282803321946886 · Cited by 288
Hanushek, E. A. (1981) · Journal of Policy Analysis and Management · doi:10.2307/3324107 · Cited by 282
How to do a good systematic review of effects in international development: a tool kit
Waddington, H., White, H., Snilstveit, B., Hombrados, J. G., Vojtkova, M., Davies, P., Bhavsar, A., Eyers, J., Koehlmoos, T. P., Petticrew, M., et al. (2012) · Journal of Development Effectiveness · doi:10.1080/19439342.2012.711765 · Cited by 278
Retrospective vs. prospective analyses of school inputs: the case of flip charts in Kenya
Glewwe, P., Kremer, M., Moulin, S., & Zitzewitz, E. (2004) · Journal of Development Economics · doi:10.1016/j.jdeveco.2003.12.010 · Cited by 272
Reviewing the literature: A comparison of traditional methods with meta-analysis
Cook, T. D., & Leviton, L. C. (1980) · Journal of Personality · doi:10.1111/j.1467-6494.1980.tb02379.x · Cited by 270
Cook, T. D. (2002) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737024003175 · Cited by 257
School Inputs, Household Substitution, and Test Scores
Das, J., Dercon, S., Habyarimana, J., Krishnan, P., Muralidharan, K., & Sundararaman, V. (2013) · American Economic Journal: Applied Economics · doi:10.1257/app.5.2.29 · Cited by 239
Mechanism Experiments and Policy Evaluations
Ludwig, J., Kling, J. R., & Mullainathan, S. (2011) · Journal of Economic Perspectives · doi:10.1257/jep.25.3.17 · Cited by 232
Clarke, S. E., Jukes, M. C., Njagi, J. K., Khasakhala, L., Cundill, B., Otido, J., Crudder, C., Estambale, B. B., & Brooker, S. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61034-x · Cited by 222
Improving Education in Developing Countries: Lessons From Rigorous Impact Evaluations
Ganimian, A. J., & Murnane, R. J. (2016) · Review of Educational Research · doi:10.3102/0034654315627499 · Cited by 222
The power of information in public services: Evidence from education in Uganda
Reinikka, R., & Svensson, J. (2011) · Journal of Public Economics · doi:10.1016/j.jpubeco.2011.02.006 · Cited by 213
Bruns, B., Filmer, D., & Patrinos, H. A. (2011) · World Bank Publications · doi:10.1596/978-0-8213-8679-8 · Cited by 212
Glewwe, P., Ilias, N., & Kremer, M. (2010) · American Economic Journal: Applied Economics · doi:10.1257/app.2.3.205 · Cited by 212
The Impact of Dietary Intervention on the Cognitive Development of Kenyan School Children
Whaley, S. E., Sigman, M., Neumann, C., Bwibo, N., Guthrie, D., Weiss, R. E., Alber, S., & Murphy, S. P. (2003) · The Journal of Nutrition · doi:10.1093/jn/133.11.3965s · Cited by 199
Access, Sorting, and Achievement: The Short-Run Effects of Free Primary Education in Kenya
Lucas, A. M., & Mbiti, I. M. (2012) · American Economic Journal: Applied Economics · doi:10.1257/app.4.4.226 · Cited by 195
Meta-analysis of research on the relationship of class-size and achievement
Glass, G. V., & Smith, M. L. (1981) · Medical Entomology and Zoology · Cited by 193
van Stuijvenberg, M. E., Kvalsvig, J. D., Faber, M., Kruger, M., Kenoyer, D. G., & Benadé, A. S. (1999) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/69.3.497 · Cited by 187
Scaling Up What Works: Experimental Evidence on External Validity in Kenyan Education
Bold, T., Kimenyi, M., Mwabu, G., Alice Ng'ang'a, A., & Sandefur, J. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2241240 · Cited by 186
A Review of Meta-Analyses in Education: Methodological Strengths and Weaknesses
Ahn, S., Ames, A. J., & Myers, N. D. (2012) · Review of Educational Research · doi:10.3102/0034654312458162 · Cited by 179
Improving Education in the Developing World: What Have We Learned from Randomized Evaluations?
Kremer, M., & Holla, A. (2009) · Annual Review of Economics · doi:10.1146/annurev.economics.050708.143323 · Cited by 167
Decentralized Decision-Making in Schools: The Theory and Evidence on School-Based Management
Barrera‐Osorio, F., Fasih, T., Patrinos, H. A., & Santibáñez, L. (2009) · World Bank Publications · Cited by 163
Kazianga, H., Levy, D., Linden, L., & Sloan, M. (2013) · American Economic Journal Applied Economics · doi:10.1257/app.5.3.41 · Cited by 160
Glewwe, P. W., Park, A. F., & Zhao, M. (2016) · Journal of Development Economics · doi:10.1016/j.jdeveco.2016.05.007 · Cited by 157
School Meals, Educational Achievement, and School Competition: Evidence from a Randomized Evaluation
Kremer, M. R., & Vermeersch, C. M. J. (2005) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-3523 · Cited by 150
IMPROVING EARLY‐GRADE LITERACY IN EAST AFRICA: EXPERIMENTAL EVIDENCE FROM KENYA AND UGANDA
Lucas, A. M., McEwan, P. J., Ngware, M., & Oketch, M. (2014) · Journal of Policy Analysis and Management · doi:10.1002/pam.21782 · Cited by 141
Quality education for all children? What works in education in developing countries
Krishnaratne, S., White, H., (3ie), I. I. F. I. E., & Carpenter, E. (2014) · doi:10.23846/wp0020 · Cited by 136
Baumgartner, J., Smuts, C. M., Malan, L., Kvalsvig, J. D., van Stuijvenberg, M. E., Hurrell, R. F., & Zimmermann, M. B. (2012) · American Journal of Clinical Nutrition · doi:10.3945/ajcn.112.041004 · Cited by 131
School Meals, Educational Achievement, and School Competition: Evidence from a Randomized EvaluationPreprint
Vermeersch, C. M. J., & Kremer, M. R. (2005) · SSRN Electronic Journal · doi:10.2139/ssrn.667881 · Cited by 127
Martinez, S., Naudeau, S., & Pereira, V. (2013) · doi:10.23846/ow11009 · Cited by 123
The Impact of Distributing School Uniforms on Children’s Education in Kenya
Kremer, M., Evans, D., & Ngatia, M. (2008) · World Bank, Washington, DC eBooks · doi:10.1596/26453 · Cited by 119
Popova, A., & Evans, D. K. (2015) · doi:10.1596/1813-9450-7203 · Cited by 119
Worms at Work: Long-run Impacts of Child Health Gains *
Baird, S., Hicks, J. H., Kremer, M. R., & Miguel, E. A. (2012) · Cited by 114
Ajaja, O. P., & Eravwoke, O. U. (2010) · The Electronic Journal of Science Education · Cited by 114
Petrosino, A. J., Morgan, C. L., Fronius, T. A., Tanner‐Smith, E. E., & Boruch, R. F. (2012) · Campbell Systematic Reviews · doi:10.4073/csr.2012.19 · Cited by 107
Santos, L. I. R., Alcoforado, L., & Cordeiro, A. M. R. (2024) · 美中教育评论:B · doi:10.17265/2161-6248 · Cited by 100
Numbers and Narrative: Combining Their Strengths in Research Reviews
Light, R., & Pillemer, D. (1982) · Harvard Educational Review · doi:10.17763/haer.52.1.0114v8756m170618 · Cited by 93
Conn, K. (2014) · Columbia Academic Commons (Columbia University) · doi:10.7916/d898854g · Cited by 85
Self-citationDuflo, E., Pascaline Dupas, Y., & Kremer, M. R. (2012) · National Bureau of Economic Research · doi:10.3386/w17939 · Cited by 84
Education in Sub-Saharan Africa: A Comparative Analysis
Majgaard, K., & Mingat, A. (2012) · doi:10.1596/978-0-8213-8889-1 · Cited by 80
Jukes, M. C. H., Pinder, M., Grigorenko, E. L., Smith, H. B., Walraven, G., Bariau, E. M., Sternberg, R. J., Drake, L. J., Milligan, P., Cheung, Y. B., et al. (2006) · PLoS Clinical Trials · doi:10.1371/journal.pctr.0010019 · Cited by 80
School Choice and Academic Performance: Some Evidence From Developing Countries
Tooley, J., Bao, Y., Dixon, P., & Merrifield, J. (2011) · Journal of School Choice · doi:10.1080/15582159.2011.548234 · Cited by 79
Improving School Education Outcomes in Developing Countries
Glewwe, P. W., & Muralidharan, K. (2015) · doi:10.35489/bsg-rise-wp_2015/001 · Cited by 73
Lassibille, G., Tan, J., Jesse, C., & Nguyen, T. H. T. (2010) · The World Bank Economic Review · doi:10.1093/wber/lhq009 · Cited by 71
Team Incentives for Education in Developing Countries: A Randomized Field Experiment in Benin
Blimpo, M. P. (2014) · American Economic Journal: Applied Economics · doi:10.1257/app.6.4.90 · Cited by 70
School enrollment, selection and test scoresPreprint
Filmer, D. P., & Schady, N. (2009) · RePEc: Research Papers in Economics · Cited by 69
Kazianga, H., de Walque, D., & Alderman, H. (2012) · Journal of African Economies · doi:10.1093/jae/ejs010 · Cited by 67
Using examinations to improve education : a study in fourteen African countries
Kellaghan, T. (1992) · World Bank, Washington, DC eBooks · Cited by 64
Hubbard, P. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1100131 · Cited by 59
Effects of antiparasitic treatment on dynamically and statically tested cognitive skills over time
Grigorenko, E. L., Sternberg, R. J., Jukes, M., Alcock, K., Lambo, J., Ngorosho, D., Nokes, C., & Bundy, D. A. P. (2006) · Journal of Applied Developmental Psychology · doi:10.1016/j.appdev.2006.08.005 · Cited by 58
Sarfo, F. K., & Elen, J. (2007) · Learning Environments Research · doi:10.1007/s10984-007-9031-2 · Cited by 57
Jinabhai, C. C., Taylor, M., Coutsoudis, A., Coovadia, H. M., Tomkins, A. M., & Sullivan, K. R. (2001) · Annals of Tropical Paediatrics · doi:10.1080/07430170120093508 · Cited by 57
Githua, B. N., & Nyabwa, R. A. (2007) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-006-9037-8 · Cited by 44
Improving child literacy in Africa: experiments with an automated reading tutor
Mills-Tettey, G. A., Mostow, J., Dias, M. B., Sweet, T. M., Belousov, S. M., Dias, M. F., & Gong, H. (2009) · Information and Communication Technologies and Development · doi:10.5555/1812530.1812544 · Cited by 42
Prophet, R. B., & Badede, N. B. (2007) · International Journal of Science and Mathematics Education · doi:10.1007/s10763-006-9058-3 · Cited by 37
Does Money Matter for Student Performance? Evidence from a Grant Program in UgandaPreprint
Björkman, M. (2007) · RePEc: Research Papers in Economics · Cited by 36
Peer effects and textbooks in African primary education
Frölich, M., & Michaelowa, K. (2010) · Labour Economics · doi:10.1016/j.labeco.2010.11.008 · Cited by 36
Zopluoglu, C. (2012) · Eğitimde ve Psikolojide Ölçme ve Değerlendirme Dergisi · Cited by 32
Garlick, R. (2014) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-6787 · Cited by 29
The Role of Meta-analysis in Educational Research
Hattie, J., Rogers, H. J., & Swaminathan, H. (2013) · Springer eBooks · doi:10.1007/978-94-007-6809-3_26 · Cited by 28
Causality, Causality, Causality: The View of Education Inputs and Outputs From Economics
Barrow, L., & Rouse, C. E. (2020) · Routledge eBooks · doi:10.4324/9781003064466-11 · Cited by 28
The High Return to Private Schooling in a Low-Income CountryPreprint
Bold, T., Kimenyi, M. S., Mwabu, G., & Sandefur, J. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.1973021 · Cited by 27
Agbatogun, A. O. (2012) · Journal of Information Technology Education Research · doi:10.28945/1715 · Cited by 26
Explaining mathematics achievement gains in Botswana and South Africa
Carnoy, M., & Arends, F. (2012) · Prospects · doi:10.1007/s11125-012-9246-6 · Cited by 25
Mechanism Experiments and Policy Evaluations
Ludwig, J., Kling, J. R., & Mullainathan, S. (2011) · National Bureau of Economic Research · doi:10.3386/w17062 · Cited by 20
Onu, V. C., Eskay, M., Igbo, J. N., Obiyo, N. O., & Agbo, O. E. (2012) · 美中教育评论:B · Cited by 11
Olowa, O. W. (2009) · ISU Red - Research and eData (Illinois State University) · Cited by 9
Brooker, S. (2017) · London School of Hygiene & Tropical Medicine · doi:10.7910/dvn/hsf7bt · Cited by 5
Meta-analysis in Stata: history, progress and prospectsPreprint
Sterne, J. A. C. (2004) · RePEc: Research Papers in Economics · Cited by 2
Cited by
Education in Africa: What Are We Learning?
Evans, D. K., & Mendez Acosta, A. (2021) · Journal of African Economies · doi:10.1093/jae/ejaa009 · Cited by 212
Piper, B., Simmons Zuilkowski, S., Dubeck, M., Jepkemei, E., & King, S. J. (2018) · World Development · doi:10.1016/j.worlddev.2018.01.018 · Cited by 174
Nickow, A., Oreopoulos, P., & Quan, V. (2020) · doi:10.3386/w27476 · Cited by 171
“Conn (2017) includes 56 articles that study education interventions in Sub-Saharan Africa, experimental and quasi-experimental, and the analysis includes 12 distinct intervention types.”
BackgroundMethodInfluentialMlachila, M., & Moeletsi, T. (2019) · IMF Working Papers · doi:10.5089/9781498301374.001 · Cited by 70
Fitzpatrick, D., & Burns, J. (2018) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.1002/cl2.194 · Cited by 1
Metadata
- Authors
- Conn, K. M.
- Venue
- Review of Educational Research
- Published
- 2017-05-26
- Volume
- 87
- Issue
- 5
- Pages
- 863-898
- ISSN
- 0034-6543 (ISSN-L)
- 1935-1046
- OpenAlex
- W140285439
- Cited by
- 263
- References
- 112
- FWCI
- 7.11
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.