Deliberate practice and performance in music, games, sports, education, and professions: a meta-analysis.
The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Abstract
More than 20 years ago, researchers proposed that individual differences in performance in such domains as music, sports, and games largely reflect individual differences in amount of deliberate practice, which was defined as engagement in structured activities created specifically to improve performance in a domain. This view is a frequent topic of popular-science writing-but is it supported by empirical evidence? To answer this question, we conducted a meta-analysis covering all major domains in which deliberate practice has been investigated. We found that deliberate practice explained 26% of variance in performance for games, 21% for music, 18% for sports, 4% for education, and less than 1% for professions. We conclude that deliberate practice is important, but not as important as has been argued.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“They also required that “the study report referred to at least one publication on deliberate practice by Ericsson and his colleagues” (p. 1610), and that the study report provided information on an accumulated amount of practice and a measure or index of performance.”
From Deliberate Practice and Proposed Limits on the Effects of Practice on the Acquisition of Expert Performance: Why the Original Definition Matters and Recommendations for Future Research (2019) · cites this paper as Macnamara et al., 2014
In the citing paper
“we disagree and will show that their definition of “deliberate practice” included a much broader set of activities, such as many types of domain-specific experiences and competitive events.”
From Deliberate Practice and Proposed Limits on the Effects of Practice on the Acquisition of Expert Performance: Why the Original Definition Matters and Recommendations for Future Research (2019) · cites this paper as Macnamara et al., 2014
In the citing paper
“Macnamara et al. (2014) claimed their analysis would evaluate Ericsson et al. (1993) “influential deliberate-practice view of expert performance. This view holds that expert performance largely reflects accumulated amount of deliberate practice” (Macnamara et al., 2014, p. 1608, italics added).”
From Deliberate Practice and Proposed Limits on the Effects of Practice on the Acquisition of Expert Performance: Why the Original Definition Matters and Recommendations for Future Research (2019) · cites this paper as Macnamara et al., 2014
In the citing paper
“Their definition of “deliberate practice” differs significantly from the original definition of deliberate practice and will henceforth be referred to as structured practice.”
From Deliberate Practice and Proposed Limits on the Effects of Practice on the Acquisition of Expert Performance: Why the Original Definition Matters and Recommendations for Future Research (2019) · cites this paper as Macnamara et al., 2014
In the citing paper
“These claims about the limitations of deliberate practice to influence attained levels of performance are based on Macnamara et al. (2014) meta-analysis.”
From Deliberate Practice and Proposed Limits on the Effects of Practice on the Acquisition of Expert Performance: Why the Original Definition Matters and Recommendations for Future Research (2019) · cites this paper as Macnamara et al., 2014
22 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & The PRISMA Group (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000097 · Cited by 64,042
Preferred reporting items for systematic reviews and meta-analyses: the PRISMA Statement.
(2009) · PubMed Central · Cited by 44,859
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: The PRISMA Statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.06.005 · Cited by 19,575
Duval, S., & Tweedie, R. (2000) · Biometrics · doi:10.1111/j.0006-341x.2000.00455.x · Cited by 14,099
The role of deliberate practice in the acquisition of expert performance
Ericsson, K. A., Krampe, R. T., & Tesch-Römer, C. (1993) · Psychological Review · doi:10.1037/0033-295x.100.3.363 · Cited by 9,564
The Biological Foundations of Language
Lenneberg, E. H. (1967) · Hospital Practice · doi:10.1080/21548331.1967.11707799 · Cited by 6,605
Schmidt, F. L., & Hunter, J. E. (1998) · Psychological Bulletin · doi:10.1037//0033-2909.124.2.262 · Cited by 4,180
A Nonparametric “Trim and Fill” Method of Accounting for Publication Bias in Meta-Analysis
Duval, S., & Tweedie, R. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473905 · Cited by 2,955
The g factor: the science of mental ability
(1998) · Choice Reviews Online · doi:10.5860/choice.36-2443 · Cited by 2,746
Working Memory Capacity as Executive Attention
Engle, R. W. (2002) · Current Directions in Psychological Science · doi:10.1111/1467-8721.00160 · Cited by 2,507
Research works printed but not linked: 4
- Duffy L. J., 2004, International Journal of Sport Psychology, 35, 232
- Ericsson K. A., 2007, International Journal of Sport Psychology, 38, 4
- Gladwell M., 2008, Outliers: The story of success
- Plomin R., 2008, Behavioral genetics, 5
Cited by
Items 401–500 of 658
Staff, T., Gobet, F. R., & Parton, A. D. (2020) · Brunel University Research Archive (BURA) (Brunel University London) · Cited by 4
Woody, R. H. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197546598.003.0007 · Cited by 2
Mishra, J. (2019) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198795872.013.25 · Cited by 5
Using A Model Of Scattering In A Low-Symbol-Interference Channel For Array Beamforming
Yamada, K., & Tsuji, H. (2002) · doi:10.5281/zenodo.37848 · Cited by 2
More confusion about deliberate practice: commentary on Miller et al. (2018)
Hambrick, D. Z., & Macnamara, B. N. (2019) · High Ability Studies · doi:10.1080/13598139.2019.1607723 · Cited by 2
Self-citationSchuetze, B. A., & Yan, V. X. (2021) · doi:10.31234/osf.io/ahjr5 · Cited by 2
Merim Bilalić, A., & Cocić, D. (2022) · doi:10.31219/osf.io/4ctzh · Cited by 2
Agyeman, K. O., & Brewu, J. K. (2020) · Social Education Research · doi:10.37256/ser.122020444 · Cited by 1
Relationship between Exclusive Surgical Focus and Complication Rates
Henderson, B. A. (2021) · Ophthalmology · doi:10.1016/j.ophtha.2021.03.023 · Cited by 1
Recent experience and performance during a critical in‐flight event
Wiggins, M. W., Yuris, N. C., & Molesworth, B. R. C. (2022) · Applied Cognitive Psychology · doi:10.1002/acp.4013 · Cited by 2
Schuetze, B. A., & Yan, V. X. (2024) · Meta-Psychology · doi:10.15626/mp.2021.2918 · Cited by 4
Mental health in recreational and professional dancers: a genetically informed study in Sweden
Christensen, J. F., Wesseldijk, L. W., Mosing, M. A., & Ullén, F. (2025) · SSM - Population Health · doi:10.1016/j.ssmph.2025.101894 · Cited by 2
Jiang, Y., 许秋健, Zhang, G., Yang, D., Ren, X., wang, B., Li, J., Yuan, X., Wang, X., Yang, M., et al. (2026) · Acta Psychologica · doi:10.1016/j.actpsy.2026.106262 · Cited by 1
Xiao, W., Gu, J., Li, X., Ding, F., Sun, B., & Stouten, J. (2026) · Teaching and Teacher Education · doi:10.1016/j.tate.2026.105447 · Cited by 3
Soccer pass performance following caffeine intake with deliberate or maintenance practice
Yaşli, B. Ç., Esen, Ö., Önlü, A. Ş., Tuncel, O., Sertkaya, M. U., Muñoz, A., & Karayiğit, R. (2026) · Journal of the International Society of Sports Nutrition · doi:10.1080/15502783.2026.2663140 · Cited by 2
Davies, E. A., Kunst, G., & Mosca, R. (2026) · Journal of Cardiothoracic and Vascular Anesthesia · doi:10.1053/j.jvca.2026.05.056 · Cited by 1
ADVENTURES IN THE PRINCIPLES OF LEARNING COURSE WIKI: A WIKIOGRAPHY
Parson, J. (2018) · The Canadian Journal of Action Research · doi:10.33524/cjar.v18i3.349 · Cited by 1
Diastolic Learning: Making the Tacit, Explicit
Papaspyros, S. C., & O’Regan, D. (2018) · Ergonomics International Journal · doi:10.23880/eoij-16000159 · Cited by 1
Brain Shaped by Music Performance: Cognitive Effects and Genetic Approaches
Güneş, E., & İnal, Ş. Ç. (2018) · Journal of Ankara University Faculty of Medicine · doi:10.4274/atfm.10820 · Cited by 2
Cognitive Barriers to Successful Weight Management: 7 Stymie Beasts
Kirschenbaum, D. S., & Krawczyk, R. (2021) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2020.11.003 · Cited by 1
Analogical Thinking in Problem-Solving and Creativity
Weisberg, R. W. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108785259.005 · Cited by 1
Woody, R. H. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197546598.003.0003 · Cited by 1
Woody, R. H. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197546598.003.0004 · Cited by 3
Young, S. R., Cousins, M., Suggs, L. J., & Markey, M. K. (2018) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--27785 · Cited by 1
Operative Ausbildungsziele in der Plastischen und Ästhetischen Chirurgie einfach „SMART“
Jakubietz, R. G., Giunta, R. E., Jakubietz, M. G., & Koenig, S. (2023) · Handchirurgie · Mikrochirurgie · Plastische Chirurgie · doi:10.1055/a-2157-0946 · Cited by 1
Nurse, K., O’Shea, M., & Sheen, J. A. (2024) · Counselling and Psychotherapy Research · doi:10.1002/capr.12761 · Cited by 2
Robotic Surgery in Gynecologic Oncology: Updates and Innovations
Escobar, P. F., Silva, P. E., Makhoul, J. A., et al. (2014) · Current Obstetrics and Gynecology Reports · doi:10.1007/s13669-014-0101-z · Cited by 1
Principles of Research Publication
Patience, G. S., Pounis, G., Patience, P. A., & Boffito, D. C. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-814556-2.00008-7 · Cited by 2
Human Resources Management and Human Resources Development
Radel, J. (2019) · Springer eBooks · doi:10.1007/978-3-319-94532-3_99 · Cited by 1
Developing talent among low-income gifted learners: A review of recent research
Cross, J. R., & Dockery, D. W. (2014) · W&M Publish (College of William & Mary) · Cited by 2
Józefacka-Szram, N., & Marszałek, D. (2018) · Niepełnosprawność · doi:10.4467/25439561.np.18.010.9848 · Cited by 1
Berkel, G. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108863599 · Cited by 1
Resch, C., Hurks, P. P. M., & Heugten, C. M. V. (2020) · Neuropraxis · doi:10.1007/s12474-020-00254-3 · Cited by 1
Mental practice of musically gifted adolescents
Kaczmarek, S. (2020) · Roczniki Psychologiczne · doi:10.18290/rpsych.2019.22.4-4 · Cited by 2
The Neuroscience of Creativity
Weisberg, R. W. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108785259.013 · Cited by 1
McCutcheon, H., & Connor, S. J. (2021) · ANZ Journal of Surgery · doi:10.1111/ans.16945 · Cited by 1
Student Conceptions of Expertise.
Bertram, C. A., Leak, A. E., Sayre, E. C., et al. (2016) · Digital Commons-DePaul (DePaul University) · Cited by 1
Eminent Creators: Early Experiences and Adult Achievement
Simonton, D. K. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108755726.031 · Cited by 1
The influence of past situations on present behaviors: how school life predicts managerial learning
Rigolizzo, M., Zhu, Z., & Cruz, A. (2021) · Journal of Workplace Learning · doi:10.1108/jwl-04-2021-0043 · Cited by 2
Is there a g in gunslinger? Cognitive predictors of firearms proficiency
Cucina, J. M., Wilson, K. J., Walmsley, P. T., Votraw, L. M., & Hayes, T. L. (2023) · Intelligence · doi:10.1016/j.intell.2023.101768 · Cited by 2
Development of the Employee Expertise Development Scale (EEDS)
Kim, Y. (2015) · OpenCommons at University of Connecticut (University of Connecticut) · Cited by 3
Instrumental music teacher perceptions regarding student self-regulation of music learning
Horsley, P. T. (2019) · MOspace Institutional Repository (University of Missouri) · doi:10.32469/10355/70070 · Cited by 2
Truth and transparency in expertise researchPreprint
Searston, R. A., Thompson, M. B., Robson, S. G., Corbett, B. J., Ribeiro, G., Edmond, G., & Tangen, J. M. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/bn85g · Cited by 4
Kronzer, J. (2020) · University of Minnesota Digital Conservancy (University of Minnesota) · Cited by 1
Vialle, W., Stoeger, H., & Ziegler, A. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.712661 · Cited by 1
Thinking Broad and Deep: Why Some Directors Exert an Outsized Influence on Strategic ChangePreprint
Lungeanu, R., & Zajac, E. J. (2018) · SSRN Electronic Journal · doi:10.2139/ssrn.3243557 · Cited by 1
An examination of musical instrument practice among collegiate musicians
Liu, Y. (2021) · MOspace Institutional Repository (University of Missouri) · doi:10.32469/10355/85795 · Cited by 4
Adaptive expertise in solving technical-medical problems
Overkamp, L. (2014) · Cited by 1
A study into the experiences of pre-registration nurses’ use of mental simulation
White, N. A. (2022) · Sheffield Hallam University · doi:10.7190/shu-thesis-00455 · Cited by 1
Ecological dynamics of spin bowling in cricket: Adapting to environmental constraints
Crowther, R. H. (2023) · Queensland University of Technology · doi:10.5204/thesis.eprints.240365 · Cited by 2
The Antecedents of Whistleblowing at Individual Level : A Predictive Integrative Framework
Haroon, A. (2021) · theses.fr (ABES) · doi:10.70675/c96a3c79z1a4bz4d8ez96c4z3e90d857c1fc · Cited by 4
Acting Strengths: The Development of Resilience and Character Strengths in Actors
Taylor, L. E. (2014) · Scholarly Commons (University of Pennsylvania)
Kelley, K. J. (2015) · Elsevier eBooks · doi:10.1016/b978-0-08-100076-2.00013-5
Narita, C., Shimode, Y., Yamada, K., et al. (2015) · Advances in Anthropology · doi:10.4236/aa.2015.54022
Surgical ergonomics - Analysis of technical skills, simulation models and assessment methods
Papaspyros, S. C., Kar, A., & O'Regan, D. J. (2015) · Journal of Cardiothoracic Surgery · doi:10.1186/1749-8090-10-s1-a201
Deliberate Practice Revisited: Complexity and Creativity in the Practice Process in Breakdance.
Shimizu, D., & Okada, T. (2015) · Cognitive Science
Alda, A. C. (2016) · UPM Digital Archive (Technical University of Madrid) · doi:10.20868/upm.thesis.42318 · Cited by 2
Colby, R. (2016) · Advances in educational technologies and instructional design book series · doi:10.4018/978-1-5225-1718-4.ch001
Vaz, A. (2016) · Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT)
How Experts Learn: The Role of Deliberate Practice
Coughlan, E. K. (2016) · Liverpool John Moores University · doi:10.24377/ljmu.t.00004591 · Cited by 2
Operators are Only Human: Facilitating Situated Decision Support in Industrial Environments
Hals, N. H. (2016) · NVA (Nasjonalt vitenarkiv)
Mastergradsoppgave Klient- og resultatstyrt praksis i psykisk helsearbeid
Austdal, S. V. (2015)
Towards An Understanding of Talent Identification in Elite Sport
Robinson, K. D. (2016) · YorkSpace (York University) · Cited by 2
Video Production as a Pathway for Building IdentityPreprint
Choe, E. Y. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2969114
Domain-specific activities in ASL-English interpreting and their relevance to expertise development
Adams, K. (2017) · Interpreting International Journal of Research and Practice in Interpreting · doi:10.1075/intp.19.2.02ada
Dockery, D. W. (2017) · W&M Publish (College of William & Mary) · doi:10.21220/w4936f · Cited by 1
The Impact of Education and Experience on Diagnostic Accuracy
Gross, S. I. (2015) · OhioLink ETD Center (Ohio Library and Information Network)
GROWING SUBJECT MATTER EXPERTS – NATURE VS NURTURE
Rouse, D., Wasche, D., & Couch, A. G. (2017) · International Oil Spill Conference Proceedings · doi:10.7901/2169-3358-2017.1.762
Mercier, H. (2018) · ISU Red - Research and eData (Illinois State University) · doi:10.30707/etd2018.mercier.h
Synergizing Research on Constructing Number: Themes and Prospects
Alibali, M. W., & Norton, A. (2018) · Research in mathematics education · doi:10.1007/978-3-030-00491-0_16
The Influence of Maturity Status on Jumping Performance of Inner London Secondary School Students
Kite, R. J. (2018) · UEL Research Repository (University of East London) · doi:10.15123/pub.7971 · Cited by 1
Two Ships Passing in the Night—But Shooting Up Flairs From Time to Time!
Simonton, D. K. (2019) · Empirical Studies of the Arts · doi:10.1177/0276237419868956
Brinums, M. (2019) · The University of Queensland · doi:10.14264/uql.2019.726
Plazinić, L., Mutavdžin, D., & Dimitrijević, A. A. (2019) · Zbornik Instituta za pedagoska istrazivanja · doi:10.2298/zipi1902373p
Implicaciones éticas de la identificación del potencial atlético infantil mediante pruebas genéticas
Pérez, L. A. S. (2019) · Revista Habanera de Ciencias Médicas
The effectiveness of risk assessments in informing decision makers
Peace, C. (2019) · Open Access Victoria University of Wellington | Te Herenga Waka (Figshare) · doi:10.26686/wgtn.17142020 · Cited by 2
Chan, S. (2020) · Professional and practice-based learning · doi:10.1007/978-981-15-2129-4_6 · Cited by 1
Testing and training lifeguard visual search
Laxton, V. (2019) · Nottingham Trent University's Institutional Repository (Nottingham Trent Repository) · Cited by 1
More confusion about deliberate practice? Not really
Miller, S. D., Hubble, M. A., Chow, D. L., & Wampold, B. E. (2019) · High Ability Studies · doi:10.1080/13598139.2020.1780004
The Ingredients of the Creative Mind
Abraham, A. (2021) · The American Journal of Psychology · doi:10.5406/amerjpsyc.134.1.0107
Weisberg, R. W. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108785259.009
The Degree of Knowledge of Sports Games During their Practice
Malik, A. I., & Hassan, M. N. (2021) · Medico-Legal Update · doi:10.37506/mlu.v21i2.2903
Testing for Creativity: Divergent Thinking, Executive Functioning, and Creative Thinking
Weisberg, R. W. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108785259.010 · Cited by 1
The Separate and Joint Influence of Teammate and Opponent Skill on Player Skill DevelopmentPreprint
Liu, Y. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/xgw7a
The Soft Skills Veterans Bring to the Workforce
Hayes, T. L., & Hogan, R. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780190642983.003.0007
Greats: Learning Strategies of Master Forensic Psychiatrists
Glancy, G., & Miller, D. J. (2021) · International Journal of Risk and Recovery · doi:10.15173/ijrr.v4i1.3911
Talent and Teams in Elite Motor Sport: Driving Development Through An Interpersonal Focus
Cameron, B. W. (2020) · CLOK (University of Central Lancashire)
The Question of Unconscious Processes in Creative Thinking
Weisberg, R. W. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108785259.008
Insight in Problem-Solving and Creative Thinking
Weisberg, R. W. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108785259.007
Case Studies of Creativity: The Universality of Creativity
Weisberg, R. W. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108785259.004
Two Confluence Theories of Creativity
Weisberg, R. W. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108785259.012
Unravelling the Web of Qualitative Dissertation Writing!
Akella, N. (2021) · Advances in knowledge acquisition, transfer, and management book series/Advances in knowledge acquisition, transfer and management book series · doi:10.4018/978-1-7998-8283-1.ch014
How Do You Get to Carnegie Hall? Practice, Talent, and Creativity
Weisberg, R. W. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108785259.006
The Search for the “Creative Personality”
Weisberg, R. W. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108785259.011
Woody, R. H. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197546598.003.0006
Simulation for Infant Lumbar Puncture Training
Kessler, D. O., & Auerbach, M. A. (2021) · American Academy of PediatricsItasca, IL eBooks · doi:10.1542/9781610022613-ch7
Introduction to Music Psychology
Woody, R. H. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197546598.003.0001
Learning and Remembering Musical Works
Woody, R. H. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197546598.003.0005
Toner, J., Montero, B. G., & Moran, A. P. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780198852261.003.0004
Woody, R. H. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197546598.003.0012
Metadata
- Authors
- Macnamara, B. N., Hambrick, D. Z., & Oswald, F. L.
- Affiliations
- Princeton University (US)
- Michigan State University (US)
- Rice University (US)
- Corresponding author
- Macnamara, Brooke N.
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2014-07-01
- Volume
- 25
- Issue
- 8
- Pages
- 1608-1618
- ISSN
- 0956-7976 (ISSN-L)
- 1467-9280
- OpenAlex
- W2166265073
- Cited by
- 656
- References
- 50
- Citations by year
- 2026: 38 · 2025: 59 · 2024: 42 · 2023: 35 · 2022: 59 · 2021: 84 · 2020: 85 · 2019: 62 · 2018: 50 · 2017: 50 · 2016: 47 · 2015: 37 · 2014: 7
- FWCI
- 9.07
- Type
- journal article
- Language
- en
- Update notices
- correction (2018-05-07)
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Rice Research Repository (Rice University) (acceptedVersion)
- Rice Research Repository (Rice University) (submittedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- Topics
- Social Sciences › Psychology › Developmental and Educational Psychology › Sport Psychology and Performance
- Social Sciences › Arts and Humanities › Music › Diverse Music Education Insights
- Social Sciences › Psychology › Social Psychology › Grit, Self-Efficacy, and Motivation
- Keywords
- deliberate practice, individual differences in performance, music performance, athletic performance, games, education, professional development
- MeSH terms
- Achievement, Educational Status, Employment, Humans, Individuality, Music, Practice, Psychological, Recreation, Sports, Work, Athletic Performance
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.