The DOI matches its Crossref record; 118 of the 118 references it cites were found in a registry or an index.
Missing data: our view of the state of the art
Abstract
Statistical procedures for missing data have vastly improved, yet misconception and unsound practice still abound. The authors frame the missing-data problem, review methods, offer advice, and raise issues that remain unresolved. They clear up common misunderstandings regarding the missing at random (MAR) concept. They summarize the evidence against older procedures and, with few exceptions, discourage their use. They present, in both technical and practical language, 2 general approaches that come highly recommended: maximum likelihood (ML) and Bayesian multiple imputation (MI). Newer developments are discussed, including some for dealing with missing data that are not MAR. Although not yet in the mainstream, these procedures may eventually extend the ML and MI methods that currently represent the state of the art.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“In line with the intention to treat, principle maximum likelihood estimation, an approach that uses information from all available observations, was used to estimate parameters and provides unbiased estimates and standard errors in the presence of incomplete data [35], under the assumption that data are missing at random (MAR).”
From Baseline Pro-Inflammatory Cytokine Levels Moderate Psychological Inflexibility in Behavioral Treatment for Chronic Pain (2022) · cites this paper as [35]
Experimental — accuracy not yet measuredThe cited source says what the claim attributes to it.
In the citing paper
“MI is viewed as a conservative approach for analyzing incomplete data sets, as it takes into account uncertainty due to missing information (Schafer and Graham, 2002).”
From Learning how to recover from stress: Results from an internet-based randomized controlled pilot trial (2023) · cites this paper as Schafer and Graham, 2002
The cited source says what the claim attributes to it.
In the citing paper
“we incorporated the methods for replacing missing data at the item level as described by Schafer and Graham (2002) for our psychological measures.”
From Postponement of elective cardiac surgery: A prospective observational analysis of anxiety, depression, social support and clinical complications. (2023) · cites this paper as Schafer and Graham (2002)
The cited source says what the claim attributes to it.
In the citing paper
“Missingness patterns are categorised by the literature into either not missing at random (NMAR), missing at random (MAR) or missing completely at random (MCAR)227,228.”
From The METRIC-framework for assessing data quality for trustworthy AI in medicine: A systematic review (2024) · cites this paper as [228]
The check wasn’t confident either way, so it gives no verdict — never disputed.
In the citing paper
“randomization to FC is associated with a variety of positive child and family outcomes, including increased connections to community resources, higher-quality home environments and parenting during infancy, reduced postpartum mental health symptoms, and a 37% reduction in child emergency medical care use through 24 months of age.10,11”
From Effect of a Universal Postpartum Nurse Home Visiting Program on Child Maltreatment and Emergency Medical Care at 5 Years of Age: A Randomized Clinical Trial (2021) · cites this paper as [11]
Experimental — accuracy not yet measured
In the citing paper
“Multiple imputation was employed to estimate missing data (93), using the Markov Chain Monte Carlo procedure (94) in SPSS software. The percentages of missing data ranged from 0–11.1%, well within the recommended ranges for imputation procedures.”
From Disorganized attachment in infancy predicts greater amygdala volume in adulthood (2016) · cites this paper as [93]
In the citing paper
“Missing data were at an acceptable level (missing value percentage = 13%, with 120 of 226 cases missing values) to use the multiple imputation approach [32] and thus this approach was pursued.”
From Measuring Experiential Avoidance: Evidence toward Multidimensional Predictors of Trauma Sequelae (2017) · cites this paper as [32]
In the citing paper
“Missing data will be handled using multiple imputations (MI).”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Maximum Likelihood from Incomplete Data Via the EM Algorithm
Dempster, A. P., Laird, N. M., & Rubin, D. B. (1977) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1977.tb01600.x · Cited by 50,444
Gelman, A., Carlin, J. B., Stern, H. S., & Rubin, D. B. (2003) · doi:10.1201/9780429258480 · Cited by 27,276
Multiple Imputation for Nonresponse in Surveys
Rubin, D. B. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/9780470316696 · Cited by 20,701
(2005) · Springer eBooks · doi:10.1007/0-387-27255-0_9 · Cited by 20,333
Statistical Analysis With Missing Data
Lahiff, M., Little, R. J. A., & Rubin, D. B. (1989) · Journal of the American Statistical Association · doi:10.2307/2289883 · Cited by 17,385
McCullagh, P., & Nelder, J. A. (1989) · doi:10.1007/978-1-4899-3242-6 · Cited by 16,836
McLachlan, G., & Peel, D. (2000) · Wiley Series in Probability and Statistics · doi:10.1002/0471721182 · Cited by 10,991
Littell, R. C. (1996) · Medical Entomology and Zoology · Cited by 10,345
Philosophical transactions of the Royal Society of London. B
Press, H. (1886) · Cited by 10,087
RUBIN, D. B. (1976) · Biometrika · doi:10.1093/biomet/63.3.581 · Cited by 9,925
Research works printed but not linked: 11
- Arbuckle, 1999, AMOS 4.0 user's guide
- Statistical Software, 1992, BMDP statistical software manual.
- Bryk, 1996, Hierarchical linear and nonlinear modeling with the HLM/2L and HLM/3L programs.
- Joreskog, 2001, LISREL (Version 8.5)
- Madow, 1983, Report and case studies., Vol. I
- 1996, Multilevel modeling applications--A guide for users of MLn.
- Muthen, 1998, Mplus user's guide
- Neale, 1999, Mx: Statistical modeling
- Raghunathan, 2000, IVEware: Imputation and variance estimation software.
- Schimert, 2001, Analyzing missing values in SPLUS.
- 1998, SOLAS for missing data analysis (Version 1).
Cited by
Sorted by citations
Items 1,201–1,268 of 1,268
Ertel, K. A., Kleinman, K., van Rossem, L., Sagiv, S., Tiemeier, H., Hofman, A., Jaddoe, V. W. V., & Raat, H. (2012) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.05.013 · Cited by 25
Youth Risk and Mentoring Relationship Quality: The Moderating Effect of Program Experiences
Weiler, L. M., Boat, A. A., & Haddock, S. A. (2019) · American Journal of Community Psychology · doi:10.1002/ajcp.12304 · Cited by 28
Simon, V. A., Feiring, C., & Cleland, C. M. (2016) · Psychology of Violence · doi:10.1037/a0038264 · Cited by 28
Magnusson, K., Nilsson, A., Andersson, G., Hellner, C., & Carlbring, P. (2019) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000425 · Cited by 26
Lin, J., Sander, L., Paganini, S., Schlicker, S., Ebert, D., Berking, M., Bengel, J., Nobis, S., Lehr, D., Mittag, O., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2016-015226 · Cited by 27
Pechtel, P., Woodman, A., & Lyons-Ruth, K. (2012) · International Journal of Cognitive Therapy · doi:10.1521/ijct.2012.5.3.316 · Cited by 26
Luk, J. W., King, K. M., McCarty, C. A., McCauley, E., & Stoep, A. V. (2017) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2017.78.521 · Cited by 26
Glashouwer, K. A., de Jong, P. J., & Penninx, B. W. J. H. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.05.002 · Cited by 25
Hornstra, L., Mathijssen, A. C. S., Denissen, J. J. A., & Bakx, A. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102345 · Cited by 25
Åkerblom, S., Perrin, S., Fischer, M. R., & McCracken, L. M. (2016) · International Journal of Behavioral Medicine · doi:10.1007/s12529-016-9539-x · Cited by 26
Verschueren, M., Claes, L., Palmeroni, N., Bogaerts, A., Gandhi, A., Moons, P., & Luyckx, K. (2020) · Journal of Youth and Adolescence · doi:10.1007/s10964-019-01174-0 · Cited by 26
Liebendörfer, M., & Schukajlow, S. (2017) · ZDM · doi:10.1007/s11858-016-0827-3 · Cited by 25
Vowles, K. E., Sowden, G., Hickman, J., & Ashworth, J. (2019) · Behaviour Research and Therapy · doi:10.1016/j.brat.2018.10.012 · Cited by 24
O'Toole, M. S., Mennin, D. S., Hougaard, E., Zachariae, R., & Rosenberg, N. K. (2015) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1926 · Cited by 24
Mechanisms of Mindfulness: A Longitudinal Study of a Mindfulness-Based Stress Reduction Program
Davis, K. M., Wojcik, C. M., Baillie, A. J., Foley, E., Goddard, T., Lau, M. A., & Haigh, E. A. P. (2024) · Mindfulness · doi:10.1007/s12671-024-02359-w · Cited by 25
Trait Mindfulness: A Multifaceted Evaluation.
Polizzi, C., Gautam, A., & Lynn, S. J. (2018) · Imagination Cognition and Personality · doi:10.1177/0276236618774321 · Cited by 23
Quinn, P. D., Pettersson, E., Lundström, S., Anckarsäter, H., Långström, N., Gumpert, C. H., Larsson, H., Lichtenstein, P., & D'Onofrio, B. M. (2016) · American Journal of Medical Genetics Part B: Neuropsychiatric Genetics · doi:10.1002/ajmg.b.32412 · Cited by 22
Michiels, B., Tanious, R., De, T. K., & Onghena, P. (2020) · Behavior Research Methods · doi:10.3758/s13428-019-01266-6 · Cited by 23
Shaffer, A., & Egeland, B. (2011) · Family Relations · doi:10.1111/j.1741-3729.2011.00653.x · Cited by 23
Interrater reliability for multilevel data: A generalizability theory approach.
ten Hove, D., Jorgensen, T. D., & van der Ark, L. A. (2022) · Psychological Methods · doi:10.1037/met0000391 · Cited by 22
Handling missing data in single-case studies
Peng, C.-Y. J., & Chen, L.-T. (2018) · Journal of Modern Applied Statistical Methods · doi:10.22237/jmasm/1525133280 · Cited by 22
Schoenfelder, E. N., Tein, J.-Y., Wolchik, S., & Sandler, I. N. (2015) · Journal of Abnormal Child Psychology · doi:10.1007/s10802-014-9905-6 · Cited by 21
Developmental Pathways to BPD-Related Features in Adolescence: Infancy to Age 15
Brumariu, L. E., Owen, M. T., Dyer, N., & Lyons-Ruth, K. (2020) · Journal of Personality Disorders · doi:10.1521/pedi_2020_34_480 · Cited by 21
Growth mixture modeling of depression symptoms following traumatic brain injury
Gomez, R., Skilbeck, C., Thomas, M., & Slatyer, M. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01320 · Cited by 21
Cross-country variations in the caregiver role: evidence from the ENTWINE-iCohort study
Zarzycki, M., Vilchinsky, N., Bei, E., Ferraris, G., Seddon, D., & Morrison, V. (2024) · BMC Public Health · doi:10.1186/s12889-024-18302-6 · Cited by 21
Bryan, A. D., Magnan, R. E., Hooper, A. E., Ciccolo, J. T., Marcus, B., & Hutchison, K. E. (2013) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/1479-5868-10-139 · Cited by 21
Grey, I. K., Berzenski, S. R., & Yates, T. M. (2015) · Emerging Adulthood · doi:10.1177/2167696815576457 · Cited by 19
Maddock, A., Hevey, D., D’Alton, P., & Kirby, B. (2020) · Journal of Clinical Psychology in Medical Settings · doi:10.1007/s10880-019-09686-4 · Cited by 19
Feeling Loved: A novel brief self-report health measure
Barrett, B., Muller, D., Hayer, S., Ewers, T., Chase, J., Barnet, J. H., & Brown, R. (2019) · EXPLORE · doi:10.1016/j.explore.2018.07.005 · Cited by 19
Measuring Experiential Avoidance: Evidence toward Multidimensional Predictors of Trauma Sequelae
Lewis, M., & Naugle, A. (2017) · Behavioral Sciences · doi:10.3390/bs7010009 · Cited by 20
“missing values) to use the multiple imputation approach [32] and thus this approach was pursued.”
MethodHo, R. T. H., Fong, T. C. T., Wan, A. H. Y., Au-Yeung, F. S. W., Chen, E. Y. H., & Spiegel, D. (2016) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2016.06.014 · Cited by 19
Stein, J. Y., Itzhaky, L., Levi-Belz, Y., & Solomon, Z. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00281 · Cited by 18
Åkerblom, S., Perrin, S., Fischer, M. R., & McCracken, L. M. (2020) · European Journal of Pain · doi:10.1002/ejp.1530 · Cited by 19
Gupta, T., Rogers-Sirin, L., Okazaki, S., Ryce, P., & Sirin, S. R. (2014) · Cultural Diversity & Ethnic Minority Psychology · doi:10.1037/a0035022 · Cited by 18
Persson Asplund, R., Asplund, S., von Buxhoeveden, H., Delby, H., Eriksson, K., Svenning Gerhardsson, M., Palm, J., Skyttberg, T., Torstensson, J., Ljótsson, B., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/34446 · Cited by 18
Fulginiti, A., He, A. S., & Negriff, S. (2018) · Child Abuse & Neglect · doi:10.1016/j.chiabu.2018.10.010 · Cited by 17
Sex differences in sub-clinical psychosis—Results from a community study over 30years
Rössler, W., Hengartner, M. P., Ajdacic-Gross, V., Haker, H., & Angst, J. (2012) · Schizophrenia Research · doi:10.1016/j.schres.2012.04.017 · Cited by 16
Managing Element Interactivity in Equation Solving
Ngu, B. H., Phan, H. P., Yeung, A. S., & Chung, S. F. (2018) · Educational Psychology Review · doi:10.1007/s10648-016-9397-8 · Cited by 16
Wang, L., Norman, I., Xiao, T., Li, Y., Li, X., Liu, T., Wang, J., Zeng, L., Zhong, Z., Jian, C., et al. (2024) · European Journal of Psychotraumatology · doi:10.1080/20008066.2023.2299195 · Cited by 17
Heleniak, C., Bolden, C. R., McCabe, C. J., Lambert, H. K., Rosen, M. L., King, K. M., Monahan, K. C., & McLaughlin, K. A. (2021) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-021-00805-0 · Cited by 16
Wright, A. C., Davies, G., Fowler, D., & Greenwood, K. E. (2019) · Schizophrenia Bulletin · doi:10.1093/schbul/sby155 · Cited by 15
Affective differentiation in breast cancer patients
Dasch, K. B., Cohen, L. H., Belcher, A., Laurenceau, J.-P., Kendall, J., Siegel, S., Parrish, B., & Graber, E. (2010) · Journal of Behavioral Medicine · doi:10.1007/s10865-010-9274-8 · Cited by 13
Beiwinkel, T., Hey, S., Bock, O., & Rössler, W. (2017) · Frontiers in Public Health · doi:10.3389/fpubh.2017.00249 · Cited by 15
Dahlin, M., Johansson, A., Romare, H., Carlbring, P., & Andersson, G. (2022) · Internet Interventions · doi:10.1016/j.invent.2022.100531 · Cited by 15
Denning, D. M., Perry, T. R., Reilly, E. E., Berner, L. A., Velkoff, E. A., Kaye, W. H., Wierenga, C. E., & Brown, T. A. (2022) · Suicide and Life-Threatening Behavior · doi:10.1111/sltb.12907 · Cited by 14
Becker, S. P., Dvorsky, M. R., Tamm, L., & Willoughby, M. T. (2021) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-020-00728-2 · Cited by 13
Ferrajão, P. C. (2020) · Journal of Family Trauma, Child Custody & Child Development · doi:10.1080/15379418.2020.1731399 · Cited by 14
Lilja, M. M., Sandblom, E., Lichtenstein, P., Serlachius, E., Hellner, C., Bhagia, J., & Halldner, L. (2022) · Journal of Neurodevelopmental Disorders · doi:10.1186/s11689-022-09424-2 · Cited by 14
Graham, S., Irving, J., Cano, I., & Edwards, M. (2018) · Alcoholism Treatment Quarterly · doi:10.1080/07347324.2018.1500873 · Cited by 13
Austin, S. C., McIntosh, K., Smolkowski, K., Santiago-Rosario, M. R., Arbuckle, S. L., & Barney, N. E. (2024) · Journal of School Psychology · doi:10.1016/j.jsp.2024.101284 · Cited by 12
Tang, V. M., Yu, D., Weissman, C. R., Jones, B. D. M., Wang, G., Sloan, M. E., Blumberger, D. M., Daskalakis, Z. J., Le Foll, B., & Voineskos, D. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.07.049 · Cited by 11
Predictive Validity of a Quality Measure for Intensive Substance use Disorder Treatment
Schmidt, E. M., Gupta, S., Bowe, T., Ellerbe, L. S., Phelps, T. E., Finney, J. W., Asch, S. M., Humphreys, K., Trafton, J., Vanneman, M., et al. (2017) · Substance Abuse · doi:10.1080/08897077.2016.1212779 · Cited by 12
Konradt, U., Ellwart, T., & Gevers, J. (2021) · Learning and Individual Differences · doi:10.1016/j.lindif.2021.102003 · Cited by 11
Valenstein-Mah, H., Simpson, T. L., Bowen, S., Enkema, M. C., Bird, E. R., In Cho, H., & Larimer, M. E. (2019) · Mindfulness · doi:10.1007/s12671-018-1077-y · Cited by 11
“Regarding missing data, data for this study were considered to be missing at random and considered Bignorable nonresponse^ as most longitudinal studies have attrition (Schafer and Graham 2002).”
Hogue, A., Horan Fisher, J., Dauber, S., Bobek, M., Porter, N., Henderson, C. E., & Evans, S. W. (2021) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2020.1716362 · Cited by 10
Walderhaug, E. P., Gjestad, R., Egeland, J., Havik, O. E., & Nordgreen, T. (2019) · Nordic Journal of Psychiatry · doi:10.1080/08039488.2019.1646803 · Cited by 8
Kok, G., van Rijsbergen, G., Burger, H., Elgersma, H., Riper, H., Cuijpers, P., Dekker, J., Smit, F., & Bockting, C. (2014) · PLoS ONE · doi:10.1371/journal.pone.0111711 · Cited by 9
Ditlhong, K. E., Ngesa, O. O., & Kombo, A. Y. (2018) · Open Journal of Statistics · doi:10.4236/ojs.2018.85051 · Cited by 7
Russotti, J., Herd, T., Handley, E. D., Toth, S. L., & Noll, J. G. (2023) · Journal of Interpersonal Violence · doi:10.1177/08862605221138654 · Cited by 8
“Missing data for endogenous variables were estimated as a function of 6898 Journal of Interpersonal Violence 38(9-10) exogenous variables based on the missing at random assumption (Schafer & Graham, 2002) using full-information maximum likelihood estimation (FIML; Muthén & Muthén, 2019).”
MethodAsplund, R. P., Carvallo, F., Christensson, H., Videsäter, E., Häggman, A., Ljótsson, B., Carlbring, P., & Andersson, G. (2023) · Internet Interventions · doi:10.1016/j.invent.2023.100681 · Cited by 6
“Although we applied Multiple imputation, which is considered a conservative approach to handle missing data (Schafer and Graham, 2002), and even though attrition is common in internet-based intervention studies (Eysenbach, 2005), we cannot rule out a potential bias caused from missing data.”
BackgroundMethodGandy, M., Karin, E., Jones, M. P., McDonald, S., Sharpe, L., Titov, N., & Dear, B. F. (2018) · European Journal of Pain · doi:10.1002/ejp.1239 · Cited by 6
Linear and Non-Linear Regression Methods in Epidemiology and Biostatistics
Vittinghoff, E., McCulloch, C. E., Glidden, D. V., & Shiboski, S. C. (2011) · Essential Statistical Methods for Medical Statistics · doi:10.1016/b978-0-444-53737-9.50006-2 · Cited by 6
Karshikoff, B., Åström, J., Holmström, L., Lekander, M., Kemani, M. K., & Wicksell, R. K. (2022) · Journal of Clinical Medicine · doi:10.3390/jcm11092285 · Cited by 6
“In line with the intention to treat, principle maximum likelihood estimation, an approach that uses information from all available observations, was used to estimate parameters and provides unbiased estimates and standard errors in the presence of incomplete data [35], under the assumption that data are missing at ran…”
MethodWang, F. L., Chassin, L., Bates, J. E., Dick, D., Lansford, J. E., Pettit, G. S., & Dodge, K. A. (2018) · Development and Psychopathology · doi:10.1017/s095457941700058x · Cited by 6
Longitudinal associations between sleep and BMI in a low-income, predominantly Black American sample
Brooks Holliday, S., Dong, L., Haas, A., Ghosh-Dastidar, M. (., Dubowitz, T., Buysse, D. J., Hale, L., & Troxel, W. M. (2023) · Sleep Health · doi:10.1016/j.sleh.2022.10.012 · Cited by 4
Spindler, H., Thorup, C. B., Nøhr, D., & Andreasen, J. J. (2023) · Journal of Clinical Nursing · doi:10.1111/jocn.16818 · Cited by 4
Lesner, T., Clarke, B., Kosty, D., Nelson, N., Ketterlin-Geller, L., & Smolkowski, K. (2023) · Learning Disability Quarterly · doi:10.1177/07319487231168385 · Cited by 3
McLaughlin, A. E., Campbell, F. A., Pungello, E. P., & Skinner, M. (2007) · Child Development · doi:10.1111/j.1467-8624.2007.01030.x · Cited by 128
Metadata
- Authors
- Schafer, J. L., & Graham, J. W.
- Affiliations
- Pennsylvania State University (US)
- Venue
- Psychological Methods
- Published
- 2002
- Volume
- 7
- Issue
- 2
- Pages
- 147-177
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2156267802
- Semantic Scholar
- f867e56d3a8ac2bbef6bfe5c74ee80ab43239718
- Cited by
- 11,638
- References
- 107
- Citations by year
- 2026: 438 · 2025: 485 · 2024: 449 · 2023: 466 · 2022: 510 · 2021: 635 · 2020: 621 · 2019: 655 · 2018: 614 · 2017: 697 · 2016: 693 · 2015: 712 · 2014: 701 · 2013: 686 · 2012: 604
- FWCI
- 113.09
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Methods (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute on Drug Abuse (P50DA010075, 1-P50-DA10075)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Keywords
- missing data, missing at random, maximum likelihood estimation, missing data mechanisms, statistical practice, survey data analysis
- MeSH terms
- Humans, Models, Theoretical, Research, Software, Databases as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review