Speech- and language-based classification of Alzheimer's disease: a systematic review
Open accessThe DOI matches its Crossref record; 68 of the 68 references it cites were found in a registry or an index.
Abstract
Background: Alzheimer’s disease (AD) has paramount importance due to its rising prevalence, the impact on the patient and society, and the related healthcare costs. However, current diagnostic techniques are not designed for frequent mass screening, delaying therapeutic intervention and worsening prognoses. To be able to detect AD at an early stage, ideally at a pre-clinical stage, speech analysis emerges as a simple low-cost non-invasive procedure. Objectives: In this work it is our objective to do a systematic review about speech-based detection and classification of Alzheimer’s Disease with the purpose of identifying the most effective algorithms and best practices. Methods: A systematic literature search was performed from Jan 2015 up to May 2020 using ScienceDirect, PubMed and DBLP. Articles were screened by title, abstract and full text as needed. A manual complementary search among the references of the included papers was also performed. Inclusion criteria and search strategies were defined a priori. Results: We were able: to identify the main resources that can support the development of decision support systems for AD, to list speech features that are correlated with the linguistic and acoustic footprint of the disease, to recognize the data models that can provide robust results and to observe the performance indicators that were reported. Discussion: A computational system with the adequate elements combination, based on the identified best-practices, can point to a whole new diagnostic approach, leading to better insights about AD symptoms and its disease patterns, creating conditions to promote a longer life span as well as an improvement in patient quality of life. The clinically relevant results that were identified can be used to establish a reference system and help to define research guidelines for future developments.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures


![Figure 3 Flowchart of a general machine learning pipeline to process acoustic/prosodic correlates of disease. Adapted from Braga et al. [31].](https://figures.cochat.ai/paper-figures/3d41c425c17e4d7b87b1481c58367ada/speech-and-language-based-classification-of-alzheimer-s-disease-a-systematic-figure-3.jpg)


Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The source backs part of the claim, not all of it — or backs it for a different population, condition or comparison.
In the citing paper
“As such, it is increasingly recognized as a promising digital biomarker for the early detection and monitoring of ADRD.81,82”
From Review of Artificial Intelligence for Clinical Use in Alzheimer's Disease and Related Dementias (2026) · cites this paper as [82]
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PRISMA 2020 statement: An updated guideline for reporting systematic reviews
Page, M. J., McKenzie, J. E., Bossuyt, P. M., Boutron, I., Hoffmann, T. C., Mulrow, C. D., Shamseer, L., Tetzlaff, J. M., Akl, E. A., Brennan, S. E., et al. (2021) · BMJ · doi:10.1136/bmj.n71 · Cited by 108,283
PRISMA Extension for Scoping Reviews (PRISMA-ScR): Checklist and Explanation
Tricco, A. C., Lillie, E., Zarin, W., O'Brien, K. K., Colquhoun, H., Levac, D., Moher, D., Peters, M. D. J., Horsley, T., Weeks, L., et al. (2018) · Annals of Internal Medicine · doi:10.7326/m18-0850 · Cited by 43,565
McKhann, G. M., Knopman, D. S., Chertkow, H., Hyman, B. T., Jack, C. R., Kawas, C. H., Klunk, W. E., Koroshetz, W. J., Manly, J. J., Mayeux, R., et al. (2011) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2011.03.005 · Cited by 18,657
The global prevalence of dementia: a systematic review and metaanalysis.
Prince, M., Bryce, R., Albanese, E., Wimo, A., Ribeiro, W., & Ferri, C. P. (2013) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2012.11.007 · Cited by 4,941
Forecasting the global burden of Alzheimer's disease
Brookmeyer, R., Johnson, E., Ziegler‐Graham, K., & Arrighi, H. M. (2007) · Alzheimer's & Dementia · doi:10.1016/j.jalz.2007.04.381 · Cited by 3,370
Diagnosis of Alzheimer's Disease
Khachaturian, Z. S. (1985) · Archives of Neurology · doi:10.1001/archneur.1985.04060100083029 · Cited by 2,499 · cited 1×
“Early and accurate diagnosis of AD has a major impact on its progress and follow-up, and although memory loss and behavioral changes are relevant indicators for its detection, these only become evident in more advanced stages of the disease, often leading to the late diagnosis of dementia [3,4].”
BackgroundAlzheimer's Disease and Parkinson's Disease
Nussbaum, R. L., & Ellis, C. E. (2003) · New England Journal of Medicine · doi:10.1056/nejm2003ra020003 · Cited by 1,351
Current understanding of Alzheimer’s disease diagnosis and treatment
Weller, J., & Budson, A. (2018) · F1000Research · doi:10.12688/f1000research.14506.1 · Cited by 1,083 · cited 1×
“Early and accurate diagnosis of AD has a major impact on its progress and follow-up, and although memory loss and behavioral changes are relevant indicators for its detection, these only become evident in more advanced stages of the disease, often leading to the late diagnosis of dementia [3,4].”
BackgroundQuality of life in Alzheimer's disease: Patient and caregiver reports.
Logsdon, R. G., Gibbons, L. E., McCurry, S. M., & Teri, L. L. (1999) · Journal of Mental Health and Aging · Cited by 843
(2019) · Handbook of Clinical Neurology · doi:10.1016/b978-0-12-804766-8.00013-3 · Cited by 783
The Natural History of Alzheimer's Disease: Description of Study Cohort and Accuracy of Diagnosis
Becker, J. T. (1994) · Archives of Neurology · doi:10.1001/archneur.1994.00540180063015 · Cited by 576
Automatic speech analysis for the assessment of patients with predementia and Alzheimer's disease
König, A., Satt, A., Sorin, A., Hoory, R., Toledo‐Ronen, O., Derreumaux, A., Manera, V., Verhey, F., Aalten, P., Robert, P. H., et al. (2015) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1016/j.dadm.2014.11.012 · Cited by 380 · cited 2×
“[36] proposed to use several short cognitive vocal tasks to distinguish between healthy controls, mild cognitive impairment and AD patients, with the best distinction being between healthy subjects and Alzheimer’s patients, with an accuracy of 87%.”
BackgroundMueller, K. D., Hermann, B., Mecollari, J., & Turkstra, L. S. (2018) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2018.1446513 · Cited by 336
The Wisconsin Registry for Alzheimer's Prevention: A review of findings and current directions
Johnson, S. C., Koscik, R. L., Jonaitis, E. M., Clark, L. R., Mueller, K. D., Berman, S. E., Bendlin, B. B., Engelman, C. D., Okonkwo, O. C., Hogan, K. J., et al. (2018) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1016/j.dadm.2017.11.007 · Cited by 316
Consortium for the Early Identification of Alzheimer’s disease-Quebec, Belleville, S., Fouquet, C., Hudon, C., Zomahoun, H. T. V., & Croteau, J. (2017) · Neuropsychology Review · doi:10.1007/s11065-017-9361-5 · Cited by 308
Toth, L., Hoffmann, I., Gosztolya, G., Vincze, V., Szatloczki, G., Banreti, Z., Pakaski, M., & Kalman, J. (2018) · Current Alzheimer Research · doi:10.2174/1567205014666171121114930 · Cited by 290
Szatloczki, G., Hoffmann, I., Vincze, V., Kalman, J., & Pakaski, M. (2015) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2015.00195 · Cited by 249
On the early diagnosis of Alzheimer's Disease from multimodal signals: A survey
Alberdi, A., Aztiria, A., & Basarab, A. (2016) · Artificial Intelligence in Medicine · doi:10.1016/j.artmed.2016.06.003 · Cited by 221
Communication Difficulties as a Result of Dementia
(2018) · Materia Socio Medica · doi:10.5455/msm.2018.30.221-224 · Cited by 210
Gosztolya, G., Vincze, V., Tóth, L., Pákáski, M., Kálmán, J., & Hoffmann, I. (2019) · Computer Speech & Language · doi:10.1016/j.csl.2018.07.007 · Cited by 196
Language impairment in Alzheimer's disease and benefits of acetylcholinesterase inhibitors
Ferris, S., & Farlow, M. (2013) · Clinical Interventions in Aging · doi:10.2147/cia.s39959 · Cited by 181
Temporal parameters of spontaneous speech in Alzheimer's disease
Hoffmann, I., Nemeth, D., Dye, C. D., Pákáski, M., Irinyi, T., & Kálmán, J. (2010) · International Journal of Speech-Language Pathology · doi:10.3109/17549500903137256 · Cited by 179
Predicting probable Alzheimer's disease using linguistic deficits and biomarkers
Orimaye, S. O., Wong, J. S.-M., Golden, K. J., Wong, C. P., & Soyiri, I. N. (2017) · BMC Bioinformatics · doi:10.1186/s12859-016-1456-0 · Cited by 158
Speech in Alzheimer's Disease: Can Temporal and Acoustic Parameters Discriminate Dementia?
Meilán, J. J. G., Martínez-Sánchez, F., Carro, J., López, D. E., Millian-Morell, L., & Arana, J. M. (2014) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000356726 · Cited by 152
Mueller, K. D., Koscik, R. L., Hermann, B. P., Johnson, S. C., & Turkstra, L. S. (2018) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2017.00437 · Cited by 128
Alzheimer's disease and automatic speech analysis: A review
Pulido, M. L. B., Hernández, J. B. A., Ballester, M. Á. F., González, C. M. T., Mekyska, J., & Smékal, Z. (2020) · Expert Systems with Applications · doi:10.1016/j.eswa.2020.113213 · Cited by 120 · cited 1×
“Although the nature of AD is unknown and is likely to be a multiple-cause disease, it has been observed that its onset is insidious and appears in adulthood, causing, in advanced stages, a cognitive and behavioral disability [10].”
BackgroundKonig, A., Satt, A., Sorin, A., Hoory, R., Derreumaux, A., David, R., & Robert, P. H. (2018) · Current Alzheimer Research · doi:10.2174/1567205014666170829111942 · Cited by 119
Hernández‐Domínguez, L., Ratté, S., Sierra‐Martínez, G., & Roche‐Bergua, A. (2018) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1016/j.dadm.2018.02.004 · Cited by 113
Fiber anatomy of dorsal and ventral language streams
Axer, H., Klingner, C. M., & Prescher, A. (2012) · Brain and Language · doi:10.1016/j.bandl.2012.04.015 · Cited by 111
Artificial intelligence and neuropsychological measures: the case of Alzheimer's disease
Battista, P., Salvatore, C., Berlingeri, M., Cerasa, A., & Castiglioni, I. (2020) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2020.04.026 · Cited by 98
Predicting MCI Status From Multimodal Language Data Using Cascaded Classifiers
Fraser, K. C., Lundholm Fors, K., Eckerström, M., Öhman, F., & Kokkinakis, D. (2019) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2019.00205 · Cited by 97
Test Your Memory test: diagnostic utility in a memory clinic population
Hancock, P., & Larner, A. J. (2010) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.2639 · Cited by 94
Emotional Prosody Perception and Production in Dementia of the Alzheimer’s Type
Horley, K., Reid, A., & Burnham, D. (2010) · Journal of Speech, Language, and Hearing Research · doi:10.1044/1092-4388(2010/09-0030 · Cited by 91
Mahajan, P., & Baths, V. (2021) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2021.623607 · Cited by 89
Cacho, J. L., Benito‐León, J., García, R. G., Fernández‐Calvo, B., Villardón, J. L. V., & Mitchell, A. J. (2010) · Journal of Alzheimer s Disease · doi:10.3233/jad-2010-101182 · Cited by 83
Zhang, Y., Schuff, N., Camacho, M., Chao, L. L., Fletcher, T. P., Yaffe, K., Woolley, S. C., Madison, C., Rosen, H. J., Miller, B. L., et al. (2013) · PLoS ONE · doi:10.1371/journal.pone.0066367 · Cited by 82
Khodabakhsh, A., Yesil, F., Guner, E., & Demiroglu, C. (2015) · EURASIP Journal on Audio, Speech, and Music Processing · doi:10.1186/s13636-015-0052-y · Cited by 81
Fully Automatic Speech-Based Analysis of the Semantic Verbal Fluency Task
König, A., Linz, N., Tröger, J., Wolters, M., Alexandersson, J., & Robert, P. (2018) · Dementia and Geriatric Cognitive Disorders · doi:10.1159/000487852 · Cited by 77
Themistocleous, C., Eckerström, M., & Kokkinakis, D. (2018) · Frontiers in Neurology · doi:10.3389/fneur.2018.00975 · Cited by 73
Chien, Y.-W., Hong, S.-Y., Cheah, W.-T., Yao, L.-H., Chang, Y., & Fu, L. (2019) · Scientific Reports · doi:10.1038/s41598-019-56020-x · Cited by 73
Lopez-de-Ipina, K., Martinez-de-Lizarduy, U., Calvo, P. M., Mekyska, J., Beitia, B., Barroso, N., Estanga, A., Tainta, M., & Ecay-Torres, M. (2018) · Current Alzheimer Research · doi:10.2174/1567205014666171120143800 · Cited by 65
de Ipiña, K. L., Solé‐Casals, J., Eguiraun, H., Alonso, J. B., Travieso, C. M., Ezeiza, A., Barroso, N., Ecay‐Torres, M., Martínez‐Lage, P., & Beitia, B. (2014) · Computer Speech & Language · doi:10.1016/j.csl.2014.08.002 · Cited by 60
Toledo, C. M., Aluísio, S. M., dos Santos, L. B., Brucki, S. M. D., Trés, E. S., de Oliveira, M. O., & Mansur, L. L. (2018) · Alzheimer's & Dementia: Diagnosis, Assessment & Disease Monitoring · doi:10.1016/j.dadm.2017.08.005 · Cited by 59
Initiative, A. D. N., Pereira, T., Ferreira, F. L., Cardoso, S., Silva, D., de Mendonça, A., Guerreiro, M., & Madeira, S. C. (2018) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-018-0710-y · Cited by 58
Two-stage feature selection of voice parameters for early Alzheimer’s disease prediction
Mirzaei, S., El Yacoubi, M., Garcia-Salicetti, S., Boudy, J., Kahindo, C., Cristancho-Lacroix, V., Kerhervé, H., & Rigaud, A.-S. (2018) · IRBM · doi:10.1016/j.irbm.2018.10.016 · Cited by 52
Multilingual word embeddings for the assessment of narrative speech in mild cognitive impairment
Fraser, K. C., Lundholm Fors, K., & Kokkinakis, D. (2019) · Computer Speech & Language · doi:10.1016/j.csl.2018.07.005 · Cited by 51
A Prototype for the Voice Analysis Diagnosis of Alzheimer’s Disease
Martínez‐Sánchez, F., Meilán, J. J. G., Carro, J., & Ivanova, O. (2018) · Journal of Alzheimer s Disease · doi:10.3233/jad-180037 · Cited by 50
Qiao, Y., Xie, X., Lin, G., Zou, Y., Chen, S., Ren, R., & Wang, G. (2020) · Journal of Alzheimer s Disease · doi:10.3233/jad-191056 · Cited by 41
Rentoumi, V., Paliouras, G., Danasi, E., Arfani, D., Fragkopoulou, K., Varlokosta, S., & Papadatos, S. (2017) · 2017 8th IEEE International Conference on Cognitive Infocommunications (CogInfoCom) · doi:10.1109/coginfocom.2017.8268212 · Cited by 39
Detecting Alzheimer’s Disease from Continuous Speech Using Language Models
Guo, Z., Ling, Z., & Li, Y. (2019) · Journal of Alzheimer’s Disease · doi:10.3233/jad-190452 · Cited by 38
Hoffman, J. I. E. (2019) · Elsevier eBooks · doi:10.1016/b978-0-12-817084-7.00033-4 · Cited by 37
de Ipiña, K. L., Alonso, J. B., Solé‐Casals, J., Travieso, C. M., Ezeiza, A., Faúndez-Zanuy, M., Calvo, P. M., & Beitia, B. (2014) · Neurocomputing · doi:10.1016/j.neucom.2014.05.083 · Cited by 30
A Study on Feature Selection and Classification Techniques of Indian Music
Kalapatapu, P., Goli, S., Arthum, P., & Malapati, A. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.09.020 · Cited by 28
Analysis of Speech-Based Measures for Detecting and Monitoring Alzheimer’s Disease
Khodabakhsh, A., & Demiroğlu, C. (2014) · Methods in molecular biology · doi:10.1007/978-1-4939-1985-7_11 · Cited by 22
Enhancing energy efficiency in buildings through innovative data analytics technologiesa
Capozzoli, A., Cerquitelli, T., & Piscitelli, M. S. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-803663-1.00011-5 · Cited by 20
Alzheimer's Dementia Detection from Audio and Language Modalities in Spontaneous Speech
Campbell, E. L., Docío-Fernández, L., Jiménez-Raboso, J., & Mateo, C. G. (2021) · IberSPEECH · doi:10.21437/iberspeech.2021-57 · Cited by 19
Beltrami, D., Calzà, L., Gagliardi, G., Ghidoni, E., Marcello, N., Favretti, R. R., & Tamburini, F. (2016) · Language Resources and Evaluation Conference (LREC) · doi:10.63317/29dtk8secyzx · Cited by 18
Robust Methods in Analysis of Multivariate Food Chemistry Data
Stanimirova, I., Daszykowski, M., & Walczak, B. (2013) · Data handling in science and technology · doi:10.1016/b978-0-444-59528-7.00008-9 · Cited by 15
Detection of Alzheimer's disease using prosodic cues in conversational speech
Khodabakhsh, A., Kuscuoglu, S., & Demiroğlu, C. (2014) · Signal Processing and Communications Applications Conference (SIU) · doi:10.1109/siu.2014.6830401 · Cited by 14
Components of Artificial Intelligence and Data Analytics
Carvajal, G., Maučec, M., & Cullick, S. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-804642-5.00004-9 · Cited by 12
Allen, M., & Cervo, D. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-800835-5.00010-5 · Cited by 12
Land, W. H., & Schaffer, J. D. (2016) · Procedia Computer Science · doi:10.1016/j.procs.2016.09.308 · Cited by 10
Neurodegenerative Diseases Detection Through Voice Analysis
Braga, D., Madureira, A. M., Coelho, L. P., & Abraham, A. (2018) · Advances in intelligent systems and computing · doi:10.1007/978-3-319-76351-4_22 · Cited by 10
Self-citationValidity of a computerised population registry of dementia based on clinical databases
Mar, J., Arrospide, A., Soto‐Gordoa, M., Machón, M., Iruín, Á., Martínez‐Lage, P., Gabilondo, A., Moreno, F., Gabilondo, A., & Arriola, L. (2020) · Neurología (English Edition) · doi:10.1016/j.nrleng.2018.03.005 · Cited by 10
Machine Learning Techniques for Data Classification
Yahyaoui, A., Yahyaoui, I., & Yumuşak, N. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-813185-5.00009-7 · Cited by 9
Soldan, A., Gazes, Y., & Stern, Y. (2016) · Elsevier eBooks · doi:10.1016/b978-0-12-809324-5.06319-7 · Cited by 7
Alzheimer’s Disease and Speech Background
Land, W. H., & Schaffer, J. D. (2019) · Springer eBooks · doi:10.1007/978-3-030-18496-4_4 · Cited by 5
Siau, K. L. (2003) · Elsevier eBooks · doi:10.1016/b978-008044198-6/50017-6 · Cited by 2
Research works printed but not linked: 3
- Hantke, N., Etkin, A., and O’Hara, R. (2020). Chapter 14—Alzheimer’s Disease and Other Neurocognitive Disorders. Handbook of Mental Health and Aging, Academic Press. [3rd ed.].
- Walker, L., and Schaffer, J.D. (2020). The Art and Science of Machine Intelligence, Springer.
- Sojka, P., Horák, A., Kopeček, I., and Pala, K. Development of a Large Spontaneous Speech Database of Agglutinative Hungarian Language. Proceedings of the Text, Speech and Dialogue.
Cited by
Deep learning-based speech analysis for Alzheimer’s disease detection: a literature review
Yang, Q., Li, X., Ding, X., Xu, F., & Ling, Z.-H. (2022) · Alzheimer s Research & Therapy · doi:10.1186/s13195-022-01131-3 · Cited by 150
Dementia Detection from Speech Using Machine Learning and Deep Learning Architectures
Kumar, M. R., Vekkot, S., Lalitha, S., Gupta, D., Govindraj, V. J., Shaukat, K., Alotaibi, Y. A., & Zakariah, M. (2022) · Sensors · doi:10.3390/s22239311 · Cited by 116
Alzheimer's disease recognition from spontaneous speech using large language models
Bang, J., Han, S., & Kang, B. (2024) · ETRI Journal · doi:10.4218/etrij.2023-0356 · Cited by 61
Noninvasive automatic detection of Alzheimer's disease from spontaneous speech: a review
Qi, X., Zhou, Q., Dong, J., & Bao, W. (2023) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2023.1224723 · Cited by 59
Wang, C., Liu, S., Li, A., & Liu, J. (2023) · Journal of Medical Internet Research · doi:10.2196/51501 · Cited by 41
Metadata
- Authors
- Vigo, I., Coelho, L., & Reis, S.
- Affiliations
- Instituto Superior de Engenharia do Porto (PT)
- Corresponding author
- Coelho, Luis
- Venue
- Bioengineering
- Publisher
- MDPI AG
- Published
- 2022-01-11
- Volume
- 9
- Issue
- 1
- Pages
- 27
- ISSN
- 2306-5354 (ISSN-L)
- PMC
- PMC8772820
- OpenAlex
- W4206056517
- Cited by
- 83
- References
- 68
- Citations by year
- 2026: 18 · 2025: 23 · 2024: 23 · 2023: 14 · 2022: 5
- FWCI
- 2.80
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Bioengineering (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Portuguese National Funding Agency for Science, Research and Technology (RCAAP Project by FCT) (submittedVersion, cc-by-nc-nd)
- Funders
- Fundação para a Ciência e Tecnologia (FCT- UIDB/04730/2020)
- Topics
- Health Sciences › Medicine › Psychiatry and Mental health › Dementia and Cognitive Impairment Research
- Health Sciences › Health Professions › Speech and Hearing › Voice and Speech Disorders
- Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
- Keywords
- Alzheimer's disease, speech analysis, linguistic analysis, early diagnosis, preclinical detection, acoustic features, linguistic features, decision support system, machine learning algorithms, non-invasive diagnosis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.