Identifying Neuroimaging Markers of Motor Disability in Acute Stroke by Machine Learning Techniques
The DOI matches its Crossref record; 71 of the 71 references it cites were found in a registry or an index.
Abstract
Conventional mass-univariate analyses have been previously used to test for group differences in neural signals. However, machine learning algorithms represent a multivariate decoding approach that may help to identify neuroimaging patterns associated with functional impairment in "individual" patients. We investigated whether fMRI allows classification of individual motor impairment after stroke using support vector machines (SVMs). Forty acute stroke patients and 20 control subjects underwent resting-state fMRI. Half of the patients showed significant impairment in hand motor function. Resting-state connectivity was computed by means of whole-brain correlations of seed time-courses in ipsilesional primary motor cortex (M1). Lesion location was identified using diffusion-weighted images. These features were used for linear SVM classification of unseen patients with respect to motor impairment. SVM results were compared with conventional mass-univariate analyses. Resting-state connectivity classified patients with hand motor deficits compared with controls and nonimpaired patients with 82.6-87.6% accuracy. Classification was driven by reduced interhemispheric M1 connectivity and enhanced connectivity between ipsilesional M1 and premotor areas. In contrast, lesion location provided only 50% sensitivity to classify impaired patients. Hence, resting-state fMRI reflects behavioral deficits more accurately than structural MRI. In conclusion, multivariate fMRI analyses offer the potential to serve as markers for endophenotypes of functional impairment.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Rehme et al used SVM in resting-state functional MRI data, by which endophenotypes of motor disability after stroke were identified and classified.50”
From Artificial intelligence in healthcare: past, present and future (2017) · cites this paper as [50]
In the citing paper
“SVM can correctly classify patients with stroke with 87.6% accuracy.”
From Artificial intelligence in healthcare: past, present and future (2017) · cites this paper as [50]
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
Cortes, C., & Vapnik, V. (1995) · Machine-mediated learning · doi:10.1023/a:1022627411411 · Cited by 48,445
LIBSVM: A library for support vector machines
Chang, C.-C., & Lin, C.-J. (2011) · ACM Transactions on Intelligent Systems and Technology · doi:10.1145/1961189.1961199 · Cited by 40,918
Functional connectivity in the motor cortex of resting human brain using echo‐planar mri
Biswal, B., Zerrin Yetkin, F., Haughton, V. M., & Hyde, J. S. (1995) · Magnetic Resonance in Medicine · doi:10.1002/mrm.1910340409 · Cited by 9,812
Ashburner, J., & Friston, K. J. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2005.02.018 · Cited by 7,507 · cited 1×
“Then, all images were spatially normalized to the standard template of the Montreal Neurological Institute (MNI, Canada) using the unified segmentation approach with masked lesions (Ashburner and Friston 2005).”
Power, J. D., Barnes, K. A., Snyder, A. Z., Schlaggar, B. L., & Petersen, S. E. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.10.018 · Cited by 7,429 · cited 1×
“We tested for group differences in head motion parameters from image realignment by comparing the framewise displacement and the root mean squared error (RMSE) (Power et al. 2012).”
MethodHeart Disease and Stroke Statistics—2013 Update: A Report From the American Heart Association
Go, A. S., Mozaffarian, D., Roger, V. L., Benjamin, E. J., Berry, J. D., Borden, W. B., Bravata, D. M., Dai, S., Ford, E. S., Fox, C. S., et al. (2013) · Circulation · doi:10.1161/cir.0b013e31828124ad · Cited by 5,292
Note on the Sampling Error of the Difference Between Correlated Proportions or Percentages
McNemar, Q. (1947) · Psychometrika · doi:10.1007/bf02295996 · Cited by 4,754
A component based noise correction method (CompCor) for BOLD and perfusion based fMRI
Behzadi, Y., Restom, K., Liau, J., & Liu, T. T. (2007) · NeuroImage · doi:10.1016/j.neuroimage.2007.04.042 · Cited by 4,502
A new SPM toolbox for combining probabilistic cytoarchitectonic maps and functional imaging data
Eickhoff, S. B., Stephan, K. E., Mohlberg, H., Grefkes, C., Fink, G. R., Amunts, K., & Zilles, K. (2005) · NeuroImage · doi:10.1016/j.neuroimage.2004.12.034 · Cited by 4,033 · cited 2×
“To this end, we used the same connectivity maps as for the SVM analysis consisting of positive correlations between seed voxel time-courses in ipsilesional M1 and wholebrain target voxels, which were transformed into Fisher Z-scores and then masked by frontoparietal sensorimotor areas (Eickhoff et al. 2005).”
MethodSelf-citationCircular analysis in systems neuroscience: the dangers of double dipping
Kriegeskorte, N., Simmons, W. K., Bellgowan, P. S. F., & Baker, C. I. (2009) · Nature Neuroscience · doi:10.1038/nn.2303 · Cited by 2,696
Analysis of fMRI Time-Series Revisited
Friston, K. J., Holmes, A. P., Poline, J.-B., Grasby, P. J., Williams, S. C. R., Frackowiak, R. S. J., & Turner, R. (1995) · NeuroImage · doi:10.1006/nimg.1995.1007 · Cited by 2,502
Functional and effective connectivity in neuroimaging: a synthesis
Friston, K. J. (1994) · Human Brain Mapping · doi:10.1002/hbm.460020107 · Cited by 2,452
Prediction of individual brain maturity using fMRI
Dosenbach, N. U. F., Nardos, B., Cohen, A. L., Fair, D. A., Power, J. D., Church, J. A., Nelson, S. M., Wig, G. S., Vogel, A. C., Lessov-Schlaggar, C. N., et al. (2010) · Science · doi:10.1126/science.1194144 · Cited by 2,183 · cited 1×
“2) (Müller et al. 2004; Dosenbach et al. 2010; Feis et al. 2013).”
Satterthwaite, T. D., Elliott, M. A., Gerraty, R. T., Ruparel, K., Loughead, J., Calkins, M. E., Eickhoff, S. B., Hakonarson, H., Gur, R. C., Gur, R. E., et al. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.08.052 · Cited by 1,881
Self-citationVan Dijk, K. R. A., Hedden, T., Venkataraman, A., Evans, K. C., Lazar, S. W., & Buckner, R. L. (2010) · Journal of Neurophysiology · doi:10.1152/jn.00783.2009 · Cited by 1,844 · cited 3×
“In contrast to this study, we used restingstate fMRI, which is particularly useful in clinical routine assessment of acute, severely disabled patients because it yields robust signals after only 5–6 min and requires no task-related behavior (Friston 1994; Carter et al. 2010; Van Dijk et al. 2010; Wang et al. 2010).”
MethodThe Balanced Accuracy and Its Posterior Distribution
Brodersen, K. H., Ong, C. S., Stephan, K. E., & Buhmann, J. M. (2010) · 2010 20th International Conference on Pattern Recognition · doi:10.1109/icpr.2010.764 · Cited by 1,816 · cited 2×
“We then computed the posterior accuracy of these clinical ratings (Brodersen et al. 2010).”
MethodMachine learning classifiers and fMRI: A tutorial overview
Pereira, F., Mitchell, T., & Botvinick, M. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2008.11.007 · Cited by 1,624
The Atlas of Heart Disease and Stroke
Mackay, J., Mensah, G. A., & Mendis, S. (2004) · Medical Entomology and Zoology · Cited by 1,550
On the interpretation of weight vectors of linear models in multivariate neuroimaging
Haufe, S., Meinecke, F., Görgen, K., Dähne, S., Haynes, J.-D., Blankertz, B., & Bießmann, F. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2013.10.067 · Cited by 1,389
Identifying natural images from human brain activity
Kay, K. N., Naselaris, T., Prenger, R. J., & Gallant, J. L. (2008) · Nature · doi:10.1038/nature06713 · Cited by 1,286
Automatic classification of MR scans in Alzheimer’s disease.
Kloppel, S., Stonnington, C. M., Chu, C., Draganski, B., Scahill, R. I., Rohrer, J. D., Fox, N. C., Jack, C. R., Ashburner, J., & Frackowiak, R. S. J. (2008) · Brain · doi:10.1093/brain/awm319 · Cited by 1,170
Anticorrelations in resting state networks without global signal regression
Chai, X. J., Castañón, A. N., Öngür, D., & Whitfield-Gabrieli, S. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.08.048 · Cited by 1,144
Chollet, F., Di Piero, V., Wise, R. J. S., Brooks, D. J., Dolan, R. J., & Frackowiak, R. S. J. (1991) · Annals of Neurology · doi:10.1002/ana.410290112 · Cited by 1,098
Orrù, G., Pettersson-Yeo, W., Marquand, A. F., Sartori, G., & Mechelli, A. (2012) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2012.01.004 · Cited by 1,012
Neural correlates of motor recovery after stroke: a longitudinal fMRI study
Ward, N. S. (2003) · Brain · doi:10.1093/brain/awg245 · Cited by 1,006
He, B. J., Snyder, A. Z., Vincent, J. L., Epstein, A., Shulman, G. L., & Corbetta, M. (2007) · Neuron · doi:10.1016/j.neuron.2007.02.013 · Cited by 920
Naselaris, T., Kay, K. N., Nishimoto, S., & Gallant, J. L. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.07.073 · Cited by 905
Functional potential in chronic stroke patients depends on corticospinal tract integrity
Stinear, C. M., Barber, P. A., Smale, P. R., Coxon, J. P., Fleming, M. K., & Byblow, W. D. (2006) · Brain · doi:10.1093/brain/awl333 · Cited by 859
Motor Evaluation in Vascular Hemiplegia
Demeurisse, G., Demol, O., & Robaye, E. (1980) · European Neurology · doi:10.1159/000115178 · Cited by 811
Carter, A. R., Astafiev, S. V., Lang, C. E., Connor, L. T., Rengachary, J., Strube, M. J., Pope, D. L. W., Shulman, G. L., & Corbetta, M. (2010) · Annals of Neurology · doi:10.1002/ana.21905 · Cited by 767
Zeng, L.-L., Shen, H., Liu, L., Wang, L., Li, B., Fang, P., Zhou, Z., Li, Y., & Hu, D. (2012) · Brain · doi:10.1093/brain/aws059 · Cited by 748
Electrophysiological correlates of the brain's intrinsic large-scale functional architecture
He, B. J., Snyder, A. Z., Zempel, J. M., Smyth, M. D., & Raichle, M. E. (2008) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0807010105 · Cited by 670 · cited 1×
“Intracranial recordings in humans and animals showed that resting-state connectivity reflects spontaneous oscillations of synchronous neuronal activity (He et al. 2008; Nir et al. 2008; van Meer et al. 2012).”
BackgroundMotor areas in the frontal lobe of the primate
DUM, R., & STRICK, P. (2002) · Physiology & Behavior · doi:10.1016/s0031-9384(02)00929-0 · Cited by 653
Introduction to machine learning for brain imaging
Lemm, S., Blankertz, B., Dickhaus, T., & Müller, K.-R. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2010.11.004 · Cited by 630
Dynamic functional reorganization of the motor execution network after stroke
Wang, L., Yu, C., Chen, H., Qin, W., He, Y., Fan, F., Zhang, Y., Wang, M., Li, K., Zang, Y., et al. (2010) · Brain · doi:10.1093/brain/awq043 · Cited by 629
Cellular and molecular mechanisms of neural repair after stroke: making waves
Carmichael, S. T. (2006) · Annals of Neurology · doi:10.1002/ana.20845 · Cited by 595
Cortical connectivity after subcortical stroke assessed with functional magnetic resonance imaging
Grefkes, C., Nowak, D. A., Eickhoff, S. B., Dafotakis, M., Küst, J., Karbe, H., & Fink, G. R. (2008) · Annals of Neurology · doi:10.1002/ana.21228 · Cited by 577
Self-citationCorrelation between motor improvements and altered fMRI activity after rehabilitative therapy
Johansen‐Berg, H., Dawes, H., Guy, C., Smith, S. M., Wade, D. T., & Matthews, P. M. (2002) · Brain · doi:10.1093/brain/awf282 · Cited by 558
Connectivity-based approaches in stroke and recovery of function
Grefkes, C., & Fink, G. R. (2014) · The Lancet Neurology · doi:10.1016/s1474-4422(13)70264-3 · Cited by 554
Self-citationLongitudinal Changes of Resting-State Functional Connectivity During Motor Recovery After Stroke
Park, C.-H., Chang, W. H., Ohn, S. H., Kim, S. T., Bang, O. Y., Pascual-Leone, A., & Kim, Y.-H. (2011) · Stroke · doi:10.1161/strokeaha.110.596155 · Cited by 498
Nir, Y., Mukamel, R., Dinstein, I., Privman, E., Harel, M., Fisch, L., Gelbard-Sagiv, H., Kipervasser, S., Andelman, F., Neufeld, M. Y., et al. (2008) · Nature Neuroscience · doi:10.1038/nn.2177 · Cited by 485
Reorganization of the human ipsilesional premotor cortex after stroke
Fridman, E. A. (2004) · Brain · doi:10.1093/brain/awh082 · Cited by 433
Motor system activation after subcortical stroke depends on corticospinal system integrity
Ward, N. S., Newton, J. M., Swayne, O. B. C., Lee, L., Thompson, A. J., Greenwood, R. J., Rothwell, J. C., & Frackowiak, R. S. J. (2006) · Brain · doi:10.1093/brain/awl002 · Cited by 422
Hand strength: Normative values
Crosby, C. A., & Wehbé, M. A. (1994) · The Journal of Hand Surgery · doi:10.1016/0363-5023(94)90280-1 · Cited by 417
Gerardin, E., Chételat, G., Chupin, M., Cuingnet, R., Desgranges, B., Kim, H.-S., Niethammer, M., Dubois, B., Lehéricy, S., Garnero, L., et al. (2009) · NeuroImage · doi:10.1016/j.neuroimage.2009.05.036 · Cited by 414
Identification of MCI individuals using structural and functional connectivity networks
Wee, C.-Y., Yap, P.-T., Zhang, D., Denny, K., Browndyke, J. N., Potter, G. G., Welsh-Bohmer, K. A., Wang, L., & Shen, D. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.10.015 · Cited by 379
Activation likelihood estimation meta-analysis of motor-related neural activity after stroke
Rehme, A. K., Eickhoff, S. B., Rottschy, C., Fink, G. R., & Grefkes, C. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.10.023 · Cited by 375
Self-citationSynchronous neuronal activity is a signal for axonal sprouting after cortical lesions in the adult
Carmichael, S. T., & Chesselet, M.-F. (2002) · The Journal of Neuroscience · doi:10.1523/jneurosci.22-14-06062.2002 · Cited by 371
Hand strength: Normative values
Cooney, W. P. (1995) · The Journal of Hand Surgery · doi:10.1016/s0363-5023(05)80159-5 · Cited by 370
Rehme, A. K., Fink, G. R., von Cramon, D. Y., & Grefkes, C. (2011) · Cerebral Cortex · doi:10.1093/cercor/bhq140 · Cited by 362
Self-citationLotze, M., Markert, J., Sauseng, P., Hoppe, J., Plewnia, C., & Gerloff, C. (2006) · The Journal of Neuroscience · doi:10.1523/jneurosci.4564-05.2006 · Cited by 360
Shen, H., Wang, L., Liu, Y., & Hu, D. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.11.011 · Cited by 352
Dynamic causal modeling of cortical activity from the acute to the chronic stage after stroke
Rehme, A. K., Eickhoff, S. B., Wang, L. E., Fink, G. R., & Grefkes, C. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.01.014 · Cited by 328
Self-citationRehme, A. K., & Grefkes, C. (2013) · The Journal of Physiology · doi:10.1113/jphysiol.2012.243469 · Cited by 290
Self-citationMRI atlas of human white matter
Oishi, K., & Crain, B. J. (2010) · Cited by 269
Predicting functional motor potential in chronic stroke patients using diffusion tensor imaging
Lindenberg, R., Zhu, L. L., Rüber, T., & Schlaug, G. (2012) · Human Brain Mapping · doi:10.1002/hbm.21266 · Cited by 244
van Meer, M. P. A., Otte, W. M., van der Marel, K., Nijboer, C. H., Kavelaars, A., van der Sprenkel, J. W. B., Viergever, M. A., & Dijkhuizen, R. M. (2012) · The Journal of Neuroscience · doi:10.1523/jneurosci.3662-11.2012 · Cited by 232
Longitudinal Evaluation of Resting-State fMRI After Acute Stroke With Hemiparesis
Golestani, A.-M., Tymchuk, S., Demchuk, A., Goodyear, B. G., & VISION-2 Study Group (2013) · Neurorehabilitation and Neural Repair · doi:10.1177/1545968312457827 · Cited by 212
Upstream Dysfunction of Somatomotor Functional Connectivity After Corticospinal Damage in Stroke
Carter, A. R., Patel, K. R., Astafiev, S. V., Snyder, A. Z., Rengachary, J., Strube, M. J., Pope, A., Shimony, J. S., Lang, C. E., Shulman, G. L., et al. (2012) · Neurorehabilitation and Neural Repair · doi:10.1177/1545968311411054 · Cited by 199
Pattern-information analysis: From stimulus decoding to computational-model testing
Kriegeskorte, N. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.01.061 · Cited by 194
Anterior temporal lobe connectivity correlates with functional outcome after aphasic stroke
Warren, J. E., Crinion, J. T., Lambon Ralph, M. A., & Wise, R. J. S. (2009) · Brain · doi:10.1093/brain/awp270 · Cited by 190
Wang, L. E., Tittgemeyer, M., Imperati, D., Diekhoff, S., Ameli, M., Fink, G. R., & Grefkes, C. (2011) · Human Brain Mapping · doi:10.1002/hbm.21417 · Cited by 152
Self-citationEarly functional magnetic resonance imaging activations predict language outcome after stroke
Saur, D., Ronneberger, O., Kümmerer, D., Mader, I., Weiller, C., & Klöppel, S. (2010) · Brain · doi:10.1093/brain/awq021 · Cited by 128
Noradrenergic enhancement improves motor network connectivity in stroke patients
Wang, L. E., Fink, G. R., Diekhoff, S., Rehme, A. K., Eickhoff, S. B., & Grefkes, C. (2011) · Annals of Neurology · doi:10.1002/ana.22237 · Cited by 128
Self-citationRichiardi, J., Gschwind, M., Simioni, S., Annoni, J.-M., Greco, B., Hagmann, P., Schluep, M., Vuilleumier, P., & Van De Ville, D. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.05.078 · Cited by 99
Gbureck, U., Lansnicker, L., Holste, T., & Thull, R. (2004) · Biomedizinische Technik/Biomedical Engineering · doi:10.1515/bmt.2004.003 · Cited by 73
Rehme, A. K., Eickhoff, S. B., & Grefkes, C. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2012.11.027 · Cited by 71
Self-citationKay, K., & Gallant, J. L. (2009) · Nature Neuroscience · doi:10.1038/nn0309-245 · Cited by 70
Decoding gender dimorphism of the human brain using multimodal anatomical and diffusion MRI data
Feis, D., Brodersen, K. H., von Cramon, D. Y., Luders, E., & Tittgemeyer, M. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2012.12.068 · Cited by 68
Self-citationTranscranial Electrostimulation in Treatment of Chronic Diffuse Liver Diseases
Skvortsov, V. V., & Тумаренко, А. В. (2015) · Biomedical Engineering · doi:10.1007/s10527-015-9530-x · Cited by 12
Cited by
Artificial intelligence in healthcare: past, present and future
Jiang, F., Jiang, Y., Zhi, H., Dong, Y., Li, H., Ma, S., Wang, Y., Dong, Q., Shen, H., & Wang, Y. (2017) · Stroke and Vascular Neurology · doi:10.1136/svn-2017-000101 · Cited by 4,837
Disruptions of network connectivity predict impairment in multiple behavioral domains after stroke
Siegel, J. S., Ramsey, L. E., Snyder, A. Z., Metcalf, N. V., Chacko, R. V., Weinberger, K., Baldassarre, A., Hacker, C. D., Shulman, G. L., & Corbetta, M. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1521083113 · Cited by 656
Applications of machine learning to diagnosis and treatment of neurodegenerative diseases
Myszczynska, M. A., Ojamies, P. N., Lacoste, A. M. B., Neil, D., Saffari, A., Mead, R., Hautbergue, G. M., Holbrook, J. D., & Ferraiuolo, L. (2020) · Nature Reviews Neurology · doi:10.1038/s41582-020-0377-8 · Cited by 595
Recovery from stroke: current concepts and future perspectives
Grefkes, C., & Fink, G. R. (2020) · Neurological Research and Practice · doi:10.1186/s42466-020-00060-6 · Cited by 546
Self-citationBrain networks and their relevance for stroke rehabilitation
Guggisberg, A. G., Koch, P. J., Hummel, F. C., & Buetefisch, C. M. (2019) · Clinical Neurophysiology · doi:10.1016/j.clinph.2019.04.004 · Cited by 245
Metadata
- Authors
- Rehme, A. K., Volz, L. J., Feis, D.-L., Bomilcar-Focke, I., Liebig, T., Eickhoff, S. B., Fink, G. R., & Grefkes, C.
- Affiliations
- Forschungszentrum Jülich (DE)
- Max Planck Society (DE)
- Max Planck Institute for Metabolism Research (DE)
- University of Cologne (DE)
- Corresponding author
- Rehme, A. K.
- Venue
- Cerebral Cortex
- Publisher
- Oxford University Press (OUP)
- Published
- 2014-05-16
- Volume
- 25
- Issue
- 9
- Pages
- 3046-3056
- ISSN
- 1047-3211 (ISSN-L)
- 1460-2199
- OpenAlex
- W2120701355
- Cited by
- 117
- References
- 70
- Citations by year
- 2026: 3 · 2025: 10 · 2024: 6 · 2023: 6 · 2022: 14 · 2021: 19 · 2020: 16 · 2019: 13 · 2018: 11 · 2017: 7 · 2016: 8 · 2015: 4
- FWCI
- 3.53
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Cerebral Cortex (publishedVersion)
- PubMed (publishedVersion)
- Kölner Universitäts PublikationsServer (Universität zu Köln) (publishedVersion)
- MPG.PuRe (Max Planck Society) (submittedVersion)
- Topics
- Life Sciences › Neuroscience › Cognitive Neuroscience › Functional Brain Connectivity Studies
- Health Sciences › Medicine › Rehabilitation › Stroke Rehabilitation and Recovery
- Life Sciences › Neuroscience › Neurology › Transcranial Magnetic Stimulation Studies
- Keywords
- acute stroke, motor impairment, resting-state fMRI, support vector machine, multivariate decoding, interhemispheric connectivity, primary motor cortex, premotor cortex, lesion localization, endophenotypes
- MeSH terms
- Machine Learning, Aged, Aged, 80 and over, Brain, Brain Mapping, Disability Evaluation, Female, Humans, Image Processing, Computer-Assisted, Male, Middle Aged, Movement Disorders, Neural Pathways, Rest, Severity of Illness Index, Stroke, Neuroimaging
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.