The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
Machine Learning and the Future of Cardiovascular Care
Open accessAbstract
The role of physicians has always been to synthesize the data available to them to identify diagnostic patterns that guide treatment and follow response. Today, increasingly sophisticated machine learning algorithms may grow to support clinical experts in some of these tasks. Machine learning has the potential to benefit patients and cardiologists, but only if clinicians take an active role in bringing these new algorithms into practice. The aim of this review is to introduce clinicians who are not data science experts to key concepts in machine learning that will allow them to better understand the field and evaluate new literature and developments. The current published data in machine learning for cardiovascular disease is then summarized, using both a bibliometric survey, with code publicly available to enable similar analysis for any research topic of interest, and select case studies. Finally, several ways that clinicians can and must be involved in this emerging field are presented.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Dermatologist-level classification of skin cancer with deep neural networks
Esteva, A., Kuprel, B., Novoa, R. A., Ko, J., Swetter, S. M., Blau, H. M., & Thrun, S. (2017) · Nature · doi:10.1038/nature21056 · Cited by 14,362
Rudin, C. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0048-x · Cited by 10,561
Gulshan, V., Peng, L., Coram, M., Stumpe, M. C., Wu, D., Narayanaswamy, A., Venugopalan, S., Widner, K., Madams, T., Cuadros, J., et al. (2016) · JAMA · doi:10.1001/jama.2016.17216 · Cited by 7,697
Rajkomar, A., Dean, J., & Kohane, I. (2019) · New England Journal of Medicine · doi:10.1056/nejmra1814259 · Cited by 4,579
Deo, R. C. (2015) · Circulation · doi:10.1161/circulationaha.115.001593 · Cited by 3,466
Hannun, A. Y., Rajpurkar, P., Haghpanahi, M., Tison, G. H., Bourn, C., Turakhia, M. P., & Ng, A. Y. (2019) · Nature Medicine · doi:10.1038/s41591-018-0268-3 · Cited by 3,148
Prediction of cardiovascular risk factors from retinal fundus photographs via deep learning
Poplin, R., Varadarajan, A. V., Blumer, K., Liu, Y., McConnell, M. V., Corrado, G. S., Peng, L., & Webster, D. R. (2018) · Nature Biomedical Engineering · doi:10.1038/s41551-018-0195-0 · Cited by 1,865
Zech, J. R., Badgeley, M. A., Liu, M., Costa, A. B., Titano, J. J., & Oermann, E. K. (2018) · PLOS Medicine · doi:10.1371/journal.pmed.1002683 · Cited by 1,719 · cited 1×
“Overfitting is one of the most common problems encountered when using supervised machine learning algorithms, and the main limitation to their application to real-life clinical situations (31).”
BackgroundMiotto, R., Li, L., Kidd, B. A., & Dudley, J. T. (2016) · Scientific Reports · doi:10.1038/srep26094 · Cited by 1,710 · cited 1×
“Unsupervised learning approaches are common in the analysis of EHR or genetic data to automatically extract the most useful information (24) to identify distinct disease subgroups —of type 2 diabetes, for example (25)—or to find a new set of biomarkers that may be better predictors than standard…”
MethodAttia, Z. I., Noseworthy, P. A., Lopez-Jimenez, F., Asirvatham, S. J., Deshmukh, A. J., Gersh, B. J., Carter, R. E., Yao, X., Rabinstein, A. A., Erickson, B. J., et al. (2019) · The Lancet · doi:10.1016/s0140-6736(19)31721-0 · Cited by 1,613
Attia, Z. I., Kapa, S., Lopez-Jimenez, F., McKie, P. M., Ladewig, D. J., Satam, G., Pellikka, P. A., Enriquez-Sarano, M., Noseworthy, P. A., Munger, T. M., et al. (2019) · Nature Medicine · doi:10.1038/s41591-018-0240-2 · Cited by 1,389
Artificial intelligence in cardiology
Johnson, K. W., Torres Soto, J., Glicksberg, B. S., Shameer, K., Miotto, R., Ali, M., Ashley, E., & Dudley, J. T. (2018) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.03.521 · Cited by 1,202
(2019) · Cited by 986
Deep Learning for Segmentation Using an Open Large-Scale Dataset in 2D Echocardiography
Leclerc, S., Smistad, E., Pedrosa, J., Ostvik, A., Cervenansky, F., Espinosa, F., Espeland, T., Berg, E. A. R., Jodoin, P.-M., Grenier, T., et al. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2019.2900516 · Cited by 780
Artificial Intelligence in Cardiovascular Imaging
Dey, D., Slomka, P. J., Leeson, P., Comaniciu, D., Shrestha, S., Sengupta, P. P., & Marwick, T. H. (2019) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2018.12.054 · Cited by 680
Minimum information about clinical artificial intelligence modeling: the MI-CLAIM checklist.
Norgeot, B., Quer, G., Beaulieu-Jones, B. K., Torkamani, A., Dias, R., Gianfrancesco, M., Arnaout, R., Kohane, I. S., Saria, S., Topol, E., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1041-y · Cited by 665 · cited 2×
“In order to evaluate performance of any ML algorithm on a clinical task, full information on the data and methods used in training and testing must be reported (11).”
BackgroundMethodSelf-citationConvolutional Recurrent Neural Networks for Dynamic MR Image Reconstruction
Qin, C., Schlemper, J., Caballero, J., Price, A. N., Hajnal, J. V., & Rueckert, D. (2019) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2863670 · Cited by 603
Fast and accurate view classification of echocardiograms using deep learning
Madani, A., Arnaout, R., Mofrad, M., & Arnaout, R. (2018) · npj Digital Medicine · doi:10.1038/s41746-017-0013-1 · Cited by 585
Self-citationMachine learning in cardiovascular medicine: are we there yet?
Shameer, K., Johnson, K. W., Glicksberg, B. S., Dudley, J. T., & Sengupta, P. P. (2018) · Heart · doi:10.1136/heartjnl-2017-311198 · Cited by 555
Identification of type 2 diabetes subgroups through topological analysis of patient similarity
Li, L., Cheng, W.-Y., Glicksberg, B. S., Gottesman, O., Tamler, R., Chen, R., Bottinger, E. P., & Dudley, J. T. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aaa9364 · Cited by 549
Privacy-Preserving Generative Deep Neural Networks Support Clinical Data Sharing
Beaulieu-Jones, B. K., Wu, Z. S., Williams, C., Lee, R., Bhavnani, S. P., Byrd, J. B., & Greene, C. S. (2019) · Circulation: Cardiovascular Quality and Outcomes · doi:10.1161/circoutcomes.118.005122 · Cited by 390
State-of-the-Art Deep Learning in Cardiovascular Image Analysis
Litjens, G., Ciompi, F., Wolterink, J. M., de Vos, B. D., Leiner, T., Teuwen, J., & Išgum, I. (2019) · JACC: Cardiovascular Imaging · doi:10.1016/j.jcmg.2019.06.009 · Cited by 388
Arnaout, R., Curran, L., Zhao, Y., Levine, J. C., Chinn, E., & Moon-Grady, A. J. (2020) · doi:10.1101/2020.06.22.20137786 · Cited by 315
Self-citationLost in thought—the limits of the human mind and the future of medicine
Obermeyer, Z., & Lee, T. H. (2017) · New England Journal of Medicine · doi:10.1056/nejmp1705348 · Cited by 252
van Velzen, S. G. M., Lessmann, N., Velthuis, B. K., Bank, I. E. M., van den Bongard, D. H. J. G., Leiner, T., de Jong, P. A., Veldhuis, W. B., Correa, A., Terry, J. G., et al. (2020) · Radiology · doi:10.1148/radiol.2020191621 · Cited by 244
Machine Learning Outperforms ACC/AHA CVD Risk Calculator in MESA
Kakadiaris, I. A., Vrigkas, M., Yen, A. A., Kuznetsova, T., Budoff, M., & Naghavi, M. (2018) · Journal of the American Heart Association · doi:10.1161/jaha.118.009476 · Cited by 227
Al’Aref, S. J., Maliakal, G., Singh, G., van Rosendael, A. R., Ma, X., Xu, Z., Alawamlh, O. A. H., Lee, B., Pandey, M., Achenbach, S., et al. (2020) · European Heart Journal · doi:10.1093/eurheartj/ehz565 · Cited by 227
Sengupta, P. P., Shrestha, S., Berthon, B., Messas, E., Donal, E., Tison, G. H., Min, J. K., D’hooge, J., Voigt, J.-U., Dudley, J., et al. (2020) · JACC: Cardiovascular Imaging · doi:10.1016/j.jcmg.2020.07.015 · Cited by 221
Self-citationTracking the popularity and outcomes of all bioRxiv preprints
Abdill, R. J., & Blekhman, R. (2019) · eLife · doi:10.7554/elife.45133 · Cited by 196 · cited 1×
“The past five years have seen over 3,000 papers on machine learning in cardiology published in PubMed (about 80% original research) or posted on the popular preprint servers arXiv and bioRxiv, where scientists are increasingly sharing their papers with each other and with the public before, during, and sometimes as an…”
BackgroundPorumb, M., Stranges, S., Pescapè, A., & Pecchia, L. (2020) · Scientific Reports · doi:10.1038/s41598-019-56927-5 · Cited by 196
Eisenberg, E., McElhinney, P. A., Commandeur, F., Chen, X., Cadet, S., Goeller, M., Razipour, A., Gransar, H., Cantu, S., Miller, R. J. H., et al. (2020) · Circulation: Cardiovascular Imaging · doi:10.1161/circimaging.119.009829 · Cited by 169
Benz, D. C., Benetos, G., Rampidis, G., von Felten, E., Bakula, A., Sustar, A., Kudura, K., Messerli, M., Fuchs, T. A., Gebhard, C., et al. (2020) · Journal of Cardiovascular Computed Tomography · doi:10.1016/j.jcct.2020.01.002 · Cited by 168
Commandeur, F., Slomka, P. J., Goeller, M., Chen, X., Cadet, S. J., Razipour, A., McElhinney, P. A., Gransar, H., Cantú, S. M., Miller, R. J. H., et al. (2019) · Cardiovascular Research · doi:10.1093/cvr/cvz321 · Cited by 159
Impact of Artificial Intelligence on Interventional Cardiology
Sardar, P., Abbott, J. D., Kundu, A., Aronow, H. D., Granada, J. F., & Giri, J. (2019) · JACC: Cardiovascular Interventions · doi:10.1016/j.jcin.2019.04.048 · Cited by 151
Machine Learning Approaches in Cardiovascular Imaging
Henglin, M., Stein, G., Hushcha, P. V., Snoek, J., Wiltschko, A. B., & Cheng, S. C. (2017) · Circulation Cardiovascular Imaging · doi:10.1161/circimaging.117.005614 · Cited by 150
Retrospective correction of motion‐affected MR images using deep learning frameworks
Küstner, T., Armanious, K., Yang, J., Yang, B., Schick, F., & Gatidis, S. (2019) · Magnetic Resonance in Medicine · doi:10.1002/mrm.27783 · Cited by 150
Automatic Plaque Detection in IVOCT Pullbacks Using Convolutional Neural Networks
Gessert, N., Lutz, M., Heyder, M., Latus, S., Leistner, D. M., Abdelwahed, Y. S., & Schlaefer, A. (2018) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2018.2865659 · Cited by 136
Østvik, A., Smistad, E., Aase, S. A., Haugen, B. O., & Løvstakken, L. (2018) · Ultrasound in Medicine & Biology · doi:10.1016/j.ultrasmedbio.2018.07.024 · Cited by 133
Tokodi, M., Schwertner, W. R., Kovács, A. D., Tősér, Z., Staub, L., Sárkány, A., Lakatos, B. K., Behon, A., Boros, A. M., Perge, P., et al. (2019) · European Heart Journal · doi:10.1093/eurheartj/ehz902 · Cited by 121
Weakly supervised classification of aortic valve malformations using unlabeled cardiac MRI sequences
Fries, J., Varma, P., Chen, V. S., Xiao, K., Tejeda, H., Saha, P., Dunnmon, J., Chubb, H., Maskatia, S. A., Fiterau, M., et al. (2019) · Nature Communications · doi:10.1038/s41467-019-11012-3 · Cited by 106
Yao, X., McCoy, R. G., Friedman, P. A., Shah, N. D., Barry, B. A., Behnken, E. M., Inselman, J. W., Attia, Z. I., & Noseworthy, P. A. (2020) · American Heart Journal · doi:10.1016/j.ahj.2019.10.007 · Cited by 98
Katz, D. H., Deo, R. C., Aguilar, F. G., Selvaraj, S., Martinez, E. E., Beussink‐Nelson, L., Kim, K. A., Peng, J., Irvin, M. R., Tiwari, H. K., et al. (2017) · Journal of Cardiovascular Translational Research · doi:10.1007/s12265-017-9739-z · Cited by 98
The Future of Cardiovascular Computed Tomography
Nicol, E. D., Nørgaard, B. L., Blanke, P., Ahmadi, A. A., Weir-McCall, J. R., Maurovich‐Horvat, P., Han, K., Bax, J. J., & Leipsic, J. A. (2019) · JACC. Cardiovascular imaging · doi:10.1016/j.jcmg.2018.11.037 · Cited by 92
Building medical image classifiers with very limited data using segmentation networks
Wong, K. C. L., Syeda-Mahmood, T. F., & Moradi, M. (2018) · Medical Image Analysis · doi:10.1016/j.media.2018.07.010 · Cited by 73
Diagnosing Heart Failure from Chest X-Ray Images Using Deep Learning
Matsumoto, T., Kodera, S., Shinohara, H., Ieki, H., Yamaguchi, T., Higashikuni, Y., Kiyosue, A., Ito, K., Ando, J., Takimoto, E., et al. (2020) · International Heart Journal · doi:10.1536/ihj.19-714 · Cited by 71
Automatic Plaque Detection in IVOCT Pullbacks Using Convolutional Neural Networks
Gessert, N., Lutz, M., Heyder, M., et al. (2019) · tub.dok (Hamburg University of Technology) · Cited by 71
Lee, J., Prabhu, D. S., Kolluru, C., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-59315-6 · Cited by 69
Shomorony, I., Cirulli, E. T., Huang, L., Napier, L. A., Heister, R., Hicks, M. A., Cohen, I. V., Yu, H., Swisher, C. L., Schenker-Ahmed, N. M., et al. (2020) · Genome Medicine · doi:10.1186/s13073-019-0705-z · Cited by 67
Yu, C., Liu, J., & Zhào, H. (2019) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-019-0763-6 · Cited by 66
Guo, F., NG, M. M., Goubran, M., Petersen, S. E., Piechnik, S. K., Neubauer, S., & Wright, G. A. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101636 · Cited by 65
Au-Yeung, W.-T. M., Sahani, A. K., Isselbacher, E. M., & Armoundas, A. A. (2019) · npj Digital Medicine · doi:10.1038/s41746-019-0160-7 · Cited by 59
Virtual genetic diagnosis for familial hypercholesterolemia powered by machine learning
Pina, A. F., Helgadóttir, S., Mancina, R. M., Pavanello, C., Pirazzi, C., Montalcini, T., Henriques, R., Calabresi, L., Wiklund, O., Macedo, M. P., et al. (2020) · European Journal of Preventive Cardiology · doi:10.1177/2047487319898951 · Cited by 57
Optimization of reconstruction and quantification of motion-corrected coronary PET-CT
Doris, M. K., Otaki, Y., Krishnan, S. K., Kwieciński, J., Rubeaux, M., Alessio, A. M., Pan, T., Cadet, S. J., Dey, D., Dweck, M. R., et al. (2018) · Journal of Nuclear Cardiology · doi:10.1007/s12350-018-1317-5 · Cited by 54
Duchateau, N., Maxime Sermesant, B., Delingette, H., & Ayache, N. (2017) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2017.2714343 · Cited by 53
Tensor Factorization for Precision Medicine in Heart Failure with Preserved Ejection Fraction
Luo, Y., Ahmad, F. S., & Shah, S. J. (2017) · Journal of Cardiovascular Translational Research · doi:10.1007/s12265-016-9727-8 · Cited by 48
Du, X., Yin, S., Tang, R., Zhang, Y., & Li, S. (2019) · IEEE Journal of Translational Engineering in Health and Medicine · doi:10.1109/jtehm.2019.2900628 · Cited by 48
Toba, S., Mitani, Y., Yodoya, N., Ohashi, H., Sawada, H., Hayakawa, H., Hirayama, M., Futsuki, A., Yamamoto, N., Ito, H., et al. (2020) · JAMA Cardiology · doi:10.1001/jamacardio.2019.5620 · Cited by 47
Cardiovascular disease diagnosis using cross-domain transfer learning
Tadesse, G. A., Zhu, T., Liu, Y., Zhou, Y., Chen, J., Tian, M., & Clifton, D. A. (2019) · Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC) · doi:10.1109/embc.2019.8857737 · Cited by 45
MimickNet, Mimicking Clinical Image Post- Processing Under Black-Box Constraints
Huang, O., Long, W., Bottenus, N. B., Lerendegui, M., Trahey, G. E., Farsiu, S., & Palmeri, M. L. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2970867 · Cited by 43
Applications of machine learning in decision analysis for dose management for dofetilide
Levy, A. E., Biswas, M., Weber, R. A., Tarakji, K. G., Chung, M. K., Noseworthy, P. A., Newton‐Cheh, C., & Rosenberg, M. A. (2019) · PLoS ONE · doi:10.1371/journal.pone.0227324 · Cited by 41
Chen, H., Liu, C., Chang, S., Chang, P. Y.-C., Chen, W.-S., Pan, Y.-M., Fang, S.-T., Zhan, S.-Q., Chuang, C., Lin, Y., et al. (2020) · International Journal of Cardiology · doi:10.1016/j.ijcard.2020.03.075 · Cited by 40
Multimodal 3D medical image registration guided by shape encoder–decoder networks
Blendowski, M., Bouteldja, N., & Heinrich, M. P. (2019) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-019-02089-8 · Cited by 39
Cilla, M., Pérez‐Rey, I., Martínez, M. A., Peña, E., & Martínez, J. (2018) · International Journal for Numerical Methods in Biomedical Engineering · doi:10.1002/cnm.3121 · Cited by 38
Pixel-Level Tissue Classification for Ultrasound Images
Pazinato, D. V., Stein, B. V., de Almeida, W. R., et al. (2014) · IEEE Journal of Biomedical and Health Informatics · doi:10.1109/jbhi.2014.2386796 · Cited by 37
Using neural attention networks to detect adverse medical events from electronic health records
Chu, J., Dong, W., He, K., Duan, H., & Huang, Z. (2018) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2018.10.002 · Cited by 35
Yang, Y., Hirdes, J. P., Dubin, J. A., & Lee, J. (2019) · JMIR Aging · doi:10.2196/12153 · Cited by 34
Diller, G., Lammers, A. E., Babu‐Narayan, S. V., Li, W., Radke, R., Baumgartner, H., Gatzoulis, M. Α., & Orwat, S. (2019) · International journal of cardiac imaging · doi:10.1007/s10554-019-01671-0 · Cited by 33
Lassen, M. L., Beyer, T., Berger, A., Beitzke, D., Rasul, S., Büther, F., Hacker, M., & Cal-González, J. (2019) · Journal of Nuclear Cardiology · doi:10.1007/s12350-019-01613-2 · Cited by 31
Machine learning applied to multi-sensor information to reduce false alarm rate in the ICU
Hever, G., Cohen-Lavi, L., O’Connor, M. F., Matot, I., Lerner, B., & Bitan, Y. (2019) · Journal of Clinical Monitoring and Computing · doi:10.1007/s10877-019-00307-x · Cited by 31
Intelligent Platforms for Disease Assessment
Sengupta, P. P. (2013) · JACC. Cardiovascular imaging · doi:10.1016/j.jcmg.2013.09.003 · Cited by 28
Carlin, C. S., Ho, V. L., Ledbetter, D., Aczon, M., & Wetzel, R. C. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy122 · Cited by 26
Dekker, M., Waissi, F., Bank, I. E. M., Lessmann, N., Išgum, I., Velthuis, B. K., Scholtens, A. M., Leenders, G. E., Pasterkamp, G., de Kleijn, D. P. V., et al. (2020) · IJC Heart & Vasculature · doi:10.1016/j.ijcha.2019.100434 · Cited by 20
Adverse Drug Reaction Detection in Social Media by Deepm Learning Methods.
Rezaei, Z., Ebrahimpour-Komleh, H., Eslami, B., Chavoshinejad, R., & Totonchi, M. (2020) · PubMed · doi:10.22074/cellj.2020.6615 · Cited by 19
On the Effectiveness of Deep Representation Learning: The Atrial Fibrillation Case
Gadaleta, M., Rossi, M., Topol, E. J., et al. (2019) · Computer · doi:10.1109/mc.2019.2932716 · Cited by 9
Labovitz, D., Shafner, L., Virmani, D., & Hanina, A. (2016) · Iproceedings · doi:10.2196/iproc.6201 · Cited by 1
Cited by
Opening the black box: the promise and limitations of explainable machine learning in cardiology
Petch, J., Di, S., & Nelson, W. (2022) · Canadian Journal of Cardiology · doi:10.1016/j.cjca.2021.09.004 · Cited by 552
Deep Learning Electrocardiographic Analysis for Detection of Left-Sided Valvular Heart Disease
Elias, P., Poterucha, T. J., Rajaram, V., Moller, L. M., Rodriguez, V., Bhave, S., Hahn, R. T., Tison, G., Abreau, S. A., Barrios, J., et al. (2022) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2022.05.029 · Cited by 153
Detection of Left Ventricular Systolic Dysfunction From Electrocardiographic Images
Sangha, V., Nargesi, A. A., Dhingra, L. S., Khunte, A., Mortazavi, B. J., Ribeiro, A. H., Banina, E., Adeola, O., Garg, N., Brandt, C. A., et al. (2023) · Circulation · doi:10.1161/circulationaha.122.062646 · Cited by 150
Leclercq, C., Witt, H., Hindricks, G., Katra, R. P., Albert, D., Belliger, A., Cowie, M. R., Deneke, T., Friedman, P., Haschemi, M., et al. (2022) · EP Europace · doi:10.1093/europace/euac052 · Cited by 109
Schepart, A., Burton, A., Durkin, L., Fuller, A., Charap, E., Bhambri, R., & Ahmad, F. S. (2023) · Cardiovascular Digital Health Journal · doi:10.1016/j.cvdhj.2023.04.003 · Cited by 40
Metadata
- Authors
- Quer, G., Arnaout, R., Henne, M., & Arnaout, R.
- Venue
- Journal of the American College of Cardiology
- Publisher
- Elsevier BV
- Published
- 2021-01
- Volume
- 77
- Issue
- 3
- Pages
- 300-313
- ISSN
- 0735-1097 (ISSN-L)
- OpenAlex
- W3125603166
- Cited by
- 337
- References
- 75
- FWCI
- 13.89
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.