The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Clinically Applicable Segmentation of Head and Neck Anatomy for Radiotherapy: Deep Learning Algorithm Development and Validation Study
Open accessAbstract
Background: Over half a million individuals are diagnosed with head and neck cancer each year globally. Radiotherapy is an important curative treatment for this disease, but it requires manual time to delineate radiosensitive organs at risk. This planning process can delay treatment while also introducing interoperator variability, resulting in downstream radiation dose differences. Although auto-segmentation algorithms offer a potentially time-saving solution, the challenges in defining, quantifying, and achieving expert performance remain. Objective: Adopting a deep learning approach, we aim to demonstrate a 3D U-Net architecture that achieves expert-level performance in delineating 21 distinct head and neck organs at risk commonly segmented in clinical practice. Methods: The model was trained on a data set of 663 deidentified computed tomography scans acquired in routine clinical practice and with both segmentations taken from clinical practice and segmentations created by experienced radiographers as part of this research, all in accordance with consensus organ at risk definitions. Results: We demonstrated the model’s clinical applicability by assessing its performance on a test set of 21 computed tomography scans from clinical practice, each with 21 organs at risk segmented by 2 independent experts. We also introduced surface Dice similarity coefficient, a new metric for the comparison of organ delineation, to quantify the deviation between organ at risk surface contours rather than volumes, better reflecting the clinical task of correcting errors in automated organ segmentations. The model’s generalizability was then demonstrated on 2 distinct open-source data sets, reflecting different centers and countries to model training. Conclusions: Deep learning is an effective and clinically applicable technique for the segmentation of the head and neck anatomy for radiotherapy. With appropriate validation studies and regulatory approvals, this system could improve the efficiency, consistency, and safety of radiotherapy pathways.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
U-Net: Convolutional Networks for Biomedical Image Segmentation
Ronneberger, O., Fischer, P., & Brox, T. (2015) · Lecture notes in computer science · doi:10.1007/978-3-319-24574-4_28 · Cited by 99,404
Self-citationJemal, A., Bray, F., Center, M. M., Ferlay, J., Ward, E., & Forman, D. (2011) · CA: A Cancer Journal for Clinicians · doi:10.3322/caac.20107 · Cited by 54,679
Measures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 11,874
Marching cubes: A high resolution 3D surface construction algorithm
Lorensen, W. E., & Cline, H. E. (1987) · ACM SIGGRAPH Computer Graphics · doi:10.1145/37402.37422 · Cited by 8,647
3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
Self-citationThe Cancer Imaging Archive (TCIA): Maintaining and Operating a Public Information Repository
Clark, K., Vendt, B., Smith, K., Freymann, J., Kirby, J., Koppel, P., Moore, S., Phillips, S., Maffitt, D., Pringle, M., et al. (2013) · Journal of Digital Imaging · doi:10.1007/s10278-013-9622-7 · Cited by 4,599
Clinically applicable deep learning for diagnosis and referral in retinal disease
De Fauw, J., Ledsam, J. R., Romera-Paredes, B., Nikolov, S., Tomasev, N., Blackwell, S., Askham, H., Glorot, X., O’Donoghue, B., Visentin, D., et al. (2018) · Nature Medicine · doi:10.1038/s41591-018-0107-6 · Cited by 2,639
Self-citationNutting, C. M., Morden, J. P., Harrington, K. J., Urbano, T. G., Bhide, S. A., Clark, C., Miles, E. A., Miah, A. B., Newbold, K., Tanay, M., et al. (2011) · The Lancet Oncology · doi:10.1016/s1470-2045(10)70290-4 · Cited by 1,706
Parkin, D. M., Boyd, L., & Walker, L. C. (2011) · British Journal of Cancer · doi:10.1038/bjc.2011.489 · Cited by 663
Segmentation of organs‐at‐risks in head and neck CT images using convolutional neural networks
Ibragimov, B., & Xing, L. (2017) · Medical Physics · doi:10.1002/mp.12045 · Cited by 502
Chen, Z., King, W., Pearcey, R., Kerba, M., & Mackillop, W. J. (2008) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2007.11.016 · Cited by 424
Vision 20/20: Perspectives on automated image segmentation for radiotherapy
Sharp, G., Fritscher, K. D., Pekar, V., Peroni, M., Shusharina, N., Veeraraghavan, H., & Yang, J. (2014) · Medical Physics · doi:10.1118/1.4871620 · Cited by 375
Evaluation of segmentation methods on head and neck CT: Auto‐segmentation challenge 2015
Raudaschl, P. F., Zaffino, P., Sharp, G. C., Spadea, M. F., Chen, A., Dawant, B. M., Albrecht, T., Gass, T., Langguth, C., Lüthi, M., et al. (2017) · Medical Physics · doi:10.1002/mp.12197 · Cited by 259
Institutional Clinical Trial Accrual Volume and Survival of Patients With Head and Neck Cancer
Wuthrick, E. J., Zhang, Q., Machtay, M., Rosenthal, D. I., Nguyen-Tan, P. F., Fortin, A., Silverman, C. L., Raben, A., Kim, H. E., Horwitz, E. M., et al. (2015) · Journal of Clinical Oncology · doi:10.1200/jco.2014.56.5218 · Cited by 250
Wong, J., Fong, A., McVicar, N., Smith, S., Giambattista, J., Wells, D., Kolbeck, C., Giambattista, J., Gondara, L., & Alexander, A. (2020) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2019.10.019 · Cited by 246
Improving automatic delineation for head and neck organs at risk by Deep Learning Contouring
van Dijk, L. V., Van den Bosch, L., Aljabar, P., Peressutti, D., Both, S., J.H.M. Steenbakkers, R., Langendijk, J. A., Gooding, M. J., & Brouwer, C. L. (2020) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2019.09.022 · Cited by 239
Variations in the Contouring of Organs at Risk: Test Case From a Patient With Oropharyngeal Cancer
Nelms, B. E., Tomé, W. A., Robinson, G., & Wheeler, J. (2012) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2010.10.019 · Cited by 236
Jensen, K., Lambertsen, K., & Grau, C. (2007) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2007.06.004 · Cited by 234
Veiga, C., McClelland, J., Moinuddin, S., Lourenço, A., Ricketts, K., Annkah, J., Modat, M., Ourselin, S., D'Souza, D., & Royle, G. (2014) · Medical Physics · doi:10.1118/1.4864240 · Cited by 216
Self-citationTong, N., Gou, S., Yang, S., Ruan, D., & Sheng, K. (2018) · Medical Physics · doi:10.1002/mp.13147 · Cited by 208
Vaassen, F., Hazelaar, C., Vaniqui, A., Gooding, M., van der Heyden, B., Canters, R., & van Elmpt, W. (2020) · Physics and Imaging in Radiation Oncology · doi:10.1016/j.phro.2019.12.001 · Cited by 204
Atlas-Based Auto-segmentation of Head and Neck CT Images
Han, X., Hoogeman, M. S., Levendag, P. C., Hibbard, L. S., Teguh, D. N., Voet, P., Cowen, A. C., & Wolf, T. K. (2008) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-85990-1_52 · Cited by 195
Teguh, D. N., Levendag, P. C., Voet, P. W. J., Al-Mamgani, A., Han, X., Wolf, T. K., Hibbard, L. S., Nowak, P., Akhiat, H., Dirkx, M. L. P., et al. (2011) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2010.07.009 · Cited by 194
Clinically applicable deep learning framework for organs at risk delineation in CT images
Tang, H., Chen, X., Liu, Y., Lu, Z., You, J., Yang, M., Yao, S., Zhao, G., Xu, Y., Chen, T., et al. (2019) · Nature Machine Intelligence · doi:10.1038/s42256-019-0099-z · Cited by 180
Zhang, T., Chi, Y., Meldolesi, E., & Yan, D. (2007) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2007.01.038 · Cited by 177
La Macchia, M., Fellin, F., Amichetti, M., Cianchetti, M., Gianolini, S., Paola, V., Lomax, A. J., & Widesott, L. (2012) · Radiation Oncology · doi:10.1186/1748-717x-7-160 · Cited by 172
Shape-Aware Organ Segmentation by Predicting Signed Distance Maps
Xue, Y., Tang, H., Qiao, Z., Gong, G., Yin, Y., Qian, Z. Y., Huang, C., Fan, W., & Huang, X. (2020) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v34i07.6946 · Cited by 155
Daisne, J., & Blumhofer, A. (2013) · Radiation Oncology · doi:10.1186/1748-717x-8-154 · Cited by 149
Interleaved 3D‐ CNN s for joint segmentation of small‐volume structures in head and neck CT images
Ren, X., Xiang, L., Nie, D., Shao, Y., Zhang, H., Shen, D. G., & Wang, Q. (2018) · Medical Physics · doi:10.1002/mp.12837 · Cited by 149
Liang, S., Tang, F., Huang, X., Yang, K., Zhong, T., Hu, R., Liu, S., Yuan, X., & Zhang, Y. (2018) · European Radiology · doi:10.1007/s00330-018-5748-9 · Cited by 146
Rapid advances in auto-segmentation of organs at risk and target volumes in head and neck cancer
Kosmin, M., Ledsam, J. R., Romera‐Paredes, B., Mendes, R. L., Moinuddin, S. A., D’Souza, D., Gunn, L., Kelly, C. J., Hughes, C., Karthikesalingam, A., et al. (2019) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2019.03.004 · Cited by 138
Self-citationDeep Learning-Based Delineation of Head and Neck Organs at Risk: Geometric and Dosimetric Evaluation
van Rooij, W., Dahele, M. R., Brandao, H. R., Delaney, A. R., Slotman, B. J., & Verbakel, W. F. A. R. (2019) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2019.02.040 · Cited by 128
Qazi, A. A., Pekar, V., Kim, J., Xie, J., Breen, S. L., & Jaffray, D. A. (2011) · Medical Physics · doi:10.1118/1.3654160 · Cited by 124
Fritscher, K. D., Peroni, M., Zaffino, P., Spadea, M. F., Schubert, R., & Sharp, G. C. (2014) · Medical Physics · doi:10.1118/1.4871623 · Cited by 121
Voet, P. W. J., Dirkx, M. L. P., Teguh, D. N., Hoogeman, M. S., Levendag, P. C., & Heijmen, B. J. M. (2011) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2010.11.017 · Cited by 115
Mikeljevic, J. S., Haward, R., Johnston, C., Crellin, A. M., Dodwell, D. J., Jones, A., Pisani, P., & Forman, D. (2004) · British Journal of Cancer · doi:10.1038/sj.bjc.6601693 · Cited by 111
Fortunati, V., Verhaart, R. F., van der Lijn, F., Niessen, W. J., Veenland, J. F., Paulides, M. M., & van Walsum, T. (2013) · Medical Physics · doi:10.1118/1.4810971 · Cited by 104
Tao, C., Yi, J., Chen, N., Ren, W., Cheng, J. C., Tung, S. Y., Kong, L., Lin, S., Pan, J.-J., Zhang, G.-S., et al. (2015) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2015.05.012 · Cited by 104
Deep Neural Networks for Fast Segmentation of 3D Medical Images
Fritscher, K. D., Raudaschl, P., Zaffino, P., Spadea, M. F., Sharp, G. C., & Schubert, R. (2016) · Lecture notes in computer science · doi:10.1007/978-3-319-46723-8_19 · Cited by 99
Automatic detection of contouring errors using convolutional neural networks
Rhee, D. J., Cárdenas, C., Elhalawani, H. M., McCarroll, R. E., Zhang, L., Yang, J., Garden, A. S., Peterson, C. B., Beadle, B. M., & Court, L. E. (2019) · Medical Physics · doi:10.1002/mp.13814 · Cited by 97
Emphasizing Conformal Avoidance Versus Target Definition for IMRT Planning in Head-and-Neck Cancer
Harari, P. M., Song, S., & Tomé, W. A. (2010) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2009.09.062 · Cited by 95
A pre-clinical assessment of an atlas-based automatic segmentation tool for the head and neck
Sims, R., Isambert, A., Grégoire, V., et al. (2009) · Radiotherapy and Oncology · doi:10.1016/j.radonc.2009.08.013 · Cited by 92
Wang, Y., Zhao, L., Wang, M., & Song, Z. (2019) · IEEE Access · doi:10.1109/access.2019.2944958 · Cited by 87
Evaluation of an automatic segmentation algorithm for definition of head and neck organs at risk
Thomson, D. J., Boylan, C., Liptrot, T., Aitkenhead, A. H., Lee, L. W., Yap, B. K., Sykes, A. J., Rowbottom, C. G., & Slevin, N. J. (2014) · Radiation Oncology · doi:10.1186/1748-717x-9-173 · Cited by 75
Guo, D., Jin, D., Zhu, Z., Ho, T., Harrison, A. P., Chao, C.-H., Xiao, J. Z., & Lü, L. (2020) · IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings - IEEE Computer Society Conference on Computer Vision and Pattern Recognition/Proceedings · doi:10.1109/cvpr42600.2020.00428 · Cited by 75
Duc, A. K. H., Eminowicz, G., Mendes, R. L., Wong, S., McClelland, J. R., Marc Modat, A., Cardoso, M. J., Mendelson, A., Veiga, C., Kadir, T., et al. (2015) · Medical Physics · doi:10.1118/1.4927567 · Cited by 73
Self-citationQiu, B., Guo, J., Kraeima, J., Glas, H. H., Borra, R., Witjes, M. J. H., & van Ooijen, P. M. A. (2019) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ab2c95 · Cited by 73
Tong, N., Gou, S., Yang, S., Cao, M., & Sheng, K. (2019) · Medical Physics · doi:10.1002/mp.13553 · Cited by 69
Gao, Y., Huang, R., Chen, M., et al. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32248-9_92 · Cited by 67
Wang, Z., Wei, L., Wang, L., Gao, Y., Chen, W., & Shen, D. G. (2017) · IEEE Transactions on Image Processing · doi:10.1109/tip.2017.2768621 · Cited by 66
Mak, R. H., Endres, M. G., Paik, J. H., Sergeev, R. A., Aerts, H. J. W. L., Williams, C. L., Lakhani, K. R., & Guinan, E. C. (2019) · JAMA Oncology · doi:10.1001/jamaoncol.2019.0159 · Cited by 66
Chan, J. W. S., Kearney, V. P., Haaf, S., Wu, S. Y., Bogdanov, M., Reddick, M., Dixit, N., Sudhyadhom, A., Chen, J., Yom, S. S., et al. (2019) · Medical Physics · doi:10.1002/mp.13495 · Cited by 60
Men, K., Geng, H., Cheng, C., Zhong, H., Huang, M., Yong Fan, A., Plastaras, J. P., Lin, A., & Xiao, Y. (2018) · Medical Physics · doi:10.1002/mp.13296 · Cited by 56
Tappeiner, E., Pröll, S., Hönig, M., Raudaschl, P., Zaffino, P., Spadea, M. F., Sharp, G. C., Schubert, R., & Fritscher, K. D. (2019) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-019-01922-4 · Cited by 55
McCarroll, R. E., Beadle, B. M., Balter, P. A., Burger, H., Cárdenas, C., Dalvie, S., Followill, D. S., Kisling, K. D., Mejia, M. B. A., Naidoo, K., et al. (2018) · Journal of Global Oncology · doi:10.1200/jgo.18.00055 · Cited by 53
Zhu, W., Huang, Y., Tang, H., Qian, Z. Y., Du, N., Fan, W., & Xie, X. S. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/392969 · Cited by 53
Radiotherapy Demand and Activity in England 2006–2020
Round, C., Williams, M. V., Mee, T., Kirkby, N. F., Cooper, T., Hoskin, P., & Jena, R. (2013) · Clinical Oncology · doi:10.1016/j.clon.2013.05.005 · Cited by 50
Kiser, K. J., Barman, A., Stieb, S., Fuller, C. D., & Giancardo, L. (2021) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-021-00460-3 · Cited by 49
Liang, S., Thung, K., Nie, D., Zhang, Y., & Shen, D. G. (2020) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2020.2975853 · Cited by 48
Zhong, T., Huang, X., Tang, F., Liang, S., Deng, X., & Zhang, Y. (2019) · Medical Physics · doi:10.1002/mp.13825 · Cited by 47
Gou, S., Tong, N., Qi, X. S., Yang, S., Chin, R., & Sheng, K. (2020) · Physics in Medicine and Biology · doi:10.1088/1361-6560/ab79c3 · Cited by 44
Contour-Driven Atlas-Based Segmentation
Wachinger, C., Fritscher, K. D., Sharp, G. C., et al. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2442753 · Cited by 41
Segmentation of parotid glands from registered CT and MR images
Močnik, D., Ibragimov, B., Xing, L., Strojan, P., Likar, B., Pernuš, F., & Vrtovec, T. (2018) · Physica Medica · doi:10.1016/j.ejmp.2018.06.012 · Cited by 40
Segmentation of Head and Neck Organs at Risk Using CNN with Batch Dice Loss
Kodym, O., Španěl, M., & Herout, A. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-12939-2_8 · Cited by 35
Wu, X., Udupa, J. K., Tong, Y., Odhner, D., Pednekar, G. V., Simone, C. B., McLaughlin, D., Apinorasethkul, C., Apinorasethkul, O., Lukens, J. N., et al. (2019) · Medical Image Analysis · doi:10.1016/j.media.2019.01.008 · Cited by 32
Tam, C., Tian, S., Beitler, J. J., et al. (2018) · SPIE Medical Imaging: Biomedical Applications in Molecular, Structural, and Functional Imaging · doi:10.1117/12.2292556 · Cited by 26
Accurate and rapid CT image segmentation of the eyes and surrounding organs for precise radiotherapy
Sun, Y., Shi, H., Zhang, S., Wang, P., Zhao, W., Zhou, X., & Yuan, K. (2019) · Medical Physics · doi:10.1002/mp.13463 · Cited by 20
Comparison of different deep learning approaches for parotid gland segmentation from CT images
Gerken, A., Schwier, M., Morgaś, T., Klein, J., Hahn, H. K., Gass, T., & Haas, B. (2018) · SPIE Medical Imaging: Computer-Aided Diagnosis · doi:10.1117/12.2292962 · Cited by 19
Zhou, L., Heller, N., Shi, Y., Xiao, Y., Sznitman, R., Cheplygina, V., Mateus, D., Trucco, E., Hu, X. S., Chen, D., et al. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-33642-4 · Cited by 19
Dynamic multiatlas selection‐based consensus segmentation of head and neck structures from CT images
Haq, R., Berry, S. L., Deasy, J. O., Hunt, M. A., & Veeraraghavan, H. (2019) · Medical Physics · doi:10.1002/mp.13854 · Cited by 17
Sun, S., Liu, Y., Bai, N., et al. (2020) · IEEE International Symposium on Biomedical Imaging (ISBI) · doi:10.1109/isbi45749.2020.9098588 · Cited by 11
Segmentation of Mandibles in Computer Tomography Volumes of Patients with Foam Cells Carcinoma
Gacha, S. J., & Galindo-Leon, S. (2018) · International Seminar of Biomedical Engineering (SIB) · doi:10.1109/sib.2018.8467732 · Cited by 4
Data Augmentation Based on Substituting Regional MRIs Volume Scores
Leng, T., Zhao, Q., Yang, C., Lu, Z., Adeli, E., & Pohl, K. M. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-33642-4_4 · Cited by 4
Cited by
The Medical Segmentation Decathlon
Antonelli, M., Reinke, A., Bakas, S., Farahani, K., Kopp-Schneider, A., Landman, B. A., Litjens, G., Menze, B., Ronneberger, O., Summers, R. M., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-30695-9 · Cited by 1,384
Self-citationArtificial intelligence and machine learning for medical imaging: A technology review
Barragán-Montero, A., Javaid, U., Valdés, G., Nguyen, D., Desbordes, P., Macq, B., Willems, S., Vandewinckele, L., Holmström, M., Löfman, F., et al. (2021) · Physica Medica · doi:10.1016/j.ejmp.2021.04.016 · Cited by 450
Analyzing the quality and challenges of uncertainty estimations for brain tumor segmentation
Jungo, A., Balsiger, F., & Reyes, M. (2020) · Frontiers in Neuroscience · doi:10.3389/fnins.2020.00282 · Cited by 115
Fathi Kazerooni, A., Arif, S., Madhogarhia, R., Khalili, N., Haldar, D., Bagheri, S., Familiar, A. M., Anderson, H., Haldar, S., Tu, W., et al. (2023) · Neuro-Oncology Advances · doi:10.1093/noajnl/vdad027 · Cited by 55
A Survey on Deep Learning for Precision Oncology
Wang, C.-W., Khalil, M.-A., & Firdi, N. (2022) · Diagnostics · doi:10.3390/diagnostics12061489 · Cited by 23
Metadata
- Authors
- Nikolov, S., Blackwell, S., Zverovitch, A., Mendes, R., Livne, M., De Fauw, J., Patel, Y., Meyer, C., Askham, H., Romera-Paredes, B., Kelly, C., Karthikesalingam, A., Chu, C., Carnell, D., Boon, C., D'Souza, D., Moinuddin, S. A., Garie, B., McQuinlan, Y., Ireland, S., Hampton, K., Fuller, K., Montgomery, H., Rees, G., Suleyman, M., Back, T., Hughes, C. O., Ledsam, J. R., & Ronneberger, O.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2021-07-12
- Volume
- 23
- Issue
- 7
- Pages
- e26151
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W3180629942
- Cited by
- 366
- References
- 73
- FWCI
- 18.43
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.