The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Automatic segmentation of the spinal cord and intramedullary multiple sclerosis lesions with convolutional neural networks
Open accessAbstract
&NA; The spinal cord is frequently affected by atrophy and/or lesions in multiple sclerosis (MS) patients. Segmentation of the spinal cord and lesions from MRI data provides measures of damage, which are key criteria for the diagnosis, prognosis, and longitudinal monitoring in MS. Automating this operation eliminates inter‐rater variability and increases the efficiency of large‐throughput analysis pipelines. Robust and reliable segmentation across multi‐site spinal cord data is challenging because of the large variability related to acquisition parameters and image artifacts. In particular, a precise delineation of lesions is hindered by a broad heterogeneity of lesion contrast, size, location, and shape. The goal of this study was to develop a fully‐automatic framework — robust to variability in both image parameters and clinical condition — for segmentation of the spinal cord and intramedullary MS lesions from conventional MRI data of MS and non‐MS cases. Scans of 1042 subjects (459 healthy controls, 471 MS patients, and 112 with other spinal pathologies) were included in this multi‐site study (n = 30). Data spanned three contrasts (T1‐, T2‐, and T2*‐weighted) for a total of 1943 vol and featured large heterogeneity in terms of resolution, orientation, coverage, and clinical conditions. The proposed cord and lesion automatic segmentation approach is based on a sequence of two Convolutional Neural Networks (CNNs). To deal with the very small proportion of spinal cord and/or lesion voxels compared to the rest of the volume, a first CNN with 2D dilated convolutions detects the spinal cord centerline, followed by a second CNN with 3D convolutions that segments the spinal cord and/or lesions. CNNs were trained independently with the Dice loss. When compared against manual segmentation, our CNN‐based approach showed a median Dice of 95% vs. 88% for PropSeg (p ≤ 0.05), a state‐of‐the‐art spinal cord segmentation method. Regarding lesion segmentation on MS data, our framework provided a Dice of 60%, a relative volume difference of −15%, and a lesion‐wise detection sensitivity and precision of 83% and 77%, respectively. In this study, we introduce a robust method to segment the spinal cord and intramedullary MS lesions on a variety of MRI contrasts. The proposed framework is open‐source and readily available in the Spinal Cord Toolbox.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
LeCun, Y., Bengio, Y., & Hinton, G. (2015) · Nature · doi:10.1038/nature14539 · Cited by 84,126
Pan, S. J., & Yang, Q. (2010) · IEEE Transactions on Knowledge and Data Engineering · doi:10.1109/tkde.2009.191 · Cited by 23,387
A survey on deep learning in medical image analysis
Litjens, G., Kooi, T., Bejnordi, B. E., Setio, A. A. A., Ciompi, F., Ghafoorian, M., van der Laak, J. A. W. M., van Ginneken, B., & Sánchez, C. I. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.07.005 · Cited by 15,332
V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentation
Milletari, F., Navab, N., & Ahmadi, S.-A. (2016) · 2016 Fourth International Conference on 3D Vision (3DV) · doi:10.1109/3dv.2016.79 · Cited by 11,931 · cited 6×
“Prior experiments also explored the use of 3D instead of 2D patches compared to the commonly used 2D patches, as they were preferred in recent work on biomedical volumes (Çiçek et al., 2016; Kamnitsas et al., 2017; Milletari et al., 2016) .”
BackgroundMethodInfluentialMeasures of the Amount of Ecologic Association Between Species
Dice, L. R. (1945) · Ecology · doi:10.2307/1932409 · Cited by 11,874
Jenkinson, M., Beckmann, C. F., Behrens, T. E. J., Woolrich, M. W., & Smith, S. M. (2012) · NeuroImage · doi:10.1016/j.neuroimage.2011.09.015 · Cited by 11,314
Self-citationDiagnosis of multiple sclerosis: 2017 revisions of the McDonald criteria
Thompson, A. J., Banwell, B. L., Barkhof, F., Carroll, W. M., Coetzee, T., Comi, G., Correale, J., Fazekas, F., Filippi, M., Freedman, M. S., et al. (2018) · The Lancet Neurology · doi:10.1016/s1474-4422(17)30470-2 · Cited by 8,167
Self-citation3D U-Net: Learning Dense Volumetric Segmentation from Sparse Annotation
Çiçek, Ö., Abdulkadir, A., Lienkamp, S. S., Brox, T., & Ronneberger, O. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_49 · Cited by 7,945
Multi-scale context aggregation by dilated convolutions
Yu, F., & Koltun, V. (2015) · arXiv · doi:10.48550/arxiv.1511.07122 · Cited by 7,738 · cited 4×
“1 of (Yu and Koltun, 2015)).”
BackgroundInfluentialN4ITK: Improved N3 Bias Correction
Tustison, N. J., Avants, B. B., Cook, P. A., Zheng, Y., Egan, A., Yushkevich, P. A., & Gee, J. C. (2010) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2010.2046908 · Cited by 6,073
Efficient multi-scale 3D CNN with fully connected CRF for accurate brain lesion segmentation
Kamnitsas, K., Ledig, C., Newcombe, V. F. J., Simpson, J. P., Kane, A. D., Menon, D. K., Rueckert, D., & Glocker, B. (2017) · Medical Image Analysis · doi:10.1016/j.media.2016.10.004 · Cited by 3,498
Efficient Inference in Fully Connected CRFs with Gaussian Edge Potentials
Krähenbühl, P., & Koltun, V. (2012) · arXiv · doi:10.48550/arxiv.1210.5644 · Cited by 2,908
Generalised Dice Overlap as a Deep Learning Loss Function for Highly Unbalanced Segmentations
Sudre, C. H., Li, W., Vercauteren, T., Ourselin, S., & Jorge Cardoso, M. (2017) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-67558-9_28 · Cited by 2,829
Brain Tumor Segmentation Using Convolutional Neural Networks in MRI Images
Pereira, S., Pinto, A., Alves, V., & Silva, C. A. (2016) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2016.2538465 · Cited by 2,735
Conditional Random Fields as Recurrent Neural Networks
Zheng, S., Jayasumana, S., Romera-Paredes, B., Vineet, V., Su, Z., Du, D., Huang, C., & Torr, P. H. S. (2015) · 2015 IEEE International Conference on Computer Vision (ICCV) · doi:10.1109/iccv.2015.179 · Cited by 2,386
Compston, A., & Coles, A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)08220-x · Cited by 1,743
An Optimized Blockwise Non Local Means Denoising Filter for 3D Magnetic Resonance Images
Barillot, C., Inserm, H. I., & Barillot, C. (2007) · Cited by 1,209
Losseff, N. A., Webb, S. L., O'Riordan, J. I., Page, R., Wang, L., Barker, G. J., Tofts, P. S., McDonald, W. I., Miller, D. H., & Thompson, A. J. (1996) · Brain · doi:10.1093/brain/119.3.701 · Cited by 643
SCT: Spinal Cord Toolbox, an open-source software for processing spinal cord MRI data
De Leener, B., Lévy, S., Dupont, S. M., Fonov, V. S., Stikov, N., Louis Collins, D., Callot, V., & Cohen-Adad, J. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.10.009 · Cited by 621
Self-citationOn standardizing the MR image intensity scale
Ny�l, L. G., & Udupa, J. K. (1999) · Magnetic Resonance in Medicine · doi:10.1002/(sici)1522-2594(199912)42:6<1072::aid-mrm11>3.0.co;2-m · Cited by 583
Automated model-based bias field correction of MR images of the brain
Van Leemput, K., Maes, F., Vandermeulen, D., & Suetens, P. (1999) · IEEE Transactions on Medical Imaging · doi:10.1109/42.811268 · Cited by 583
Deep Feature Learning for Knee Cartilage Segmentation Using a Triplanar Convolutional Neural Network
Prasoon, A., Petersen, K., Igel, C., Lauze, F., Dam, E., & Nielsen, M. (2013) · Lecture Notes in Computer Science · doi:10.1007/978-3-642-40763-5_31 · Cited by 582
Pathology of Demyelinating Diseases
Popescu, B. F. G., & Lucchinetti, C. F. (2012) · Annual Review of Pathology: Mechanisms of Disease · doi:10.1146/annurev-pathol-011811-132443 · Cited by 397
Valverde, S., Cabezas, M., Roura, E., González-Villà, S., Pareto, D., Vilanova, J. C., Ramió-Torrentà, L., Rovira, À., Oliver, A., & Lladó, X. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2017.04.034 · Cited by 392
Longitudinal multiple sclerosis lesion segmentation: Resource and challenge
Carass, A., Roy, S., Jog, A., Cuzzocreo, J. L., Magrath, E., Gherman, A., Button, J., Nguyen, J., Prados, F., Sudre, C. H., et al. (2017) · NeuroImage · doi:10.1016/j.neuroimage.2016.12.064 · Cited by 357
Self-citationGarcía-Lorenzo, D., Francis, S., Narayanan, S., Arnold, D. L., & Collins, D. L. (2013) · Medical Image Analysis · doi:10.1016/j.media.2012.09.004 · Cited by 355
Self-citationHeMIS: Hetero-Modal Image Segmentation
Havaei, M., Guizard, N., Chapados, N., & Bengio, Y. (2016) · Lecture Notes in Computer Science · doi:10.1007/978-3-319-46723-8_54 · Cited by 332 · cited 1×
“Using data acquired with isotropic resolution (to minimise partial volume effect in one direction) and/or CNN architectures based on multimodal data (Havaei et al., 2016) would likely reduce the false positive rate and can be investigated in future studies (see also the next section below).”
A topology-preserving approach to the segmentation of brain images with multiple sclerosis lesions
Shiee, N., Bazin, P.-L., Ozturk, A., Reich, D. S., Calabresi, P. A., & Pham, D. L. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.09.005 · Cited by 331
Self-citationSimon, J. H., Li, D. K. B., Traboulsee, A. L., Coyle, P. K., Arnold, D. L., Barkhof, F., Frank, J. A., Grossman, R. L., Paty, D. W., Radue, E. W., et al. (2006) · PubMed · Cited by 325
Horsfield, M. A., Sala, S., Neema, M., Absinta, M., Bakshi, A., Sormani, M. P., Rocca, M. A., Bakshi, R., & Filippi, M. (2010) · NeuroImage · doi:10.1016/j.neuroimage.2009.12.121 · Cited by 257
Self-citationPAM50: Unbiased multimodal template of the brainstem and spinal cord aligned with the ICBM152 space
De Leener, B., Fonov, V. S., Collins, D. L., Callot, V., Stikov, N., & Cohen-Adad, J. (2018) · NeuroImage · doi:10.1016/j.neuroimage.2017.10.041 · Cited by 250
Self-citationSegmentation of multiple sclerosis lesions in brain MRI: A review of automated approaches
Lladó, X., Oliver, A., Cabezas, M., Freixenet, J., Vilanova, J. C., Quiles, A., Valls, L., Ramió-Torrentà, L., & Rovira, À. (2012) · Information Sciences · doi:10.1016/j.ins.2011.10.011 · Cited by 240
Spinal cord MRI in multiple sclerosis—diagnostic, prognostic and clinical value
Kearney, H., Miller, D. H., & Ciccarelli, O. (2015) · Nature Reviews Neurology · doi:10.1038/nrneurol.2015.80 · Cited by 235 · cited 2×
“Clinicians and researchers extensively use conventional MRI (e.g., T2-weighted) to non-invasively quantify the lesion burden in time and space (Filippi and Rocca, 2007; Kearney et al., 2015b; Simon et al., 2006; Sombekke et al., 2013; Weier et al., 2012).”
BackgroundSelf-citationSpatial decision forests for MS lesion segmentation in multi-channel magnetic resonance images
Geremia, E., Clatz, O., Menze, B. H., Konukoglu, E., Criminisi, A., & Ayache, N. (2011) · NeuroImage · doi:10.1016/j.neuroimage.2011.03.080 · Cited by 231
Learning normalized inputs for iterative estimation in medical image segmentation
Drozdzal, M., Chartrand, G., Vorontsov, E., Shakeri, M., Di Jorio, L., Tang, A., Romero, A., Bengio, Y., Pal, C., & Kadoury, S. (2018) · Medical Image Analysis · doi:10.1016/j.media.2017.11.005 · Cited by 223
Thorpe, J. W., Kidd, D., Moseley, I. F., Kendall, B. E., Thompson, A. J., MacManus, D. G., McDonald, W. I., & Miller, D. H. (1996) · Neurology · doi:10.1212/wnl.46.2.373 · Cited by 199
Evaluating intensity normalization on MRIs of human brain with multiple sclerosis
Shah, M., Xiao, Y., Subbanna, N., Francis, S., Arnold, D. L., Collins, D. L., & Arbel, T. (2011) · Medical Image Analysis · doi:10.1016/j.media.2010.12.003 · Cited by 178
Yushkevich, P. A., & Gerig, G. (2017) · IEEE Pulse · doi:10.1109/mpul.2017.2701493 · Cited by 160
Robust, accurate and fast automatic segmentation of the spinal cord
Leener, B. D., Kadoury, S., & Cohen‐Adad, J. (2014) · NeuroImage · doi:10.1016/j.neuroimage.2014.04.051 · Cited by 156
Self-citationSombekke, M. H., Wattjes, M. P., Balk, L. J., Nielsen, J. M., Vrenken, H., Uitdehaag, B. M. J., Polman, C. H., & Barkhof, F. (2013) · Neurology · doi:10.1212/wnl.0b013e31827b1a67 · Cited by 153
A multicenter assessment of cervical cord atrophy among MS clinical phenotypes
Rocca, M. A., Horsfield, M. A., Sala, S., Copetti, M., Valsasina, P., Mesaroš, Š., Martinelli, V., Caputo, D., Stošić-Opinćal, T., Drulovic, J. S., et al. (2011) · Neurology · doi:10.1212/wnl.0b013e31821f46b8 · Cited by 149
Self-citationArrambide, G., Rovira, À., Sastre‐Garriga, J., Tur, C., Castilló, J., Río, J., Vidal‐Jordana, Á., Galán, I., Rodríguez‐Acevedo, B., Midaglia, L. S., et al. (2017) · Multiple Sclerosis Journal · doi:10.1177/1352458517697830 · Cited by 127
Egger, C., Opfer, R., Wang, C., Kepp, T., Sormani, M. P., Spies, L., Barnett, M. H., & Schippling, S. (2016) · NeuroImage Clinical · doi:10.1016/j.nicl.2016.11.020 · Cited by 116
Cervical cord lesion load is associated with disability independently from atrophy in MS
KEARNEY, H. F., Altmann, D. R., Samson, R. S., Yiannakas, M. C., Wheeler‐Kingshott, C. A. M. G., Ciccarelli, O., & Miller, D. H. (2014) · Neurology · doi:10.1212/wnl.0000000000001186 · Cited by 113
Self-citationBakshi, R., Dandamudi, V. S. R., Neema, M., De, C., & Bermel, R. A. (2005) · Journal of Neuroimaging · doi:10.1177/1051228405283901 · Cited by 110
Self-citationBiplanar MRI for the assessment of the spinal cord in multiple sclerosis
Weier, K., Mazraeh, J., Naegelin, Y., Thoeni, A., Hirsch, J. G., Fabbro, T., Bruni, N., Duyar, H., Bendfeldt, K., Radue, E. W., et al. (2012) · Multiple Sclerosis Journal · doi:10.1177/1352458512442754 · Cited by 107
Cohen, A. B., Neema, M., Arora, A., Dell’Oglio, E., Benedict, R. H. B., Tauhid, S., Goldberg‐Zimring, D., Chavarro‐Nieto, C., Ceccarelli, A., Klein, J. P., et al. (2011) · Journal of Neuroimaging · doi:10.1111/j.1552-6569.2011.00589.x · Cited by 105
Self-citationMartin, A. R., Leener, B. D., Cohen‐Adad, J., Cadotte, D. W., Kalsi‐Ryan, S., Lange, S. F., Tetreault, L. A., Nouri, A., Crawley, A. P., Mikulis, D. J., et al. (2017) · American Journal of Neuroradiology · doi:10.3174/ajnr.a5162 · Cited by 95
Self-citationSegmentation of the human spinal cord
Leener, B. D., Taso, M., Cohen‐Adad, J., & Callot, V. (2016) · Magnetic Resonance Materials in Physics Biology and Medicine · doi:10.1007/s10334-015-0507-2 · Cited by 92
Self-citationAutomatic Segmentation of the Spinal Cord and Spinal Canal Coupled With Vertebral Labeling
Leener, B. D., Cohen‐Adad, J., & Kadoury, S. (2015) · IEEE Transactions on Medical Imaging · doi:10.1109/tmi.2015.2437192 · Cited by 91
Self-citationRotation-invariant multi-contrast non-local means for MS lesion segmentation
Guizard, N., Coupé, P., Fonov, V., Manjón, J. V., Arnold, D. L., & Collins, D. L. (2015) · NeuroImage Clinical · doi:10.1016/j.nicl.2015.05.001 · Cited by 85
Conventional MRI in Multiple Sclerosis
Filippi, M., & Rocca, M. A. (2007) · Journal of Neuroimaging · doi:10.1111/j.1552-6569.2007.00129.x · Cited by 85
Self-citationImproved MRI quantification of spinal cord atrophy in multiple sclerosis
KEARNEY, H. F., Yiannakas, M. C., Abdel‐Aziz, K., Wheeler‐Kingshott, C. A. M. G., Altmann, D. R., Ciccarelli, O., & Miller, D. H. (2013) · Journal of Magnetic Resonance Imaging · doi:10.1002/jmri.24194 · Cited by 84
Self-citationChen, M., Carass, A., Oh, J., Nair, G., Pham, D. L., Reich, D. S., & Prince, J. L. (2013) · NeuroImage · doi:10.1016/j.neuroimage.2013.07.060 · Cited by 82
Self-citationAutomated tissue segmentation of MR brain images in the presence of white matter lesions
Valverde, S., Oliver, A., Roura, E., González-Villà, S., Pareto, D., Vilanova, J. C., Ramió‐Torrentà, L., Rovira, À., & Lladó, X. (2016) · Medical Image Analysis · doi:10.1016/j.media.2016.08.014 · Cited by 77
Stroman, P. W., Figley, C. R., & Cahill, C. M. (2008) · Magnetic Resonance Imaging · doi:10.1016/j.mri.2008.01.038 · Cited by 69
Spinal Cord Gray Matter Atrophy in Amyotrophic Lateral Sclerosis
Paquin, M.-Ê., Mendili, M. M. E., Gros, C., Dupont, S. M., Cohen‐Adad, J., & Pradat, P. (2017) · American Journal of Neuroradiology · doi:10.3174/ajnr.a5427 · Cited by 65
Self-citationRocca, M. A., Valsasina, P., Damjanovic, D., Horsfield, M. A., Mesaroš, Š., Stošić-Opinćal, T., Drulovic, J. S., & Filippi, M. (2012) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp-2012-303821 · Cited by 53
Self-citationAutomatic spinal cord localization, robust to MRI contrasts using global curve optimization
Gros, C., Leener, B. D., Dupont, S. M., Martin, A. R., Fehlings, M. G., Bakshi, R., Tummala, S., Auclair, V., McLaren, D. G., Callot, V., et al. (2017) · Medical Image Analysis · doi:10.1016/j.media.2017.12.001 · Cited by 47
Self-citationDual‐Sensitivity Multiple Sclerosis Lesion and CSF Segmentation for Multichannel 3T Brain MRI
Meier, D., Guttmann, C. R. G., Tummala, S., Moscufo, N., Cavallari, M., Tauhid, S., Bakshi, R., & Weiner, H. L. (2017) · Journal of Neuroimaging · doi:10.1111/jon.12491 · Cited by 44
Self-citationCharacterizing Clinical and MRI Dissociation in Patients with Multiple Sclerosis
Healy, B. C., Buckle, G. J., Ali, E. N., Egorova, S., Khalid, F., Tauhid, S., Glanz, B. I., Chitnis, T., Guttmann, C. R. G., Weiner, H. L., et al. (2017) · Journal of Neuroimaging · doi:10.1111/jon.12433 · Cited by 40
Self-citationA 24‐channel shim array for the human spinal cord: Design, evaluation, and application
Topfer, R., Starewicz, P. M., Lo, K., Metzemaekers, K., Jette, D., Hetherington, H. P., Stikov, N., & Cohen‐Adad, J. (2016) · Magnetic Resonance in Medicine · doi:10.1002/mrm.26354 · Cited by 38
Self-citationHarmouche, R., Subbanna, N. K., Collins, D. L., Arnold, D. L., & Arbel, T. (2014) · IEEE Transactions on Biomedical Engineering · doi:10.1109/tbme.2014.2385635 · Cited by 29
Hua, L. H., Donlon, S., Sobhanian, M., Portner, S. M., & Okuda, D. T. (2015) · Spinal Cord · doi:10.1038/sc.2014.238 · Cited by 29
The Effect of Glatiramer Acetate on Spinal Cord Volume in Relapsing‐Remitting Multiple Sclerosis
Singhal, T., Tauhid, S., Hurwitz, S., Neema, M., & Bakshi, R. (2016) · Journal of Neuroimaging · doi:10.1111/jon.12378 · Cited by 19
Self-citationDupuy, S. L., Khalid, F., Healy, B. C., Bakshi, S., Neema, M., Tauhid, S., & Bakshi, R. (2016) · BMC Medical Imaging · doi:10.1186/s12880-016-0158-4 · Cited by 17
Self-citationConsensus acquisition protocol for quantitative MRI of the cervical spinal cord at 3T
Alley, S., Gilbert, G., Wheeler‐Kingshott, C. A. M. G., Samson, R. S., Grussu, F., Martin, A., Bannier, É., Callot, V., Smith, S. A., Xu, J., et al. (2018) · PolyPublie (École Polytechnique de Montréal) · Cited by 9
Self-citation
Cited by
Deep semantic segmentation of natural and medical images: a review
Asgari Taghanaki, S., Abhishek, K., Cohen, J. P., Cohen-Adad, J., & Hamarneh, G. (2021) · Artificial Intelligence Review · doi:10.1007/s10462-020-09854-1 · Cited by 870
Self-citationRowald, A., Komi, S., Demesmaeker, R., Baaklini, E., Hernandez-Charpak, S. D., Paoles, E., Montanaro, H., Cassara, A., Becce, F., Lloyd, B., et al. (2022) · Nature Medicine · doi:10.1038/s41591-021-01663-5 · Cited by 455
Metadata
- Authors
- Gros, C., De Leener, B., Badji, A., Maranzano, J., Eden, D., Dupont, S. M., Talbott, J., Zhuoquiong, R., Liu, Y., Granberg, T., Ouellette, R., Tachibana, Y., Hori, M., Kamiya, K., Chougar, L., Stawiarz, L., Hillert, J., Bannier, E., Kerbrat, A., Edan, G., Labauge, P., Callot, V., Pelletier, J., Audoin, B., Rasoanandrianina, H., Brisset, J.-C., Valsasina, P., Rocca, M. A., Filippi, M., Bakshi, R., Tauhid, S., Prados, F., Yiannakas, M., Kearney, H., Ciccarelli, O., Smith, S., Treaba, C. A., Mainero, C., Lefeuvre, J., Reich, D. S., Nair, G., Auclair, V., McLaren, D. G., Martin, A. R., Fehlings, M. G., Vahdat, S., Khatibi, A., Doyon, J., Shepherd, T., Charlson, E., Narayanan, S., & Cohen-Adad, J.
- Venue
- NeuroImage
- Publisher
- Elsevier BV
- Published
- 2019-01
- Volume
- 184
- Pages
- 901-915
- ISSN
- 1053-8119 (ISSN-L)
- OpenAlex
- W2803959545
- Cited by
- 289
- References
- 67
- FWCI
- 9.72
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.