The DOI matches its Crossref record; 56 of the 56 references it cites were found in a registry or an index.
Artificial Intelligence in Fracture Detection: A Systematic Review and Meta-Analysis
Open accessAbstract
Background Patients with fractures are a common emergency presentation and may be misdiagnosed at radiologic imaging. An increasing number of studies apply artificial intelligence (AI) techniques to fracture detection as an adjunct to clinician diagnosis. Purpose To perform a systematic review and meta-analysis comparing the diagnostic performance in fracture detection between AI and clinicians in peer-reviewed publications and the gray literature (ie, articles published on preprint repositories). Materials and Methods A search of multiple electronic databases between January 2018 and July 2020 (updated June 2021) was performed that included any primary research studies that developed and/or validated AI for the purposes of fracture detection at any imaging modality and excluded studies that evaluated image segmentation algorithms. Meta-analysis with a hierarchical model to calculate pooled sensitivity and specificity was used. Risk of bias was assessed by using a modified Prediction Model Study Risk of Bias Assessment Tool, or PROBAST, checklist. Results Included for analysis were 42 studies, with 115 contingency tables extracted from 32 studies (55 061 images). Thirty-seven studies identified fractures on radiographs and five studies identified fractures on CT images. For internal validation test sets, the pooled sensitivity was 92% (95% CI: 88, 93) for AI and 91% (95% CI: 85, 95) for clinicians, and the pooled specificity was 91% (95% CI: 88, 93) for AI and 92% (95% CI: 89, 92) for clinicians. For external validation test sets, the pooled sensitivity was 91% (95% CI: 84, 95) for AI and 94% (95% CI: 90, 96) for clinicians, and the pooled specificity was 91% (95% CI: 81, 95) for AI and 94% (95% CI: 91, 95) for clinicians. There were no statistically significant differences between clinician and AI performance. There were 22 of 42 (52%) studies that were judged to have high risk of bias. Meta-regression identified multiple sources of heterogeneity in the data, including risk of bias and fracture type. Conclusion Artificial intelligence (AI) and clinicians had comparable reported diagnostic performance in fracture detection, suggesting that AI technology holds promise as a diagnostic adjunct in future clinical practice. Clinical trial registration no. CRD42020186641 © RSNA, 2022 Online supplemental material is available for this article. See also the editorial by Cohen and McInnes in this issue.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
International evaluation of an AI system for breast cancer screening
McKinney, S. M., Sieniek, M., Godbole, V., Godwin, J., Antropova, N., Ashrafian, H., Back, T., Chesus, M., Corrado, G. S., Darzi, A., et al. (2020) · Nature · doi:10.1038/s41586-019-1799-6 · Cited by 3,287
PROBAST: A Tool to Assess the Risk of Bias and Applicability of Prediction Model Studies
Wolff, R. F., Moons, K. G. M., Riley, R. D., Whiting, P. F., Westwood, M., Collins, G. S., Reitsma, J. B., Kleijnen, J., Mallett, S., & for the PROBAST Group† (2019) · Annals of Internal Medicine · doi:10.7326/m18-1376 · Cited by 2,984
Deeks, J. J., Macaskill, P., & Irwig, L. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.01.016 · Cited by 2,910
Collins, G. S., Reitsma, J. B., Altman, D. G., & Moons, K. G. M. (2015) · Circulation · doi:10.1161/circulationaha.114.014508 · Cited by 793
Liu, X., Rivera, S. C., Moher, D., Calvert, M. J., & Denniston, A. K. (2020) · BMJ · doi:10.1136/bmj.m3164 · Cited by 702
Reporting of artificial intelligence prediction models
Collins, G. S., & Moons, K. G. M. (2019) · The Lancet · doi:10.1016/s0140-6736(19)30037-6 · Cited by 701
Self-citationDeep neural network improves fracture detection by clinicians
Lindsey, R., Daluiski, A., Chopra, S., Lachapelle, A., Mozer, M., Sicular, S., Hanel, D., Gardner, M., Gupta, A., Hotchkiss, R., et al. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1806905115 · Cited by 640
Turner, L., Shamseer, L., Altman, D. G., Schulz, K. F., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-60 · Cited by 628
Power analysis for random-effects meta-analysis
Jackson, D., & Turner, R. (2017) · Research Synthesis Methods · doi:10.1002/jrsm.1240 · Cited by 619
Kim, D. H., & MacKinnon, T. (2018) · Clinical Radiology · doi:10.1016/j.crad.2017.11.015 · Cited by 495
Rivera, S. C., Liu, X., Chan, A.-W., Denniston, A. K., & Calvert, M. J. (2020) · BMJ · doi:10.1136/bmj.m3210 · Cited by 463
Chung, S. W., Han, S. S., Lee, J. W., Oh, K.-S., Kim, N. R., Yoon, J. P., Kim, J. Y., Moon, S. H., Kwon, J., Lee, H.-J., et al. (2018) · Acta Orthopaedica · doi:10.1080/17453674.2018.1453714 · Cited by 462
Curtis, E. M., van der Velde, R., Moon, R. J., van den Bergh, J. P. W., Geusens, P., de Vries, F., van Staa, T. P., Cooper, C., & Harvey, N. C. (2016) · Bone · doi:10.1016/j.bone.2016.03.006 · Cited by 456
metandi: Meta-analysis of diagnostic accuracy using hierarchical logistic regression
Harbord, R. M., & Whiting, P. (2009) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0900900203 · Cited by 453
Trends in Fracture Incidence: A Population-Based Study Over 20 Years
Amin, S., Achenbach, S. J., Atkinson, E. J., Khosla, S., & Melton, L. J. (2014) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.2072 · Cited by 400
Cheng, C.-T., Ho, T.-Y., Lee, T.-Y., Chang, C.-C., Chou, C.-C., Chen, C.-C., Chung, I.-F., & Liao, C.-H. (2019) · European Radiology · doi:10.1007/s00330-019-06167-y · Cited by 310
Balki, I., Amirabadi, A., Levman, J., Martel, A. L., Emersic, Z., Meden, B., Garcia-Pedrero, A., Ramirez, S. C., Kong, D., Moody, A. R., et al. (2019) · Canadian Association of Radiologists Journal · doi:10.1016/j.carj.2019.06.002 · Cited by 299
Sounderajah, V., Ashrafian, H., Aggarwal, R., De Fauw, J., Denniston, A. K., Greaves, F., Karthikesalingam, A., King, D., Liu, X., Markar, S. R., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0941-1 · Cited by 270
Urakawa, T., Tanaka, Y., Goto, S., Matsuzawa, H., Watanabe, K., & Endo, N. (2019) · Skeletal Radiology · doi:10.1007/s00256-018-3016-3 · Cited by 269
Bergh, C., Wennergren, D., Möller, M., & Brisby, H. (2020) · PLOS ONE · doi:10.1371/journal.pone.0244291 · Cited by 260
Convolutional Neural Networks for Automated Fracture Detection and Localization on Wrist Radiographs
Thian, Y. L., Li, Y., Jagmohan, P., Sia, D., Chan, V. E. Y., & Tan, R. T. (2019) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2019180001 · Cited by 205
Langerhuizen, D. W. G., Janssen, S. J., Mallee, W. H., van den Bekerom, M. P. J., Ring, D., Kerkhoffs, G. M. M. J., Jaarsma, R. L., & Doornberg, J. N. (2019) · Clinical Orthopaedics & Related Research · doi:10.1097/corr.0000000000000848 · Cited by 197
Machine Learning Solutions for Osteoporosis—A Review
Smets, J., Shevroja, E., Hügle, T., Leslie, W. D., & Hans, D. (2020) · Journal of Bone and Mineral Research · doi:10.1002/jbmr.4292 · Cited by 197
Automatic Hip Fracture Identification and Functional Subclassification with Deep Learning
Krogue, J. D., Cheng, K. V., Hwang, K. M., Toogood, P., Meinberg, E. G., Geiger, E. J., Zaid, M., McGill, K. C., Patel, R., Sohn, J. H., et al. (2020) · Radiology: Artificial Intelligence · doi:10.1148/ryai.2020190023 · Cited by 187
Gan, K., Xu, D., Lin, Y., Shen, Y., Zhang, T., Hu, K., Zhou, K., Bi, M., Pan, L., Wu, W., et al. (2019) · Acta Orthopaedica · doi:10.1080/17453674.2019.1600125 · Cited by 183
Pranata, Y. D., Wang, K.-C., Wang, J., Idram, I., Lai, J., Liu, J., & Hsieh, I.-H. (2019) · Computer Methods and Programs in Biomedicine · doi:10.1016/j.cmpb.2019.02.006 · Cited by 166
Deep learning in fracture detection: a narrative review
Kalmet, P. H. S., Sanduleanu, S., Primakov, S., Wu, G., Jochems, A., Refaee, T., Ibrahim, A., Hulst, L. V., Lambin, P., & Poeze, M. (2020) · Acta Orthopaedica · doi:10.1080/17453674.2019.1711323 · Cited by 166
Duron, L., Ducarouge, A., Gillibert, A., Lainé, J., Allouche, C., Cherel, N., Zhang, Z., Nitche, N., Lacave, E., Pourchot, A., et al. (2021) · Radiology · doi:10.1148/radiol.2021203886 · Cited by 162
Kitamura, G., Chung, C. Y., & Moore, B. (2019) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-018-0167-7 · Cited by 156
Adams, M., Chen, W., Holcdorf, D., McCusker, M. W., Howe, P. D. L., & Gaillard, F. (2018) · Journal of Medical Imaging and Radiation Oncology · doi:10.1111/1754-9485.12828 · Cited by 148
Mutasa, S., Varada, S. L., Goel, A., Wong, T. T., & Rasiej, M. J. (2020) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-020-00364-8 · Cited by 124
Artificial intelligence for the detection of vertebral fractures on plain spinal radiography
Murata, K., Endo, K., Aihara, T., Suzuki, H., Sawaji, Y., Matsuoka, Y., Nishimura, H., Takamatsu, T., Konishi, T., Maekawa, A., et al. (2020) · Scientific Reports · doi:10.1038/s41598-020-76866-w · Cited by 123
Choi, J. W., Cho, Y. J., Lee, S., Lee, J. S., Lee, S., Choi, Y. H., Cheon, J., & Ha, J. Y. (2019) · Investigative Radiology · doi:10.1097/rli.0000000000000615 · Cited by 119
A scalable physician-level deep learning algorithm detects universal trauma on pelvic radiographs
Cheng, C., Wang, Y., Chen, H., Hsiao, P.-M., Yeh, C., Hsieh, C., Miao, S., Xiao, J. Z., Liao, C., & Lü, L. (2021) · Nature Communications · doi:10.1038/s41467-021-21311-3 · Cited by 113
Zhou, Q.-Q., Wang, J., Tang, W., Hu, Z.-C., Xia, Z.-Y., Li, X.-S., Zhang, R., Yin, X., Zhang, B., & Zhang, H. (2020) · Korean Journal of Radiology · doi:10.3348/kjr.2019.0651 · Cited by 111
Yoon, A. P., Lee, Y.-L., Kane, R. L., Kuo, C.-F., Lin, C., & Chung, K. C. (2021) · JAMA Network Open · doi:10.1001/jamanetworkopen.2021.6096 · Cited by 107
Rayan, J. C., Reddy, N. E., Kan, J. H., Zhang, W., & Annapragada, A. (2019) · Radiology Artificial Intelligence · doi:10.1148/ryai.2019180015 · Cited by 103
Detection and localization of distal radius fractures: Deep learning system versus radiologists
Blüthgen, C., Becker, A. S., Martini, I. V. D., Meier, A., Martini, K., & Frauenfelder, T. (2020) · European Journal of Radiology · doi:10.1016/j.ejrad.2020.108925 · Cited by 103
Femoral neck fracture detection in X-ray images using deep learning and genetic algorithm approaches
Beyaz, S. (2020) · Joint Diseases and Related Surgery · doi:10.5606/ehc.2020.72163 · Cited by 96
Weikert, T., Noordtzij, L. A., Bremerich, J., Stieltjes, B., Parmar, V., Cyriac, J., Sommer, G., & Sauter, A. W. (2020) · Korean Journal of Radiology · doi:10.3348/kjr.2019.0653 · Cited by 88
Langerhuizen, D. W. G., Bulstra, A. E. J., Janssen, S. J., Ring, D., Kerkhoffs, G. M. M. J., Jaarsma, R. L., & Doornberg, J. N. (2020) · Clinical Orthopaedics and Related Research · doi:10.1097/corr.0000000000001318 · Cited by 85
Chen, H., Hsu, B. W., Yin, Y.-K., Lin, F., Yang, T.-H., Yang, R., Lee, C., & Tseng, V. S. M. (2021) · PLoS ONE · doi:10.1371/journal.pone.0245992 · Cited by 82
Derkatch, S., Kirby, C. K., Kimelman, D., Jozani, M. J., Davidson, J. M., & Leslie, W. D. (2019) · Radiology · doi:10.1148/radiol.2019190201 · Cited by 77
Ozkaya, E., Topal, F. E., Bulut, T., Gürsoy, M., Özuysal, M., & Karakaya, Z. (2020) · European Journal of Trauma and Emergency Surgery · doi:10.1007/s00068-020-01468-0 · Cited by 76
Classification of Shoulder X-ray Images with Deep Learning Ensemble Models
Uysal, F., Hardalaç, F., Peker, O., Tolunay, T., & Tokgöz, N. (2021) · Applied Sciences · doi:10.3390/app11062723 · Cited by 75
Diagnostic accuracy of deep learning in orthopaedic fractures: a systematic review and meta-analysis
Yang, S., Yin, B., Cao, W., Feng, C., Fan, G., & He, S. (2020) · Clinical Radiology · doi:10.1016/j.crad.2020.05.021 · Cited by 72
Yu, J. S., Yu, S. M., Erdal, B. S., Demirer, M., Gupta, V., Bigelow, M. T., Salvador, A., Rink, T., Lenobel, S. S., Prevedello, L. M. S., et al. (2019) · Clinical Radiology · doi:10.1016/j.crad.2019.10.022 · Cited by 64
Mehta, S. D., & Sebro, R. (2019) · Journal of Imaging Informatics in Medicine · doi:10.1007/s10278-019-00224-0 · Cited by 62
Precise proximal femur fracture classification for interactive training and surgical planning
Jiménez-Sánchez, A., Kazi, A., Albarqouni, S., Kirchhoff, C., Biberthaler, P., Navab, N., Kirchhoff, S., & Mateus, D. (2020) · International Journal of Computer Assisted Radiology and Surgery · doi:10.1007/s11548-020-02150-x · Cited by 54
Weakly Supervised Universal Fracture Detection in Pelvic X-Rays
Wang, Y., Lu, L., Cheng, C.-T., Jin, D., Harrison, A. P., Xiao, J., Liao, C.-H., & Miao, S. (2019) · Lecture notes in computer science · doi:10.1007/978-3-030-32226-7_51 · Cited by 53
Mawatari, T., Hayashida, Y., Katsuragawa, S., Yoshimatsu, Y., Hamamura, T., Anai, K., Ueno, M., Yamaga, S., Ueda, I., Terasawa, T., et al. (2020) · European Journal of Radiology · doi:10.1016/j.ejrad.2020.109188 · Cited by 45
Deep learning for accurately recognizing common causes of shoulder pain on radiographs
Grauhan, N. F., Niehues, S. M., Gaudin, R., Keller, S., Vahldiek, J. L., Adams, L. C., & Bressem, K. K. (2021) · Skeletal Radiology · doi:10.1007/s00256-021-03740-9 · Cited by 43
Cheng, C., Chen, C.-C., Cheng, F., Chen, H., Su, Y.-S., Yeh, C., Chung, I., & Liao, C. (2020) · JMIR Medical Informatics · doi:10.2196/19416 · Cited by 42
Radiologist Burnout Is Not Just Isolated to the United States: Perspectives From Canada
Zha, N., Patlas, M. N., & Duszak, R. (2018) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2018.07.010 · Cited by 22
Perspectives: A surgeon’s guide to machine learning
Kuo, R. Y. L., Harrison, C. J., Jones, B., Geoghegan, L., & Furniss, D. (2021) · International Journal of Surgery · doi:10.1016/j.ijsu.2021.106133 · Cited by 19
Self-citationChoi, J., Hui, J. Z., Spain, D. A., Su, Y.-S., Cheng, C., & Liao, C. (2021) · Trauma Surgery & Acute Care Open · doi:10.1136/tsaco-2021-000705 · Cited by 17
Cited by
Artificial Intelligence in Emergency Radiology: Where Are We Going?
Cellina, M., Cè, M., Irmici, G., Ascenti, V., Caloro, E., Bianchi, L., Pellegrino, G., D’Amico, N., Papa, S., & Carrafiello, G. (2022) · Diagnostics · doi:10.3390/diagnostics12123223 · Cited by 62
Perrier, E., Rifai, M., Terzic, A., Dubois, C., & Cohen, J. F. (2022) · Frontiers in Pediatrics · doi:10.3389/fped.2022.1065957 · Cited by 37
Cabitza, F., Famiglini, L., Fregosi, C., Pe, S., Parimbelli, E., La Maida, G. A., & Gallazzi, E. (2025) · Proceedings of the 30th International Conference on Intelligent User Interfaces · doi:10.1145/3708359.3712157 · Cited by 11
Metadata
- Authors
- Kuo, R. Y. L., Harrison, C., Curran, T.-A., Jones, B., Freethy, A., Cussons, D., Stewart, M., Collins, G. S., & Furniss, D.
- Venue
- Radiology
- Published
- 2022-07
- Volume
- 304
- Issue
- 1
- Pages
- 50-62
- ISSN
- 0033-8419 (ISSN-L)
- 1527-1315
- OpenAlex
- W4220933981
- Cited by
- 365
- References
- 56
- FWCI
- 5.44
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.