Cited by 23Artificial Intelligence in Healthcare and EducationRadiology practices and educationRadiomics and Machine Learning in Medical Imaging

Medical machine learning operations: A framework to facilitate clinical AI development and deployment in radiology

Open access
de Almeida, José Guilherme, Messiou, Christina, Withey, Sam J., Matos, Celso, Koh, Dow-Mu, Papanikolaou, Nickolas·2025·European Radiology

Abstract

The integration of machine-learning technologies into radiology practice has the potential to significantly enhance diagnostic workflows and patient care. However, the successful deployment and maintenance of medical machine-learning (MedML) systems in radiology requires robust operational frameworks. Medical machine-learning operations (MedMLOps) offer a structured approach ensuring persistent MedML reliability, safety, and clinical relevance. MedML systems are increasingly employed to analyse sensitive clinical and radiological data, which continuously changes due to advancements in data acquisition and model development. These systems can alleviate the workload of radiologists by streamlining diagnostic tasks, such as image interpretation and triage. MedMLOps ensures that such systems stay accurate and dependable by facilitating continuous performance monitoring, systematic validation, and simplified model maintenance—all critical to maintaining trust in machine-learning-driven diagnostics. Furthermore, MedMLOps aligns with established principles of patient data protection and regulatory compliance, including recent developments in the European Union, emphasising transparency, documentation, and safe model retraining. This enables radiologists to implement modern machine-learning tools with control and oversight at the forefront, ensuring reliable model performance within the dynamic context of clinical practice. MedMLOps empowers radiologists to deliver consistent, high-quality care with confidence, ensuring that MedML systems stay aligned with evolving medical standards and patient needs. MedMLOps can assist multiple stakeholders in radiology by ensuring models are available, continuously monitored and easy to use and maintain while preserving patient privacy. MedMLOps can better serve patients by facilitating the clinical implementation of cutting-edge MedML and clinicians by ensuring that MedML models are only utilised when they are performing as expected. Key Points: Question MedML applications are becoming increasingly adopted in clinics, but the necessary infrastructure to sustain these applications is currently not well-defined . Findings Adapting machine learning operations concepts enhances MedML ecosystems by improving interoperability, automating monitoring/validation, and reducing deployment burdens on clinicians and medical informaticians . Clinical relevance Implementing these solutions eases the faster and safer adoption of advanced MedML models, ensuring consistent performance while reducing workload for clinicians, benefiting patient care through streamlined diagnostic workflows .

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s00330-025-11654-6

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

The citation lists haven’t been fetched yet

References 123 · Cited by 23

Research works printed but not linked: 94

  1. [1]May M (2021) Eight ways machine learning is assisting medicine. Nat Med 27:2–3 33442003
  2. [3]Hickman SE, Payne NR, Black RT et al (2023) Mammography breast cancer screening triage using deep learning: a UK retrospective study. Radiology 309:e231173 37987665
  3. [4]Swanson K, Wu E, Zhang A et al (2023) From patterns to patients: advances in clinical machine learning for cancer diagnosis, prognosis, and treatment. Cell 186:1772–1791 36905928
  4. [5]Hunter B, Hindocha S, Lee RW (2022) The role of artificial intelligence in early cancer diagnosis. Cancers (Basel) 14:1524. 10.3390/cancers14061524 PMC8946688 35326674 · DOI
  5. [7]Kwak SH, Kim E-K, Kim MH et al (2023) Incidentally found resectable lung cancer with the usage of artificial intelligence on chest radiographs. PLoS One 18:e0281690 36897865 PMC10004566
  6. [8]Angelopoulos AN, Pomerantz S, Do S et al (2024) Conformal triage for medical imaging AI deployment. Preprint at 10.1101/2024.02.09.24302543 · DOI
  7. [9]Koetzier LR, Mastrodicasa D, Szczykutowicz TP et al (2023) Deep learning image reconstruction for CT: technical principles and clinical prospects. Radiology 306:e221257 36719287 PMC9968777
  8. [10]Kiryu S, Akai H, Yasaka K et al (2023) Clinical impact of deep learning reconstruction in MRI. Radiographics 43:e220133 37200221
  9. [11]Zeng G, Guo Y, Zhan J et al (2021) A review on deep learning MRI reconstruction without fully sampled k-space. BMC Med Imaging 21:195 34952572 PMC8710001
  10. [12]Wasserthal J, Breit H-C, Meyer MT et al (2023) TotalSegmentator: robust segmentation of 104 anatomic structures in CT images. Radiol Artif Intell 5:e230024 37795137 PMC10546353
  11. [13]Fassia M-K, Balasubramanian A, Woo S et al (2024) Deep learning prostate MRI segmentation accuracy and robustness: a systematic review. Radiol Artif Intell 6:e230138 38568094 PMC11294957
  12. [14]Rodrigues NM, Almeida de JG, Verde ASC et al (2024) Analysis of domain shift in whole prostate gland, zonal and lesions segmentation and detection, using multicentric retrospective data. Comput Biol Med 171:108216 38442555
  13. [15]Ginn JS, Gay HA, Hilliard J et al (2023) A clinical and time savings evaluation of a deep learning automatic contouring algorithm. Med Dosim 48:55–60 36550000
  14. [16]Palazzo G, Mangili P, Deantoni C et al (2023) Real-world validation of artificial intelligence-based computed tomography auto-contouring for prostate cancer radiotherapy planning. Phys Imaging Radiat Oncol 28:100501 37920450 PMC10618761
  15. [17]Sung J, Park S, Lee SM et al (2021) Added value of deep learning-based detection system for multiple major findings on chest radiographs: a randomized crossover study. Radiology 299:450–459 33754828
  16. [18]Mišić VV, Rajaram K, Gabel E (2021) A simulation-based evaluation of machine learning models for clinical decision support: application and analysis using hospital readmission. NPJ Digit Med 4:98 34127786 PMC8203794
  17. [19]Rozenblum R, Rodriguez-Monguio R, Volk LA et al (2020) Using a machine learning system to identify and prevent medication prescribing errors: a clinical and cost analysis evaluation. Jt Comm J Qual Patient Saf 46:3–10 31786147
  18. [20]Ng AY, Glocker B, Oberije C et al (2023) Artificial intelligence as supporting reader in breast screening: a novel workflow to preserve quality and reduce workload. J Breast Imaging 5:267–276 38416889
  19. [22]Zhang A, Xing L, Zou J, Wu JC (2022) Shifting machine learning for healthcare from development to deployment and from models to data. Nat Biomed Eng 6:1330–1345 35788685 PMC12063568
  20. [23]Feinstein JA, Gill PJ, Anderson BR (2023) Preparing for the international classification of diseases, 11th revision (ICD-11) in the US Health Care System. JAMA Health Forum 4:e232253 37505488 PMC10495107
  21. [24]Bizzo BC, Dasegowda G, Bridge C et al (2023) Addressing the challenges of implementing artificial intelligence tools in clinical practice: principles from experience. J Am Coll Radiol 20:352–360 36922109
  22. [25]Jiang S, Bukhari SMA, Krishnan A et al (2024) Deployment of artificial intelligence in radiology: Strategies for success. AJR Am J Roentgenol. 10.2214/AJR.24.31898 39475198 · DOI
  23. [27]Swed S, Alibrahim H, Elkalagi NKH et al (2022) Knowledge, attitude, and practice of artificial intelligence among doctors and medical students in Syria: a cross-sectional online survey. Front Artif Intell Appl. 10.3389/frai.2022.1011524 PMC9558737 36248622 · DOI · Paper page
  24. [28]Ahmed Z, Bhinder KK, Tariq A et al (2022) Knowledge, attitude, and practice of artificial intelligence among doctors and medical students in Pakistan: a cross-sectional online survey. Ann Med Surg (Lond) 76:103493 35308436 PMC8928127
  25. [29]Mousavi Baigi SF, Sarbaz M, Ghaddaripouri K et al (2023) Attitudes, knowledge, and skills towards artificial intelligence among healthcare students: a systematic review. Health Sci Rep 6:e1138 36923372 PMC10009305
  26. [31]Shevtsova D, Ahmed A, Boot IWA et al (2024) Trust in and acceptance of artificial intelligence applications in medicine: mixed methods study. JMIR Hum Factors 11:e47031 38231544 PMC10831593
  27. [33]Shankar S, Garcia R, Hellerstein JM, Parameswaran AG (2024) “We have no idea how models will behave in production until production”: how engineers operationalize machine learning. In: Proceedings of the ACM on Human-Computer Interaction. ACM, pp 1–34
  28. [35]Varoquaux G, Cheplygina V (2022) Machine learning for medical imaging: methodological failures and recommendations for the future. NPJ Digit Med 5:48 35413988 PMC9005663
  29. [36]Almeida de JG, Rodrigues NM, Castro Verde AS et al (2025) Impact of scanner manufacturer, endorectal coil use, and clinical variables on deep learning-assisted prostate cancer classification using multiparametric MRI. Radiol Artif Intell 7:e230555 39841063
  30. [39]Yan W, Huang L, Xia L et al (2020) MRI manufacturer shift and adaptation: increasing the generalizability of deep learning segmentation for MR images acquired with different scanners. Radiol Artif Intell 2:e190195 33937833 PMC8082399
  31. [40]Vela D, Sharp A, Zhang R et al (2022) Temporal quality degradation in AI models. Sci Rep 12:11654 35803963 PMC9270447
  32. [42]Otles E, Oh J, Li B et al (2021) Mind the performance gap: examining dataset shift during prospective validation. In: Jung K, Yeung S, Sendak M et al (eds) Proceedings of the 6th machine learning for healthcare conference. PMLR, pp 506–534 PMC13213727 42211431
  33. [44]Mäkinen S, Skogström H, Laaksonen E, Mikkonen T (2021) Who needs MLOps: What data scientists seek to accomplish and how can MLOps help? In: 2021 IEEE/ACM 1st workshop on AI engineering—software engineering for AI (WAIN). IEEE, pp 109–112
  34. [45]Granlund T, Kopponen A, Stirbu V et al (2021) MLOps challenges in multi-organization setup: experiences from two real-world cases. In: 2021 IEEE/ACM 1st workshop on AI engineering—software engineering for AI (WAIN). IEEE, pp 82–88
  35. [46]Bobb MR, Van Heukelom PG, Faine BA et al (2016) Telemedicine provides noninferior research informed consent for remote study enrollment: a randomized controlled trial. Acad Emerg Med 23:759–765 26990899 PMC4938779
  36. [49]Kolar Narayanappa A, Amrit C (2024) An analysis of the barriers preventing the implementation of MLOps. In: Transfer, diffusion and adoption of next-generation digital technologies. Springer Nature Switzerland, pp 101–114
  37. [50]Daniel P, Siewiorek RS (1998) GENERAL-PURPOSE COMPUTING. In: Reliable computer systems. 3rd edn. A K Peters/CRC Press, 444–444
  38. [51]Guinney J, Saez-Rodriguez J (2018) Alternative models for sharing confidential biomedical data. Nat Biotechnol 36:391–392 29734317
  39. [52]Salem O, Alsubhi K, Shaafi A et al (2022) Man-in-the-middle attack mitigation in internet of medical things. IEEE Trans Ind Inf 18:2053–2062
  40. [53]Mangaokar N, Pu J, Bhattacharya P et al (2020) Jekyll: attacking medical image diagnostics using deep generative models. In: 2020 IEEE European Symposium on Security and Privacy (EuroS&P). IEEE, pp 139–157
  41. [54]Rasool RU, Ahmad HF, Rafique W et al (2022) Security and privacy of internet of medical things: a contemporary review in the age of surveillance, botnets, and adversarial ML. J Netw Comput Appl 201:103332
  42. [55]Heckmann O, Ravindran A (2023) Evaluating kubernetes at the edge for fault tolerant multi-camera computer vision applications. In: 2023 IEEE/ACM 23rd International symposium on cluster, cloud and internet computing workshops (CCGridW). IEEE, pp 269–271
  43. [56]Gutiérrez-Martínez J, Núñez-Gaona MA, Aguirre-Meneses H, Delgado-Esquerra RE (2012) A software and hardware architecture for a high-availability PACS. J Digit Imaging 25:471–479 22692771 PMC3389080
  44. [57]Sakamoto N (1998) Availability of software services for a hospital information system. Int J Med Inform 49:89–96 9723806
  45. [59]Shumailov I, Shumaylov Z, Zhao Y et al (2023) The curse of recursion: training on generated data makes models forget. Preprint at https://arxiv.org/abs/2305.17493 · arXiv
  46. [60]Sharma N, Ng AY, James JJ et al (2023) Multi-vendor evaluation of artificial intelligence as an independent reader for double reading in breast cancer screening on 275,900 mammograms. BMC Cancer 23:460 37208717 PMC10197505
  47. [61]Bassi E, Russo A, Oliboni E et al (2024) The role of an artificial intelligence software in clinical senology: a mammography multi-reader study. Radiol Med 129:202–210 38082194
  48. [62]Khanna NN, Maindarkar MA, Viswanathan V et al (2022) Economics of artificial Intelligence in healthcare: diagnosis vs. treatment. Healthcare (Basel) 10:2493 36554017 PMC9777836
  49. [63]Sahiner B, Chen W, Samala RK, Petrick N (2023) Data drift in medical machine learning: implications and potential remedies. Br J Radiol 96:20220878 36971405 PMC10546450
  50. [66]Käding C, Rodner E, Freytag A, Denzler J (2017) Fine-tuning deep neural networks in continuous learning scenarios. Computer vision–ACCV 2016 workshops. Springer International Publishing, 588–605
  51. [67]Nguyen CV, Achille A, Lam M et al (2019) Toward understanding catastrophic forgetting in continual learning. Preprint at 10.48550/arXiv.1908.01019 · DOI
  52. [68]Hofmanninger J, Perkonigg M, Brink JA et al (2020) Dynamic memory to alleviate catastrophic forgetting in continuous learning settings. In: Medical image computing and computer assisted intervention—MICCAI 2020. Springer International Publishing, pp 359–368
  53. [69]Kirkpatrick J, Pascanu R, Rabinowitz N et al (2017) Overcoming catastrophic forgetting in neural networks. Proc Natl Acad Sci U S A 114:3521–3526 28292907 PMC5380101
  54. [72]de Kok JWTM, de la Hoz MÁA, de Jong Y et al (2023) A guide to sharing open healthcare data under the general data protection regulation. Sci Data 10:404 37355751 PMC10290652
  55. [73]Yuan B, Li J (2019) The policy effect of the general data protection regulation (GDPR) on the digital public health Sector in the European Union: an empirical investigation. Int J Environ Res Public Health. 10.3390/ijerph16061070 PMC6466053 30934648 · DOI
  56. [79]Mitsuyama Y, Tatekawa H, Takita H et al (2024) Comparative analysis of GPT-4-based ChatGPT’s diagnostic performance with radiologists using real-world radiology reports of brain tumors. Eur Radiol. 10.1007/s00330-024-11032-8 PMC11913992 39198333 · DOI
  57. [80]Kalidindi S, Baradwaj J (2024) Advancing radiology with GPT-4: innovations in clinical applications, patient engagement, research, and learning. Eur J Radiol Open 13:100589 39170856 PMC11337693
  58. [82]Shen N, Bernier T, Sequeira L et al (2019) Understanding the patient privacy perspective on health information exchange: a systematic review. Int J Med Inform 125:1–12 30914173
  59. [83]Al-Rubaie M, Morris Chang J (2019) Privacy-preserving machine learning: threats and solutions. IEEE Secur Priv 17:49–58
  60. [84]Phong LT, Aono Y, Hayashi T et al (2018) Privacy-preserving deep learning via additively homomorphic encryption. IEEE Trans Inf Forensics Secur 13:1333–1345
  61. [85]Tan S, Knott B, Tian Y, Wu DJ (2021) CryptGPU: fast privacy-preserving machine learning on the GPU. In: 2021 IEEE symposium on security and privacy (SP). IEEE, pp 1021–1038
  62. [86]Mohassel P, Zhang Y (2017) SecureML: a system for scalable privacy-preserving machine learning. In: 2017 IEEE symposium on security and privacy (SP). IEEE, San Jose, pp 19–38
  63. [89]Warnat-Herresthal S, Schultze H, Shastry KL et al (2021) Swarm learning for decentralized and confidential clinical machine learning. Nature 594:265–270 34040261 PMC8189907
  64. [90]Kwak L, Bai H (2023) The role of federated learning models in medical imaging. Radiol Artif Intell 5:e230136 37293343 PMC10245176
  65. [93]de Man Y, Wieland-Jorna Y, Torensma B et al (2023) Opt-in and opt-out consent procedures for the reuse of routinely recorded health data in scientific research and their consequences for consent rate and consent bias: systematic review. J Med Internet Res 25:e42131 36853745 PMC10015347
  66. [94]Oakes AH, Epstein JA, Ganguly A et al (2021) Effect of opt-in vs opt-out framing on enrollment in a COVID-19 surveillance testing program: the COVID SAFE. JAMA Netw Open 4:e2112434 34081141 PMC8176333
  67. [95]Johnson KB, Neuss MJ, Detmer DE (2021) Electronic health records and clinician burnout: a story of three eras. J Am Med Inform Assoc 28:967–973 33367815 PMC8068425
  68. [96]Lidströmer N, Davids J, ElSharkawy M et al (2024) Systematic review and meta-analysis for a global patient co-owned cloud (GPOC). Nat Commun 15:2186 38467643 PMC10928077
  69. [97]Mirchev M, Mircheva I, Kerekovska A (2020) The academic viewpoint on patient data ownership in the context of big data: scoping review. J Med Internet Res 22:e22214 32808934 PMC7463395
  70. [98]Mandel JC, Kreda DA, Mandl KD et al (2016) SMART on FHIR: a standards-based, interoperable apps platform for electronic health records. J Am Med Inform Assoc 23:899–908 26911829 PMC4997036
  71. [99]Sculley D, Holt G, Golovin D et al (2015) Hidden technical debt in machine learning systems. In: Advances in neural information processing systems, 28
  72. [100]Bidgood WD Jr, Horii SC, Prior FW, Van Syckle DE (1997) Understanding and using DICOM, the data interchange standard for biomedical imaging. J Am Med Inform Assoc 4:199–212 9147339 PMC61235
  73. [103]Brodie ML (1984) On the development of data models. In: Brodie ML, Mylopoulos J, Schmidt JW (eds) On conceptual modelling: perspectives from artificial intelligence, databases, and programming languages. Springer New York, New York, pp 19–47
  74. [104]Danese MD, Halperin M, Duryea J, Duryea R (2019) The generalized data model for clinical research. BMC Med Inform Decis Mak 19:117 31234921 PMC6591926
  75. [105]Dutruel SP, Jeph S, Margolis DJA, Wehrli N (2020) PI-RADS: what is new and how to use it. Abdom Radiol (NY) 45:3951–3960 32185445
  76. [106]Spak DA, Plaxco JS, Santiago L et al (2017) BI-RADS® fifth edition: a summary of changes. Diagn Interv Imaging 98:179–190 28131457
  77. [109]Moradi E, Jafari SM, Doorbash ZM, Mirzaei A (2021) Impact of organizational inertia on business model innovation, open innovation and corporate performance. Asia Pacific Management Review 26:171–179
  78. [110]Mival O, Benyon D (2015) User experience (UX) design for medical personnel and patients. In: Fricker SA, Thümmler C, Gavras A (eds) Requirements engineering for digital health. Springer International Publishing, Cham, pp 117–131
  79. [111]Shaalan D, Jusoh S (2020) Visualization in medical system interfaces: UX guidelines. In: 2020 12th International conference on electronics, computers and artificial intelligence (ECAI). IEEE, pp 1–8
  80. [112]Jansson M, Liisanantti J, Ala-Kokko T, Reponen J (2022) The negative impact of interface design, customizability, inefficiency, malfunctions, and information retrieval on user experience: a national usability survey of ICU clinical information systems in Finland. Int J Med Inform 159:104680 34990942
  81. [115]Krishnan A, Subasri V, McKeen K et al (2022) CyclOps: cyclical development towards operationalizing ML models for health. Preprint at 10.1101/2022.12.02.22283021 · DOI
  82. [116]Moskalenko V, Kharchenko V (2024) Resilience-aware MLOps for AI-based medical diagnostic system. Front Public Health 12:1342937 38601490 PMC11004236
  83. [117]Harris S, Bonnici T, Keen T et al (2022) Clinical deployment environments: five pillars of translational machine learning for health. Front Digit Health 4:939292 36060542 PMC9437594
  84. [118]Khattak FK, Subasri V, Krishnan A et al (2025) MLHOps: Machine learning health operations. IEEE Access 13:20374–20412
  85. [119]Brady AP, Allen B, Chong J et al (2024) Developing, purchasing, implementing and monitoring AI tools in radiology: Practical considerations. A multi-society statement from the ACR, CAR, ESR, RANZCR & RSNA. J Am Coll Radiol 21:1292–1310 38276923
  86. [120]Linguraru MG, Bakas S, Aboian M et al (2024) Clinical, cultural, computational, and regulatory considerations to deploy AI in radiology: perspectives of RSNA and MICCAI experts. Radiol Artif Intell 6:e240225 38984986 PMC11294958
  87. [122]Tejani AS, Elhalawani H, Moy L et al (2023) Artificial intelligence and radiology education. Radiol Artif Intell 5:e220084 36721409 PMC9885376
  88. [125]Jeyakumar T, Younus S, Zhang M et al (2023) Preparing for an artificial intelligence–enabled future: patient perspectives on engagement and health care professional training for adopting artificial intelligence technologies in health care settings. JMIR AI 2:e40973 38875561 PMC11041489
  89. [126]Yakar D, Ongena YP, Kwee TC, Haan M (2022) Do people favor artificial intelligence over physicians? A survey among the general population and their view on artificial intelligence in medicine. Value Health 25:374–381 35227448
  90. [127]McDonald JA, Terry MB, Tehranifar P (2014) Racial and gender discrimination, early life factors, and chronic physical health conditions in midlife. Womens Health Issues 24:e53–e59 24345610 PMC3905987
  91. [128]Ayhan CHB, Bilgin H, Uluman OT et al (2020) A systematic review of the discrimination against sexual and gender minority in health care settings. Int J Health Serv 50:44–61 31684808
  92. [129]Brown CE, Engelberg RA, Sharma R et al (2018) Race/ethnicity, socioeconomic status, and healthcare intensity at the end of life. J Palliat Med 21:1308–1316 29893618 PMC6154447
  93. [131]Hong R, Baumann BM, Boudreaux ED (2007) The emergency department for routine healthcare: race/ethnicity, socioeconomic status, and perceptual factors. J Emerg Med 32:149–158 17307624
  94. [132]Frølich A, Ghith N, Schiøtz M et al (2019) Multimorbidity, healthcare utilization and socioeconomic status: a register-based study in Denmark. PLoS One 14:e0214183 31369580 PMC6675513

Authors
de Almeida, J. G., Messiou, C., Withey, S. J., Matos, C., Koh, D.-M., & Papanikolaou, N.
Affiliations
  • Royal Marsden Hospital (GB)
  • Champalimaud Foundation (PT)
Venue
European Radiology
Published
2025-05-08
Volume
35
Issue
11
Pages
6828-6841
ISSN
  • 0938-7994 (ISSN-L)
  • 1432-1084
OpenAlex
W4410193416
Cited by
23
References
123
Citations by year
2026: 17 · 2025: 6
FWCI
1.36
Type
journal article
Language
en
Open access
Locations
  • European Radiology (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Funders
Horizon 2020 (952159)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiology practices and education
  • Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiomics and Machine Learning in Medical Imaging
Keywords
machine learning in medicine, MLOps, radiology, clinical implementation of AI, model monitoring, model validation, model maintenance, model retraining, patient data protection, regulatory compliance, clinical implementation, diagnostic workflow, radiologist workload
MeSH terms
Machine Learning, Artificial Intelligence, Humans, Radiology, Workflow

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review