CoChat

Algor-ethics: charting the ethical path for AI in critical care

Montomoli, Jonathan, Bitondo, Maria Maddalena, Cascella, Marco, Rezoagli, Emanuele, Romeo, Luca, Bellini, Valentina, Semeraro, Federico, Gamberini, Emiliano, Frontoni, Emanuele, Agnoletti, Vanni, Altini, Mattia, Benanti, Paolo, Bignami, Elena Giovanna · 2024 · Journal of Clinical Monitoring and Computing
Cited by 36

The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.

Abstract

The integration of Clinical Decision Support Systems (CDSS) based on artificial intelligence (AI) in healthcare is groundbreaking evolution with enormous potential, but its development and ethical implementation, presents unique challenges, particularly in critical care, where physicians often deal with life-threating conditions requiring rapid actions and patients unable to participate in the decisional process. Moreover, development of AI-based CDSS is complex and should address different sources of bias, including data acquisition, health disparities, domain shifts during clinical use, and cognitive biases in decision-making. In this scenario algor-ethics is mandatory and emphasizes the integration of ‘Human-in-the-Loop’ and ‘Algorithmic Stewardship’ principles, and the benefits of advanced data engineering. The establishment of Clinical AI Departments (CAID) is necessary to lead AI innovation in healthcare, ensuring ethical integrity and human-centered development in this rapidly evolving field.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1007/s10877-024-01157-y

Cites

14 of 14 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 14 references

Research works printed but not linked: 32

  1. Moazemi S, Vahdati S, Li J, Kalkhoff S, Castano LJV, Dewitz B, et al. Artificial intelligence for clinical decision support for monitoring patients in cardiovascular ICUs: a systematic review. Front Med. 2023;10:1109411. · DOI · Paper page
  2. Muehlematter UJ, Bluethgen C, Vokinger KN. FDA-cleared artificial intelligence and machine learning-based medical devices and their 510(k) predicate networks. Lancet Digit Health. 2023;5:e618–26. · DOI · Paper page
  3. van de Sande D, van Bommel J, Fung Fen Chung E, Gommers D, van Genderen ME. Algorithmic fairness audits in intensive care medicine: artificial intelligence for all? Crit Care. 2022;26:315. · DOI
  4. Grote T, Keeling G. Enabling Fairness in Healthcare through Machine Learning. Ethics Inf Technol. 2022;24:39. · DOI
  5. Mosqueira-Rey E, Hernández-Pereira E, Alonso-Ríos D, Bobes-Bascarán J, Fernández-Leal Á. Human-in-the-loop machine learning: a state of the art. Artif Intell Rev. 2023;56:3005–54. · DOI · Paper page
  6. Friedman TL. Thank you for being late: an Optimist’s guide to thriving in the age of accelerations. London, UK: Allen Lane; 2016.
  7. Nakanishi R, Okubo R, Sobue Y, Kaneko U, Sato H, Fujimoto S, Nozaki Y, Kajiya T, Miyoshi T, Ichikawa K, Abe M, Kitagawa T, Ikenaga H, Osawa K, Saji M, Iguchi N, Nakazawa G, Takahashi K, Ijich T, Mikamo H, Kurata A, Moroi M, Iijima R, Malkasian S, Crabtree T, Chamie D, Alexandra LJ, Min JK, Earls JP, Matsuo H. Rationale and design of the INVICTUS Registry: (Multicenter Registry of Invasive and Non-Invasive imaging modalities to compare Coronary Computed Tomography Angiography, Intravascular Ultrasound and Optical Coherence Tomography for the determination of Severity, Volume and Type of coronary atherosclerosiS). J Cardiovasc Comput Tomogr. 2023 Sep 5:S1934-5925(23)00427-6. · DOI
  8. Gerard SE, Herrmann J, Xin Y, Martin KT, Rezoagli E, Ippolito D, Bellani G, Cereda M, Guo J, Hoffman EA, Kaczka DW, Reinhardt JM. CT image segmentation for inflamed and fibrotic lungs using a multi-resolution convolutional neural network. Sci Rep. 2021;11(1):1455. · DOI
  9. Connell M, Xin Y, Gerard SE, Herrmann J, Shah PK, Martin KT, Rezoagli E, Ippolito D, Rajaei J, Baron R, Delvecchio P, Humayun S, Rizi RR, Bellani G, Cereda M. Unsupervised segmentation and quantification of COVID-19 lesions on computed tomography scans using CycleGAN. Methods. 2022;205:200–9. · DOI
  10. Maddali MV, Churpek M, Pham T, Rezoagli E, Zhuo H, Zhao W, He J, Delucchi KL, Wang C, Wickersham N, McNeil JB, Jauregui A, Ke S, Vessel K, Gomez A, Hendrickson CM, Kangelaris KN, Sarma A, Leligdowicz A, Liu KD, Matthay MA, Ware LB, Laffey JG, Bellani G, Calfee CS, Sinha P. LUNG SAFE investigators and the ESICM Trials Group. Validation and utility of ARDS subphenotypes identified by machine-learning models using clinical data: an observational, multicohort, retrospective analysis. Lancet Respir Med. 2022;10(4):367–77. · DOI · Paper page
  11. Stephens AF, Šeman M, Diehl A, Pilcher D, Barbaro RP, Brodie D, Pellegrino V, Kaye DM, Gregory SD, Hodgson C. Extracorporeal Life Support Organization Member centres. ECMO PAL: using deep neural networks for survival prediction in venoarterial extracorporeal membrane oxygenation. Intensive Care Med. 2023;49(9):1090–9. · DOI
  12. Chen YY, Liu CF, Shen YT, Kuo YT, Ko CC, Chen TY, Wu TC, Shih YJ. Development of real-time individualized risk prediction models for contrast associated acute kidney injury and 30-day dialysis after contrast enhanced computed tomography. Eur J Radiol. 2023;167:111034. · DOI
  13. Avidan A, Sprung CL, Schefold JC, Ricou B, Hartog CS, Nates JL, et al. Variations in end-of-life practices in intensive care units worldwide (Ethicus-2): a prospective observational study. Lancet Respiratory Med. 2021;9:1101–10. · DOI · Paper page
  14. Denney MJ, Long DM, Armistead MG, Anderson JL, Conway BN. Validating the extract, transform, load process used to populate a large clinical research database. Int J Med Inf. 2016;94:271–4. · DOI
  15. Quiroz JC, Chard T, Sa Z, Ritchie A, Jorm L, Gallego B. Extract, transform, load framework for the conversion of health databases to OMOP. Deserno TM, editor. PLoS ONE. 2022;17:e0266911. · DOI
  16. Henke E, Peng Y, Reinecke I, Zoch M, Sedlmayr M, Bathelt F. An extract-transform-load process design for the Incremental Loading of German Real-World Data based on FHIR and OMOP CDM: Algorithm Development and Validation. JMIR Med Inf. 2023;11:e47310.
  17. Unberath P, Prokosch HU, Gründner J, Erpenbeck M, Maier C, Christoph J. EHR-Independent Predictive decision Support Architecture based on OMOP. Appl Clin Inf. 2020;11:399–404. · DOI
  18. Fleuren LM, Dam TA, Tonutti M, De Bruin DP, Lalisang RCA, Gommers D, et al. The Dutch Data Warehouse, a multicenter and full-admission electronic health records database for critically ill COVID-19 patients. Crit Care. 2021;25:304. · DOI
  19. McNicholas BA, Madotto F, Pham T, Rezoagli E, Masterson CH, Horie S, Bellani G, Brochard L, Laffey JG, LUNG SAFE Investigators and the ESICM Trials Group. Demographics, management and outcome of females and males with acute respiratory distress syndrome in the LUNG SAFE prospective cohort study. Eur Respir J. 2019;54(4):1900609. · DOI
  20. Rezoagli E, McNicholas BA, Madotto F, Pham T, Bellani G, Laffey JG, LUNG SAFE Investigators, the ESICM Trials Group. Presence of comorbidities alters management and worsens outcome of patients with acute respiratory distress syndrome: insights from the LUNG SAFE study. Ann Intensive Care. 2022;12(1):42. · DOI
  21. Majid Z, Welch C, Davies J, Jackson T. Global frailty: the role of ethnicity, migration and socioeconomic factors. Maturitas. 2020;139:33–41. · DOI
  22. Bellini V, Montomoli J, Bignami E. Poor quality data, privacy, lack of certifications: the lethal triad of new technologies in intensive care. Intensive Care Med 202147:1052–3. · DOI
  23. Farahani A, Voghoei S, Rasheed K, Arabnia HR. A Brief Review of Domain Adaptation. In: Stahlbock R, Weiss GM, Abou-Nasr M, Yang C-Y, Arabnia HR, Deligiannidis L, editors. Advances in Data Science and Information Engineering [Internet]. Cham: Springer International Publishing; 2021 [cited 2023 Jun 16]. pp. 877–94. https://link.springer.com/https://doi.org/10.1007/978-3-030-71704-9_65. · DOI · Paper page
  24. Kahneman D. Thinking, fast and slow. London: Penguin Books; 2012.
  25. Adler-Milstein J, Chen JH, Dhaliwal G. Next-generation Artificial Intelligence for diagnosis: from Predicting Diagnostic labels to Wayfinding. JAMA. 2021;326:2467. · DOI
  26. Montomoli J, Rezoagli E, Bellini V, Finazzi S, Bignami EG. A generalized wayfinding paradigm for improving AKI understanding and classification: insights from the Dutch registries. Minerva Anestesiol. 2023. · DOI
  27. Celi LA, Cellini J, Charpignon M-L, Dee EC, Dernoncourt F, Eber R et al. Sources of bias in artificial intelligence that perpetuate healthcare disparities—A global review. Fraser HS, editor. PLOS Digit Health. 2022;1:e0000022. · DOI · Paper page
  28. Montomoli J, Hilty MP, Ince C. Artificial intelligence in intensive care: moving towards clinical decision support systems. Minerva Anestesiol. 2022. · DOI
  29. Blanchard MD, Kleitman S, Aidman E. Are two naïve and distributed heads better than one? Factors influencing the performance of teams in a challenging real-time task. Front Psychol. 2023;14:1042710. · DOI
  30. Koriat A. When two heads are better than one and when they can be worse: the amplification hypothesis. J Exp Psychol Gen. 2015;144:934–50. · DOI
  31. Aporta C, Higgs E. Satellite Culture: Global Positioning Systems, Inuit Wayfinding, and the need for a New Account of Technology. Curr Anthropol. 2005;46:729–53. · DOI · Paper page
  32. Cosgriff CV, Stone DJ, Weissman G, Pirracchio R, Celi LA. The clinical artificial intelligence department: a prerequisite for success. BMJ Health Care Inf. 2020;27:e100183. · DOI · Paper page

Cited by

See all 36

Metadata

Authors
Montomoli, J., Bitondo, M. M., Cascella, M., Rezoagli, E., Romeo, L., Bellini, V., Semeraro, F., Gamberini, E., Frontoni, E., Agnoletti, V., Altini, M., Benanti, P., & Bignami, E. G.
Venue
Journal of Clinical Monitoring and Computing
Published
2024-04-04
Volume
38
Issue
4
Pages
931-939
ISSN
  • 1387-1307
  • 1573-2614
Cited by
36
References
14
Language
en
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Algor-ethics: charting the ethical path for AI in critical care. https://app.cochat.ai/papers/10.1007/s10877-024-01157-y
The paper
Montomoli, J., Bitondo, M. M., Cascella, M., Rezoagli, E., Romeo, L., Bellini, V., Semeraro, F., Gamberini, E., Frontoni, E., Agnoletti, V., Altini, M., Benanti, P., & Bignami, E. G. (2024). Algor-ethics: charting the ethical path for AI in critical care. Journal of Clinical Monitoring and Computing. https://doi.org/10.1007/s10877-024-01157-y

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.