CoChat

Assessing the Economic Value of Clinical Artificial Intelligence: Challenges and Opportunities

Open access
Hendrix, Nathaniel, Veenstra, David L., Cheng, Mindy, Anderson, Nicholas C., Verguet, Stéphane · 2022 · Value in Health
Cited by 83

The DOI matches its Crossref record; 27 of the 27 references it cites were found in a registry or an index.

Abstract

OBJECTIVES Clinical artificial intelligence (AI) is a novel technology, and few economic evaluations have focused on it to date. Before its wider implementation, it is important to highlight the aspects of AI that challenge traditional health technology assessment methods. METHODS We used an existing broad value framework to assess potential ways AI can provide good value for money. We also developed a rubric of how economic evaluations of AI should vary depending on the case of its use. RESULTS We found that the measurement of core elements of value-health outcomes and cost-are complicated by AI because its generalizability across different populations is often unclear and because its use may necessitate reconfigured clinical processes. Clinicians' productivity may improve when AI is used. If poorly implemented though, AI may also cause clinicians' workload to increase. Some AI has been found to exacerbate health disparities. Nevertheless, AI may promote equity by expanding access to medical care and, when properly trained, providing unbiased diagnoses and prognoses. The approach to assessment of AI should vary based on its use case: AI that creates new clinical possibilities can improve outcomes, but regulation and evidence collection may be difficult; AI that extends clinical expertise can reduce disparities and lower costs but may result in overuse; and AI that automates clinicians' work can improve productivity but may reduce skills. CONCLUSIONS The potential uses of clinical AI create challenges for health technology assessment methods originally developed for pharmaceuticals and medical devices. Health economists should be prepared to examine data collection and methods used to train AI, as these may impact its future value.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.jval.2021.08.015

Cites

27 of 27 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 27 references

Research works printed but not linked: 38

  1. Garvey, 2018, Interview with Colin Garvey, Rensselaer Polytechnic Institute. Artificial intelligence and systems medicine convergence, Omics, 22, 130, 10.1089/omi.2017.0218 · DOI
  2. Miller, 2009, Computer-assisted diagnostic decision support: history, challenges, and possible paths forward, Adv Health Sci Educ Theory Pract, 14, 89, 10.1007/s10459-009-9186-y · DOI
  3. Stinton C, Jenkinson D, Adekanmbi V, Clarke A, Taylor-Phillips S. Does time of day influence cancer detection and recall rates in mammography? In: Proceeding from the SPIE 10136, Medical Imaging 2017: Image Perception, Observer Performance, and Technology Assessment; March 10, 2017; Orlando, FL. Abstract 10136B. · doi:10.1117/12.2254280
  4. Berrouiguet, 2019, Combining mobile-health (mHealth) and artificial intelligence (AI) methods to avoid suicide attempts: the Smartcrises study protocol, BMC Psychiatry, 19, 277, 10.1186/s12888-019-2260-y · DOI · Paper page
  5. Beam, 2016, Translating artificial intelligence into clinical care, JAMA, 316, 2368, 10.1001/jama.2016.17217 · DOI · Paper page
  6. Zakhem, 2018, How should artificial intelligence screen for skin cancer and deliver diagnostic predictions to patients?, JAMA Dermatol, 154, 1383, 10.1001/jamadermatol.2018.2714 · DOI
  7. Hekler, 2019, Superior skin cancer classification by the combination of human and artificial intelligence, Eur J Cancer, 120, 114, 10.1016/j.ejca.2019.07.019 · DOI · Paper page
  8. Lin, 2018, Reimagining clinical documentation with artificial intelligence, Mayo Clin Proc, 93, 563, 10.1016/j.mayocp.2018.02.016 · DOI
  9. Chaudhari, 2021, Prospective deployment of deep learning in MRI: a framework for important considerations, challenges, and recommendations for best practices, J Magn Reson Imaging, 54, 357, 10.1002/jmri.27331 · DOI
  10. Dixon, 2007, Development of a taxonomy for health information technology, Stud Health Technol Inform, 129, 616
  11. Combi, 2019, Clinical information systems and artificial intelligence: recent research trends, Yearb Med Inform, 28, 83, 10.1055/s-0039-1677915 · DOI
  12. Habbema, 2015, Models in the development of clinical practice guidelines, Ann Intern Med, 162, 530, 10.7326/L15-5075-2 · DOI
  13. Ostherr K. Artificial intelligence and medical humanities [published online July 11, 2020]. J Med Humanit. https://doi.org/10.1007/s10912-020-09636-4. · DOI · Paper page
  14. Lakdawalla, 2018, Defining elements of value in health care—a health economics approach: an ISPOR Special Task Force Report:[3], Value Health, 21, 131, 10.1016/j.jval.2017.12.007 · DOI · Paper page
  15. 2016, General wellness: policy for low risk devices; guidance for Industry and Food and Drug Administration staff; availability, Fed Regist, 81, 49993
  16. Hwang, 2019, Lifecycle regulation of artificial intelligence--and machine learning--based software devices in medicine, JAMA, 322, 2285, 10.1001/jama.2019.16842 · DOI
  17. Babic, 2021, Direct-to-consumer medical machine learning and artificial intelligence applications, Nat Mach Intell, 3, 283, 10.1038/s42256-021-00331-0 · DOI
  18. Wu, 2021, How medical AI devices are evaluated: limitations and recommendations from an analysis of FDA approvals, Nat Med, 27, 582, 10.1038/s41591-021-01312-x · DOI · Paper page
  19. Obermeyer, 2020, Adoption of artificial intelligence and machine learning is increasing, but irrational exuberance remains, NEJM Catal, 1, 2
  20. Schwalbe, 2020, Artificial intelligence and the future of global health, Lancet, 395, 1579, 10.1016/S0140-6736(20)30226-9 · DOI · Paper page
  21. Topol, 2020, Welcoming new guidelines for AI clinical research, Nat Med, 26, 1318, 10.1038/s41591-020-1042-x · DOI
  22. Park, 2021, Key principles of clinical validation, device approval, and insurance coverage decisions of artificial intelligence, Korean J Radiol, 22, 442, 10.3348/kjr.2021.0048 · DOI
  23. Rose, 2018, Machine learning for prediction in electronic health data, JAMA Netw Open, 1, 10.1001/jamanetworkopen.2018.1404 · DOI · Paper page
  24. Parikh, 2019, Addressing bias in artificial intelligence in health care, JAMA, 322, 2377, 10.1001/jama.2019.18058 · DOI · Paper page
  25. Salim, 2020, External evaluation of 3 commercial artificial intelligence algorithms for independent assessment of screening mammograms, JAMA Oncol, 6, 1581, 10.1001/jamaoncol.2020.3321 · DOI · Paper page
  26. Schaffter, 2020, Evaluation of combined artificial intelligence and radiologist assessment to interpret screening mammograms [published correction appears in JAMA Netw Open. 2020;3(3):e204429], JAMA Netw Open, 3
  27. Wu, 2020, Deep neural networks improve radiologists’ performance in breast cancer screening, IEEE Trans Med Imaging, 39, 1184, 10.1109/TMI.2019.2945514 · DOI · Paper page
  28. Sondermann, 2019, Prediction of melanoma evolution in melanocytic nevi via artificial intelligence: a call for prospective data [published correction appears in Eur J Cancer. 2019;123:171], Eur J Cancer, 119, 30, 10.1016/j.ejca.2019.07.009 · DOI
  29. van Erkel, 1998, Receiver operating characteristic (ROC) analysis: basic principles and applications in radiology, Eur J Radiol, 27, 88, 10.1016/S0720-048X(97)00157-5 · DOI · Paper page
  30. Levy, 2019, Deskilling in ophthalmology is the inevitable controllable?, Eye (Lond), 33, 347, 10.1038/s41433-018-0252-7 · DOI
  31. Schapira, 2018, Communication practices of mammography facilities and timely follow-up of a screening mammogram with a BI-RADS 0 assessment, Acad Radiol, 25, 1118, 10.1016/j.acra.2017.12.028 · DOI
  32. Lake, 2020, Black patients referred to a lung cancer screening program experience lower rates of screening and longer time to follow-up, BMC Cancer, 20, 561, 10.1186/s12885-020-06923-0 · DOI
  33. Wiens, 2014, A study in transfer learning: leveraging data from multiple hospitals to enhance hospital-specific predictions, J Am Med Inform Assoc, 21, 699, 10.1136/amiajnl-2013-002162 · DOI · Paper page
  34. Gupta, 2020, Transfer learning for clinical time series analysis using deep neural networks, J Healthc Inform Res, 4, 112, 10.1007/s41666-019-00062-3 · DOI · Paper page
  35. Mukherjee, 2003, Estimating dataset size requirements for classifying DNA microarray data, J Comput Biol, 10, 119, 10.1089/106652703321825928 · DOI · Paper page
  36. Figueroa, 2012, Predicting sample size required for classification performance, BMC Med Inform Decis Mak, 12, 8, 10.1186/1472-6947-12-8 · DOI · Paper page
  37. Morey JR, Fiano E, Yaeger KA, Zhang X, Fifi JT. Impact of viz LVO on time-to-treatment and clinical outcomes in large vessel occlusion stroke patients presenting to primary stroke centers. Preprint. Posted online July 5, 2020. medRxiv 2020.07.02.20143834. https://doi.org/10.1101/2020.07.02.20143834. · DOI
  38. Maliha, 2021, Artificial intelligence and liability in medicine: balancing safety and innovation, Milbank Q, 99, 629, 10.1111/1468-0009.12504 · DOI · Paper page

Cited by

See all 83

Metadata

Authors
Hendrix, N., Veenstra, D. L., Cheng, M., Anderson, N. C., & Verguet, S.
Venue
Value in Health
Publisher
Elsevier BV
Published
2022-03
Volume
25
Issue
3
Pages
331-339
ISSN
1098-3015 (ISSN-L)
OpenAlex
W3206003576
Cited by
83
References
27
FWCI
7.03
Type
journal article
Language
en
Open access
bronze
Licence

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Assessing the Economic Value of Clinical Artificial Intelligence: Challenges and Opportunities. https://app.cochat.ai/papers/10.1016/j.jval.2021.08.015
The paper
Hendrix, N., Veenstra, D. L., Cheng, M., Anderson, N. C., & Verguet, S. (2022). Assessing the Economic Value of Clinical Artificial Intelligence: Challenges and Opportunities. Value in Health. https://doi.org/10.1016/j.jval.2021.08.015

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.