Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 59 of the 59 references it cites were found in a registry or an index.

Artificial Intelligence and the Implementation Challenge

Open access
Shaw, James, Rudzicz, Frank, Jamieson, Trevor, Goldfarb, Avi · 2019 · Journal of Medical Internet Research

Published version of a preprint

Abstract

BACKGROUND: Applications of artificial intelligence (AI) in health care have garnered much attention in recent years, but the implementation issues posed by AI have not been substantially addressed. OBJECTIVE: In this paper, we have focused on machine learning (ML) as a form of AI and have provided a framework for thinking about use cases of ML in health care. We have structured our discussion of challenges in the implementation of ML in comparison with other technologies using the framework of Nonadoption, Abandonment, and Challenges to the Scale-Up, Spread, and Sustainability of Health and Care Technologies (NASSS). METHODS: After providing an overview of AI technology, we describe use cases of ML as falling into the categories of decision support and automation. We suggest these use cases apply to clinical, operational, and epidemiological tasks and that the primary function of ML in health care in the near term will be decision support. We then outline unique implementation issues posed by ML initiatives in the categories addressed by the NASSS framework, specifically including meaningful decision support, explainability, privacy, consent, algorithmic bias, security, scalability, the role of corporations, and the changing nature of health care work. RESULTS: Ultimately, we suggest that the future of ML in health care remains positive but uncertain, as support from patients, the public, and a wide range of health care stakeholders is necessary to enable its meaningful implementation. CONCLUSIONS: If the implementation science community is to facilitate the adoption of ML in ways that stand to generate widespread benefits, the issues raised in this paper will require substantial attention in the coming years.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/13659

Cites

59 of 59 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 58 references

Research works printed but not linked: 8

  1. Ajay, A, 2019, The Economics of Artificial Intelligence: An Agenda
  2. 10.1016/j.socscimed.2012.11.021published · doi:10.1016/j.socscimed.2012.11.021published
  3. Agrawal, A, 2018, Prediction Machines: The Simple Economics of Artificial Intelligence
  4. RajpurkarPPolamreddiVBalakrishnanAResearchGate2017Cornell University LibraryMalaria likelihood prediction by effectively surveying households using deep reinforcement learning https://www.researchgate.net/publication/321324506_Malaria_Likelihood_Prediction_By_Effectively_Surveying_Households_Using_Deep_Reinforcement_Learning
  5. CaseyDBeyanOMurphyKFelzmannHRobot-Assisted Care for Elderly With Dementia: Is There a Potential for Genuine End-User Empowerment?Proceedings of the Tenth Annual ACM/IEEE International Conference on Human-Robot Interaction Extended Abstracts2015HRI'15 Extended AbstractsMarch 2-5, 2015Portland, OR2478
  6. RossiRAAhmedNKThe Network Data Repository with Interactive Graph Analytics and VisualizationProceedings of the Twenty-Ninth AAAI Conference on Artificial Intelligence2015AAAI'15January 25-30, 2015Austin Texas42923
  7. CulnaneCRubinsteinBTeagueVarXiv2017Health data in an open world https://arxiv.org/ftp/arxiv/papers/1712/1712.05627.pdf
  8. TsymbalAResearchGate2004Computer Science Department, Trinity College DublinThe problem of concept drift: definitions and related work https://www.researchgate.net/publication/228723141_The_Problem_of_Concept_Drift_Definitions_and_Related_Work

Cited by

See all 443

Metadata

Authors
Shaw, J., Rudzicz, F., Jamieson, T., & Goldfarb, A.
Affiliations
  • University of Toronto (CA)
  • St. Michael's Hospital (CA)
Corresponding author
Shaw, James
Venue
Journal of Medical Internet Research
Published
2019-07-10
Volume
21
Issue
7
Pages
e13659
ISSN
1438-8871 (ISSN-L)
OpenAlex
W2947151330
Cited by
389
References
58
Citations by year
2026: 62 · 2025: 70 · 2024: 68 · 2023: 77 · 2022: 49 · 2021: 36 · 2020: 22 · 2019: 5
FWCI
8.91
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
Keywords
artificial intelligence in healthcare, machine learning implementation, NASSS framework, clinical decision support, explainability, algorithmic bias, privacy and consent, healthcare workforce, scalability, technology adoption, implementation science
MeSH terms
Machine Learning, Artificial Intelligence, Humans, Telemedicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Artificial Intelligence and the Implementation Challenge. https://app.cochat.ai/papers/10.2196/13659
The paper
Shaw, J., Rudzicz, F., Jamieson, T., & Goldfarb, A. (2019). Artificial Intelligence and the Implementation Challenge. Journal of Medical Internet Research. https://doi.org/10.2196/13659

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.