Cited by 57Artificial Intelligence in Healthcare and EducationElectronic Health Records SystemsArtificial Intelligence in Healthcare

Adoption of Machine Learning Systems for Medical Diagnostics in Clinics: Qualitative Interview Study

Open access
Pumplun, Luisa, Fecho, Mariska, Wahl, Nihal, Peters, Felix, Buxmann, Peter·2021·Journal of Medical Internet Research

Published version of a preprint

Abstract

Background: Recently, machine learning (ML) has been transforming our daily lives by enabling intelligent voice assistants, personalized support for purchase decisions, and efficient credit card fraud detection. In addition to its everyday applications, ML holds the potential to improve medicine as well, especially with regard to diagnostics in clinics. In a world characterized by population growth, demographic change, and the global COVID-19 pandemic, ML systems offer the opportunity to make diagnostics more effective and efficient, leading to a high interest of clinics in such systems. However, despite the high potential of ML, only a few ML systems have been deployed in clinics yet, as their adoption process differs significantly from the integration of prior health information technologies given the specific characteristics of ML. Objective: This study aims to explore the factors that influence the adoption process of ML systems for medical diagnostics in clinics to foster the adoption of these systems in clinics. Furthermore, this study provides insight into how these factors can be used to determine the ML maturity score of clinics, which can be applied by practitioners to measure the clinic status quo in the adoption process of ML systems. Methods: To gain more insight into the adoption process of ML systems for medical diagnostics in clinics, we conducted a qualitative study by interviewing 22 selected medical experts from clinics and their suppliers with profound knowledge in the field of ML. We used a semistructured interview guideline, asked open-ended questions, and transcribed the interviews verbatim. To analyze the transcripts, we first used a content analysis approach based on the health care–specific framework of nonadoption, abandonment, scale-up, spread, and sustainability. Then, we drew on the results of the content analysis to create a maturity model for ML adoption in clinics according to an established development process. Results: With the help of the interviews, we were able to identify 13 ML-specific factors that influence the adoption process of ML systems in clinics. We categorized these factors according to 7 domains that form a holistic ML adoption framework for clinics. In addition, we created an applicable maturity model that could help practitioners assess their current state in the ML adoption process. Conclusions: Many clinics still face major problems in adopting ML systems for medical diagnostics; thus, they do not benefit from the potential of these systems. Therefore, both the ML adoption framework and the maturity model for ML systems in clinics can not only guide future research that seeks to explore the promises and challenges associated with ML systems in a medical setting but also be a practical reference point for clinicians.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.2196/29301

Cites

68 of 68 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 13

  1. [1]Hufnagl C Doctor E Behrens L Buck C Eymann T Digitisation along the patient pathway in hospitals Proceedings of the 27th European Conference on Information Systems - ECIS 2019 27th European Conference on Information Systems - ECIS Jun 8-14, 2019 Stockholm & Uppsala, Sweden
  2. [12]Russell SJ Norvig P Artificial Intelligence: A Modern Approach. 3rd Ed 2016 Boston, MA Addison Wesley
  3. [19]Lebovitz S Diagnostic doubt and artificial intelligence: An inductive field study of radiology work Proceedings of the 40th International Conference on Information Systems (ICIS) 2019 40th International Conference on Information Systems (ICIS) December 15-18, 2019 Munich, Germany
  4. [24]Pumplun L Tauchert C Heidt M A new organizational chassis for artificial intelligence—Exploring organizational readiness factors Proceedings of the 27th European Conference on Information Systems (ECIS) 2019 27th European Conference on Information Systems (ECIS) June 8-14, 2019 Stockholm & Uppsala, Sweden
  5. [26]Alsheibani S Cheung Y Messom C Factors inhibiting the adoption of artificial intelligence at organizational-level: A preliminary investigation Proceedings of the 25th Americas Conference on Information Systems (AMCIS) 2019 25th Americas Conference on Information Systems (AMCIS) August 15-17, 2019 Cancun, Mexico
  6. [34]Hofmann P Oesterle S Rust P Urbach N Machine learning approaches along the radiology value chain – Rethinking value propositions Proceedings of the Twenty-Seventh European Conference on Information Systems (ECIS) 2019 Twenty-Seventh European Conference on Information Systems (ECIS) June 8-14, 2019 Stockholm & Uppsala, Sweden
  7. [49]Creswell JW Qualitative Inquiry and Research Design: Choosing Among Five Traditions. 2nd Ed 2007 California, USA SAGE Publications
  8. [50]Bogner A Littig B Menz W Bogner A Littig B Menz W Introduction: Expert interviews – an introduction to a new methodological debate Interviewing Experts 2009 London, UK Palgrave Macmillan 1 13
  9. [53]De Bruin T Rosemann M Freeze R Kulkarni U Understanding the main phases of developing a maturity assessment model Proceedings of the 16th Australasian Conference on Information Systems (ACIS) 2005 16th Australasian Conference on Information Systems (ACIS) Nov 29 - Dec 2, 2005 Sydney, Australia
  10. [61]Alsheibani S Cheung Y Messom C Towards an artifificial intelligence maturity model: From science fiction to business facts Proceedings of the 23rd Pacific Asia Conference on Information Systems 2019 23rd Pacific Asia Conference on Information Systems July 8-12, 2019 Xi’an, China
  11. [64]Joachim N Beimborn D Weitzel T An instrument for measuring SOA maturity Proceedings of the 32nd International Conference on Information Systems 2011 32nd International Conference on Information Systems December 4-7, 2011 Shanghai, China
  12. [79]Lee J Liu C Shang N Jiang X Chen K Kalluri KS Pang C Natarajan K Ryan P Weng C Generate the concept representation using OMOP ontology graph Observational Health Data Sciences and Informatics 2019 2021-04-02 https://www.ohdsi.org/2019-us-symposium-showcase-52/
  13. [83]Raber D Wortmann F Winter R Towards the measurement of business intelligence maturity Proceedings of the 21st European Conference on Information Systems 2013 21st European Conference on Information Systems Jun 6 - 8, 2013 Utrecht, Netherlands

Cited by

Sorted by citations

Authors
Pumplun, L., Fecho, M., Wahl, N., Peters, F., & Buxmann, P.
Affiliations
Technische Universität Darmstadt (DE)
Corresponding author
Pumplun, Luisa
Venue
Journal of Medical Internet Research
Published
2021-10-15
Volume
23
Issue
10
Pages
e29301
ISSN
1438-8871 (ISSN-L)
OpenAlex
W3207870808
Cited by
57
References
68
Citations by year
2026: 13 · 2025: 16 · 2024: 17 · 2023: 6 · 2022: 5
FWCI
2.02
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Journal of Medical Internet Research (publishedVersion, cc-by)
  • Europe PMC (PubMed Central) (publishedVersion, other-oa)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • RePEc: Research Papers in Economics (submittedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
  • TUbilio (Technical University of Darmstadt) (submittedVersion)
Funders
Bundesministerium für Bildung und Forschung
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Health Professions › Health Information Management › Electronic Health Records Systems
  • Health Sciences › Health Professions › Health Information Management › Artificial Intelligence in Healthcare
Keywords
machine learning adoption, medical diagnostics, clinics, technology adoption, maturity model, adoption framework, abandonment, scale-up, spreads, sustainability, health information technology, medical experts, adoption factors
MeSH terms
Machine Learning, COVID-19, SARS-CoV-2, Humans, Qualitative Research, Pandemics

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review