Cited by 42Artificial Intelligence in Healthcare and EducationInnovations in Medical EducationBiomedical and Engineering Education

Putting undergraduate medical students in AI-CDSS designers’ shoes: An innovative teaching method to develop digital health critical thinking

Open access
Tsopra, Rosy, Peiffer-Smadja, Nathan, Charlier, Caroline, Campeotto, Florence, Lemogne, Cédric, Ruszniewski, Philippe, Vivien, Benoît, Burgun, Anita·2023·International Journal of Medical Informatics

Abstract

INTRODUCTION: Digital health programs are urgently needed to accelerate the adoption of Artificial Intelligence and Clinical Decision Support Systems (AI-CDSS) in clinical settings. However, such programs are still lacking for undergraduate medical students, and new approaches are required to prepare them for the arrival of new and unknown technologies. At University Paris Cité medical school, we designed an innovative program to develop the digital health critical thinking of undergraduate medical students that consisted of putting medical students in AI-CDSS designers' shoes. METHODS: We followed the six steps of Kern's approach for curriculum development: identification of needs, definition of objectives, design of an educational strategy, implementation, development of an assessment and design of program evaluation. RESULTS: A stand-alone and elective AI-CDSS program was implemented for fourth-year medical students. Each session was designed from an AI-CDSS designer viewpoint, with theoretical and practical teaching and brainstorming time on a project that consisted of designing an AI-CDSS in small groups. From 2021 to 2022, 15 students were enrolled: they rated the program 4.4/5, and 80% recommended it. Seventy-four percent considered that they had acquired new skills useful for clinical practice, and 66% felt more confident with technologies. The AI-CDSS program aroused great enthusiasm and strong engagement of students: 8 designed an AI-CDSS and wrote two scientific 5-page articles presented at the Medical Informatics Europe conference; 4 students were involved in a CDSS research project; 2 students asked for a hospital internship in digital health; and 1 decided to pursue PhD training. DISCUSSION: Putting students in AI-CDSS designers' shoes seemed to be a fruitful and innovative strategy to develop digital health skills and critical thinking toward AI technologies. We expect that such programs could help future doctors work in rapidly evolving digitalized environments and position themselves as key leaders in digital health.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.ijmedinf.2022.104980

Cites

54 of 54 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

3 of the 57 references couldn’t be matched to a known paper.

Research works printed but not linked: 4

  1. [20][20] [A.G. Pereira, M. Kim, M. Seywerd, B. Nesbitt, M.B. Pitt, Minnesota Epic101 Collaborative. Collaborating for Competency-A Model for Single Electronic Health Record Onboarding for Medical Students Rotating among Separate Health Systems. Appl Clin, Inform. 9 (1) (2018 Jan) 199 -204.](http://refhub.elsevier.com/S1386-5056(22)00294-5/h0100) -
  2. [26][26] [P.A. Thomas, D.E. Kern, M.T. Hughes, B.Y. Chen, Curriculum development for medical education: A six-step approach [Internet], Johns Hopkins University Press, 2015 [cited 2022 Feb 11]. Available from:.](http://refhub.elsevier.com/S1386-5056(22)00294-5/h0130) -
  3. [29][29] Berner ES. Clinical Decision Support Systems: Theory and Practice. 3rd ed. 2016 ´ edition. New York, NY: Springer International Publishing AG; 2016. 313 p. -
  4. [45][45] [L.G. McCoy, S. Nagaraj, F. Morgado, V. Harish, S. Das, L.A. Celi, What do medical students actually need to know about artificial intelligence? npj Digit Med. 3 (1) (2020 Jun 19) 1 -3.](http://refhub.elsevier.com/S1386-5056(22)00294-5/h0225) -

Cited by

Sorted by citations

Authors
Tsopra, R., Peiffer-Smadja, N., Charlier, C., Campeotto, F., Lemogne, C., Ruszniewski, P., Vivien, B., & Burgun, A.
Affiliations
  • Institut national de recherche en sciences et technologies du numérique (FR)
  • Inserm (FR)
  • Hôpital Necker-Enfants Malades (FR)
Corresponding author
Tsopra, Rosy
Venue
International Journal of Medical Informatics
Publisher
Elsevier BV
Published
2023-03
Volume
171
Pages
104980
ISSN
1386-5056 (ISSN-L)
OpenAlex
W4313410647
Cited by
42
References
57
Citations by year
2026: 10 · 2025: 16 · 2024: 10 · 2023: 6
FWCI
2.41
Type
journal article
Language
en
Open access
Locations
  • International Journal of Medical Informatics (publishedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • HAL (submittedVersion, cc-by-nc-nd)
Topics
  • Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
  • Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
  • Physical Sciences › Engineering › Biomedical Engineering › Biomedical and Engineering Education
Keywords
artificial intelligence, clinical decision support systems, digital health, undergraduate medical education, critical thinking, curriculum development, student engagement, medical informatics education
MeSH terms
Artificial Intelligence, Curriculum, Education, Medical, Undergraduate, Humans, Shoes, Students, Medical, Thinking

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review