The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index; 11 of the 18 sources its claims cite were checked for support.
Evolving Medical Students’ Digital Health Perceptions and Intentions: Insights From a Prepandemic and Postpandemic Survey Study
Open accessAbstract
Background: Digital health (dHealth) technologies, such as telehealth, artificial intelligence (AI), and mobile apps, are increasingly essential in medical practice. However, despite their growing significance, medical curricula often lack structured dHealth training, leaving students underprepared for digitally integrated health care environments. Objective: This study investigates the factors influencing medical students’ intentions to integrate dHealth technologies into their future practice and examines changes in their perceptions over time. Methods: We conducted a 2-phase survey at a large Canadian medical school to assess changes in perceptions before (N=184) and after (N=177) the COVID-19 pandemic. A mixed methods approach combined component-based structural equation modeling and fuzzy-set qualitative comparative analysis. The model was grounded in the technology acceptance model and Triandis’ theory of interpersonal behavior, examining constructs such as individual background, facilitating conditions, perceived usefulness, and beliefs about AI. Results: Across both phases, over 85% (306/361) of students agreed that dHealth education should be a mandatory component of medical training. Mean ratings for intention to use dHealth in future practice increased significantly between t 0 and t 1 for patient communication (3.4 to 4.2, P <.001), monitoring (3.3 to 4.0, P <.001), and diagnosis/treatment (3.6 to 4.2, P <.001). Experience with AI tools increased from 1.3 to 1.5 ( P <.001), and telehealth from 1.2 to 1.6 ( P <.001), while exposure to hospital IT systems and mobile apps remained unchanged. Results confirmed that perceived usefulness ( β =.37 at t 0 ; β =.34 at t 1 ) and beliefs about AI ( β =.39 at t 0 ; β =.27 at t 1 ) were strong predictors of intention to integrate dHealth ( P <.001). The explanatory power of the structural equation modeling model declined postpandemic ( R ²=0.53 at t 0 vs R ²=0.25 at t 1 ), suggesting increasing complexity in influencing factors. Fuzzy-set qualitative comparative analysis revealed multiple configurations leading to high intention, with consistency values exceeding 0.88 and overall solution coverage of 0.74 postpandemic. Core conditions across high-intention profiles included strong beliefs in the role of AI and perceived importance of dHealth education. Conversely, gender appeared as a recurring core condition in non–high-intention configurations, suggesting persistent disparities in dHealth adoption. Conclusions: The study advocates for the integration of formal dHealth training in medical curricula to better prepare future physicians for the demands of an increasingly digital health care landscape. While the COVID-19 pandemic may have contributed to shifting perceptions, other factors, such as recent AI advancements, likely played a role. These findings highlight the urgent need for medical education to adapt to the changing dHealth environment.
Overview
CoChat Summary
TL;DR
This two-phase survey at a large Canadian medical school found that medical students’ intentions to integrate digital health into future practice increased significantly from pre- to post-COVID-19, while perceived usefulness and beliefs about AI remained key predictors. The authors argue for formal digital health training in medical curricula, noting persistent gender-related disparities in non-high-intention profiles.
Key findings
- Across both phases, over 85% (306/361) of students agreed that digital health education should be mandatory in medical training.
- Mean intention to use digital health in future practice rose significantly from t0 to t1 for patient communication (3.4 to 4.2, P<.001), monitoring (3.3 to 4.0, P<.001), and diagnosis/treatment (3.6 to 4.2, P<.001).
- Experience with AI tools increased from 1.3 to 1.5 (P<.001) and telehealth from 1.2 to 1.6 (P<.001), while hospital IT systems and mobile apps remained unchanged.
- SEM confirmed perceived usefulness (β=.37 at t0; β=.34 at t1) and beliefs about AI (β=.39 at t0; β=.27 at t1) as strong predictors of intention (P<.001), but explanatory power declined postpandemic (R²=0.53 at t0 vs R²=0.25 at t1); fsQCA showed multiple high-intention configurations with consistency values exceeding 0.88 and overall solution coverage of 0.74 postpandemic, with gender recurring as a core condition in non-high-intention configurations.
Methods
- Two-phase survey at one large Canadian medical school: t0 in February 2020 before COVID-19 (N=184; 13% response rate) and t1 in May 2023 after COVID-19 (N=177; 12% response rate).
- Mixed methods combining component-based structural equation modeling (PLS-SEM in SmartPLS, bootstrapping 10,000 times) grounded in the technology acceptance model and Triandis’ theory of interpersonal behavior, plus fuzzy-set qualitative comparative analysis (fsQCA in R with raw consistency threshold 0.80, frequency threshold 3, and proportional reduction in inconsistency threshold 0.50).
- Questionnaire adapted from validated instruments, refined with a panel of 10 medical students, consisting of 70 five-point Likert questions and 8 yes/no items; no significant curriculum changes regarding digital health training occurred during the study.
Limitations
- Stated by the authors: the study was conducted at a single medical school with relatively low response rates, limiting generalizability; the model is based on only two theoretical foundations and omits factors such as social influence, effort expectancy, specialization choices, and prior clinical experience; content validity of the “Experimentation with dHealth technologies” and “Importance of dHealth in the medical curriculum” constructs could be improved with more specific items; fsQCA differences and persistent gender effects warrant further study.
- Evident from the text: the design uses self-administered, single-respondent surveys at two time points, which limits causal inference and may risk common method bias, although the authors tested for it and found no evidence; the sample was predominantly women (65% at t0 and 70% at t1 per Table 1), which may affect representativeness.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
6 Valid · 2 Not valid · 6 Not checked · 104 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Furthermore, previous research has typically examined isolated technologies (eg, AI in radiology [1415], EHRs [16], or telemedicine [17]) or local contexts (eg, studies conducted in Canada [14], the United Kingdom [15], Vietnam [18], or Finland [19]), offering fragmented insights into how students engage with dHealth more broadly.”
§ Evolving Medical Students’ Digital Health Perceptions and Intentions: Insights From a Prepandemic and Postpandemic Survey Study > Introduction > Background
What the sources say
- Supportedcites [17] Ghaddaripouri, Attitude, awareness, and knowledge of telemedicine among medical students: a systematic review of cross-sectional studies, Health Sci Rep source
The cited paper is a systematic review of medical students’ attitudes, awareness, and knowledge of telemedicine (Strengths and limitations; page not supplied). In the citing sentence, [17] is attached specifically to telemedicine as an example of a technology studied, not to the claims about other technologies or countries. (LLM, conf=0.93)
- Not matchedcites [1415]
Couldn’t be matched to a paper in Crossref, so it can’t be checked.
- Supportedcites [16] Welcher, Barriers to medical students’ electronic health record access can impede their preparedness for practice, Acad Med source
The citation here is offered only as an example of prior work on an 'isolated technology' (EHRs), not for the citing authors' broader synthesis about fragmentation across dHealth. Our copy plainly confines itself to that single technology: the Abstract states the authors 'explore medical students' current access to electronic health records (EHRs) as well as policy proposals from medical societies, innovative models implemented at some U.S. medical schools,' and the 'Students' Access to EHRs' section reports only LCME and Alliance for Clinical Education survey data on EHR access. No other digital-health technology is treated, so the source is what the citing sentence takes it to be. The 'fragmented insights' framing and the comparison with AI/telemedicine and non-U.S. settings belong to the citing authors, not to this paper. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
Every source the paper cites for this claim was checked and supports it.
In the paper
“Reliability coefficients were all above the minimum acceptable of 0.60 for exploratory research [42].”
§ Evolving Medical Students’ Digital Health Perceptions and Intentions: Insights From a Prepandemic and Postpandemic Survey Study > Results > Variance Perspective Results
What the sources say
- Supportedcites [42] Straub, Validation guidelines for IS positivist research, CAIS source
Vignette #7 (p. 23) states that Nunnally’s rule of thumb allows reliability values as low as .60 for exploratory research. The statement that the citing study’s coefficients were all above that threshold reports its own results, not a result attributed to this source. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources that could be checked couldn’t confirm or dispute this claim.
In the paper
“No existing questionnaire fully captured the variables included in our research model. Therefore, we adapted survey items from previously validated instruments in related contexts [17], modifying them to better align with our study’s focus.”
§ Evolving Medical Students’ Digital Health Perceptions and Intentions: Insights From a Prepandemic and Postpandemic Survey Study > Methods > Questionnaire Development
What the sources say
- Could not verifycites [17] Ghaddaripouri, Attitude, awareness, and knowledge of telemedicine among medical students: a systematic review of cross-sectional studies, Health Sci Rep sourceExperimental — accuracy not yet measured
The Results (Study characteristics; page unavailable) describe questionnaires used by the studies in this systematic review, and the Methods (Quality assessment; page unavailable) describe a checklist used to assess those studies. Neither passage addresses whether the citing authors adapted survey items from previously validated instruments; searches for adapted and validated questionnaires found no such passage. (LLM, conf=0.76)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Could not verify
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“While the extant literature recognizes the importance of equipping future clinicians with digital competencies [9-11], many medical schools have been slow to incorporate dHealth training into their formal curricula.”
§ Evolving Medical Students’ Digital Health Perceptions and Intentions: Insights From a Prepandemic and Postpandemic Survey Study > Introduction > Background
What the sources say
- Partly supportedcites [9] Cheng, An electronic medical record in pediatric medical education: survey of medical students’ expectations and experiences, Appl Clin Inform sourceExperimental — accuracy not yet measured
Cheng et al. (2018) speak only to EHRs, not dHealth broadly. Their Abstract records that 'among established EHRs there remains considerable interinstitution and interdepartment variability in medical student access and usage policies' and that 'there is a paucity of data directly evaluating medical students' beliefs about EHRs and their associated implications to aid in ongoing strategy and curricula development' — inconsistent, still-developing student EHR exposure rather than the claim that many schools have been slow to put digital-health training into formal curricula. The Methods-type description (Potential Benefits section) that at their single institution 'there were no specific workflows, order sets, or training materials or modules for students' is likewise one-site detail, not a survey of schools' curricula. No passage in our copy asserts slow curricular incorporation across many medical schools; that part of the claim is unsupported. (LLM, conf=0.65)
- Supportedcites [10] Herrmann-Werner, Navigating through electronic health records: survey study on medical students’ perspectives in general and with regard to a specific training, JMIR Med Inform source
The citation is attached to the importance of equipping future clinicians with digital competencies, not to the subsequent claim about slow curricular adoption. The Introduction says medical students need specific training in electronic health care systems, and the Discussion > Teaching calls EHR documentation a core competency requiring training. The paper does not establish that many schools have been slow to incorporate dHealth training, but that clause is not attributed to this citation. (LLM, conf=0.90)
- Partly supportedcites [11] Waseh, Telemedicine training in undergraduate medical education: mixed-methods review, JMIR Med Educ sourceExperimental — accuracy not yet measured
The Results (Trends in Geographic Distribution) describe states where few or no medical schools include telemedicine training, and the Discussion (The Current Landscape of Telemedicine Training) calls for faster incorporation into curricula. These passages support the point for telemedicine, but the source does not establish the same pattern for dHealth training more broadly. (LLM, conf=0.84)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Rather than attributing the improvement solely to the pandemic, it is likely that these shifts are part of a broader evolution in health care, driven by rapid technological advancements [44].”
§ Evolving Medical Students’ Digital Health Perceptions and Intentions: Insights From a Prepandemic and Postpandemic Survey Study > Discussion > Main Findings
What the sources say
- Partly supportedcites [44] Ringeval, Advancing health care with digital twins: meta-review of applications and implementation challenges, J Med Internet Res sourceExperimental — accuracy not yet measured
The Discussion’s Conclusions describe digital twins as a potentially transformative health care technology, supporting the broad point that technological advances may change care. The paper does not establish that the cited shifts in engagement are part of that evolution or compare technological change with the pandemic as an explanation (no page numbers are available in our copy). (LLM, conf=0.80)
hedgedstates a possible cause- Asserted: passes — The authors put it forward as true.
- Checkable: unclear — It is unclear whether it could be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
67 more claims · 1 with their cited sources checked
Create a free account to see all 118 claims and every source verdict.
- It may state two separate claims as one. 27
- The quote only partly states this claim. 4
- Probably not a substantial claim. 23
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Evolving Medical Students’ Digital Health Perceptions and Intentions: Insights From a Prepandemic and Postpandemic Survey Study > Results > Configurational Perspective Results
“After COVID, experimentation with dHealth technologies and apps had the highest consistency (0.697) and coverage (0.755).”
§ Evolving Medical Students’ Digital Health Perceptions and Intentions: Insights From a Prepandemic and Postpandemic Survey Study > Results > Configurational Perspective Results
“The role of AI maintained high consistency (0.789) and coverage (0.854)”
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
“The majority of participants were women, constituting 65% at t0 and increasing to 75% at t1.”
§ Evolving Medical Students’ Digital Health Perceptions and Intentions: Insights From a Prepandemic and Postpandemic Survey Study > Results > Demographic and Descriptive Statistics
Reported 75 · recomputed 70.056497
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Podsakoff, P. M., MacKenzie, S. B., Lee, J.-Y., & Podsakoff, N. P. (2003) · Journal of Applied Psychology · doi:10.1037/0021-9010.88.5.879 · Cited by 82,194
Perceived usefulness, perceived ease of use, and user acceptance of information technology
Davis, F. D. (1989) · MIS Quarterly · doi:10.2307/249008 · Cited by 68,483
Partial Least Squares Structural Equation Modeling (PLS-SEM) Using R: A Workbook
Hair, J. F., Hult, G. T. M., Ringle, C. M., Sarstedt, M., Danks, N. P., & Ray, S. (2021) · Classroom Companion: Business · doi:10.1007/978-3-030-80519-7 · Cited by 10,343
Venkatesh, V. (2000) · Information Systems Research · doi:10.1287/isre.11.4.342.11872 · Cited by 6,664
Building Better Causal Theories: A Fuzzy Set Approach to Typologies in Organization Research
Fiss, P. C. (2011) · Academy of Management Journal · doi:10.5465/amj.2011.60263120 · Cited by 5,930
Redesigning Social Inquiry: Fuzzy Sets and Beyond
Ragin, C. C. (2008) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226702797.001.0001 · Cited by 4,445
Configurational Comparative Methods: Qualitative Comparative Analysis (QCA) and Related Techniques
Rihoux, B., & Ragin, C. (2009) · SAGE Publications · doi:10.4135/9781452226569 · Cited by 3,089
Digital Transformation Strategies
Matt, C., Hess, T., & Benlian, A. (2015) · Business & Information Systems Engineering · doi:10.1007/s12599-015-0401-5 · Cited by 2,899
Validation Guidelines for IS Positivist Research
Straub, D., & Gefen, D. (2004) · Communications of the Association for Information Systems · doi:10.17705/1cais.01324 · Cited by 2,797
Research works printed but not linked: 2
- Triandis, Nebr Symp Motiv, 27
- Hair JF Hult GTM Ringle CM Sarstedt M Danks NP Ray S . Partial Least Squares Structural Equation Modeling (PLS-SEM) Using R. 2021. [doi: 10.1007/978-3-030-80519-7] · DOI · Paper page
Cited by
Ringeval, M., Raymond, L., & Paré, G. (2026) · BMC Medical Education · doi:10.1186/s12909-026-09432-z
“The development of medical students’ perspectives on dHealth technologies, in general, and AI technologies in particular, is a dynamic process, shaped by various factors such as curriculum content, and hands-on exposure to digital tools [9–11].”
Self-citationJohnson, D. J. (2026) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-026-00664-w
Reevaluating Clinical Exposure in Competency-Based Radiology Training: A Critical Appraisal
Xu, H., Liu, X., Wang, W., & An, P. (2025) · Academic Radiology · doi:10.1016/j.acra.2025.10.056
Metadata
- Authors
- Ringeval, M., Raymond, L., Pomey, M.-P., & Paré, G.
- Affiliations
- Bentley University (US)
- Université du Québec à Trois-Rivières (CA)
- Centre Hospitalier de l’Université de Montréal (CA)
- HEC Montréal (CA)
- Corresponding author
- Ringeval, Mickaël
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2025-09-03
- Volume
- 27
- Pages
- e64804-e64804
- ISSN
- 1438-8871 (ISSN-L)
- PMC
- PMC12407568
- OpenAlex
- W4412415421
- Cited by
- 4
- References
- 48
- Citations by year
- 2026: 3 · 2025: 1
- FWCI
- 0.95
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Journal of Medical Internet Research (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (publishedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Health Sciences › Medicine › Health Informatics › Artificial Intelligence in Healthcare and Education
- Social Sciences › Education › Innovations in Medical Education
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Telemedicine and Telehealth Implementation
- Keywords
- digital health, medical students, technology acceptance, telemedicine, artificial intelligence in healthcare, medical education, perceived usefulness, COVID-19 pandemic, technology acceptance model, gender differences, mobile health apps
- MeSH terms
- COVID-19, SARS-CoV-2, Digital Health, Adult, Artificial Intelligence, Attitude of Health Personnel, Canada, Female, Humans, Male, Surveys and Questionnaires, Students, Medical, Telemedicine, Intention, Young Adult, Pandemics, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-10, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-10 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol and qwen3.8-omni-flash).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Evolving Medical Students’ Digital Health Perceptions and Intentions: Insights From a Prepandemic and Postpandemic Survey Study. https://app.cochat.ai/papers/10.2196/64804
- The paper
- Ringeval, M., Raymond, L., Pomey, M.-P., & Paré, G. (2025). Evolving Medical Students’ Digital Health Perceptions and Intentions: Insights From a Prepandemic and Postpandemic Survey Study. Journal of Medical Internet Research. https://doi.org/10.2196/64804
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.