Adaptive tutorials versus web-based resources in radiology: A mixed methods comparison of efficacy and student engagement
Open accessAbstract
Rationale and objectives Diagnostic imaging is under-represented in medical curricula globally. Adaptive tutorials, online intelligent tutoring systems that provide a personalized learning experience, have the potential to bridge this gap. However, there is limited evidence of their effectiveness for learning about diagnostic imaging.Materials and methods We performed a randomized mixed methods crossover trial to determine the impact of adaptive tutorials on perceived engagement and understanding of the appropriate use and interpretation of common diagnostic imaging investigations. Although concurrently engaged in disparate blocks of study, 99 volunteer medical students (from years 1-4 of the 6-year program) were randomly allocated to one of two groups. In the first arm of the trial on chest X-rays, one group received access to an adaptive tutorial, whereas the other received links to an existing peer-reviewed Web resource. These two groups crossed over in the second arm of the trial, which focused on computed tomography scans of the head, chest, and abdomen. At the conclusion of each arm of the trial, both groups completed an examination-style assessment, comprising questions both related and unrelated to the topics covered by the relevant adaptive tutorial. Online questionnaires were used to evaluate student perceptions of both learning resources.Results In both arms of the trial, the group using adaptive tutorials obtained significantly higher assessment scores than controls. This was because of higher assessment scores by senior students in the adaptive tutorial group when answering questions related to topics covered in those tutorials. Furthermore, students indicated significantly better engagement with adaptive tutorials than the Web resource and rated the tutorials as a significantly more valuable tool for learning.Conclusions Medical students overwhelmingly accept adaptive tutorials for diagnostic imaging. The tutorials significantly improve the understanding of diagnostic imaging by senior students.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Video-based feedback enhances understanding and retention.
“Video-based feedback has been shown to enhance understanding and retention, while adaptive tutorials that adjust content based on learners' responses increase engagement and comprehension [180,204].”
From Leveraging AI in E-Learning: Personalized Learning and Adaptive Assessment through Cognitive Neuropsychology—A Systematic Analysis (2024) · cites this paper as [204]
Adaptive tutorials that adjust content based on learners' responses increase engagement and comprehension.
“Video-based feedback has been shown to enhance understanding and retention, while adaptive tutorials that adjust content based on learners' responses increase engagement and comprehension [180,204].”
From Leveraging AI in E-Learning: Personalized Learning and Adaptive Assessment through Cognitive Neuropsychology—A Systematic Analysis (2024) · cites this paper as [204]
Cites
Kirschner, P. A., Sweller, J., & Clark, R. E. (2006) · Educational Psychologist · doi:10.1207/s15326985ep4102_1 · Cited by 6,887 · see citing works
The development and evaluation of a survey to measure user engagement
O'Brien, H. L., & Toms, E. G. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21229 · Cited by 794 · see citing works
Examining the generalizability of the User Engagement Scale (UES) in exploratory search
O'Brien, H. L., & Toms, E. G. (2012) · Information Processing & Management · doi:10.1016/j.ipm.2012.08.005 · Cited by 180 · see citing works
The Uncritical Use of High-Tech Medical Imaging
Hillman, B. J., & Goldsmith, J. (2010) · New England Journal of Medicine · doi:10.1056/nejmp1003173 · Cited by 147 · see citing works
Do Computers Teach Better? A Media Comparison Study for Case-based Teaching in Radiology
Maleck, M., Fischer, M. R., Kammer, B., Zeiler, C., Mangel, E., Schenk, F., & Pfeifer, K.-J. (2001) · Radiographics · doi:10.1148/radiographics.21.4.g01jl091025 · Cited by 90 · see citing works
Competency in chest radiography
Eisen, L. A., Berger, J. S., Hegde, A., et al. (2006) · Journal of General Internal Medicine · doi:10.1111/j.1525-1497.2006.00427.x · Cited by 89 · see citing works
E-learning and education in radiology
Pinto, A., Brunese, L., Pinto, F., Acampora, C., & Romano, L. (2011) · European Journal of Radiology · doi:10.1016/j.ejrad.2010.12.029 · Cited by 86 · see citing works
Howlett, D. C., Vincent, T. J., Watson, G. M. T., Owens, E., Webb, R., Gainsborough, N., Fairclough, J., Taylor, N., Miles, K. A., Cohen, J., et al. (2009) · European Journal of Radiology · doi:10.1016/j.ejrad.2009.07.028 · Cited by 68 · see citing works
Radiology curriculum for undergraduate medical studies—A consensus survey
Mirsadraee, S., Mankad, K., McCoubrie, P., et al. (2012) · Clinical Radiology · doi:10.1016/j.crad.2012.03.017 · Cited by 66 · see citing works
Pascual, T. N. B., Chhem, R. K., Wang, S., et al. (2010) · European Journal of Radiology · doi:10.1016/j.ejrad.2010.08.039 · Cited by 63 · see citing works
Educational Programs in US Medical Schools, 1998-1999
BARZANSKY, B. M. (1999) · JAMA · doi:10.1001/jama.282.9.840 · Cited by 54 · see citing works
Strategies for Incorporating Radiology into Early Medical School Curricula
Naeger, D. M., Webb, E. M., Zimmerman, L., & Elicker, B. M. (2013) · Journal of the American College of Radiology · doi:10.1016/j.jacr.2013.07.013 · Cited by 54 · see citing works
Examining the reliability of self-reported data on school participation
Baird, S., & Özler, B. (2011) · Journal of Development Economics · doi:10.1016/j.jdeveco.2011.05.006 · Cited by 49 · see citing works
Radiology in the undergraduate medical curriculum — Who, how, what, when, and where?
Bhogal, P., Booth, T. C., Phillips, A. J., & Golding, S. J. (2012) · Clinical Radiology · doi:10.1016/j.crad.2012.05.005 · Cited by 39 · see citing works
Radiology Curriculum Topics for Medical Students
Subramaniam, R. M., Beckley, V., Chan, M., et al. (2006) · Academic Radiology · doi:10.1016/j.acra.2006.02.034 · Cited by 38 · see citing works
COMET: A Collaborative Tutoring System for Medical Problem-Based Learning
Suebnukarn, S., & Haddawy, P. (2007) · IEEE Intelligent Systems · doi:10.1109/mis.2007.66 · Cited by 38 · see citing works
The development and evaluation of a survey to measure user engagement in e-commerce environments
O'Brien, H. L., & Toms, E. G. (2011) · cIRcle (University of British Columbia) · doi:10.14288/1.0107443 · Cited by 35 · see citing works
Halting the growth in diagnostic testing
Hammett, R. J. H., & Harris, R. D. (2002) · The Medical Journal of Australia · doi:10.5694/j.1326-5377.2002.tb04693.x · Cited by 34 · see citing works
A general architecture for intelligent tutoring of diagnostic classification problem solving.
Crowley, R. S., & Medvedeva, O. (2003) · PubMed · Cited by 33 · see citing works
Imaging for Whom: Patient or Physician?
Gottlieb, R. H. (2005) · American Journal of Roentgenology · doi:10.2214/ajr.05.0482 · Cited by 18 · see citing works
Adaptive Tutorials Using Virtual Slides to Enhance Learning of Microscopic Morphology
Velan, G. M., Ben-Naim, D., Kumar, R. K., et al. (2009) · E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education · Cited by 11 · see citing works
Self-citation
Flagged first, then by citations
Cited by
Sorted by citations
Halkiopoulos, C., & Gkintoni, E. (2024) · Electronics · doi:10.3390/electronics13183762 · Cited by 328 · see citing works
“Video-based feedback has been shown to enhance understanding and retention, while adaptive tutorials that adjust content based on learners’ responses increase engagement and comprehension [180,204].”
Fontaine, G., Cossette, S., Maheu-Cadotte, M.-A., Mailhot, T., Deschênes, M.-F., Mathieu-Dupuis, G., Côté, J., Gagnon, M.-P., & Dubé, V. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-025252 · Cited by 193 · see citing works
- Authors
- Wong, V., Smith, A. J., Hawkins, N. J., Kumar, R. K., Young, N., Kyaw, M., & Velan, G. M.
- Affiliations
- UNSW Sydney (AU)
- Westmead Hospital (AU)
- Corresponding author
- Velan, Gary M.
- ORCID
- Venue
- Academic Radiology
- Publisher
- Elsevier BV
- Published
- 2015-10
- Volume
- 22
- Issue
- 10
- Pages
- 1299-1307
- ISSN
- 1076-6332 (ISSN-L)
- OpenAlex
- W1923702955
- Cited by
- 55
- References
- 21
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 15 · 2023: 2 · 2022: 9 · 2021: 3 · 2020: 4 · 2019: 7 · 2018: 4 · 2017: 2 · 2016: 1 · 2015: 1
- FWCI
- 2.61
- Type
- journal article
- Language
- en
- Open access
- green
- hdl.handle.net
- Licence
- cc-by-nc-nd
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Locations
- Academic Radiology (publishedVersion)
- PubMed (publishedVersion)
- UNSWorks (University of New South Wales, Sydney, Australia) (submittedVersion, cc-by-nc-nd)
- UNSWorks (UNSW Sydney) (submittedVersion, cc-by-nc-nd)
- Funders
- University of New South Wales
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Innovations in Medical Education
- Health Sciences › Medicine › Radiology, Nuclear Medicine and Imaging › Radiology practices and education
- Keywords
- intelligent tutoring systems, medical imaging education, medical students, student engagement, chest radiography, computed tomography, web-based learning resources, personalized learning, radiology curriculum
- MeSH terms
- Clinical Competence, Computer-Assisted Instruction, Curriculum, Humans, Surveys and Questionnaires, Radiology, Cross-Over Studies, Problem-Based Learning, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review