An experimental study on the effects of a simulation game on students’ clinical cognitive skills and motivation
Open accessThe DOI matches its Crossref record; 47 of the 48 references it cites were found in a registry or an index.
Abstract
Simulation games are becoming increasingly popular in education, but more insight in their critical design features is needed. This study investigated the effects of fidelity of open patient cases in adjunct to an instructional e-module on students' cognitive skills and motivation. We set up a three-group randomized post-test-only design: a control group working on an e-module; a cases group, combining the e-module with low-fidelity text-based patient cases, and a game group, combining the e-module with a high-fidelity simulation game with the same cases. Participants completed questionnaires on cognitive load and motivation. After a 4-week study period, blinded assessors rated students' cognitive emergency care skills in two mannequin-based scenarios. In total 61 students participated and were assessed; 16 control group students, 20 cases students and 25 game students. Learning time was 2 h longer for the cases and game groups than for the control group. Acquired cognitive skills did not differ between groups. The game group experienced higher intrinsic and germane cognitive load than the cases group (p = 0.03 and 0.01) and felt more engaged (p < 0.001). Students did not profit from working on open cases (in adjunct to an e-module), which nonetheless challenged them to study longer. The e-module appeared to be very effective, while the high-fidelity game, although engaging, probably distracted students and impeded learning. Medical educators designing motivating and effective skills training for novices should align case complexity and fidelity with students' proficiency level. The relation between case-fidelity, motivation and skills development is an important field for further study.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“some results suggest that digital learning requires a good matching of expertise in the form of prior content domain knowledge, as has been shown in a study on a game-based simulation for medical training (Dankbaar et al., 2016)”
From Understanding Cognitive Load in Digital and Online Learning: a New Perspective on Extraneous Cognitive Load (2022) · cites this paper as Dankbaar et al., 2016
The cited source says what the claim attributes to it.
In the citing paper
“In that study, medical students did not learn more if they used a game-based simulation than using other methods such as case-based learning.”
From Understanding Cognitive Load in Digital and Online Learning: a New Perspective on Extraneous Cognitive Load (2022) · cites this paper as Dankbaar et al., 2016
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1999) · Cited by 12,812
Barry Issenberg, S., Mcgaghie, W. C., Petrusa, E. R., Lee Gordon, D., & Scalese, R. J. (2005) · Medical Teacher · doi:10.1080/01421590500046924 · Cited by 3,966 · cited 2×
“In contrast, the effectiveness of technology-enhanced simulation training, in comparison with no intervention, has been well established for knowledge and skills (Cook et al. 2011; Issenberg et al. 2005).”
BackgroundGames, Motivation, and Learning: A Research and Practice Model
Garris, R., Ahlers, R., & Driskell, J. E. (2002) · Simulation & Gaming · doi:10.1177/1046878102238607 · Cited by 3,201
A systematic literature review of empirical evidence on computer games and serious games
Connolly, T. M., Boyle, E. A., MacArthur, E., Hainey, T., & Boyle, J. M. (2012) · Computers & Education · doi:10.1016/j.compedu.2012.03.004 · Cited by 2,890
(2000) · Cited by 2,779
Streiner, D. L., & Norman, G. R. (2008) · doi:10.1093/acprof:oso/9780199231881.001.0001 · Cited by 2,631
Cognitive Load Measurement as a Means to Advance Cognitive Load Theory
Paas, F., Tuovinen, J. E., Tabbers, H., & Van Gerven, P. W. M. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_8 · Cited by 2,527
Cook, D. A., Hatala, R., Brydges, R., Zendejas, B., Szostek, J. H., Wang, A. T., Erwin, P. J., & Hamstra, S. J. (2011) · JAMA · doi:10.1001/jama.2011.1234 · Cited by 2,170
Kalyuga, S., Ayres, P., Chandler, P., & Sweller, J. (2003) · Educational Psychologist · doi:10.1207/s15326985ep3801_4 · Cited by 1,927
Internet-Based Learning in the Health Professions: A Meta-analysis
Cook, D. A., Levinson, A. J., Garside, S., Dupras, D. M., Erwin, P. J., & Montori, V. M. (2008) · JAMA · doi:10.1001/jama.300.10.1181 · Cited by 1,498
Digital game-based learning: Towards an experiential gaming model
Kiili, K. (2005) · The Internet and Higher Education · doi:10.1016/j.iheduc.2004.12.001 · Cited by 1,457 · cited 1×
“…simulation games (or digital games in general) apply game characteristics (players compete in attaining game objectives by following rules and principles) to create a challenging, immersive learning environment which may lead the player into a flow experience (Huang et al. 2010; Kiili 2005).”
BackgroundInfluentialCognitive load theory, educational research, and instructional design: some food for thought
de Jong, T. (2010) · Instructional Science · doi:10.1007/s11251-009-9110-0 · Cited by 1,180 · cited 1×
“An important theme is finding the right balance between stimulating germane processes while offering sufficient structure to avoid cognitive overload (de Jong 2010).”
BackgroundDevelopment of an instrument for measuring different types of cognitive load
Leppink, J., Paas, F., Van der Vleuten, C. P. M., Van Gog, T., & Van Merriënboer, J. J. G. (2013) · Behavior Research Methods · doi:10.3758/s13428-013-0334-1 · Cited by 1,066 · cited 1×
“Proper measurement of the different types of cognitive load can help understand why effectiveness may differ as a function of instructional formats and learner characteristics and how they may interact (Leppink et al. 2013).”
BackgroundA META‐ANALYTIC EXAMINATION OF THE INSTRUCTIONAL EFFECTIVENESS OF COMPUTER‐BASED SIMULATION GAMES
SITZMANN, T. (2011) · Personnel Psychology · doi:10.1111/j.1744-6570.2011.01190.x · Cited by 882
THE COMPARATIVE EFFECTIVENESS OF WEB‐BASED AND CLASSROOM INSTRUCTION: A META‐ANALYSIS
SITZMANN, T., KRAIGER, K., STEWART, D., & WISHER, R. (2006) · Personnel Psychology · doi:10.1111/j.1744-6570.2006.00049.x · Cited by 809
Our Princess Is in Another Castle: A Review of Trends in Serious Gaming for Education
Young, M. F., Slota, S., Cutter, A. B., Jalette, G., Mullin, G., Lai, B., Simeoni, Z., Tran, M., & Yukhymenko, M. (2012) · Review of Educational Research · doi:10.3102/0034654312436980 · Cited by 736
Cook, D. A., Hamstra, S. J., Brydges, R., Zendejas, B., Szostek, J. H., Wang, A. T., Erwin, P. J., & Hatala, R. (2013) · Medical Teacher · doi:10.3109/0142159x.2012.714886 · Cited by 709
Systematic review of serious games for medical education and surgical skills training
Graafland, M., Schraagen, J. M., & Schijven, M. P. (2012) · British Journal of Surgery · doi:10.1002/bjs.8819 · Cited by 676
Reconsidering Fidelity in Simulation-Based Training
Hamstra, S. J., Brydges, R., Hatala, R., Zendejas, B., & Cook, D. A. (2014) · Academic Medicine · doi:10.1097/acm.0000000000000130 · Cited by 624
The minimal relationship between simulation fidelity and transfer of learning
Norman, G., Dore, K., & Grierson, L. (2012) · Medical Education · doi:10.1111/j.1365-2923.2012.04243.x · Cited by 591
Ten Steps to Complex Learning: A Systematic Approach to Four-Component Instructional Design
van Merriënboer, J. J. G., Kirschner, P. A., & Frèrejean, J. (2024) · Research Publications (Maastricht University) · doi:10.4324/9781003322481 · Cited by 579
Computerized Virtual Patients in Health Professions Education: A Systematic Review and Meta-Analysis
Cook, D. A., Erwin, P. J., & Triola, M. M. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181edfe13 · Cited by 570
Effects of pairs of problems and examples on task performance and different types of cognitive load
Leppink, J., Paas, F., van Gog, T., van der Vleuten, C. P. M., & van Merriënboer, J. J. G. (2014) · Learning and Instruction · doi:10.1016/j.learninstruc.2013.12.001 · Cited by 520 · cited 1×
“…in terms of learning to (online) instruction with a demonstration video, is in line with research showing that studying worked examples is superior to solving training problems, attributed to the fact that examples allow for building a cognitive scheme (Leppink et al. 2014; Stark et al. 2011).”
BackgroundGrissom, R. J., & Kim, J. J. (2012) · doi:10.4324/9780203803233 · Cited by 470 · cited 1×
“Effect sizes (ES) were calculated using Glass’s delta, as homoscedasticity (same variance) is not assumed (Grissom and Kim 2012).”
MethodHojat, M., & Xu, G. (2004) · Advances in Health Sciences Education · doi:10.1023/b:ahse.0000038173.00909.f6 · Cited by 427
Evaluating Clinical Simulations for Learning Procedural Skills: A Theory-Based Approach
Kneebone, R. (2005) · Academic Medicine · doi:10.1097/00001888-200506000-00006 · Cited by 423 · cited 1×
“Although simulation training is becoming widely established within medical education, too little attention is often paid to its effects on motivation and the clinical context (Kneebone 2005).”
BackgroundPaas, F., Tuovinen, J. E., van Merriënboer, J. J. G., & Aubteen Darabi, A. (2005) · Educational Technology Research and Development · doi:10.1007/bf02504795 · Cited by 401 · cited 1×
“The role of motivation has increasingly been recognized and integrated in cognitive load theory (Paas et al. 2005).”
BackgroundA meta-analytic review of the role of instructional support in game-based learning
Wouters, P., & van Oostendorp, H. (2013) · Computers & Education · doi:10.1016/j.compedu.2012.07.018 · Cited by 381
Effect Sizes for Research: Univariate and Multivariate Applications
Grissom, R. J., & Kim, J. J. (2005) · Cited by 372
The evolution of cognitive load theory and its application to medical education
Leppink, J., & Van den Heuvel, A. (2015) · Perspectives on Medical Education · doi:10.1007/s40037-015-0192-x · Cited by 299 · cited 1×
“Learning task fidelity should only gradually increase as learners become more proficient (Leppink and van den Heuvel 2015).”
BackgroundHuang, W.-H., Huang, W.-Y., & Tschopp, J. (2010) · Computers & Education · doi:10.1016/j.compedu.2010.03.011 · Cited by 253
Computer Games for Learning: An Evidence-Based Approach
Mayer, R. E. (2014) · The MIT Press eBooks · doi:10.7551/mitpress/9427.001.0001 · Cited by 239
Akl, E. A., Pretorius, R. W., Sackett, K., Erdley, W. S., Bhoopathi, P. S., Alfarah, Z., & Schünemann, H. J. (2010) · Medical Teacher · doi:10.3109/01421590903473969 · Cited by 238
The use of clinical simulations in assessment
Schuwirth, L. W. T., & Van Der Vleuten, C. P. M. (2003) · Medical Education · doi:10.1046/j.1365-2923.37.s1.8.x · Cited by 204
Technology‐enhanced Simulation in Emergency Medicine: A Systematic Review and Meta‐Analysis
Ilgen, J. S., Sherbino, J., & Cook, D. A. (2013) · Academic Emergency Medicine · doi:10.1111/acem.12076 · Cited by 197
Research in medical education: three decades of progress
Norman, G. (2002) · BMJ · doi:10.1136/bmj.324.7353.1560 · Cited by 179
Coordinating Progressive Levels of Simulation Fidelity to Maximize Educational Benefit
Brydges, R., Carnahan, H., Rose, D., Rose, L., & Dubrowski, A. (2010) · Academic Medicine · doi:10.1097/acm.0b013e3181d7aabd · Cited by 167
Ten Steps to Complex Learning: A Systematic Approach to Four-Component Instructional Design
van Merriënboer, J. J. G., & Kirschner, P. A. (2012) · Routledge eBooks · doi:10.4324/9780203096864 · Cited by 157
Stark, R., Kopp, V., & Fischer, M. R. (2011) · Learning and Instruction · doi:10.1016/j.learninstruc.2009.10.001 · Cited by 154 · cited 1×
“…in terms of learning to (online) instruction with a demonstration video, is in line with research showing that studying worked examples is superior to solving training problems, attributed to the fact that examples allow for building a cognitive scheme (Leppink et al. 2014; Stark et al. 2011).”
BackgroundAssessment of Clinical Skills With Standardized Patients: State of the Art Revisited
Swanson, D. B., & van der Vleuten, C. P. M. (2013) · Teaching and Learning in Medicine · doi:10.1080/10401334.2013.842916 · Cited by 149
Computer Games for Learning: An Evidence-Based Approach
Mayer, R. E. (2014) · Cited by 143
Nousiainen, M. T., Brydges, R., Backstein, D. J., & Dubrowski, A. (2008) · Surgery · doi:10.1016/j.surg.2007.10.022 · Cited by 140
Does training learners on simulators benefit real patients?
Teteris, E., Fraser, K. L., Wright, B. J., & McLaughlin, K. (2011) · Advances in Health Sciences Education · doi:10.1007/s10459-011-9304-5 · Cited by 82
Baxter, P. E., Akhtar‐Danesh, N., Landeen, J., & Norman, G. R. (2012) · Nursing Education Perspectives · doi:10.5480/1536-5026-33.2.106 · Cited by 26
Assessing the Assessment in Emergency Care Training
Dankbaar, M. E. W., Stegers‐Jager, K. M., Baarveld, F., van Merriënboer, J. J. G., Norman, G. R., Rutten, F., van Saase, J. L. C. M., & Schuit, S. C. E. (2014) · PLoS ONE · doi:10.1371/journal.pone.0114663 · Cited by 22
Self-citationDurning, S. J., LaRochelle, J. S., Pangaro, L. N., Artino, A. R., Boulet, J. R., van der Vleuten, C. P. M., Hemmer, P. A., Denton, G. D., & Schuwirth, L. (2012) · Teaching and Learning in Medicine · doi:10.1080/10401334.2012.664991 · Cited by 20
Gaming as a training tool to train cognitive skills in Emergency Care: how effective is it?
Dankbaar, M. E. W., Roozeboom, M. B., Oprins, E. A. P. B., Rutten, F., van Saase, J., van Merriënboer, J. J. G., & Schuit, S. C. E. (2014) · Springer eBooks · doi:10.1007/978-3-658-07141-7_3 · Cited by 5
Self-citation
Research works printed but not linked: 2
- Johnson, L., Adams, B. S., Cummins, M., Estrada, V., Freeman, A., Ludgate, H. (2013). In T. new media Consortium (Ed.), Horizon report 2013 higher education edition (40 p). Austin, TX.
- Prensky, M. (2001). The digital game-based learning revolution (Vol. 1). New York: Mc Graw Hill.
Cited by
Simulation-Based Learning in Higher Education: A Meta-Analysis
Chernikova, O., Heitzmann, N., Stadler, M., Holzberger, D., Seidel, T., & Fischer, F. (2020) · Review of Educational Research · doi:10.3102/0034654320933544 · Cited by 1,072
“…the simulation environment, which suggested actions or allowed to revisit the conceptual level during the exploration of the simulation (e.g., Dankbaar et al., 2016; Kumar & Sherwood, 2007); another form of prompting are questions that may lead the learner to further actions (Alfred & Chung,…”
BackgroundThe effect of games and simulations on higher education: a systematic literature review
Vlachopoulos, D., & Makri, A. (2017) · International Journal of Educational Technology in Higher Education · doi:10.1186/s41239-017-0062-1 · Cited by 776
“…et al., 2012; Bellotti et al., 2013; Hannig et al., 2013; Ahmad et al., 2013; Pløhn, 2013; Li et al., 2013; Denholm et al., 2012; Dzeng et al., 2014; Lancaster, 2014; Ariffin et al., 2014; Bolliger et al., 2015; Cózar-Gutiérrez, & Sáez-López, 2016; Dankbaar et al., 2016; Fu et al., 2016).”
BackgroundSkulmowski, A., & Xu, K. M. (2022) · Educational Psychology Review · doi:10.1007/s10648-021-09624-7 · Cited by 678
Serious gaming and gamification education in health professions: systematic review
Gentry, S. V., Gauthier, A., L’Estrade Ehrstrom, B., Wortley, D., Lilienthal, A., Tudor Car, L., Dauwels-Okutsu, S., Nikolaou, C. K., Zary, N., Campbell, J., et al. (2019) · Journal of Medical Internet Research · doi:10.2196/12994 · Cited by 648
“Sixteen studies addressed participant satisfaction [15-17,19-22,26,27,29,32, 37,39,42,43,45].”
BackgroundInfluentialGamification of health professions education: a systematic review
van Gaalen, A. E. J., Brouwer, J., Schönrock-Adema, J., Bouwkamp-Timmer, T., Jaarsma, A. D. C., & Georgiadis, J. R. (2021) · Advances in Health Sciences Education · doi:10.1007/s10459-020-10000-3 · Cited by 625
Metadata
- Authors
- Dankbaar, M. E. W., Alsma, J., Jansen, E. E. H., van Merrienboer, J. J. G., van Saase, J. L. C. M., & Schuit, S. C. E.
- Affiliations
- Erasmus MC (NL)
- Corresponding author
- Dankbaar, Mary E. W.
- Venue
- Advances in Health Sciences Education
- Published
- 2015-10-03
- Volume
- 21
- Issue
- 3
- Pages
- 505-521
- ISSN
- 1382-4996 (ISSN-L)
- 1573-1677
- PMC
- PMC4923100
- OpenAlex
- W1852425754
- Cited by
- 147
- References
- 48
- Citations by year
- 2026: 6 · 2025: 13 · 2024: 22 · 2023: 16 · 2022: 23 · 2021: 16 · 2020: 19 · 2019: 13 · 2018: 9 · 2017: 7 · 2016: 3
- FWCI
- 4.67
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Locations
- Advances in Health Sciences Education (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Research Publications (Maastricht University) (publishedVersion, cc-by)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion, cc-by)
- EUR Research Repository (Erasmus University Rotterdam) (submittedVersion, other-oa)
- RePub (Erasmus University Rotterdam) (submittedVersion, other-oa)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion)
- Research Publications (Maastricht University) (submittedVersion, other-oa)
- Topics
- Social Sciences › Education › Simulation-Based Education in Healthcare
- Social Sciences › Education › Innovations in Medical Education
- Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
- Keywords
- simulation games, student motivation, emergency care skills, e-module, cognitive load, intrinsic cognitive load, germane cognitive load, student engagement, medical education, skill acquisition
- MeSH terms
- Clinical Competence, Cognition, Female, Games, Experimental, Humans, Male, Motivation, Students, Medical, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.


