The DOI matches its Crossref record; 44 of the 44 references it cites were found in a registry or an index.
Measuring problem solving skills via stealth assessment in an engaging video game
Open accessAbstract
We used stealth assessment, embedded in a game called Use Your Brainz (a slightly modified version of Plants vs. Zombies 2), to measure middle-school students' problem solving skills. We began by developing a problem solving competency model based on a review of the relevant literature. We then identified in-game indicators that would provide evidence about students' levels on various problem-solving facets. Our problem solving model was then implemented in the game via Bayesian networks. To validate the stealth assessment, we collected data from students who played the game-based assessment for three hours and completed two external problem solving measures (i.e., Raven's Progressive Matrices and MicroDYN). Results indicated that the problem solving estimates derived from the game significantly correlated with the external measures, which suggests that our stealth assessment is valid. Our next steps include running a larger validation study and developing tools to help educators interpret the results of the assessment, which will subsequently support the development of problem solving skills. We embedded our problem solving competency model in an engaging game.We measured problem solving skills of students via stealth assessment.Two external measures were used for validation: Raven's matrices and MicroDYN.Significant correlations were found between stealth and external measures.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Handbook of educational psychology
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3084 · Cited by 4,825
Cognitive Psychology and Its Implications
Anderson, J. R. (2014) · Cited by 4,121
Toward a design theory of problem solving
Jonassen, D. H. (2000) · Educational Technology Research and Development · doi:10.1007/bf02300500 · Cited by 2,114
How to Solve It. A New Aspect of Mathematical Method.
Bell, E. T., & Polya, G. (1945) · The American Mathematical Monthly · doi:10.2307/2306109 · Cited by 1,806
Immersive Interfaces for Engagement and Learning
Dede, C. (2009) · Science · doi:10.1126/science.1167311 · Cited by 1,707
Robertson, S. I. (2001) · Cited by 1,650
Instructional design models for well-structured and III-structured problem-solving learning outcomes
Jonassen, D. H. (1997) · Educational Technology Research and Development · doi:10.1007/bf02299613 · Cited by 1,608
The Raven's Progressive Matrices: Change and Stability over Culture and Time
Raven, J. (2000) · Cognitive Psychology · doi:10.1006/cogp.1999.0735 · Cited by 1,560
Academically Adrift: Limited Learning on College Campuses
Arum, R., & Roksa, J. (2011) · Cited by 1,457
How to Solve It : A New Aspect of Mathematical Method
Pólya, G. (2014) · Cited by 1,416
Cited by
Review of computer‐based assessment for learning in elementary and secondary education
Shute, V. J., & Rahimi, S. (2017) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12172 · Cited by 282
Self-citationA Scoping Review of Digital Game-Based Technology on English Language Learning
Xu, Z., Chen, Z., Eutsler, L., Geng, Z., & Kogut, A. (2020) · Educational Technology Research and Development · doi:10.1007/s11423-019-09702-2 · Cited by 162
Artificial intelligence moving serious gaming: Presenting reusable game AI components
Westera, W., Prada, R., Mascarenhas, S., Santos, P. A., Dias, J., Guimarães, M., Georgiadis, K., Nyamsuren, E., Bahreini, K., Yumak, Z., et al. (2020) · Education and Information Technologies · doi:10.1007/s10639-019-09968-2 · Cited by 136
Sung, S. H., Li, C., Huang, X., & Xie, C. (2021) · Journal of Computer Assisted Learning · doi:10.1111/jcal.12600 · Cited by 35
Using machine learning to model trace behavioral data from a game‐based assessment
Auer, E. M., Mersy, G., Marin, S., Blaik, J., & Landers, R. N. (2022) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12363 · Cited by 24
Metadata
- Authors
- Shute, V. J., Wang, L., Greiff, S., Zhao, W., & Moore, G.
- Venue
- Computers in Human Behavior
- Publisher
- Elsevier BV
- Published
- 2016-10
- Volume
- 63
- Pages
- 106-117
- ISSN
- 0747-5632 (ISSN-L)
- OpenAlex
- W2398473626
- Cited by
- 271
- References
- 44
- FWCI
- 41.03
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Measuring problem solving skills via stealth assessment in an engaging video game. https://app.cochat.ai/papers/10.1016/j.chb.2016.05.047
- The paper
- Shute, V. J., Wang, L., Greiff, S., Zhao, W., & Moore, G. (2016). Measuring problem solving skills via stealth assessment in an engaging video game. Computers in Human Behavior. https://doi.org/10.1016/j.chb.2016.05.047
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.