Quality Criteria for Serious Games: Serious Part, Game Part, and Balance
Open accessThe DOI matches its Crossref record; 12 of the 12 references it cites were found in a registry or an index.
Abstract
Serious games are digital games that have an additional goal beyond entertainment. Recently, many studies have explored different quality criteria for serious games, including effectiveness and attractiveness. Unfortunately, the double mission of serious games, that is, simultaneous achievement of intended effects (serious part) and entertainment (game part), is not adequately considered in these studies. This paper aims to identify essential quality criteria for serious games. The fundamental goal of our research is to identify important factors of serious games and to adapt the existing principles and requirements from game-related literature to effective and attractive serious games. In addition to the review of the relevant literature, we also include workshop results. Furthermore, we analyzed and summarized 22 state-of-the-art serious games for education and health. The selected best-practice serious games either prove their effectiveness through scientific studies or by winning game awards. For the analysis of these games, we refer to “DIN SPEC 91380 Serious Games Metadata Format.” A summarized text states quality criteria for both the serious and the game part, and especially the balance between them. We provide guidelines for high-quality serious games drawn from literature analysis and in close cooperation with domain experts.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The motivational pull of video games: a self-determination theory approach
Ryan, R. M., Rigby, C. S., & Przybylski, A. (2006) · Motivation and Emotion · doi:10.1007/s11031-006-9051-8 · Cited by 3,332
Slater, M., & Wilbur, S. (1997) · Presence: Teleoperators and Virtual Environments · doi:10.1162/pres.1997.6.6.603 · Cited by 3,034 · cited 1×
“Slater and Wilbur [94] describe immersion as the extent to which the computer system can deliver an illusion of a virtual environment to players.”
BackgroundMoher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
Sweetser (2005) · doi:10.1145/1077246.1077253 · Cited by 2,124
A meta-analysis of the cognitive and motivational effects of serious games.
Wouters, P., van Nimwegen, C., van Oostendorp, H., & van der Spek, E. D. (2013) · Journal of Educational Psychology · doi:10.1037/a0031311 · Cited by 1,864
Kato, P. M., Cole, S. W., Bradlyn, A. S., & Pollock, B. H. (2008) · Pediatrics · doi:10.1542/peds.2007-3134 · Cited by 802 · cited 3×
“Studies confirmed the effectiveness of the game in randomized controlled trials with cancer patients [6,7].”
BackgroundMethodLaamarti, F., Eid, M., & El Saddik, A. (2014) · International Journal of Computer Games Technology · doi:10.1155/2014/358152 · Cited by 671 · cited 3×
“…we provide a summary of games for health [3,4,6,7, 27-52 27-52 ] We use SG-MDF because it overcomes the limitations of the existing taxonomies [23-25] and covers crucial aspects of serious games, such as the characterizing goal and the quality (based on scientific studies, game awards,…”
BackgroundMethodHoffman, H. G., Chambers, G. T., Meyer, W. J., Arceneaux, L. L., Russell, W. J., Seibel, E. J., Richards, T. L., Sharar, S. R., & Patterson, D. R. (2011) · Annals of Behavioral Medicine · doi:10.1007/s12160-010-9248-7 · Cited by 599 · cited 1×
“For example, SnowWorld [50] successfully distracts players during rehabilitation (wound treatment) by immersing them in a virtual world.”
BackgroundSerious Games: Mechanisms and Effects
(2009) · doi:10.4324/9780203891650 · Cited by 505
Nouchi, R., Taki, Y., Takeuchi, H., Hashizume, H., Akitsuki, Y., Shigemune, Y., Sekiguchi, A., Kotozaki, Y., Tsukiura, T., Yomogida, Y., et al. (2012) · PLoS ONE · doi:10.1371/journal.pone.0029676 · Cited by 347
Cited by
The Use of Gamification in the Self-Management of Patients With Chronic Diseases: Scoping Review
Huang, X., Xiang, X., Liu, Y., Wang, Z., Jiang, Z., & Huang, L. (2023) · JMIR Serious Games · doi:10.2196/39019 · Cited by 53
“…specific practice is to integrate game design elements such as points, badges, leaderboards, and avatars into nongame contexts such as marketing [8] and classroom teaching [9] to realize “meaningful play,” that is, to achieve serious purposes other than entertainment in an interesting process [10].”
Background
Metadata
- Authors
- Caserman, P., Hoffmann, K., Müller, P., Schaub, M., Straßburg, K., Wiemeyer, J., Bruder, R., & Göbel, S.
- Venue
- JMIR Serious Games
- Publisher
- JMIR Publications Inc.
- Published
- 2020-07-24
- Volume
- 8
- Issue
- 3
- Pages
- e19037
- ISSN
- 2291-9279 (ISSN-L)
- OpenAlex
- W3029181362
- Cited by
- 237
- References
- 12
- FWCI
- 31.90
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.