Heuristic evaluation for games: usability principles for video game design
The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Most video games require constant interaction, so game designers must pay careful attention to usability issues. However, there are few formal methods for evaluating the usability of game interfaces. In this paper, we introduce a new set of heuristics that can be used to carry out usability inspections of video games. The heuristics were developed to help identify usability problems in both early and functional game prototypes. We developed the heuristics by analyzing PC game reviews from a popular gaming website, and the review set covered 108 different games and included 18 from each of 6 major game genres. We analyzed the reviews and identified twelve common classes of usability problems seen in games. We developed ten usability heuristics based on the problem categories, and they describe how common game usability problems can be avoided. A preliminary evaluation of the heuristics suggests that they help identify game-specific usability problems that can easily be overlooked otherwise.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nielsen, J. (1994) · Conference companion on Human factors in computing systems - CHI '94 · doi:10.1145/259963.260531 · Cited by 2,759
Nielsen, J. (1995) · Conference companion on Human factors in computing systems - CHI '95 · doi:10.1145/223355.223730 · Cited by 2,620
Enhancing the explanatory power of usability heuristics
Nielsen, J. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191729 · Cited by 1,439
Game Design Workshop: A Playcentric Approach to Creating Innovative Games
Fullerton, T. (2024) · A K Peters/CRC Press eBooks · doi:10.1201/9781003460268 · Cited by 1,093
Proceedings of Graphics Interface 2001
Watson, B. A., & Buchanan, J. W. (2001) · Cited by 1,025
Cognitive walkthroughs: a method for theory-based evaluation of user interfaces
Polson, P. G., Lewis, C., Rieman, J., & Wharton, C. (1992) · International Journal of Man-Machine Studies · doi:10.1016/0020-7373(92)90039-n · Cited by 797
Using heuristics to evaluate the playability of games
Desurvire, H., Caplan, M., & Toth, J. A. (2004) · CHI '04 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/985921.986102 · Cited by 643
User interface evaluation in the real world: a comparison of four techniques
Jeffries, R., Miller, J. R., Wharton, C., & Uyeda, K. (1991) · Proceedings of the SIGCHI conference on Human factors in computing systems Reaching through technology - CHI '91 · doi:10.1145/108844.108862 · Cited by 619
Testing a walkthrough methodology for theory-based design of walk-up-and-use interfaces
Lewis, C., Polson, P. G., Wharton, C., & Rieman, J. (1990) · Proceedings of the SIGCHI conference on Human factors in computing systems Empowering people - CHI '90 · doi:10.1145/97243.97279 · Cited by 559
Heuristics for designing enjoyable user interfaces: Lessons from computer games
Malone, T. W. (1982) · Proceedings of the 1982 conference on Human factors in computing systems - CHI '82 · doi:10.1145/800049.801756 · Cited by 454
HEURISTICS AND USABILITY GUIDELINES FOR THE CREATION AND EVALUATION OF FUN IN VIDEO GAMES
Federoff, M. (2002) · Cited by 448
TASK ANALYSIS AND TRAINING DESIGN.
Annett, J., & DUNCAN, K. D. (1967) · Cited by 329
Comparison of empirical testing and walkthrough methods in user interface evaluation
Karat, C.-M., Campbell, R., & Fiegel, T. (1992) · Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '92 · doi:10.1145/142750.142873 · Cited by 300
Heuristics for designing enjoyable user interfaces: lessons from computer games
Malone, T. W. (1984) · Ablex Publishing Corp. eBooks · Cited by 274
Game design workshop : designing, prototyping, and playtesting games
Fullerton, T., Swain, C., & Hoffman, S. J. (2004) · 기초학문자료센터(KRM) (Korea Research Foundation) · Cited by 258
Blain, I. (1971) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1971.tb00460.x · Cited by 242
Video game values: Human–computer interaction and games
Barr, P., Noble, J., & Biddle, R. (2007) · Interacting with Computers · doi:10.1016/j.intcom.2006.08.008 · Cited by 226
The pluralistic usability walkthrough: coordinated empathies
Bias, R. G. (1994) · John Wiley & Sons, Inc. eBooks · Cited by 124
Marrying HCI/Usability and computer games: a preliminary look
Jørgensen, A. H. (2004) · Nordic Conference on Human-Computer Interaction · doi:10.1145/1028014.1028078 · Cited by 115
Learning from Games: HCI Design Innovations in Entertainment Software
Dyck, J., Pinelle, D., Brown, B., & Gutwin, C. (2003) · Canadian Human-Computer Communications Society and A K Peters Ltd. · doi:10.20380/gi2003.28 · Cited by 111
Self-citationInterface-Walkthroughs: efficient collaborative testing
Bias, R. (1991) · IEEE Software · doi:10.1109/52.84220 · Cited by 83
Sale must end: should discount methods be cleared off HCI's shelves?
Cockton, G., & Woolrych, A. (2002) · Interactions · doi:10.1145/566981.566990 · Cited by 78
Research works printed but not linked: 17
- 10.1145/286498.286499 · doi:10.1145/286498.286499
- Dulin R. Review of Druuna: Morbus Gravis http://www.gamespot.com/pc/adventure/druunamorbusgravis/review.html 2002. Dulin R. Review of Druuna: Morbus Gravis http://www.gamespot.com/pc/adventure/druunamorbusgravis/review.html 2002.
- Entertainment Software Association , Essential Facts about the Computer and Video Game Industry 2007 , http://www.theesa.com/archives/2007/07/2007_essential.php. Entertainment Software Association, Essential Facts about the Computer and Video Game Industry 2007, http://www.theesa.com/archives/2007/07/2007_essential.php.
- Goble , G. Review of Rugby 2004 , http://www. gamespot.com/pc/sports/rugby2004/review.html, 2003. Goble, G. Review of Rugby 2004, http://www. gamespot.com/pc/sports/rugby2004/review.html, 2003.
- Johnson , C. G. , and Jones , G. J. F. , Effective Affective Communication in Virtual Environments. In Daniel Ballin (editor) , Second Workshop on Intelligent Virtual Agents , ( 1999 ), 135--138. Johnson, C. G., and Jones, G. J. F., Effective Affective Communication in Virtual Environments. In Daniel Ballin (editor), Second Workshop on Intelligent Virtual Agents, (1999), 135--138.
- Mueller G. Review of Eragon http://www.gamespot. com/pc/action/eragon/review.html 2006. Mueller G. Review of Eragon http://www.gamespot. com/pc/action/eragon/review.html 2006.
- Mueller G. Review of Mage Knight Apocalypse http://www.gamespot.com/pc/rpg/mageknightapocalypse/review.html 2006. Mueller G. Review of Mage Knight Apocalypse http://www.gamespot.com/pc/rpg/mageknightapocalypse/review.html 2006.
- Nielsen , J. How to Conduct a Heuristic Evaluation. www.useit.com/papers/heuristic/heuristic_evaluation.html , 2007 . Nielsen, J. How to Conduct a Heuristic Evaluation. www.useit.com/papers/heuristic/heuristic_evaluation.html, 2007.
- Ocampo J. Review of Vietcong 2 http://www. gamespot.com/pc/action/vietcong2/review.html 2005. Ocampo J. Review of Vietcong 2 http://www. gamespot.com/pc/action/vietcong2/review.html 2005.
- Parker S. Review of Pax Romana http://www. gamespot.com/pc/strategy/paxromana/review.html 2004. Parker S. Review of Pax Romana http://www. gamespot.com/pc/strategy/paxromana/review.html 2004.
- Shepherd , A. Analysis and training in information technology tasks. In Task Analysis for Human-Computer Interaction, Diaper, D ., Ed. Ellis Horwood , Chichester , ( 1989 ), 15--55. Shepherd, A. Analysis and training in information technology tasks. In Task Analysis for Human-Computer Interaction, Diaper, D., Ed. Ellis Horwood, Chichester, (1989), 15--55.
- Todd B. Review of Paradise Cracked http://www. gamespot.com/pc/rpg/paradisecracked/ review.html 2003. Todd B. Review of Paradise Cracked http://www. gamespot.com/pc/rpg/paradisecracked/ review.html 2003.
- Todd , B. Review of Total Extreme Wrestling 2004 , http://www.gamespot.com/pc/sports/totalextremewarfare/review.html, 2004. Todd, B. Review of Total Extreme Wrestling 2004, http://www.gamespot.com/pc/sports/totalextremewarfare/review.html, 2004.
- Todd B. Review of DMZ: North Korea http://www. gamespot.com/pc/action/dmznorthkorea/review.html 2007. Todd B. Review of DMZ: North Korea http://www. gamespot.com/pc/action/dmznorthkorea/review.html 2007.
- Todd B. Review of Genesis Rising: The Universal Crusade http://www.gamespot.com/pc/strategy/ genesisrising/review.html 2007. Todd B. Review of Genesis Rising: The Universal Crusade http://www.gamespot.com/pc/strategy/ genesisrising/review.html 2007.
- Todd B. Review of Secrets of the Ark: A Broken Sword Game http://www.gamespot.com/pc/adventure/ brokensword4/review.html 2007. Todd B. Review of Secrets of the Ark: A Broken Sword Game http://www.gamespot.com/pc/adventure/ brokensword4/review.html 2007.
- Wolpaw E. Review of Soldner: Secret Wars http://www.gamespot.com/pc/action/soldnersecretwars/review.html 2004. Wolpaw E. Review of Soldner: Secret Wars http://www.gamespot.com/pc/action/soldnersecretwars/review.html 2004.
Cited by
The Development and Validation of the Game User Experience Satisfaction Scale (GUESS)
Phan, M. H., Keebler, J. R., & Chaparro, B. S. (2016) · Human Factors: The Journal of the Human Factors and Ergonomics Society · doi:10.1177/0018720816669646 · Cited by 342
Laine, T. H., & Lindberg, R. S. N. (2020) · IEEE Transactions on Learning Technologies · doi:10.1109/tlt.2020.3018503 · Cited by 260
Kim, K., Schmierbach, M. G., Bellur, S. (., Chung, M.-Y., Fraustino, J. D., Dardis, F., & Ahern, L. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.02.011 · Cited by 185
Generating Automatic Feedback on UI Mockups with Large Language Models
Duan, P., Warner, J., Li, Y., & Hartmann, B. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642782 · Cited by 83
“While initially designed for desktop interfaces, other work has adapted heuristic evaluation to more devices and domains [9, 31, 33, 47].”
Silva, P. A., Holden, K., & Jordan, P. (2015) · 2015 48th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2015.390 · Cited by 66
Metadata
- Authors
- Pinelle, D., Wong, N., & Stach, T.
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2008-04-06
- Pages
- 1453-1462
- OpenAlex
- W2160510495
- Cited by
- 418
- References
- 22
- FWCI
- 19.84
- Type
- conference paper
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.