CoChat

GameFlow 2020: 15 Years of a Model of Player Enjoyment

Sweetser, Penny · 2020 · 32nd Australian Conference on Human-Computer Interaction
Cited by 13

The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.

Abstract

The original GameFlow model was first published in 2005 and in the last 15 years it has seen thousands of citations and hundreds of applications to designing and evaluating games and gameful experiences. Previous work has sought to test and validate the model by applying it to different game experiences to further understand those experiences and to expose any weaknesses of the model. In this paper, we survey over 200 applications of GameFlow over the last 15 years, to understand how, where, and why the model has been applied. We found that the model has been applied to a diverse set of experiences, domains, platforms, audiences, and used in a variety of ways. This work lays the foundations for targeting the next version of the GameFlow model towards the most valuable and appropriate applications and to define how it fits within the broader landscape of player experience tools.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1145/3441000.3441048

Cites

42 of 42 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Research works printed but not linked: 23

  1. Saeed Amiri-Chimeh , Hassan Haghighi , Mojtaba Vahidi-Asl , Kamyar Setayesh-Ghajar , and Farshad Gholami-Ghavamabad . 2017 . Rings: A Game with a Purpose for Test Data Generation. Interacting with Computers 30, 1 (02 2017), 1–30. https://doi.org/10.1093/iwc/iww043 Saeed Amiri-Chimeh, Hassan Haghighi, Mojtaba Vahidi-Asl, Kamyar Setayesh-Ghajar, and Farshad Gholami-Ghavamabad. 2017. Rings: A Game with a Purpose for Test Data Generation. Interacting with Computers 30, 1 (02 2017), 1–30. https://doi.org/10.1093/iwc/iww043 · DOI
  2. Christine M. Bachen and Chad Raphael . 2011 . Social Flow and Learning in Digital Games:A Conceptual Model and Research Agenda. Springer London , London, 61–84. https://doi.org/10.1007/978-1-4471-2161-9_5 Christine M. Bachen and Chad Raphael. 2011. Social Flow and Learning in Digital Games:A Conceptual Model and Research Agenda. Springer London, London, 61–84. https://doi.org/10.1007/978-1-4471-2161-9_5 · DOI
  3. Ben Cowley , Darryl Charles , Michaela Black , and Ray Hickey . 2008. Toward an Understanding of Flow in Video Games. Comput. Entertain. 6, 2 , Article 20 (July 2008 ), 27 pages. https://doi.org/10.1145/1371216.1371223 Ben Cowley, Darryl Charles, Michaela Black, and Ray Hickey. 2008. Toward an Understanding of Flow in Video Games. Comput. Entertain. 6, 2, Article 20 (July 2008), 27 pages. https://doi.org/10.1145/1371216.1371223 · DOI · Paper page
  4. Mihaly Csikszentmihalyi . 1975. Beyond Boredom and Anxiety . Jossey-Bass Publishers , Washington . Mihaly Csikszentmihalyi. 1975. Beyond Boredom and Anxiety. Jossey-Bass Publishers, Washington.
  5. Mihaly Csikszentmihalyi . 1991 . Flow: The Psychology of Optimal Experience . Harper Perennial , New York . Mihaly Csikszentmihalyi. 1991. Flow: The Psychology of Optimal Experience. Harper Perennial, New York.
  6. Yvonne A. W. De Kort and Wijnand A. Ijsselsteijn . 2008. People, Places, and Play : Player Experience in a Socio-Spatial Context. Comput. Entertain. 6, 2 , Article 18 (July 2008 ), 11 pages. https://doi.org/10.1145/1371216.1371221 Yvonne A. W. De Kort and Wijnand A. Ijsselsteijn. 2008. People, Places, and Play: Player Experience in a Socio-Spatial Context. Comput. Entertain. 6, 2, Article 18 (July 2008), 11 pages. https://doi.org/10.1145/1371216.1371221 · DOI · Paper page
  7. Elena de la Guía , María Dolores Lozano , and Víctor M . R. Penichet. 2014. Increasing Engagement in Elderly People through Tangible and Distributed User Interfaces . In Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare ( Oldenburg, Germany) (PervasiveHealth ’14). ICST, Brussels, BEL, 390–393. https://doi.org/10.4108/icst.pervasivehealth. 2014 .255361 Elena de la Guía, María Dolores Lozano, and Víctor M. R. Penichet. 2014. Increasing Engagement in Elderly People through Tangible and Distributed User Interfaces. In Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare (Oldenburg, Germany) (PervasiveHealth ’14). ICST, Brussels, BEL, 390–393. https://doi.org/10.4108/icst.pervasivehealth.2014.255361 · doi:10.4108/icst.pervasivehealth
  8. Sha Ding , Ningjiu Tang , Tao Lin , and Shiyuan Zhao . 2009 . RTS-GameFlow: A New Evaluation Framework for RTS Games. In 2009 International Conference on Computational Intelligence and Software Engineering. 1–4. https://doi.org/10 .1109/CISE.2009.5363526 Sha Ding, Ningjiu Tang, Tao Lin, and Shiyuan Zhao. 2009. RTS-GameFlow: A New Evaluation Framework for RTS Games. In 2009 International Conference on Computational Intelligence and Software Engineering. 1–4. https://doi.org/10.1109/CISE.2009.5363526 · DOI
  9. W.A. I Jsselsteijn , Y.A.W. Kort , de, K. Poels , A. Jurgelionis , and F. Bellotti . 2007. Characterising and measuring user experiences in digital games . In Proceedings of the International Conference on Advances in Computer Entertainment Technology (ACE 2007) , June 13-15, 2007 , R. Bernhaupt and M. Tscheligi (Eds.). 1–4. W.A. IJsselsteijn, Y.A.W. Kort, de, K. Poels, A. Jurgelionis, and F. Bellotti. 2007. Characterising and measuring user experiences in digital games. In Proceedings of the International Conference on Advances in Computer Entertainment Technology (ACE 2007), June 13-15, 2007, R. Bernhaupt and M. Tscheligi (Eds.). 1–4.
  10. Kalle Jegers . 2009. Elaborating Eight Elements of Fun: Supporting Design of Pervasive Player Enjoyment. Comput. Entertain. 7, 2 , Article 25 (June 2009 ), 22 pages. https://doi.org/10.1145/1541895.1541905 Kalle Jegers. 2009. Elaborating Eight Elements of Fun: Supporting Design of Pervasive Player Enjoyment. Comput. Entertain. 7, 2, Article 25 (June 2009), 22 pages. https://doi.org/10.1145/1541895.1541905 · DOI
  11. Kornchulee Khanana and Effie L . -C. Law . 2013 . Designing Children’s Digital Games on Nutrition with Playability Heuristics. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (Paris, France) (CHI EA ’13). ACM, New York, NY, USA , 1071–1076. https://doi.org/10.1145/2468356.2468548 Kornchulee Khanana and Effie L.-C. Law. 2013. Designing Children’s Digital Games on Nutrition with Playability Heuristics. In CHI ’13 Extended Abstracts on Human Factors in Computing Systems (Paris, France) (CHI EA ’13). ACM, New York, NY, USA, 1071–1076. https://doi.org/10.1145/2468356.2468548 · doi:10.1145/2468356.2468548
  12. Hannu Korhonen , Markus Montola , and Juha Arrasvuori . 2009 . Understanding playful user experience through digital games . In International Conference on Designing Pleasurable Products and Interfaces, Vol. 2009 . Citeseer. Hannu Korhonen, Markus Montola, and Juha Arrasvuori. 2009. Understanding playful user experience through digital games. In International Conference on Designing Pleasurable Products and Interfaces, Vol. 2009. Citeseer.
  13. Ruo-Yu Li and Chang-Hwa Wang . 2020. Key factors and network model for location-based cultural mobile game design. British Journal of Educational Technology n/a, n/a ( 2020 ). https://doi.org/10.1111/bjet.12926 Ruo-Yu Li and Chang-Hwa Wang. 2020. Key factors and network model for location-based cultural mobile game design. British Journal of Educational Technology n/a, n/a (2020). https://doi.org/10.1111/bjet.12926 · DOI
  14. Andrew P. Macvean and Mark O. Riedl. 2011. An Enjoyment Metric for the Evaluation of Alternate Reality Games . In Proceedings of the 6th International Conference on Foundations of Digital Games ( Bordeaux, France) (FDG ’11). ACM, New York, NY, USA, 277–279. https://doi.org/10.1145/2159365.2159411 Andrew P. Macvean and Mark O. Riedl. 2011. An Enjoyment Metric for the Evaluation of Alternate Reality Games. In Proceedings of the 6th International Conference on Foundations of Digital Games (Bordeaux, France) (FDG ’11). ACM, New York, NY, USA, 277–279. https://doi.org/10.1145/2159365.2159411 · doi:10.1145/2159365.2159411
  15. Andrew P. Macvean and Mark O. Riedl. 2011. Evaluating Enjoyment within Alternate Reality Games . In Proceedings of the 2011 ACM SIGGRAPH Symposium on Video Games ( Vancouver, British Columbia, Canada) (Sandbox ’11). ACM, New York, NY, USA, 5–10. https://doi.org/10.1145/ 2018 556.2018558 Andrew P. Macvean and Mark O. Riedl. 2011. Evaluating Enjoyment within Alternate Reality Games. In Proceedings of the 2011 ACM SIGGRAPH Symposium on Video Games (Vancouver, British Columbia, Canada) (Sandbox ’11). ACM, New York, NY, USA, 5–10. https://doi.org/10.1145/2018556.2018558 · DOI
  16. Lisa Mörtsell . 2018. Should I stay or should I go? : Developing the Narrative model as a tool for game design. Master’s thesis . Umeå University , Department of Informatics. Lisa Mörtsell. 2018. Should I stay or should I go? : Developing the Narrative model as a tool for game design. Master’s thesis. Umeå University, Department of Informatics.
  17. Pia Niemelä , Tiina Partanen , Tero Toivanen , Tarmo Toikkanen , Vuokko Kangas , and Markus Översti . 2019. Code ABC Hackathons: Teachers as Tinkerers . In Digital Turn in Schools—Research, Policy, Practice, Terje Väljataga and Mart Laanpere (Eds.) . Springer Singapore , Singapore , 157–169. Pia Niemelä, Tiina Partanen, Tero Toivanen, Tarmo Toikkanen, Vuokko Kangas, and Markus Översti. 2019. Code ABC Hackathons: Teachers as Tinkerers. In Digital Turn in Schools—Research, Policy, Practice, Terje Väljataga and Mart Laanpere (Eds.). Springer Singapore, Singapore, 157–169.
  18. Dendi Permadi and Ahmad Rafi . 2016. Empirical Analysis of Mobile Augmented Reality Games for Engaging Users ’ Experience . In Intelligent and Evolutionary Systems, Kittichai Lavangnananda, Somnuk Phon-Amnuaisuk, Worrawat Engchuan, and Jonathan H. Chan (Eds.). Springer International Publishing , Cham , 343–355. Dendi Permadi and Ahmad Rafi. 2016. Empirical Analysis of Mobile Augmented Reality Games for Engaging Users’ Experience. In Intelligent and Evolutionary Systems, Kittichai Lavangnananda, Somnuk Phon-Amnuaisuk, Worrawat Engchuan, and Jonathan H. Chan (Eds.). Springer International Publishing, Cham, 343–355.
  19. Penny Sweetser and Daniel Johnson . 2019 . Evaluating the GameFlow Model with Different Stakeholders. In Extended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts ( Barcelona, Spain) (CHI PLAY ’19 Extended Abstracts). ACM, New York, NY, USA, 697–703. https://doi.org/10.1145/3341215.3356286 Penny Sweetser and Daniel Johnson. 2019. Evaluating the GameFlow Model with Different Stakeholders. In Extended Abstracts of the Annual Symposium on Computer-Human Interaction in Play Companion Extended Abstracts (Barcelona, Spain) (CHI PLAY ’19 Extended Abstracts). ACM, New York, NY, USA, 697–703. https://doi.org/10.1145/3341215.3356286 · DOI
  20. Penelope Sweetser , Daniel Johnson , and Peta Wyeth . 2013 . Revisiting the GameFlow Model with Detailed Heuristics . The Journal of Creative Technologies3 ( May 2013). https://ojs.aut.ac.nz/journal-of-creative-technologies/index.php/JCT/article/view/16 Penelope Sweetser, Daniel Johnson, and Peta Wyeth. 2013. Revisiting the GameFlow Model with Detailed Heuristics. The Journal of Creative Technologies3 (May 2013). https://ojs.aut.ac.nz/journal-of-creative-technologies/index.php/JCT/article/view/16
  21. Penelope Sweetser , Daniel Johnson , Peta Wyeth , Aiman Anwar , Yan Meng , and Anne Ozdowska . 2017. GameFlow in Different Game Genres and Platforms. Comput. Entertain. 15, 3 , Article 1 (April 2017 ), 24 pages. https://doi.org/10.1145/3034780 Penelope Sweetser, Daniel Johnson, Peta Wyeth, Aiman Anwar, Yan Meng, and Anne Ozdowska. 2017. GameFlow in Different Game Genres and Platforms. Comput. Entertain. 15, 3, Article 1 (April 2017), 24 pages. https://doi.org/10.1145/3034780 · DOI
  22. Penny Sweetser , Zane Rogalewicz , and Qingyang Li . 2019 . Understanding Enjoyment in VR Games with GameFlow. In 25th ACM Symposium on Virtual Reality Software and Technology (Parramatta, NSW, Australia) (VRST ’19) . ACM, New York, NY, USA, Article 96, 2 pages. https://doi.org/10.1145/3359996.3364800 Penny Sweetser, Zane Rogalewicz, and Qingyang Li. 2019. Understanding Enjoyment in VR Games with GameFlow. In 25th ACM Symposium on Virtual Reality Software and Technology (Parramatta, NSW, Australia) (VRST ’19). ACM, New York, NY, USA, Article 96, 2 pages. https://doi.org/10.1145/3359996.3364800 · DOI
  23. Jean Lee Tan , Dion Hoe-Lian Goh , Rebecca P Ang , and Vivien S Huan . 2010 . Usability and Playability Heuristics for Evaluation of an Instructional Game . In Proceedings of E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2010, Jaime Sanchez and Ke Zhang (Eds.). Association for the Advancement of Computing in Education (AACE), Orlando, Florida, USA, 363–373. https://www.learntechlib.org/p/35570 Jean Lee Tan, Dion Hoe-Lian Goh, Rebecca P Ang, and Vivien S Huan. 2010. Usability and Playability Heuristics for Evaluation of an Instructional Game. In Proceedings of E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education 2010, Jaime Sanchez and Ke Zhang (Eds.). Association for the Advancement of Computing in Education (AACE), Orlando, Florida, USA, 363–373. https://www.learntechlib.org/p/35570

Cited by

See all 13

Metadata

Authors
Sweetser, P.
Venue
32nd Australian Conference on Human-Computer Interaction
Publisher
ACM
Published
2020-12-02
Pages
705-711
Cited by
13
References
42

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.