CoChat
Sign Up
PreprintCited by 37Educational Games and GamificationFlow Experience in Various FieldsDigital Games and Media

Does gamification affect flow experience? A systematic literature review

Open access
Oliveira, Wilk, Pastushenko, Olena, Rodrigues, Luiz, Toda, Armando M., Palomino, Paula T., Hamari, Juho, Isotani, Seiji·2021·arXiv
DOI 10.48550/arxiv.2106.09942arXiv 2106.09942
Open this paper in CoChat — free accountOpen PDF

Abstract

In recent years, studies in different areas have used gamification to improve users' flow experience. However, due to the high variety of the conducted studies and the lack of secondary studies (e.g., systematic literature reviews) in this field, it is difficult to get the state-of-the-art of this research domain. To address this problem, we conducted a systematic literature review to identify i) which gamification design methods have been used in the studies about gamification and Flow Theory, ii) which gamification elements have been used in these studies, iii) which methods have been used to evaluate the users' flow experience in gamified settings, and iv) how gamification affects users' flow experience. The main results show that there is growing interest to this field, as the number of publications is increasing. The most significant interest is in the area of gamification in education. However, there is no unanimity regarding the preferred method of the study or the effects of gamification on users' experience. Our results highlight the importance of conducting new experimental studies investigating how gamification affects the users' flow experience in different gamified settings, applications and domains.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

DataCite · 10.48550/arxiv.2106.09942

Cites

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Gamified designs that balance difficulty and ability can help sustain motivation and foster a flow state.

    “Gamified designs that balance difficulty and ability can help sustain motivation and foster a flow state (Khoshnoodifar et al., 2023;Oliveira et al., 2021).”

    From Gamification on Mathematics Engagement and Motivation in Secondary School and Higher Education: A Systematic Review and Meta-Analysis (2026) · cites this paper as Oliveira et al., 2021

    The review’s RQ 4 discussion (p. 4) reports that a challenge-oriented gamification design positively affected flow in one study, while other studies found no significant effect. It does not establish that balancing difficulty with ability sustains motivation; the reported outcome was intention to continue use, not motivation. (LLM, conf=0.83)

    Experimental — accuracy not yet measured

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

No citation lists for this paper

No citation lists for this paper yet — checked again daily.

Cited by 37

Research works printed but not linked: 32

  1. [1][1] S. Deterding, D. Dixon, R. Khaled, L. Nacke, From game design elements to gamefulness: defining gamification, in: Proceedings of the 15th international academic MindTrek conference: Envisioning future media environments, ACM, 2011, pp. 9-15. -
  2. [2][2] S. Dreimane, Gamification for education: Review of current publications, in: Didactics of smart pedagogy, Springer, 2019, pp. 453-464. -
  3. [3][3] F. Noorbehbahani, F. Salehi, R. J. Zadeh, A systematic mapping study on gamification applied to e-marketing, Journal of Research in Interactive Marketing (2019). -
  4. [4][4] S. Muangsrinoon, P. Boonbrahm, Game elements from literature review of gamification in healthcare context., Journal of Technology and Science Education 9 (2019) 20-31. -
  5. [5][5] A. M. Toda, P. H. Valle, S. Isotani, The dark side of gamification: An overview of negative effects of gamification in education, in: Researcher Links Workshop: Higher Education for All, Springer, 2017, pp. 143-156. -
  6. [6][6] J. Koivisto, J. Hamari, The rise of motivational information systems: A review of gamification research, International Journal of Information Management 45 (2019) 191-210. -
  7. [7][7] W. Oliveira, A. Toda, P. Toledo, L. Shi, J. Vassileva, I. I. Bittencourt, S. Isotani, Does tailoring gamified educational systems matter? the impact on students' flow experience, Hawaii International Conference on System Sciences (2020). -
  8. [8][8] J. Hamari, J. Koivisto, H. Sarsa, Does gamification work?-a literature review of empirical studies on gamification, in: System Sciences (HICSS), 2014 47th Hawaii International Conference on System Sciences, IEEE, 2014, pp. 3025-3034. -
  9. [9][9] S. Bai, K. F. Hew, B. Huang, Is gamification 'bullshit'? evidence from a meta-analysis and synthesis of qualitative data in educational contexts, Educational Research Review (2020) 100322. -
  10. [11][11] M. Csikszentmihalyi, R. Larson, Validity and reliability of the experience-sampling method, in: Flow and the foundations of positive psychology, Springer, 2014, pp. 35-54. -
  11. [17][17] A. C. T. Klock, I. Gasparini, M. S. Pimenta, J. Hamari, Tailored gamification: A review of literature, International Journal of Human-Computer Studies 144 (2020) 102495. URL: http://www.sciencedirect.com/ science/article/pii/S1071581920300975. doi: https: //doi.org/10.1016/j.ijhcs.2020.102495 . - · DOI
  12. [19][19] W. Oliveira, I. I. Bittencourt, S. Isotani, D. Dermeval, L. B. Marques, I. F. Silveira, Flow theory to promote learning in educational systems: Is it really relevant?, Brazilian Journal of Computers in Education 26 (2018) 29. -
  13. [20][20] O. Pastushenko, W. Oliveira, S. Isotani, T. Hruška, A methodology for multimodal learning analytics and flow experience identification within gamified assignments, in: Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems, 2020, pp. 1-9. -
  14. [22][22] F. Palmas, J. Raith, et al., A novel approach to interactive dialogue generation based on natural language creation with context-free grammars and sentiment analysis, in: 2020 IEEE 20th International Conference on Advanced Learning Technologies (ICALT), IEEE, 2020, pp. 79-83. -
  15. [25][25] C.-K. Chan, H.-M. Leung, M.-W. Kung, Understanding the effect of gamification of learning using flow theory, in: Shaping the Future of Education, Communication and Technology, Springer, 2019, pp. 314. -
  16. [26][26] Y. Weng, T. Shen, S. Chen, B. Xiao, Gamification in local intangible cultural heritage museums for children: A case design, in: International Conference on Human-Computer Interaction, Springer, 2019, pp. 233-245. -
  17. [28][28] A. Ilhan, K. J. Fietkiewicz, Learning for a healthier lifestyle through gamification: a case study of fitness tracker applications, in: Perspectives on Wearable Enhanced Learning (WELL), Springer, 2019, pp. 333-364. -
  18. [29][29] A. Antonaci, D. Peter, R. Klemke, T. Bruysten, C. M. Stracke, M. Specht, gmoocs-flow and persuasion to gamify moocs, in: International Conference on Games and Learning Alliance, Springer, 2017, pp. 126-136. -
  19. [30][30] Y. Zhu, L. Pei, J. Shang, Improving video engagement by gamification: A proposed design of mooc videos, in: International Conference on Blended Learning, Springer, 2017, pp. 433-444. -
  20. [31][31] O. Korn, S. Tietz, Strategies for playful design when gamifying rehabilitation: a study on user experience, in: Proceedings of the 10th International Conference on PErvasive Technologies Related to Assistive Environments, 2017, pp. 209-214. -
  21. [32][32] L. A. Loos, M. E. Crosby, Gamification methods in higher education, in: International Conference on Learning and Collaboration Technologies, Springer, 2017, pp. 474-486. -
  22. [33][33] S. Roh, K. Seo, J. Lee, J. Kim, H. B. Ryu, C. Jung, H. Lee, J. Shin, Goal-based manufacturing gamification: bolt tightening work redesign in the automotive assembly line, in: Advances in ergonomics of manufacturing: managing the enterprise of the future, Springer, 2016, pp. 293-304. -
  23. [34][34] L. Shi, A. I. Cristea, S. Hadzidedic, N. Dervishalidovic, Contextual gamification of social interaction-towards increasing motivation in social e-learning, in: International Conference on Web-Based Learning, Springer, 2014, pp. 116-122. -
  24. [36][36] S. Sepehr, M. Head, Competition as an element of gamification for learning: an exploratory longitudinal investigation, in: Proceedings of the First International Conference on Gameful Design, Research, and Applications, 2013, pp. 2-9. -
  25. [37][37] C. S. Ikehara, M. E. Crosby, P. A. Silva, Combining augmented cognition and gamification, in: International Conference on Augmented Cognition, Springer, 2013, pp. 676-684. -
  26. [38][38] O. Korn, M. Brach, A. Schmidt, T. Hörz, R. Konrad, Context-sensitive user-centered scalability: an introduction focusing on exergames and assistive systems in work contexts, in: E-learning and games for training, education, health and sports, Springer, 2012, pp. 164-176. -
  27. [39][39] R. N. Landers, G. F. Tondello, D. L. Kappen, A. B. Collmus, E. D. Mekler, L. E. Nacke, Defining gameful experience as a psychological state caused by gameplay: Replacing the term 'gamefulness' with three distinct constructs, International Journal of Human-Computer Studies 127 (2019) 81-94. -
  28. [40][40] S. A. Jackson, R. C. Eklund, Assessing flow in physical activity: the flow state scale-2 and dispositional flow scale-2., Journal of sport & exercise psychology 24 (2002). -
  29. [44][44] R. Larson, M. Csikszentmihalyi, The experience sampling method, in: Flow and the foundations of positive psychology, Springer, 2014, pp. 21-34. -
  30. [45][45] A. Y. Mahfouz, Y. M. Guo, An overview of flow theory in ecommerce, 17th Americas Conference on Information Systems (2011). -
  31. [46][46] W. Oliveira, Towards automatic flow experience identification in educational systems: A humancomputer interaction approach, in: Extended Abstracts of the Annual Symposium on ComputerHuman Interaction in Play Companion Extended Abstracts, 2019, pp. 41-46. -
  32. [47][47] M. Jarnac de Freitas, M. Mira da Silva, Systematic literature review about gamification in moocs, Open Learning: The Journal of Open, Distance and e-Learning (2020) 1-23.

Authors
Oliveira, W., Pastushenko, O., Rodrigues, L., Toda, A. M., Palomino, P. T., Hamari, J., & Isotani, S.
ORCID
Venue
arXiv
Publisher
arXiv
Published
2021
Pages
110-119
ISSN
2331-8422 (ISSN-L)
DOI
10.48550/arxiv.2106.09942
arXiv
2106.09942
OpenAlex
W3174468424
Cited by
37
References
0
Citations by year
2026: 3 · 2025: 9 · 2024: 6 · 2023: 7 · 2022: 9 · 2021: 3
FWCI
1.35
Type
journal article
Language
en
Open access
Licence
creativecommons.org/licenses/by/4.0/legalcode
Locations
  • arXiv (Cornell University) (submittedVersion)
  • Tampere University Institutional Repository (Tampere University) (submittedVersion, cc-by)
  • arXiv (Cornell University) (cc-by)
Topics
  • Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
  • Social Sciences › Psychology › Developmental and Educational Psychology › Flow Experience in Various Fields
  • Social Sciences › Sociology and Political Science › Digital Games and Media
Keywords
gamification, flow experience, flow theory, game elements, user experience evaluation, gamified learning, user engagement

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review