Toward Meaningful Engagement: A Framework for Design and Research of Gamified Information Systems1

Liu, De; Santhanam, Radhika; Webster, Jane

doi:10.25300/misq/2017/41.4.01

Cited by 521Educational Games and GamificationTechnology Adoption and User BehaviourInnovative Human-Technology Interaction

Toward Meaningful Engagement: A Framework for Design and Research of Gamified Information Systems1

Liu, De, Santhanam, Radhika, Webster, Jane·2017·MIS Quarterly

DOI 10.25300/misq/2017/41.4.01

Open this paper in CoChat — free account

Abstract

Gamification, an emerging idea for using game design elements and principles to make everyday tasks more engaging, is permeating many different types of information systems. Excitement surrounding gamification results from its many potential organizational benefits. However, few research and design guidelines exist regarding gamified information systems. We therefore write this commentary to call upon information systems scholars to investigate the design and use of gamified information systems from a variety of disciplinary perspectives and theories, including behavioral economics, psychology, social psychology, information systems, etc. We first explicate the idea of gamified information systems, provide real-world examples of successful and unsuccessful systems, and, based on a synthesis of the available literature, present a taxonomy of gamification design elements. We then develop a framework for research and design: its main theme is to create meaningful engagement for users; that is, gamified information systems should be designed to address the dual goals of instrumental and experiential outcomes. Using this framework, we develop a set of design principles and research questions, using a running case to illustrate some of our ideas. We conclude with a summary of opportunities for IS researchers to extend our knowledge of gamified information systems, and, at the same time, advance existing theories.

Integrity signals

Registry

Crossref · 10.25300/misq/2017/41.4.01

Cites

148 of 148 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Due to absent or insufficient motivation strategies such as interactivity, proper incentives and rewards, and experiential value, the effects of digital interventions in asthma are prone to be negatively affected by the temporal decline in patients' engagement and motivation.
“Additionally, due to absent or insufficient motivation strategies such as interactivity, proper incentives and rewards [48], and experiential value [49-51], the effects of the previously reported digital interventions in asthma, such as the health condition of the young patients, are prone to be negatively affected by the temporal decline in the patients’ engagement and motivation [10,52-54].”
From Conversational Agents as Mediating Social Actors in Chronic Disease Management Involving Health Care Professionals, Patients, and Family Members: Multisite Single-Arm Feasibility Study (2021) · cites this paper as [51]
The design of MAX was driven by an interdisciplinary effort that resulted in a conceptual model with intervention components informed by human behavior and experiential learning theories, findings from technology acceptance research, and prior experiences of the authors with conversational agents.
“The design of MAX was driven by an interdisciplinary effort that resulted in a conceptual model with intervention components informed by human behavior and experiential learning theories [61,65,66], findings from technology acceptance research [49,51,58,102], and prior experiences of the authors with conversational agents that support health care professionals and young adolescent patients [67,68]”
From Conversational Agents as Mediating Social Actors in Chronic Disease Management Involving Health Care Professionals, Patients, and Family Members: Multisite Single-Arm Feasibility Study (2021) · cites this paper as [51]

Prospect Theory: An Analysis of Decision under Risk
Kahneman, D., & Tversky, A. (1979) · Econometrica · doi:10.2307/1914185 · Cited by 48,524 · see citing works
The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior
Deci, E. L., & Ryan, R. M. (2000) · Psychological Inquiry · doi:10.1207/s15327965pli1104_01 · Cited by 34,210 · see citing works
Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being.
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 27,815 · see citing works
Intrinsic Motivation and Self-Determination in Human Behavior
Deci, E. L., & Ryan, R. M. (1985) · doi:10.1007/978-1-4899-2271-7 · Cited by 26,772 · see citing works
A theory of social comparison processes
Festinger, L. (1954) · Human Relations · doi:10.1177/001872675400700202 · Cited by 20,926 · see citing works
Social Cognitive Theory: An Agentic Perspective
Bandura, A. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.1 · Cited by 15,510 · see citing works
Intrinsic Motivation and Self-Determination in Human Behavior
Miller, K. A. J., Deci, E. L., & Ryan, R. M. (1988) · Contemporary Sociology A Journal of Reviews · doi:10.2307/2070638 · Cited by 15,361 · see citing works
The DeLone and McLean Model of Information Systems Success: A Ten-Year Update
(2003) · Journal of Management Information Systems · doi:10.1080/07421222.2003.11045748 · Cited by 11,791 · see citing works
Design Science in Information Systems Research1
Hevner, A. R., March, S. T., Park, J., & Ram, S. (2004) · MIS Quarterly · doi:10.2307/25148625 · Cited by 10,707 · cited 1× · see citing works
“Particularly, the design and evaluation of IT artifacts, a key paradigm for IS research, is receiving more attention as we better understand ways to conduct and publish such research (Goes 2014; Gregor and Hevner 2013; Hevner et al. 2004).”
Background
Motivation through the design of work: test of a theory
Hackman, J. R., & Oldham, G. R. (1976) · Organizational Behavior and Human Performance · doi:10.1016/0030-5073(76)90016-7 · Cited by 8,962 · see citing works
From game design elements to gamefulness: defining "gamification"
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011) · Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments · doi:10.1145/2181037.2181040 · Cited by 8,402 · see citing works
Design science in information systems research
(2004) · Journal of the Association for Information Systems · doi:10.5555/2017212.2017217 · Cited by 8,254 · see citing works
Moral Hazard and Observability
Holmstrom, B. R. (1979) · The Bell Journal of Economics · doi:10.2307/3003320 · Cited by 8,159 · see citing works
Computer Self-Efficacy: Development of a Measure and Initial Test
Compeau, D. R., & Higgins, C. A. (1995) · MIS Quarterly · doi:10.2307/249688 · Cited by 6,553 · see citing works
Golden eggs and hyperbolic discounting
Laibson, D. (1997) · The Quarterly Journal of Economics · doi:10.1162/003355397555253 · Cited by 6,122 · see citing works
Social Influence: Compliance and Conformity
Cialdini, R. B., & Goldstein, N. J. (2004) · Annual Review of Psychology · doi:10.1146/annurev.psych.55.090902.142015 · Cited by 6,077 · see citing works
Multitask principal – agent analyses: Incentive contracts, asset ownership, and job design
Holmstrom, B., & Milgrom, P. (1991) · The Journal of Law, Economics, and Organization · doi:10.1093/jleo/7.special_issue.24 · Cited by 6,046 · see citing works
Task-Technology Fit and Individual Performance
Goodhue, D. L., & Thompson, R. L. (1995) · MIS Quarterly · doi:10.2307/249689 · Cited by 6,006 · see citing works
Beyond boredom and anxiety
Csíkszentmihályi, M. (1975) · Cited by 5,690 · see citing works
Maps of Bounded Rationality: Psychology for Behavioral Economics
Kahneman, D. (2003) · American Economic Review · doi:10.1257/000282803322655392 · Cited by 5,377 · see citing works
Does Gamification Work? -- A Literature Review of Empirical Studies on Gamification
Hamari, J., Koivisto, J., & Sarsa, H. (2014) · 2014 47th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2014.377 · Cited by 5,201 · see citing works
Time Flies When You’re Having Fun: Cognitive Absorption and Beliefs About Information Technology Usage1
Agarwal, R., & Karahanna, E. (2000) · MIS Quarterly · doi:10.2307/3250951 · Cited by 4,726 · see citing works
Handbook of Self-Determination Research
Deci, E. L., & Ryan, R. M. (2004) · Cited by 4,528 · see citing works
Motivation in the classroom: Reciprocal effects of teacher behavior and student engagement across the school year.
Skinner, E. A., & Belmont, M. J. (1993) · Journal of Educational Psychology · doi:10.1037/0022-0663.85.4.571 · Cited by 3,428 · see citing works
Incentives and Prosocial Behavior
Bénabou, R., & Tirole, J. (2006) · American Economic Review · doi:10.1257/aer.96.5.1652 · Cited by 3,357 · see citing works
Games, Motivation, and Learning: A Research and Practice Model
Garris, R. D., Ahlers, R. H., & Driskell, J. E. (2002) · Simulation & Gaming · doi:10.1177/1046878102238607 · Cited by 3,257 · see citing works
Positioning and Presenting Design Science Research for Maximum Impact1
Gregor, S. D., & Hevner, A. R. (2013) · MIS Quarterly · doi:10.25300/misq/2013/37.2.01 · Cited by 3,154 · see citing works
A Focus Theory of Normative Conduct: A Theoretical Refinement and Reevaluation of the Role of Norms in Human Behavior
Cialdini, R. B., Kallgren, C. A., & Reno, R. R. (1991) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60330-5 · Cited by 3,143 · see citing works
Doing It Now or Later
O’Donoghue, T., & Rabin, M. (1999) · American Economic Review · doi:10.1257/aer.89.1.103 · Cited by 3,055 · see citing works
Motivations for Play in Online Games
Yee, N. (2006) · CyberPsychology & Behavior · doi:10.1089/cpb.2006.9.772 · Cited by 2,939 · see citing works
Reality is Broken Why Games Make Us Better and How They Can Change the World
(2012) · Choice Reviews Online · doi:10.5860/choice.49-6095 · Cited by 2,933 · see citing works
Intrinsic and extrinsic motivation
Benabou, R., & Tirole, J. (2003) · Review of Economic Studies · doi:10.1111/1467-937x.00253 · Cited by 2,913 · see citing works
The psychology of curiosity: A review and reinterpretation.
Loewenstein, G. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.116.1.75 · Cited by 2,738 · cited 2× · see citing works
“In gamification design, many questions can be asked regarding narratives: How should we create narratives to enhance user experiences? Should the user be made part of a story line? Should fantasy elements be present? Research on narrative theory and curiosity could help address these questions (Loewenstein 1994).”
Background
Sense of relatedness as a factor in children's academic engagement and performance.
Furrer, C. J., & Skinner, E. A. (2003) · Journal of Educational Psychology · doi:10.1037/0022-0663.95.1.148 · Cited by 2,730 · see citing works
Gamification in theory and action: a survey
Seaborn, K., & Fels, D. I. (2015) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2014.09.006 · Cited by 2,515 · see citing works
Message Equivocality, Media Selection, and Manager Performance: Implications for Information Systems
Daft, R. L., Lengel, R. H., & Treviño, L. K. (1987) · MIS Quarterly · doi:10.2307/248682 · Cited by 2,322 · see citing works
Gender Differences in the Perception and Use of E-Mail: An Extension to the Technology Acceptance Model1
Gefen, D., & Straub, D. W. (1997) · MIS Quarterly · doi:10.2307/249720 · Cited by 2,242 · see citing works
Toward a Theory of Intrinsically Motivating Instruction*
Malone, T. W. (1981) · Cognitive Science · doi:10.1207/s15516709cog0504_2 · Cited by 2,197 · see citing works
The Effect of On-Line Consumer Reviews on Consumer Purchasing Intention: The Moderating Role of Involvement
Park, D.-H., Lee, J., & Han, I. (2007) · International Journal of Electronic Commerce · doi:10.2753/jec1086-4415110405 · Cited by 2,186 · see citing works
Are Individual Differences Germane to the Acceptance of New Information Technologies?
Agarwal, R., & Prasad, J. (1999) · Decision Sciences · doi:10.1111/j.1540-5915.1999.tb01614.x · Cited by 2,107 · see citing works
Motivation and cognitive abilities: An integrative/aptitude-treatment interaction approach to skill acquisition.
Kanfer, R., & Ackerman, P. L. (1989) · Journal of Applied Psychology · doi:10.1037/0021-9010.74.4.657 · Cited by 2,084 · see citing works
An Analysis of the Principal-Agent Problem
Grossman, S. J., & Hart, O. (1983) · Econometrica · doi:10.2307/1912246 · Cited by 2,070 · see citing works
An Analysis of the Principal-Agent Problem
Grossman, S. J., & Hart, O. (1992) · Hübner international series on risk, insurance, and economic security · doi:10.1007/978-94-015-7957-5_16 · Cited by 1,933 · see citing works
The Adaptive Web, Methods and Strategies of Web Personalization
Brusilovsky, P., Kobsa, A., & Nejdl, W. (2007) · The Adaptive Web · doi:10.1007/978-3-540-72079-9 · Cited by 1,776 · see citing works
Doing Good or Doing Well? Image Motivation and Monetary Incentives in Behaving Prosocially
Ariely, D., Bracha, A., & Meier, S. (2009) · American Economic Review · doi:10.1257/aer.99.1.544 · Cited by 1,753 · see citing works
Model of Adoption of Technology in Households: A Baseline Model Test and Extension Incorporating Household Life Cycle1
Brown, S. A., & Venkatesh, V. (2005) · MIS Quarterly · doi:10.2307/25148690 · Cited by 1,615 · see citing works
Group norms and the attitude-behavior relationship: A role for group identification
Terry, D. J., & Hogg, M. A. (1996) · Personality and Social Psychology Bulletin · doi:10.1177/0146167296228002 · Cited by 1,444 · see citing works
Narrative Processing: Building Consumer Connections to Brands
Escalas, J. E. (2004) · Journal of Consumer Psychology · doi:10.1207/s15327663jcp1401&2_19 · Cited by 1,398 · see citing works
Task complexity: Definition of the construct
Wood, R. E. (1986) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(86)90044-0 · Cited by 1,393 · see citing works
The Effects of Personalization and Familiarity on Trust and Adoption of Recommendation Agents1
Komiak, S. Y. X., & Benbasat, I. (2006) · MIS Quarterly · doi:10.2307/25148760 · Cited by 1,374 · see citing works
The theory of contracts
Hart, O., & Holmstrom, B. R. (1987) · Cambridge University Press eBooks · doi:10.1017/ccol0521340446.003 · Cited by 1,356 · see citing works
Psychological foundations of incentives
Fehr, E., & Falk, A. (2002) · European Economic Review · doi:10.1016/s0014-2921(01)00208-2 · Cited by 1,240 · cited 2× · see citing works
“By contrast, the literature on intrinsic motivation theory focuses more on the use of nonpecuniary motivations, such as the need for challenge, stimulation, self-determination, and social image, in schools and voluntary contexts (although there is considerable research on job design and work engagement) (Fehr and Falk…”
Background
Understanding User Evaluations of Information Systems
Goodhue, D. L. (1995) · Management Science · doi:10.1287/mnsc.41.12.1827 · Cited by 1,218 · see citing works
Gamification in Education: What, How, Why Bother?
Lee, J. J., & Hammer, J. (2011) · Academic exchange quarterly · Cited by 1,199 · see citing works
Defining gamification
Huotari, K., & Hamari, J. (2012) · International Academic Mindtrek Conference (Mindtrek) · doi:10.1145/2393132.2393137 · Cited by 1,155 · see citing works
What is Interactivity and is it Always Such a Good Thing? Implications of Definition, Person, and Situation for the Influence of Interactivity on Advertising Effectiveness
Liu–Thompkins, Y., & Shrum, L. J. (2002) · Journal of Advertising · doi:10.1080/00913367.2002.10673685 · Cited by 1,149 · see citing works
Understanding information technology acceptance by individual professionals: toward an integrative view
Yi, M. Y., Jackson, J. D., Park, J. S., & Probst, J. C. (2006) · Information & Management · doi:10.1016/j.im.2005.08.006 · Cited by 1,139 · see citing works
Interpersonal Relationships, Motivation, Engagement, and Achievement: Yields for Theory, Current Issues, and Educational Practice
Martin, A. J., & Dowson, M. N. (2009) · Review of Educational Research · doi:10.3102/0034654308325583 · Cited by 1,112 · see citing works
A Theory of Task/Technology Fit and Group Support Systems Effectiveness1
Zigurs, I., & Buckland, B. K. (1998) · MIS Quarterly · doi:10.2307/249668 · Cited by 1,027 · see citing works
The role of moderating factors in user technology acceptance
Sun, H., & Zhang, P. (2005) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2005.04.013 · Cited by 1,002 · see citing works
A Dual-Self Model of Impulse Control
Fudenberg, D., & Levine, D. K. (2006) · American Economic Review · doi:10.1257/aer.96.5.1449 · Cited by 951 · see citing works
What’s Different about Social Media Networks? A Framework and Research Agenda1
Kane, G. C., Alavi, M., Labianca, G., & Borgatti, S. P. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.1.13 · Cited by 900 · see citing works
A Social Influence Model of Technology use
Fulk, J. L., Schmitz, J., & Steinfield, C. W. (1990) · Sage eBooks · doi:10.4135/9781483325385.n6 · Cited by 879 · see citing works
Demographic differences in perceived benefits from gamification
Koivisto, J., & Hamari, J. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.03.007 · Cited by 841 · see citing works
The development and evaluation of a survey to measure user engagement
O'Brien, H. L., & Toms, E. G. (2009) · Journal of the American Society for Information Science and Technology · doi:10.1002/asi.21229 · Cited by 794 · see citing works
Our Princess Is in Another Castle
Young, M. F., Slota, S. T., Cutter, A. B., Jalette, G., Mullin, G., Lai, B., Simeoni, Z., Tran, M. T., & Yukhymenko–Lescroart, M. A. (2012) · Review of Educational Research · doi:10.3102/0034654312436980 · Cited by 737 · see citing works
The Role of Optimum Stimulation Level in Exploratory Consumer Behavior
Steenkamp, J. E. M., & Baumgartner, H. (1992) · Journal of Consumer Research · doi:10.1086/209313 · Cited by 726 · see citing works
Incentives to Exercise
Charness, G. B., & Uri Gneezy, B. (2009) · Econometrica · doi:10.3982/ecta7416 · Cited by 693 · see citing works
Changing Behavior With Normative Feedback Interventions: A Field Experiment on Curbside Recycling
Schultz, P. W. (1999) · Basic and Applied Social Psychology · doi:10.1207/s15324834basp2101_3 · Cited by 684 · see citing works
Future work design research and practice: Towards an elaborated model of work design
Parker, S. K., Wall, T. D., & Cordery, J. L. (2001) · Journal of Occupational and Organizational Psychology · doi:10.1348/096317901167460 · Cited by 617 · see citing works
The Effect of Perceived Challenges and Skills on the Quality of Subjective Experience
Moneta, G. B., & Csíkszentmihályi, M. (1996) · Journal of Personality · doi:10.1111/j.1467-6494.1996.tb00512.x · Cited by 614 · see citing works
Understanding the Impact of Web Personalization on User Information Processing and Decision Outcomes1
Tam, K. Y., & Ho, S. Y. (2006) · MIS Quarterly · doi:10.2307/25148757 · Cited by 609 · see citing works
E-Learning personalization based on hybrid recommendation strategy and learning style identification
Klašnja-Milićević, A., Vesin, B., Ivanović, M., & Budimac, Z. (2011) · Computers & Education · doi:10.1016/j.compedu.2010.11.001 · Cited by 580 · see citing works
Organizational Colleagues, Media Richness, and Electronic Mail
Schmitz, J., & Fulk, J. L. (1991) · Communication Research · doi:10.1177/009365091018004003 · Cited by 570 · see citing works
Cross-Functional “Coopetition”: The Simultaneous Role of Cooperation and Competition Within Firms
Luo, X., Slotegraaf, R. J., & Pan, X. (2006) · Journal of Marketing · doi:10.1509/jmkg.70.2.67 · Cited by 539 · see citing works
Making connections
Ross, A. (1984) · Cited by 533 · see citing works
Computer playfulness and anxiety: positive and negative mediators of the system experience effect on perceived ease of use
Hackbarth, G., Grover, V., & Yi, M. Y. (2002) · Information & Management · doi:10.1016/s0378-7206(02)00006-x · Cited by 532 · see citing works
Effects of Interactivity on Website Involvement and Purchase Intention
Jiang, Z. J., Chan, J., Tan, B. C. Y., & Chua, W. (2010) · Journal of the Association for Information Systems · doi:10.17705/1jais.00218 · Cited by 524 · see citing works
“Working out for likes”: An empirical study on social influence in exercise gamification
Hamari, J., & Koivisto, J. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2015.04.018 · Cited by 473 · see citing works
The ethics of persuasive technology
Fogg, B. J. (2003) · Persuasive Technology · doi:10.1016/b978-155860643-2/50011-1 · Cited by 473 · see citing works
Taking “Fun and Games” Seriously: Proposing the Hedonic-Motivation System Adoption Model (HMSAM)
Lowry, P. B., Gaskin, J. E., Twyman, N. W., Hammer, B. I., & Roberts, T. (2013) · Journal of the Association for Information Systems · doi:10.17705/1jais.00347 · Cited by 473 · see citing works
Heuristics for designing enjoyable user interfaces
Malone, T. W. (1982) · ACM Conference on Human Factors in Computing Systems (CHI) · doi:10.1145/800049.801756 · Cited by 453 · see citing works
The Gamification of Learning and Instruction Fieldbook: Ideas into Practice
Kapp, K. M. (2013) · Cited by 419 · see citing works
Social Motivations To Use Gamification: An Empirical Study Of Gamifying Exercise
Hamari, J., & Koivisto, J. (2013) · European Conference on Information Systems · Cited by 411 · see citing works
What Is Personalization? Perspectives on the Design and Implementation of Personalization in Information Systems
Fan, H., & Poole, M. S. (2006) · Journal of Organizational Computing and Electronic Commerce · doi:10.1080/10919392.2006.9681199 · Cited by 404 · see citing works
The Narrative Paradigm: In the Beginning
Fisher, W. R. (1985) · Journal of Communication · doi:10.1111/j.1460-2466.1985.tb02974.x · Cited by 393 · see citing works
Affect in Web Interfaces: A Study of the Impacts of Web Page Visual Complexity and Order1
Deng, L., & Poole, M. S. (2010) · MIS Quarterly · doi:10.2307/25750702 · Cited by 382 · see citing works
Individual differences in game motivation as moderators of preprogrammed strategy effects in prisoner's dilemma.
Kuhlman, D. M., & Marshello, A. F. (1975) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.32.5.922 · Cited by 367 · see citing works
Understanding the impact of web personalization on user information processing and decision outcomes
Tam, K. Y., & Ho, S. Y. (2006) · Journal of the Association for Information Systems · doi:10.5555/2017317.2017322 · Cited by 354 · see citing works
Narrative research
Spector‐Mersel, G. (2010) · Narrative Inquiry · doi:10.1075/ni.20.1.10spe · Cited by 348 · see citing works
Understanding user acceptance of digital libraries: what are the roles of interface characteristics, organizational context, and individual differences?
THONG, J. Y. L., HONG, W., & TAM, K.-Y. (2002) · International Journal of Human-Computer Studies · doi:10.1016/s1071-5819(02)91024-4 · Cited by 347 · see citing works
Individual differences in game motivation as moderators of preprogrammed strategy effects in prisoner's dilemma.
Kuhlman, D. M., & Marshello, A. F. (1975) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.32.5.922 · Cited by 345 · see citing works
Varieties of Social Influence: The Role of Utility and Norms in the Success of a New Communication Medium
Kraut, R. E., Rice, R. E., Cool, C., & Fish, R. (1998) · Organization Science · doi:10.1287/orsc.9.4.437 · Cited by 338 · see citing works
EFFECTS OF FEEDBACK AND COGNITIVE PLAYFULNESS ON PERFORMANCE IN MICROCOMPUTER SOFTWARE TRAINING
Martocchio, J. J., & Webster, J. (1992) · Personnel Psychology · doi:10.1111/j.1744-6570.1992.tb00860.x · Cited by 334 · see citing works
Self-citation
The Affective Response Model: A Theoretical Framework of Affective Concepts and Their Relationships in the ICT Context1
Zhang, P. (2013) · MIS Quarterly · doi:10.25300/misq/2013/37.1.11 · Cited by 331 · see citing works
Brand‐consumer storytelling theory and research: Introduction to a Psychology & Marketing special issue
Woodside, A. G. (2010) · Psychology and Marketing · doi:10.1002/mar.20342 · Cited by 317 · see citing works
Motivational Differences Across Post-Acceptance Information System Usage Behaviors: An Investigation in the Business Intelligence Systems Context
Li, X., Hsieh, J. J. P.-A., & Rai, A. (2013) · Information Systems Research · doi:10.1287/isre.1120.0456 · Cited by 316 · see citing works
The Effects of Trust and Enjoyment on Intention to Play Online Games
Wu, J., & De, L. (2007) · Journal of electronic commerce research · Cited by 307 · see citing works
Changing organizational energy consumption behaviour through comparative feedback
SIERO, F. W., BAKKER, A. B., DEKKER, G. B., & VAN DEN BURG, M. T. C. (1996) · Journal of Environmental Psychology · doi:10.1006/jevp.1996.0019 · Cited by 306 · see citing works
Removing gamification from an enterprise SNS
Thom, J., Millen, D. R., & DiMicco, J. M. (2012) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2145204.2145362 · Cited by 283 · see citing works
Researching and Evaluating Digital Storytelling as a Deep Learning Tool
Barrett, H. C. (2006) · Society for Information Technology & Teacher Education International Conference · Cited by 270 · see citing works
Making Connections: Complementary Influences on Communication Media Choices, Attitudes, and Use
Treviño, L. K., Webster, J., & Stein, E. W. (2000) · Organization Science · doi:10.1287/orsc.11.2.163.12510 · Cited by 265 · see citing works
Self-citation
Digital Games and Beyond: What Happens When Players Compete?1
De, L., Li, X., & Santhanam, R. (2013) · MIS Quarterly · doi:10.25300/misq/2013/37.1.05 · Cited by 259 · see citing works
Self-citation
Enhancing the Design of Web Navigation Systems: The Influence of User Disorientation on Engagement and Performance1
Webster, J., & Ahuja, J. S. (2006) · MIS Quarterly · doi:10.2307/25148744 · Cited by 250 · see citing works
Self-citation
Do Incentive Hierarchies Induce User Effort? Evidence from an Online Knowledge Exchange
Goes, P. B., Guo, C., & Lin, M. (2016) · Information Systems Research · doi:10.1287/isre.2016.0635 · Cited by 245 · see citing works
Research Note—Gamification of Technology-Mediated Training: Not All Competitions Are the Same
Santhanam, R., Liu, D., & Shen, W.-C. M. (2016) · Information Systems Research · doi:10.1287/isre.2016.0630 · Cited by 213 · see citing works
Self-citation
Turning Work into Play: Implications for Microcomputer Software Training
Webster, J., & Martocchio, J. J. (1993) · Journal of Management · doi:10.1177/014920639301900109 · Cited by 191 · see citing works
Self-citation
‘To play or not to play’: A cross-temporal investigation using hedonic and instrumental perspectives to explain user intentions to explore a technology
Magni, M., Susan Taylor, M., & Venkatesh, V. (2010) · International Journal of Human-Computer Studies · doi:10.1016/j.ijhcs.2010.03.004 · Cited by 173 · see citing works
Winning is Not Enough: The Effects of Competition and Achievement Orientation on Intrinsic Interest
Epstein, J. A., & Harackiewicz, J. M. (1992) · Personality and Social Psychology Bulletin · doi:10.1177/0146167292182003 · Cited by 166 · see citing works
Going with the flow: Web sites and customer involvement
Nel, D., van Niekerk, R., Berthon, J., et al. (1999) · Internet Research · doi:10.1108/10662249910264873 · Cited by 164 · see citing works
The Aesthetic Point of View: Selected Essays
Beardsley, M. C., Wreen, M., & Callen, D. (1983) · Poetics Today · doi:10.2307/1772303 · Cited by 163 · see citing works
Orientation Passport
Fitz-Walter, Z., Tjondronegoro, D., & Wyeth, P. A. (2011) · Australian Computer-Human Interaction Conference (OzCHI) · doi:10.1145/2071536.2071554 · Cited by 153 · see citing works
Involvement and Decision-Making Performance with a Decision Aid: The Influence of Social Multimedia, Gender, and Playfulness
Hess, T. J., Fuller, M. A., & Mathew, J. (2005) · Journal of Management Information Systems · doi:10.2753/mis0742-1222220302 · Cited by 151 · see citing works
Proposing the Multimotive Information Systems Continuance Model (MISC) to Better Explain End-User System Evaluations and Continuance Intentions
Lowry, P. B., Gaskin, J. E., & Moody, G. D. (2015) · Journal of the Association for Information Systems · doi:10.17705/1jais.00403 · Cited by 143 · see citing works
GAMIFYING INFORMATION SYSTEMS - A SYNTHESIS OF GAMIFICATION MECHANICS AND DYNAMICS
Thiebes, S., Lins, S., & Basten, D. (2014) · Journal of the Association for Information Systems · Cited by 141 · see citing works
Desktop Videoconferencing: Experiences of Complete Users, Wary Users, and Non-Users1
Webster, J. (1998) · MIS Quarterly · doi:10.2307/249666 · Cited by 140 · see citing works
Self-citation
Disassembling gamification
Mekler, E. D., Brühlmann, F., Opwis, K., & Tuch, A. N. (2013) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2468356.2468559 · Cited by 140 · see citing works
Equal opportunity tactic: Redesigning and applying competition games in classrooms
Cheng, H. N. H., Wu, W. M. C., Liao, C. C. Y., & Chan, T.-W. (2009) · Computers & Education · doi:10.1016/j.compedu.2009.05.006 · Cited by 103 · see citing works
Designing Attractive Gamification Features for Collaborative Storytelling Websites
Hsu, S. H., Chang, J., & Lee, C. (2013) · Cyberpsychology Behavior and Social Networking · doi:10.1089/cyber.2012.0492 · Cited by 100 · see citing works
THEORY AND EVIDENCE IN PSYCHOLOGY AND ECONOMICS ABOUT MOTIVATION CROWDING OUT: A POSSIBLE CONVERGENCE?
Festré, A., & Garrouste, P. (2014) · Journal of Economic Surveys · doi:10.1111/joes.12059 · Cited by 98 · see citing works
Gamification: A new paradigm for online user engagement
Kankanhalli, A., Taher, M., Cavusoglu, H., & Kim, S. H. (2012) · National University of Singapore · Cited by 97 · see citing works
Industrial playgrounds
Korn, O. (2012) · ACM SIGCHI Symposium on Engineering Interactive Computing Systems (EICS) · doi:10.1145/2305484.2305539 · Cited by 92 · see citing works
Understanding and Predicting Student Self-Regulated Learning Strategies in Game-Based Learning Environments
Sabourin, J. L., Shores, L. R., Mott, B., & Lester, J. C. (2013) · International Journal of Artificial Intelligence in Education · doi:10.1007/s40593-013-0004-6 · Cited by 92 · see citing works
An empirical study on m-learning adaptation: Learning performance and learning contexts
Garcia-Cabot, A., de-Marcos, L., & Garcia-Lopez, E. (2015) · Computers & Education · doi:10.1016/j.compedu.2014.12.007 · Cited by 91 · see citing works
Media Selection as a Strategic Component of Communication1
(2013) · doi:10.25300/misq/2013/37.4.11 · Cited by 72 · see citing works
Placing a value on aesthetics in online casual games
Andersen, E., Liu, Y.-E., Snider, R., et al. (2011) · ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) · doi:10.1145/1978942.1979131 · Cited by 70 · see citing works
How Gamification will change Business Intelligence
Hiltbrand, T., & Burke, M. (2011) · Cited by 67 · see citing works
The Gamification Of Education
Miller, C. S. (2013) · Developments in Business Simulation and Experiential Learning: Proceedings of the Annual ABSEL conference · Cited by 67 · see citing works
Validation of a Multidimensional Measure of Goal Orientation.
Zweig, D., & Webster, J. (2004) · Canadian Journal of Behavioural Science/Revue canadienne des sciences du comportement · doi:10.1037/h0087233 · Cited by 66 · see citing works
Self-citation
The Use of Narrative Paradigm Theory in Assessing Audience Value Conflict in Image Advertising
Stutts, N. B., & Barker, R. T. (1999) · Management Communication Quarterly · doi:10.1177/0893318999132002 · Cited by 63 · see citing works
Editor's comments: design science research in top information systems journals
Goes, P. B. (2014) · Journal of the Association for Information Systems · Cited by 48 · see citing works
Understanding the Antecedents of Mobile Game Addiction: The Roles of Perceived Visibility, Perceived Enjoyment and Flow
Sun, Y., Zhao, Y., Jia, S., et al. (2015) · Journal of the Association for Information Systems · Cited by 47 · see citing works
Toward a Unified Theory of Digital Games
Ralph, P., & Monu, K. (2015) · The Computer Games Journal · doi:10.1007/s40869-015-0007-7 · Cited by 44 · see citing works
Play at Work: How Games Inspire Breakthrough Thinking
Penenberg, A. L. (2013) · Cited by 42 · see citing works
Gamification – A Novel Phenomenon or a New Wrapping for Existing Concepts?
Bui, A., Veit, D. J., & Webster, J. (2015) · OPUS (Augsburg University) · Cited by 35 · see citing works
Self-citation
A systematic mapping on gamification applied to education
Borges, S. S., Durelli, V. H. S., Reis, H. M., & Isotani, S. (2014) · Scientific Electronic Library Online (São Paulo Research Foundation, Latin American and Caribbean Center on Health Sciences Information, Conselho Nacional de Desenvolvimento Científico e Tecnológico) · Cited by 33 · see citing works
A Structural Examination of Two Optimal Stimulation Level Measurement Models
Wahlers, R. G., & Etzel, M. J. (1990) · ACR North American Advances · Cited by 27 · see citing works
Untitled work
(2015) · International Conference on Information Systems · Cited by 25 · see citing works
Disassembling gamification: the effects of points and meaning on user motivation and performance
Mekler, E. D., Brühlmann, F., Opwis, K., et al. (2013) · edoc (University of Basel) · doi:10.5451/unibas-ep29200 · Cited by 25 · see citing works
Using design science research to incorporate gamification into learning activities
Cheong, C., & Filippou, J. (2013) · RMIT Research Repository (RMIT University Library) · Cited by 22 · see citing works
An understanding of the impact of gamification on purchase intentions
Shang, S. S. C., & Lin, K. Y. (2013) · Journal of the Association for Information Systems · Cited by 22 · see citing works
Exploring customer preferences for online games
Baek, S. J. (2005) · International Journal of Advanced Media and Communication · doi:10.1504/ijamc.2005.007721 · Cited by 18 · see citing works
Substitutive competition: Virtual pets as competitive buffers to alleviate possible negative influence on pupils
Chen, Z., Chou, C., Biswas, G., & Chan, T.-W. (2011) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2011.01174.x · Cited by 17 · see citing works
Digital Addiction: Gamification for Precautionary and Recovery Requirements
Jiang, J., Phalp, K. T., & Ali, R. (2015) · Bournemouth University Research Online (Bournemouth University) · Cited by 14 · see citing works
Editor’s Comments
Goes, P. B. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.1.e0 · Cited by 14 · see citing works
Can Work Be Fun? Improving Task Motivation and Help-Seeking Through Game Mechanics
Teh, N., Schuff, D., Johnson, S., et al. (2013) · International Conference on Information Systems · Cited by 13 · see citing works
Applying Game Design Elements in the Workplace
Suh, A. (2015) · International Conference on Information Systems · Cited by 11 · see citing works
Examining the Adoption of Online Game Using the Uses and Gratifications Theory
Merhi, M. I. (2012) · Journal of the Association for Information Systems · Cited by 1 · see citing works

Flagged first, then by citations

Sorted by citations

Research Note—Gamification of Technology-Mediated Training: Not All Competitions Are the Same
Santhanam, R., Liu, D., & Shen, W.-C. M. (2016) · Information Systems Research · doi:10.1287/isre.2016.0630 · Cited by 213 · see citing works
Self-citation
Conversational Agents as Mediating Social Actors in Chronic Disease Management Involving Health Care Professionals, Patients, and Family Members: Multisite Single-Arm Feasibility Study
Kowatsch, T., Schachner, T., Harperink, S., Barata, F., Dittler, U., Xiao, G., Stanger, C., v Wangenheim, F., Fleisch, E., Oswald, H., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/25060 · Cited by 103 · see citing works
Does gamification engage users in online shopping?
García-Jurado, A., Torres-Jiménez, M., Leal-Rodríguez, A. L., & Castro-González, P. (2021) · Electronic Commerce Research and Applications · doi:10.1016/j.elerap.2021.101076 · Cited by 81 · see citing works
Online social games: The effect of social comparison elements on continuance behaviour
Esteves, J., Valogianni, K., & Greenhill, A. (2021) · Information & Management · doi:10.1016/j.im.2021.103452 · Cited by 73 · see citing works
Effect of digital health applications with or without gamification on physical activity and cardiometabolic risk factors: a systematic review and meta-analysis of randomized controlled trials
Nishi, S. K., Kavanagh, M. E., Ramboanga, K., Ayoub-Charette, S., Modol, S., Dias, G. M., Kendall, C. W. C., Sievenpiper, J. L., & Chiavaroli, L. (2024) · eClinicalMedicine · doi:10.1016/j.eclinm.2024.102798 · Cited by 37 · see citing works
Breathing as an Input Modality in a Gameful Breathing Training App (Breeze 2): Development and Evaluation Study
Lukic, Y. X., Teepe, G. W., Fleisch, E., & Kowatsch, T. (2022) · JMIR Serious Games · doi:10.2196/39186 · Cited by 32 · see citing works
An Experimental Analysis of Gamification’s Impact on Customer Engagement and Retention in Subscription-Based Business Models
Israfilzade, K., & Pathania, D. (2026) · Management of Organizations: Systematic Research · doi:10.2478/mosr-2026-0005

Authors: Liu, D., Santhanam, R., & Webster, J.
Affiliations: Carlson School of Management, University of Minnesota, Minneapolis, MN 55455 U.S.A.
University of Oklahoma (US)
Queen's University (CA)
ORCID: Santhanam, Radhika
Webster, Jane
Venue: MIS Quarterly
Publisher: MIS Quarterly
Published: 2017-12-01
Volume: 41
Issue: 4
Pages: 1011-1034
ISSN: 0276-7783 (ISSN-L)
2162-9730
DOI: 10.25300/misq/2017/41.4.01
OpenAlex: W3123811346
Cited by: 521
References: 148
Citations by year: 2026: 42 · 2025: 63 · 2024: 68 · 2023: 78 · 2022: 81 · 2021: 66 · 2020: 62 · 2019: 33 · 2018: 20 · 2017: 5 · 2016: 1 · 2015: 2
FWCI: 65.72
Type: journal article
Language: en
Open access: closed
Locations: MIS Quarterly (publishedVersion)
Topics: Social Sciences › Psychology › Developmental and Educational Psychology › Educational Games and Gamification
Social Sciences › Decision Sciences › Information Systems and Management › Technology Adoption and User Behaviour
Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
Keywords: gamification, game elements, user engagement, design principles, behavioral economics, social psychology, research framework

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Toward Meaningful Engagement: A Framework for Design and Research of Gamified Information Systems1

Abstract

Integrity signals

Claims the paper makes

Claims other papers make about this one

Cites

Cited by

Related

Record

About these checks