Rotating Online Behavior Change Interventions Increases Effectiveness But Also Increases Attrition
The DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Behavior change systems help people manage their time online and achieve many other goals. These systems typically consist of a single static intervention, such as a timer or site blocker, to persuade users to behave in ways consistent with their stated goals. However, static interventions decline in effectiveness over time as users begin to ignore them. In this paper, we compare the effectiveness of static interventions to a rotation strategy, where users experience different interventions over time. We built and deployed a browser extension called HabitLab, which features many interventions that the user can enable across social media and other web sites to control their time spent browsing. We ran three in-the-wild field experiments on HabitLab to compare static interventions to rotated interventions. We found that rotating between interventions increased effectiveness as measured by time on site, but also increased attrition: more users uninstalled HabitLab. To minimize attrition, we introduced a just-in-time information design about rotation. This design reduced attrition rates by half. With this research, we suggest that interaction design, paired with rotation of behavior change interventions, can help users gain control of their online habits.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Michie, S., van Stralen, M. M., & West, R. (2011) · Implementation Science · doi:10.1186/1748-5908-6-42 · Cited by 13,697
From game design elements to gamefulness: defining "gamification"
Deterding, S., Dixon, D., Khaled, R., & Nacke, L. (2011) · Proceedings of the 15th International Academic MindTrek Conference: Envisioning Future Media Environments · doi:10.1145/2181037.2181040 · Cited by 8,402 · cited 2×
“Much previous work has focused on gamification as an approach to design behavior change systems [30].”
BackgroundThe Transtheoretical Model of Health Behavior Change.
Prochaska, J. O., & Velicer, W. F. (1997) · American Journal of Health Promotion · doi:10.4278/0890-1171-12.1.38 · Cited by 7,782
Building a practically useful theory of goal setting and task motivation: A 35-year odyssey.
Locke, E. A., & Latham, G. P. (2002) · American Psychologist · doi:10.1037/0003-066x.57.9.705 · Cited by 7,766 · cited 1×
“Interventions are designed drawing on theories of behavior change—for example, goal setting theory [63], persuasion [22, 40], and gamification [30].”
BackgroundMichie, S., Richardson, M., Johnston, M., Abraham, C., Francis, J., Hardeman, W., Eccles, M. P., Cane, J., & Wood, C. E. (2013) · Annals of Behavioral Medicine · doi:10.1007/s12160-013-9486-6 · Cited by 7,629
Status quo bias in decision making
Samuelson, W., & Zeckhauser, R. (1988) · Journal of Risk and Uncertainty · doi:10.1007/bf00055564 · Cited by 5,897 · cited 1×
“Strategy Theory Intervention Commitment Self-consistency theory [7, 22, 93] Ask the user to set a goal for the length of time they will stay on the site (generic) Enforce default limits Status quo bias [89] Automatically close tab after 60 seconds unless the user clicks a button to ask for more time (generic) Reduce s…”
BackgroundDoes Gamification Work? -- A Literature Review of Empirical Studies on Gamification
Hamari, J., Koivisto, J., & Sarsa, H. (2014) · 2014 47th Hawaii International Conference on System Sciences · doi:10.1109/hicss.2014.377 · Cited by 5,201
A taxonomy of behavior change techniques used in interventions
Abraham, C., & Michie, S. (2008) · Health Psychology · doi:10.1037/0278-6133.27.3.379 · Cited by 2,525 · cited 1×
“A number of taxonomies characterize the design space of interventions, both general [1, 31, 66, 67] and domain-specific [44, 102].”
BackgroundEysenbach, G. (2005) · Journal of Medical Internet Research · doi:10.2196/jmir.7.1.e11 · Cited by 2,524 · cited 3×
“However, static interventions suffer from high attrition and abandonment rates [23, 36], and interventions decline in effectiveness over time [59].”
BackgroundWebb, T. L., Joseph, J., Yardley, L., & Michie, S. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1376 · Cited by 2,517 · cited 1×
“While behavior change systems can be effective [12, 27, 101], many review papers are more restrained in whether behavior change systems remain effective over long periods of time [16, 42, 70, 73].”
BackgroundDevelopment of a Facebook Addiction Scale
Andreassen, C. S., Torsheim, T., Brunborg, G. S., & Pallesen, S. (2012) · Psychological Reports · doi:10.2466/02.09.18.pr0.110.2.501-517 · Cited by 1,884 · cited 1×
“Whether social media use improves well-being is a complex question depending on the nature of the engagement [55, 62, 65, 68, 88, 95, 100], but thanks to instant gratification and sites’ use of gamification [19, 49, 104] and behavior design techniques [35, 40] to drive engagement, users keep coming back to the point t…”
BackgroundRaacke, J., & Bonds-Raacke, J. (2008) · CyberPsychology & Behavior · doi:10.1089/cpb.2007.0056 · Cited by 1,577 · cited 1×
“Yet this is difficult because users turn to social media to address their need to belong, the need for self-presentation, the need for self-esteem [69], the need for entertainment and gratification [80], and self-affirmation [97].”
BackgroundPersuasive technology: using computers to change what we think and do
Fogg, B. J. (2002) · Ubiquity · doi:10.1145/764008.763957 · Cited by 1,554
The Impact of eHealth on the Quality and Safety of Health Care: A Systematic Overview
Black, A. D., Car, J., Pagliari, C., Anandan, C., Cresswell, K., Bokun, T., McKinstry, B., Procter, R., Majeed, A., & Sheikh, A. (2011) · PLoS Medicine · doi:10.1371/journal.pmed.1000387 · Cited by 1,442
Barak, A., Hen, L., Boniel-Nissim, M., & Shapira, N. (2008) · Journal of Technology in Human Services · doi:10.1080/15228830802094429 · Cited by 1,283 · cited 1×
“While behavior change systems can be effective [12, 27, 101], many review papers are more restrained in whether behavior change systems remain effective over long periods of time [16, 42, 70, 73].”
BackgroundNadkarni, A., & Hofmann, S. G. (2012) · Personality and Individual Differences · doi:10.1016/j.paid.2011.11.007 · Cited by 1,276
Eysenbach, G., Powell, J., Englesakis, M., Rizo, C., & Stern, A. (2004) · BMJ · doi:10.1136/bmj.328.7449.1166 · Cited by 1,268
Kim, J., & Lee, J.-E. R. (2011) · Cyberpsychology, Behavior, and Social Networking · doi:10.1089/cyber.2010.0374 · Cited by 930 · cited 1×
“Whether social media use improves well-being is a complex question depending on the nature of the engagement [55, 62, 65, 68, 88, 95, 100], but thanks to instant gratification and sites’ use of gamification [19, 49, 104] and behavior design techniques [35, 40] to drive engagement, users keep coming back to the point t…”
BackgroundA meta-analysis of computer-tailored interventions for health behavior change
Krebs, P., Prochaska, J. O., & Rossi, J. S. (2010) · Preventive Medicine · doi:10.1016/j.ypmed.2010.06.004 · Cited by 854 · cited 3×
“However, static interventions suffer from high attrition and abandonment rates [23, 36], and interventions decline in effectiveness over time [59].”
BackgroundFacebook use, envy, and depression among college students: is facebooking depressing?
Tandoc, E. C., Ferrucci, P., & Duffy, M. (2015) · Computers in Human Behavior · doi:10.1016/j.chb.2014.10.053 · Cited by 781
The uses and abuses of Facebook: A review of Facebook addiction
Ryan, T., Chester, A., Reece, J., & Xenos, S. (2014) · Journal of Behavioral Addictions · doi:10.1556/jba.3.2014.016 · Cited by 714 · cited 1×
“Whether social media use improves well-being is a complex question depending on the nature of the engagement [55, 62, 65, 68, 88, 95, 100], but thanks to instant gratification and sites’ use of gamification [19, 49, 104] and behavior design techniques [35, 40] to drive engagement, users keep coming back to the point t…”
BackgroundA Review of eHealth Interventions for Physical Activity and Dietary Behavior Change
Norman, G. J., Zabinski, M. F., Adams, M. A., Rosenberg, D. E., Yaroch, A. L., & Atienza, A. A. (2007) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2007.05.007 · Cited by 605 · cited 1×
“While behavior change systems can be effective [12, 27, 101], many review papers are more restrained in whether behavior change systems remain effective over long periods of time [16, 42, 70, 73].”
BackgroundMore information than you ever wanted: Does Facebook bring out the green-eyed monster of jealousy?
Muise, A., Christofides, E., & Desmarais, S. (2009) · CyberPsychology & Behavior · doi:10.1089/cpb.2008.0263 · Cited by 573
Froehlich (2009) · doi:10.1145/1518701.1518861 · Cited by 563
Internet-administered cognitive behavior therapy for health problems: a systematic review
Cuijpers, P., van Straten, A., & Andersson, G. (2008) · Journal of Behavioral Medicine · doi:10.1007/s10865-007-9144-1 · Cited by 555 · cited 1×
“While behavior change systems can be effective [12, 27, 101], many review papers are more restrained in whether behavior change systems remain effective over long periods of time [16, 42, 70, 73].”
BackgroundLyons, E. J., Lewis, Z. H., Mayrsohn, B. G., & Rowland, J. L. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3469 · Cited by 547 · cited 1×
“Gamification has been shown to have positive effects on engagement and outcomes in behavior-change contexts such as promoting healthy habits [26, 64] and improving educational engagement [8, 9], though effectiveness varies depending on the context and design [43].”
BackgroundGamification: What It Is and Why It Matters to Digital Health Behavior Change Developers
Cugelman, B. (2013) · JMIR Serious Games · doi:10.2196/games.3139 · Cited by 531 · cited 1×
“Gamification has been shown to have positive effects on engagement and outcomes in behavior-change contexts such as promoting healthy habits [26, 64] and improving educational engagement [8, 9], though effectiveness varies depending on the context and design [43].”
BackgroundNeve, M., Morgan, P. J., Jones, P. R., & Collins, C. E. (2010) · Obesity Reviews · doi:10.1111/j.1467-789x.2009.00646.x · Cited by 459
Sagioglou, C., & Greitemeyer, T. (2014) · Computers in Human Behavior · doi:10.1016/j.chb.2014.03.003 · Cited by 387 · cited 1×
“Whether social media use improves well-being is a complex question depending on the nature of the engagement [55, 62, 65, 68, 88, 95, 100], but thanks to instant gratification and sites’ use of gamification [19, 49, 104] and behavior design techniques [35, 40] to drive engagement, users keep coming back to the point t…”
BackgroundRichardson, C. R., Buis, L. R., Janney, A. W., Goodrich, D. E., Sen, A., Hess, M. L., Mehari, K. S., Fortlage, L. A., Resnick, P. J., Zikmund-Fisher, B. J., et al. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1338 · Cited by 239
Chung, C.-F., Dew, K., Cole, A., Zia, J., Fogarty, J., Kientz, J. A., & Munson, S. A. (2016) · Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing · doi:10.1145/2818048.2819926 · Cited by 222
Examination of neural systems sub-serving facebook addiction
Turel, O., He, Q., Xue, G., Xiao, L., & Bechara, A. (2014) · Psychological Reports · doi:10.2466/18.pr0.115c31z8 · Cited by 206 · cited 1×
“Whether social media use improves well-being is a complex question depending on the nature of the engagement [55, 62, 65, 68, 88, 95, 100], but thanks to instant gratification and sites’ use of gamification [19, 49, 104] and behavior design techniques [35, 40] to drive engagement, users keep coming back to the point t…”
BackgroundOutcomes of online support and resources for cancer survivors: A systematic literature review
Hong, Y., Peña-Purcell, N. C., & Ory, M. G. (2012) · Patient Education and Counseling · doi:10.1016/j.pec.2011.06.014 · Cited by 155
PopTherapy: Coping with Stress through Pop-Culture
Paredes, P., Giald-Bachrach, R., Czerwinski, M., Roseway, A., Rowan, K., & Hernandez, J. (2014) · Proceedings of the 8th International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2014.255070 · Cited by 152 · cited 6×
“Techniques that personalize interventions via multi-armed bandits show positive treatment effects, suggesting that the approach may hold promise, but this existing work cannot separate the effects of personalization from the effects of rotation [60, 76, 82].”
BackgroundInfluentialBenevolent deception in human computer interaction
Adar, E., Tan, D. S., & Teevan, J. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466246 · Cited by 93 · cited 1×
“Is telling users that the system is helping them more than it actually is a form of benevolent deception [3] that would ultimately help boost retention and help users achieve their goals? Would gamifying the system with social features, making users connect with friends and keep tabs on their friends’ social media usa…”
Background
Cited by
Generative Adversarial Networks for face generation: A survey
Kammoun, A., Slama, R., Tabia, H., Ouni, T., & Abid, M. (2022) · ACM Computing Surveys · doi:10.1145/1122445.1122456 · Cited by 311
Lyngs, U., Lukoff, K., Slovak, P., Seymour, W., Webb, H., Jirotka, M., Zhao, J., Van Kleek, M., & Shadbolt, N. (2020) · Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376672 · Cited by 157
Roffarello, A. M., & De Russis, L. (2023) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3571810 · Cited by 137
“The work of Kovacs et al. [116], for instance, extends the HabitLab tool through a mobile application, and it explores whether the time saved thanks to the DSCT is actually saved or if it is just redirected to other unproductive activities, e.g., usage sessions with mobile apps or websites that are not subjected to an…”
BackgroundInfluentialMonitoring Screen Time or Redesigning It?: Two Approaches to Supporting Intentional Social Media Use
Zhang, M. R., Lukoff, K., Rao, R., Baughan, A., & Hiniker, A. (2022) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3491102.3517722 · Cited by 43
Embedding Democratic Values into Social Media AIs via Societal Objective Functions
Jia, C., Lam, M. S., Mai, M. C., Hancock, J. T., & Bernstein, M. S. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3641002 · Cited by 31
Self-citation
Metadata
- Authors
- Kovacs, G., Wu, Z., & Bernstein, M. S.
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2018-11
- Volume
- 2
- Issue
- CSCW
- Pages
- 1-25
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W2899035333
- Cited by
- 75
- References
- 35
- FWCI
- 5.80
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.