The DOI matches its Crossref record; 49 of the 52 references it cites were found in a registry or an index.
How to evaluate technologies for health behavior change in HCI research
Abstract
New technologies for encouraging physical activity, healthy diet, and other types of health behavior change now frequently appear in the HCI literature. Yet, how such technologies should be evaluated within the context of HCI research remains unclear. In this paper, we argue that the obvious answer to this question - that evaluations should assess whether a technology brought about the intended change in behavior - is too limited. We propose that demonstrating behavior change is often infeasible as well as unnecessary for a meaningful contribution to HCI research, especially when in the early stages of design or when evaluating novel technologies. As an alternative, we suggest that HCI contributions should focus on efficacy evaluations that are tailored to the specific behavior-change intervention strategies (e.g., self-monitoring, conditioning) embodied in the system and studies that help gain a deep understanding of people's experiences with the technology.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“First, they focus on clinical outcomes, which are often more distal to the behavioral targets of specific BIT interventions and are unlikely to change within the timeframe necessary to inform design considerations or to submit BITs to rapid development, evaluation, and iteration [4].”
From The Behavioral Intervention Technology Model: An Integrated Conceptual and Technological Framework for eHealth and mHealth Interventions (2014) · cites this paper as [4]
In the citing paper
“First, they focus on clinical outcomes, which are often more distal to the behavioral targets of specific BIT interventions and are unlikely to change within the timeframe necessary to inform design considerations or to submit BITs to rapid development, evaluation, and iteration [4].”
From The Behavioral Intervention Technology Model: An Integrated Conceptual and Technological Framework for eHealth and mHealth Interventions (2014) · cites this paper as [4]
In the citing paper
“Much of the evaluation of BITs has focused on efficacy, which limits the growth in our knowledge regarding the mechanisms by which BITs achieve both their proximal intervention aims as well as the ultimate treatment goals [4].”
From The Behavioral Intervention Technology Model: An Integrated Conceptual and Technological Framework for eHealth and mHealth Interventions (2014) · cites this paper as [4]
Citations
Cites
The "what" and "why" of goal pursuits: Human needs and the self-determination of behavior
Deci, E. L., & Ryan, R. M. (2000) · Psychological Inquiry · doi:10.1207/s15327965pli1104_01 · Cited by 34,210
Social psychology: handbook of basic principles
Higgins, E., & Kruglanski, A. (2008) · Choice Reviews Online · doi:10.5860/choice.45-3496 · Cited by 5,535
Social psychology: handbook of basic principles
(1997) · Choice Reviews Online · doi:10.5860/choice.34-3595 · Cited by 4,970
Self-regulation and depletion of limited resources: Does self-control resemble a muscle?
Muraven, M., & Baumeister, R. F. (2000) · Psychological Bulletin · doi:10.1037/0033-2909.126.2.247 · Cited by 4,510
Validity and reliability of the Experience-Sampling Method
CSIKSZENTMIHALYI, M., & LARSON, R. (1987) · The Journal of Nervous and Mental Disease · doi:10.1097/00005053-198709000-00004 · Cited by 2,544
Knowledge activation: Accessibility, applicability, and salience.
Higgins, E. T. (1996) · Cited by 1,970
The automated will: nonconscious activation and pursuit of behavioral goals.
Bargh, J. A., Gollwitzer, P. M., Lee-Chai, A., Barndollar, K., & Trötschel, R. (2001) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.81.6.1014 · Cited by 1,865
Self-control as a limited resource: Regulatory depletion patterns.
Muraven, M., Tice, D. M., & Baumeister, R. F. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.3.774 · Cited by 1,724
Consolvo, S., McDonald, D. W., Toscos, T., Chen, M. Y., Froehlich, J. E., Harrison, B. L., Klasnja, P., LaMarca, A., LeGrand, L., Libby, R., et al. (2008) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357335 · Cited by 1,133
Self-citationSystematic Review of the Literature
Wool, C. (2011) · Advances in Neonatal Care · doi:10.1097/anc.0b013e31821bd92d · Cited by 1,021
Progress in Behavior Modification
Hersen, M., & Eisler, R. M. (1983) · Cited by 1,020
Persons With Chronic Conditions
Hoffman, C. (1996) · JAMA · doi:10.1001/jama.1996.03540180029029 · Cited by 1,007
Relapse Prevention for Alcohol and Drug Problems: That Was Zen, This Is Tao
Witkiewitz, K., & Marlatt, G. A. (2004) · American Psychologist · doi:10.1037/0003-066x.59.4.224 · Cited by 880
Fish’n’Steps: Encouraging Physical Activity with an Interactive Computer Game
Lin, J. J.-W., Mamykina, L., Lindtner, S., Delajoux, G., & Strub, H. B. (2006) · Lecture notes in computer science · doi:10.1007/11853565_16 · Cited by 853
Progress in behavior modification
Rachman, S. (1984) · Behaviour Research and Therapy · doi:10.1016/0005-7967(84)90019-6 · Cited by 817
Design requirements for technologies that encourage physical activity
Consolvo, S., Everitt, K., Smith, I., & Landay, J. A. (2006) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1124772.1124840 · Cited by 801
Self-citationThe Handbook of health behavior change
(2009) · Choice Reviews Online · doi:10.5860/choice.46-6233 · Cited by 616
Usability evaluation considered harmful (some of the time)
Greenberg, S., & Buxton, B. (2008) · ACM SIGCHI Conference on Human Factors in Computing Systems (CHI) · doi:10.1145/1357054.1357074 · Cited by 601
Physical activity behavior change: Issues in adoption and maintenance.
Marcus, B. H., Forsyth, L. H., Stone, E. J., Dubbert, P. M., McKenzie, T. L., Dunn, A. L., & Blair, S. N. (2000) · Health Psychology · doi:10.1037/0278-6133.19.suppl1.32 · Cited by 594
Hurling, R., Catt, M., De Boni, M., Fairley, B. W., Hurst, T., Murray, P., Richardson, A., & Sodhi, J. S. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.2.e7 · Cited by 536
Froehlich, J. E., Chen, M. Y., Consolvo, S., Harrison, B. L., & Landay, J. A. (2007) · International Conference on Mobile Systems, Applications, and Services · doi:10.1145/1247660.1247670 · Cited by 488
Self-citationFlowers or a robot army?: encouraging awareness & activity with personal, mobile displays
Consolvo, S., Klasnja, P., McDonald, D. W., Avrahami, D., Froehlich, J., LeGrand, L., Libby, R., Mosher, K., & Landay, J. A. (2008) · Proceedings of the 10th international conference on Ubiquitous computing · doi:10.1145/1409635.1409644 · Cited by 397
Self-citationMobile Therapy: Case Study Evaluations of a Cell Phone Application for Emotional Self-Awareness
Morris, M. E., Kathawala, Q., Leen, T. K., Gorenstein, E. E., Guilak, F., Labhard, M., & Deleeuw, W. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1371 · Cited by 384
Internet-based physical activity interventions: a systematic review of the literature.
van den Berg, M. H., Schoones, J. W., & Vliet Vlieland, T. P. (2007) · Journal of Medical Internet Research · doi:10.2196/jmir.9.3.e26 · Cited by 377
MAHI: investigation of social scaffolding for reflective thinking in diabetes management
Mamykina, L., Mynatt, E., Davidson, P., & Greenblatt, D. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357131 · Cited by 355
The human experience [of ubiquitous computing]
Abowd, G. D., Mynatt, E. D., & Rodden, T. A. (2002) · IEEE Pervasive Computing · doi:10.1109/mprv.2002.993144 · Cited by 353
Transtheoretical Model of Behavior Change
Prochaska, J. O. (2018) · Springer eBooks · doi:10.1007/978-1-4614-6439-6_70-2 · Cited by 296
Tsai, C. C., Lee, G., Raab, F., Norman, G. J., Sohn, T. Y., Griswold, W. G., & Patrick, K. (2007) · Mobile Networks and Applications · doi:10.1007/s11036-007-0014-4 · Cited by 267
Shakra: Tracking and Sharing Daily Activity Levels with Unaugmented Mobile Phones
Anderson, I., Maitland, J., Sherwood, S., Barkhuus, L., Chalmers, M., Hall, M., Brown, B., & Muller, H. (2007) · Mobile Networks and Applications · doi:10.1007/s11036-007-0011-7 · Cited by 223
The Handbook of health behavior change
(1991) · Choice Reviews Online · doi:10.5860/choice.28-5108 · Cited by 214
Rogers, Y., Connelly, K., Tedesco, L., Hazlewood, W., Kurtz, A., Hall, R. E., Hursey, J., & Toscos, T. (2007) · Lecture Notes in Computer Science · doi:10.1007/978-3-540-74853-3_20 · Cited by 199
From Mice to Men - 24 Years of Evaluation in CHI
Barkhuus, L., & Rode, J. A. (2007) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1240624.2180963 · Cited by 180
Predictors of Women???s Exercise Maintenance After Cardiac Rehabilitation
Moore, S. M., Dolansky, M. A., Ruland, C. M., Pashkow, F. J., & Blackburn, G. G. (2003) · Journal of Cardiopulmonary Rehabilitation · doi:10.1097/00008483-200301000-00008 · Cited by 151
Assessment and Therapeutic Functions of Self-Monitoring
Nelson, R. O. (1977) · Progress in behavior modification · doi:10.1016/b978-0-12-535605-3.50012-1 · Cited by 146
Mobile Diary for Wellness Management—Results on Usage and Usability in Two User Studies
Mattila, E., Parkka, J., Hermersdorf, M., Kaasinen, J., Vainio, J., Samposalo, K., Merilahti, J., Kolari, J., Kulju, M., Lappalainen, R., et al. (2008) · IEEE Transactions on Information Technology in Biomedicine · doi:10.1109/titb.2007.908237 · Cited by 143 · cited 1×
“…such as consistency of logging, could enable us to compare diet logs that require each food to be journaled separately (e.g., PmEB [40]) with those that use some form of shorthand logging, such as the point system of the Mobile Lifestyle Coach [17] or the food journal in the Wellness Diary [29].”
BackgroundAcceptance and usability of a relational agent interface by urban older adults
Bickmore, T. W., Caruso, L., & Clough-Gorr, K. (2005) · CHI '05 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/1056808.1056879 · Cited by 142
Dixon, M., & Fogarty, J. A. (2010) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753554 · Cited by 137
Persuasiveness of a Mobile Lifestyle Coaching Application Using Social Facilitation
Gasser, R., Brodbeck, D., Degen, M., Luthiger, J., Wyss, R., & Reichlin, S. (2006) · Lecture notes in computer science · doi:10.1007/11755494_5 · Cited by 134
Smith, B. K., Frost, J. H., Albayrak, M., & Sudhakar, R. (2006) · Personal and Ubiquitous Computing · doi:10.1007/s00779-006-0087-2 · Cited by 99
Denning, T., Andrew, A. H., Chaudhri, R., Hartung, C., Lester, J., Borriello, G., & Duncan, G. E. (2009) · IEEE Workshop on Mobile Computing Systems and Applications (WMCSA) · doi:10.1145/1514411.1514416 · Cited by 84
Embedding Behavior Modification Strategies into a Consumer Electronic Device: A Case Study
Nawyn, J., Intille, S. S., & Larson, K. (2006) · Lecture notes in computer science · doi:10.1007/11853565_18 · Cited by 69
Madden, G. J. (2000) · Digital Commons - USU (Utah State University) · doi:10.4324/9781410605061 · Cited by 57
Lee, G., Tsai, C., Griswold, W. G., Raab, F., & Patrick, K. (2006) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1125451.1125645 · Cited by 53
Self-monitoring: A literature review of research and practice
Kopp, J. B. (1988) · Social Work Research and Abstracts · doi:10.1093/swra/24.4.8 · Cited by 53
Relapse prevention and the maintenance of optimal health.
Marlatt, G. A., & George, W. H. (1998) · Cited by 48
Twardella, D., Merx, H., Hahmann, H., Wüsten, B., Rothenbacher, D., & Brenner, H. (2005) · Heart · doi:10.1136/hrt.2005.067611 · Cited by 46
Exercise Compliance in Cardiac Rehabilitation
Radtke, K. L. (1989) · Rehabilitation Nursing · doi:10.1002/j.2048-7940.1989.tb01092.x · Cited by 40
Designing and remotely testing mobile diabetes video games
DeShazo, J. P., Harris, L. T., Turner, A. M., & Pratt, W. (2010) · Journal of Telemedicine and Telecare · doi:10.1258/jtt.2010.091012 · Cited by 32
Self-citationSelf-control and health behavior.
Logue, A. W. (2000) · Cited by 20
Flagged first, then by citations
3 of the 52 references couldn’t be matched to a known paper.
Cited by
Sorted by citations
Mohr, D. C., Schueller, S. M., Montague, E., Burns, M. N., & Rashidi, P. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3077 · Cited by 510
Mercer, K., Giangregorio, L., Schneider, E., Chilana, P., Li, M., & Grindrod, K. (2016) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4225 · Cited by 419
Persuasive technology in the real world
Fritz, T., Huang, E. M., Murphy, G. C., & Zimmermann, T. (2014) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557383 · Cited by 385
Exploring Goal-setting, Rewards, Self-monitoring, and Sharing to Motivate Physical Activity
Munson, S. A., & Consolvo, S. (2012) · International Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2012.248691 · Cited by 360
Self-citationMind the theoretical gap: interpreting, using, and developing behavioral theory in HCI research
Hekler, E. B., Klasnja, P., Froehlich, J. E., & Buman, M. P. (2013) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2470654.2466452 · Cited by 328
Self-citation
Metadata
- Authors
- Klasnja, P., Consolvo, S., & Pratt, W.
- Affiliations
- University of Washington (US)
- Intel (United States) (US)
- Venue
- Proceedings of the SIGCHI Conference on Human Factors in Computing Systems
- Publisher
- ACM
- Published
- 2011-05-07
- Pages
- 3063-3072
- OpenAlex
- W2003659858
- Cited by
- 414
- References
- 52
- Citations by year
- 2026: 14 · 2025: 23 · 2024: 24 · 2023: 21 · 2022: 24 · 2021: 38 · 2020: 24 · 2019: 26 · 2018: 36 · 2017: 33 · 2016: 43 · 2015: 40 · 2014: 34 · 2013: 21 · 2012: 11
- FWCI
- 16.21
- Type
- conference paper
- Language
- en
- Open access
- closed
- Locations
- CHI Conference on Human Factors in Computing Systems (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- health behavior change, technology evaluation, behaviour change interventions, self-monitoring, conditioning, physical activity, healthy eating, user experience, preliminary design
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
