Reflection Companion: A Conversational System for Engaging Users in Reflection on Physical Activity
The DOI matches its Crossref record; 83 of the 83 references it cites were found in a registry or an index.
Abstract
Mobile, wearable and other connected devices allow people to collect and explore large amounts of data about their own activities, behavior, and well-being. Yet, learning from-, and acting upon such data remain a challenge. The process of reflection has been identified as a key component of such learning. However, most tools do not explicitly design for reflection, carrying an implicit assumption that providing access to self-tracking data is sufficient. In this paper, we present Reflection Companion, a mobile conversational system that supports engaging reflection on personal sensed data, specifically physical activity data collected with fitness trackers. Reflection Companion delivers daily adaptive mini-dialogues and graphs to users' mobile phones to promote reflection. To generate our system's mini dialogues, we conducted a set of workshops with fitness trackers users, producing a diverse corpus of 275 reflection questions synthesized into a set of 25 reflection mini dialogues. In a 2-week field deployment with 33 active Fitbit users, we examined our system's ability to engage users in reflection through dialog. Results suggest that the mini-dialogues were successful in triggering reflection and that this reflection led to increased motivation, empowerment, and adoption of new behaviors. As a strong indicator of our system's value, 16 of the 33 participants elected to continue using the system for two additional weeks without compensation. We present our findings and describe implications for the design of technology-supported dialog systems for reflection on data.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Interventions that cue users to reflect on their goals and strategies via question prompts or conversational interfaces have been shown to improve outcomes in the workplace [92,122,209], education [51], and other domains [17,147].”
From The Metacognitive Demands and Opportunities of Generative AI (2024) · cites this paper as [92]
In the citing paper
“In 3 studies, conversational agents were used for healthy behavior change, specifically targeting smoking cessation, alcohol misuse treatment, and physical activity promotion [72,73,89].”
From Conversational Agents in Health Care: Scoping Review and Conceptual Analysis (2020) · cites this paper as [89]
In the citing paper
“Moreover, 16 of the 33 participants opted to continue without any reward, suggesting participants found some added value in using the conversational system [89].”
From Conversational Agents in Health Care: Scoping Review and Conceptual Analysis (2020) · cites this paper as [89]
In the citing paper
“For physical activity promotion through the use of a reflection companion, response rates were high (96% at baseline, 90% at follow-up), insinuating high engagement throughout the study.”
From Conversational Agents in Health Care: Scoping Review and Conceptual Analysis (2020) · cites this paper as [89]
In the citing paper
“The conversations successfully triggered self-reflections that led to increased motivation, empowerment, and adoption of physical activity behaviors (eg, walking to a grocery store instead of taking a car) [26].”
Citations
Cites
The theory of planned behavior
Ajzen, I. (1991) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(91)90020-t · Cited by 90,587
(1983) · Cited by 33,192
Advances In Experimental Social Psychology
(2022) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(22)x0002-6 · Cited by 22,259
Schwartz, S. H. (1992) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60281-6 · Cited by 14,619
Metacognition and cognitive monitoring: A new area of cognitive–developmental inquiry
Flavell, J. H. (1979) · American Psychologist · doi:10.1037/0003-066x.34.10.906 · Cited by 11,282
A systematic analysis of performance measures for classification tasks
Sokolova, M., & Lapalme, G. (2009) · Information Processing & Management · doi:10.1016/j.ipm.2009.03.002 · Cited by 7,515
Construal-level theory of psychological distance.
Trope, Y., & Liberman, N. (2010) · Psychological Review · doi:10.1037/a0018963 · Cited by 6,618 · cited 2×
“Much prior work has discussed the importance of reflection in behavior change [54], has suggested that reflection can lead to greater awareness of underlying needs [53], has helped people understand their motivations and focus on higher-level goals [14,76].”
BackgroundMaps of Bounded Rationality: Psychology for Behavioral Economics
Kahneman, D. (2003) · American Economic Review · doi:10.1257/000282803322655392 · Cited by 5,377 · cited 1×
“Such conversations can elicit contemplative [41] and metacognitive [28] thinking, encouraging people to think about the needs and wants beyond their first answers that come to mind.”
BackgroundClark, H. H. (1996) · doi:10.1017/cbo9780511620539 · Cited by 5,123
(1985) · Medical Entomology and Zoology · Cited by 3,952
On the Self-Regulation of Behavior
Wright, B. R. E., Carver, C. S., & Scheier, M. F. (2000) · Contemporary Sociology · doi:10.2307/2654424 · Cited by 3,327
Nass, C., Steuer, J., & Tauber, E. R. (1994) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/191666.191703 · Cited by 2,148 · cited 1×
“The paradigm of computers as social actors [63] argues that people will apply social rules to a computer.”
Learning by doing : a guide to teaching and learning methods
Gibbs, G. (1998) · doi:10.24384/2ewd-qj09 · Cited by 2,141
Reflection in Learning and Professional Development: Theory and Practice
Moon, J. A. (2005) · Cited by 1,478
Measuring mindfulness—The Freiburg Mindfulness Inventory (FMI)
Walach, H., Buchheld, N., Buttenmüller, V., Kleinknecht, N., & Schmidt, S. (2006) · Personality and Individual Differences · doi:10.1016/j.paid.2005.11.025 · Cited by 1,475 · cited 1×
“…using a 9-item questionnaire from [39], level of reflection around self-tracking using an adaptation of Kember’s 12-item questionnaire with 4 constructs of habitual action, understanding, reflection, and critical reflection, from [42] and general mindfulness using a 13-item questionnaire from [78].”
MethodEstablishing and maintaining long-term human-computer relationships
Bickmore, T. W., & Picard, R. W. (2005) · ACM Transactions on Computer-Human Interaction · doi:10.1145/1067860.1067867 · Cited by 1,333 · cited 4×
“This is especially important for the purpose of continuous, everyday coach like interaction [11,12].”
BackgroundInfluentialA stage-based model of personal informatics systems
Li, I., Dey, A., & Forlizzi, J. (2010) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1753326.1753409 · Cited by 1,100 · cited 3×
“Much prior work has discussed the importance of reflection in behavior change [54], has suggested that reflection can lead to greater awareness of underlying needs [53], has helped people understand their motivations and focus on higher-level goals [14,76].”
BackgroundFish’n’Steps: Encouraging Physical Activity with an Interactive Computer Game
Lin, J. J., Mamykina, L., Lindtner, S., Delajoux, G., & Strub, H. B. (2006) · Lecture Notes in Computer Science · doi:10.1007/11853565_16 · Cited by 839
Development of a Questionnaire to Measure the Level of Reflective Thinking
Kember, D., Leung, D. Y. P., Jones, A., Loke, A. Y., McKay, J., Sinclair, K., Tse, H., Webb, C., Yuet Wong, F. K., Wong, M., et al. (2000) · Assessment & Evaluation in Higher Education · doi:10.1080/713611442 · Cited by 812
Kim, Y. H., Kim, D. J., & Wachter, K. (2013) · Decision Support Systems · doi:10.1016/j.dss.2013.07.002 · Cited by 769
Understanding quantified-selfers' practices in collecting and exploring personal data
Choe, E. K., Lee, N. B., Lee, B., Pratt, W., & Kientz, J. A. (2014) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2556288.2557372 · Cited by 766 · cited 2×
“All of this data, however, becomes truly useful only when it facilitates learning for the purpose of increasing awareness of one’s own behavior or the environment [15], making better future decisions [26], or supporting increased understanding [19].”
BackgroundReflection: a review of the literature
Atkins, S., & Murphy, K. (1993) · Journal of Advanced Nursing · doi:10.1046/j.1365-2648.1993.18081188.x · Cited by 703 · cited 1×
“Conveniently, Atkins and Murphy [4] in their review of literature on reflection, identified three commonly-shared stages: awareness of uncomfortable feeling and thought , critical analysis , and development of new perspective .”
BackgroundSlow Technology – Designing for Reflection
Hallnäs, L., & Redström, J. (2001) · Personal and Ubiquitous Computing · doi:10.1007/pl00000019 · Cited by 693 · cited 1×
“At the same time, we confirmed indications from prior work, that reflection is a slow process that requires time [37].”
ResultLeCompte, M. D. (2000) · Theory Into Practice · doi:10.1207/s15430421tip3903_5 · Cited by 536 · cited 1×
“This process required several iterations and followed a general procedure for analysis of qualitative data described in [52].”
MethodSpoken Language Understanding: Systems for Extracting Semantic Information from Speech
Tür, G., & Mori, R. D. (2011) · Cited by 510
A lived informatics model of personal informatics
Epstein, D. A., Ping, A., Fogarty, J., & Munson, S. A. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2804250 · Cited by 498
Understanding my data, myself: supporting self-reflection with ubicomp technologies
Li, I., Dey, A. K., & Forlizzi, J. (2011) · Proceedings of the 13th international conference on Ubiquitous computing · doi:10.1145/2030112.2030166 · Cited by 459
Portnoy, D. B., Scott-Sheldon, L. A. J., Johnson, B. T., & Carey, M. P. (2008) · Preventive Medicine · doi:10.1016/j.ypmed.2008.02.014 · Cited by 451
(2013) · doi:10.4324/9781315059051 · Cited by 449
Reflection as a visible outcome for preservice teachers
Ward, J. R., & McCotter, S. S. (2004) · Teaching and Teacher Education · doi:10.1016/j.tate.2004.02.004 · Cited by 425
How Can Decision Making Be Improved?
Milkman, K. L., Chugh, D., & Bazerman, M. H. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01142.x · Cited by 425
Flowers or a robot army?: encouraging awareness & activity with personal, mobile displays
Consolvo, S., Klasnja, P., McDonald, D. W., Avrahami, D., Froehlich, J., LeGrand, L., Libby, R., Mosher, K., & Landay, J. A. (2008) · Proceedings of the 10th international conference on Ubiquitous computing · doi:10.1145/1409635.1409644 · Cited by 397
Self-citationJolly, K., Lewis, A., Beach, J., Denley, J., Adab, P., Deeks, J. J., Daley, A., & Aveyard, P. (2011) · BMJ · doi:10.1136/bmj.d6500 · Cited by 359 · cited 2×
“Human-provided counseling sessions happen infrequently, no more than once or twice a week [74], similar to the frequency of meetings observed in programs such as Weight Watchers [40].”
BackgroundMAHI: investigation of social scaffolding for reflective thinking in diabetes management
Mamykina, L., Mynatt, E., Davidson, P., & Greenblatt, D. (2008) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1357054.1357131 · Cited by 355 · cited 2×
“In this respect, reflection has been identified as one of the key processes that can support such learning [27], which can be applied in behavior change context [56,59], as well in other domains [6,44].”
BackgroundFujita, K., & Han, H. A. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02372.x · Cited by 324 · cited 3×
“Reflection can further help people focus on long-term consequences of their choice and make decisions that are more in line with their identities [3], which also makes them more likely to tolerate short term discomfort [32].”
BackgroundReflecting on reflection: framing a design landscape
Fleck, R., & Fitzpatrick, G. (2010) · Proceedings of the 22nd Conference of the Computer-Human Interaction Special Interest Group of Australia on Computer-Human Interaction · doi:10.1145/1952222.1952269 · Cited by 319 · cited 10×
“When the purpose of reflection is more formal, such as in the case of learning from one’s physical activity patterns, structured support or guidance around reflection is of particular value [29].”
BackgroundInfluentialUsing Journal Writing to Enhance Student Teachers’ Reflectivity During Field Experience Placements
Bain, J. D., Ballantyne, R., Packer, J., & Mills, C. (1999) · Teachers and Teaching · doi:10.1080/1354060990050104 · Cited by 299 · cited 1×
“Kolb’s learning cycle defines 4 stages [51], Gibb’s reflective cycle proposes 6 stages [34], and both Moon’s levels of learning [62] and Bain’s 5Rs framework [5] suggest 5 stages (or levels) of reflection.”
BackgroundThe role of situation awareness in naturalistic decision making.
Endsley, M. R. (1997) · Cited by 267
Reviewing reflection: on the use of reflection in interactive system design
Baumer, E. P. S., Khovanskaya, V., Matthews, M., Reynolds, L., Schwanda Sosik, V., & Gay, G. (2014) · Proceedings of the 2014 conference on Designing interactive systems · doi:10.1145/2598510.2598598 · Cited by 266 · cited 5×
“As noted in [8] “prior work carries an implicit assumption that by providing access to data that has been ‘prepared, combined, and transformed’ for the purpose of reflection, reflection will occur.””
BackgroundInfluentialReflective Informatics: Conceptual Dimensions for Designing Technologies of Reflection
Baumer, E. P. S. (2015) · Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems · doi:10.1145/2702123.2702234 · Cited by 254 · cited 3×
“A key component for bridging this gap is to facilitate reflection [7, 17, 56].”
BackgroundMAINTAINING ENGAGEMENT IN LONG-TERM INTERVENTIONS WITH RELATIONAL AGENTS
Bickmore, T., Schulman, D., & Yin, L. (2010) · Applied Artificial Intelligence · doi:10.1080/08839514.2010.492259 · Cited by 246 · cited 2×
“This is especially important for the purpose of continuous, everyday coach like interaction [11,12].”
BackgroundHealth dialog systems for patients and consumers
Bickmore, T., & Giorgino, T. (2006) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.12.004 · Cited by 242
AffectAura: an intelligent system for emotional memory
McDuff, D., Karlson, A., Kapoor, A., Roseway, A., & Czerwinski, M. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208525 · Cited by 242 · cited 1×
“Indeed, one main means of facilitating reflection in behavior change and personal informatics relies on visualizations of self-tracking data, such as Fish’n’Steps [57], UbiFitGarden [22] for physical activity; Affect Aura [60] for affective states and LifelogExplorer [47] for stress.”
BackgroundBewick, B. M., Trusler, K., Barkham, M., Hill, A. J., Cahill, J., & Mulhern, B. (2008) · Preventive Medicine · doi:10.1016/j.ypmed.2008.01.005 · Cited by 233 · cited 1×
“Indeed an accumulated body of research has demonstrated the efficacy of human-counseling-inspired computer-based interventions [9, 44].”
BackgroundThe Role of Feedback in the Process of Health Behavior Change
DiClemente, C. C., Marinilli, A. S., Singh, M., & Bellino, L. E. (2001) · American Journal of Health Behavior · doi:10.5993/ajhb.25.3.8 · Cited by 215 · cited 1×
“This data can be related to the personal physical activity [35], stress monitoring [48, 49], urban spaces [30], all the way to energy conservation [25].”
BackgroundSchumann, D. W., Petty, R. E., & Clemons, D. S. (1990) · Journal of Consumer Research · doi:10.1086/208549 · Cited by 210 · cited 1×
“This is valuable, but limited [71].”
Educational Data Mining: Applications and Trends
(2014) · Studies in Computational Intelligence · doi:10.1007/978-3-319-02738-8 · Cited by 204
Understanding individuals' personal values from social media word use
Chen, J., Hsieh, G., Mahmud, J., & Nichols, J. W. (2014) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2531602.2531608 · Cited by 202 · cited 1×
“One’s values can be assessed with a survey [20] or based on language use [16].”
BackgroundSelf-citationIs Language the Key to Human Intelligence?
Premack, D. (2004) · Science · doi:10.1126/science.1093993 · Cited by 201 · cited 1×
“Conversation is a phenomenon naturally associated with intelligence [67].”
BackgroundUbiquitous computing: An overview of technology impacts
Friedewald, M., & Raabe, O. (2011) · Telematics and Informatics · doi:10.1016/j.tele.2010.09.001 · Cited by 195 · cited 1×
“The abundance of wearable sensors, mobile and IoT devices, as well as other types of UbiComp technologies together with connected cloud platforms enable collection and storage of copious amounts of data [31, 50].”
BackgroundUnderstanding self-reflection: how people reflect on personal data through visual data exploration
Choe, E. K., Lee, B., Zhu, H., Riche, N. H., & Baur, D. (2017) · Proceedings of the 11th EAI International Conference on Pervasive Computing Technologies for Healthcare · doi:10.1145/3154862.3154881 · Cited by 194 · cited 2×
“Also recent work on peoples’ insights from reflection on quantified-self data can provide such new topics [18].”
BackgroundHow do we engage with activity trackers?: a longitudinal study of Habito
Gouveia, R., Karapanos, E., & Hassenzahl, M. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2804290 · Cited by 194 · cited 2×
“This data can be related to the personal physical activity [35], stress monitoring [48, 49], urban spaces [30], all the way to energy conservation [25].”
BackgroundThe Number of Distinct Basic Values and Their Structure Assessed by PVQ–40
Cieciuch, J., & Schwartz, S. H. (2012) · Journal of Personality Assessment · doi:10.1080/00223891.2012.655817 · Cited by 184
Foth, M., Choi, J. H.-J., & Satchell, C. (2011) · Proceedings of the ACM 2011 conference on Computer supported cooperative work · doi:10.1145/1958824.1958826 · Cited by 172 · cited 1×
“This data can be related to the personal physical activity [35], stress monitoring [48, 49], urban spaces [30], all the way to energy conservation [25].”
BackgroundAkerlof, G. A., & Kranton, R. E. (2010) · The Economists Voice · doi:10.2202/1553-3832.1762 · Cited by 161
SleepTight: low-burden, self-monitoring technology for capturing and reflecting on sleep behaviors
Choe, E. K., Lee, B., Kay, M., Pratt, W., & Kientz, J. A. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2804266 · Cited by 155
Smart technologies for long-term stress monitoring at work
Kocielnik, R., Sidorova, N., Maggi, F. M., Ouwerkerk, M., & Westerink, J. H. D. M. (2013) · Proceedings of the 26th IEEE International Symposium on Computer-Based Medical Systems · doi:10.1109/cbms.2013.6627764 · Cited by 154
Self-citationDesigning for Workplace Reflection: A Chat and Voice-Based Conversational Agent
Kocielnik, R., Avrahami, D., Marlow, J., Lu, D., & Hsieh, G. (2018) · Designing Interactive Systems Conference · doi:10.1145/3196709.3196784 · Cited by 154 · cited 2×
“In this respect, reflection has been identified as one of the key processes that can support such learning [27], which can be applied in behavior change context [56,59], as well in other domains [6,44].”
BackgroundSelf-citationWang, Y.-Y., Deng, L., & Acero, A. (2005) · IEEE Signal Processing Magazine · doi:10.1109/msp.2005.1511821 · Cited by 127 · cited 1×
“We used intent-models to convert the free-text in user response into a machine-readable meaning representation [77,79].”
MethodReflective Practicum: A Framework of Sensitising Concepts to Design for Transformative Reflection
Slovák, P., Frauenberger, C., & Fitzpatrick, G. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025516 · Cited by 123 · cited 2×
“On the other hand, too infrequent reflection can cause people to forget previous revelations, preventing them from building up on past observations and disrupting support for reflection as a process [73].”
BackgroundCalendar.help: Designing a Workflow-Based Scheduling Agent with Humans in the Loop
Cranshaw, J., Elwany, E., Newman, T., Kocielnik, R., Yu, B., Soni, S., Teevan, J., & Monroy-Hernández, A. (2017) · Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3025453.3025780 · Cited by 106 · cited 1×
“Finally, the long time between subsequent mini-dialogues also permits the use of crowd-sourcing [23].”
BackgroundSelf-citationCarver, C. S., & Scheier, M. F. (2000) · Cited by 103
Lindström, M., Ståhl, A., Höök, K., Sundström, P., Laaksolathi, J., Combetto, M., Taylor, A. S., & Bresin, R. (2006) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1125451.1125649 · Cited by 90 · cited 1×
“The other approach relies on journaling [65], such as SleepTight [17] for sleep and Affective Diary [58] for manual journaling of emotions.”
MethodLee, M. K., Kim, J., Forlizzi, J., & Kiesler, S. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2807552 · Cited by 76 · cited 5×
“Yet human coaches of behavior change take much more active approaches, asking reflective questions that can help people articulate their underlying needs and goals and increase their motivation [53].”
BackgroundInfluentialApplying quantified self approaches to support reflective learning
Rivera-Pelayo, V., Zacharias, V., Müller, L., & Braun, S. (2012) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/2330601.2330631 · Cited by 74 · cited 2×
“Consequently technology has struggled to successfully support refection in practice [29, 68].”
BackgroundWilliams, J. D., Kamal, E., Ashour, M., Amr, H., Miller, J. S., & Zweig, G. (2015) · Annual Meeting of the Special Interest Group on Discourse and Dialogue · doi:10.18653/v1/w15-4622 · Cited by 72 · cited 6×
“Microsoft’s online LUIS platform is accessible through REST calls and therefore can be easily linked to any application.”
BackgroundMethodInfluentialThe search dashboard: how reflection and comparison impact search behavior
Bateman, S., Teevan, J., & White, R. W. (2012) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/2207676.2208311 · Cited by 69 · cited 1×
“In this respect, reflection has been identified as one of the key processes that can support such learning [27], which can be applied in behavior change context [56,59], as well in other domains [6,44].”
BackgroundCalendar.Help: Designing a Workflow-Based Scheduling Agent with Humans in the LoopPreprint
Cranshaw, J., Kocielnik, R., Yu, B., & Teevan, J. B. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.2940295 · Cited by 67
Self-citationHänsel, K., Wilde, N., Haddadi, H., & Alomainy, A. (2015) · Wireless Mobile Communication and Healthcare · doi:10.4108/eai.14-10-2015.2261601 · Cited by 56
Know thyself: monitoring and reflecting on facets of one's life
Li, I., Forlizzi, J., & Dey, A. (2010) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/1753846.1754181 · Cited by 55 · cited 4×
“A key component for bridging this gap is to facilitate reflection [7, 17, 56].”
BackgroundInfluentialSchulman, D. J., Bickmore, T., & Sidner, C. L. (2011) · Cited by 46
Send Me a Different Message: Utilizing Cognitive Space to Create Engaging Message Triggers
Kocielnik, R., & Hsieh, G. (2017) · ACM Conference on Computer Supported Cooperative Work (CSCW) · doi:10.1145/2998181.2998324 · Cited by 46 · cited 4×
“Too frequent requests for reflection can potentially make the topics to reflect on repetitive and can lead to boredom or frustration given similar activity data and finite diversity of our mini-dialogues [46].”
BackgroundInfluentialSelf-citationRapidly Scaling Dialog Systems with Interactive Learning
Williams, J. D., Niraula, N. B., Dasigi, P., Lakshmiratan, A., Suarez, C. G. J., Reddy, M., & Zweig, G. (2015) · Springer eBooks · doi:10.1007/978-3-319-19291-8_1 · Cited by 39 · cited 2×
“Intent models as supervised classifiers require examples of user utterances to be trained on [82].”
BackgroundPersonal informatics and reflection: a critical examination of the nature of reflection
Pirzadeh, A., He, L., & Stolterman, E. (2013) · CHI '13 Extended Abstracts on Human Factors in Computing Systems · doi:10.1145/2468356.2468715 · Cited by 36 · cited 1×
“The other approach relies on journaling [65], such as SleepTight [17] for sleep and Affective Diary [58] for manual journaling of emotions.”
MethodPersonalized Stress Management: Enabling Stress Monitoring with LifelogExplorer
Kocielnik, R., & Sidorova, N. (2015) · Künstliche Intell. · doi:10.1007/s13218-015-0348-1 · Cited by 32
Self-citationDesigning Persuasive Dialogue Systems: Using Argumentation with Care
Nguyen, H. P. N., & Masthoff, J. (2008) · Lecture notes in computer science · doi:10.1007/978-3-540-68504-3_18 · Cited by 30 · cited 2×
“Reflection was not the main focus, and when used related to reflective listening from motivational interviewing, where the approach for reflection is to provide a “tell me more” prompt or simply restate what the user said [64].”
BackgroundMethodÅberg, J. (2017) · DiVA (Digitala Vetenskapliga Arkivet) · Cited by 11
Culture and Facial Expressions: A Case Study with a Speech Interface
Dhillon, B., Kocielnik, R., Politis, I., Swerts, M. G. J., & Szostak, D. (2011) · Lecture notes in computer science · doi:10.1007/978-3-642-23771-3_29 · Cited by 10 · cited 1×
“Yet another option could be tailoring the dialogue structure itself, which has been explored for cultures [24].”
BackgroundSelf-citationEnabling self-reflection with LifelogExplorer: generating simple views from complex data
Kocielnik, R., Maggi, F. M., & Sidorova, N. (2013) · TU/e Research Portal · doi:10.5555/2534504.2534544 · Cited by 10
Self-citationStress Analytics in Education.
Kocielnik, R., Pechenizkiy, M., & Sidorova, N. (2012) · TU/e Research Portal · Cited by 9
Self-citationKocielnik, R., & Hsieh, G. (2018) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3172944.3173156 · Cited by 4 · cited 1×
“Reflection in personal informatics offers a unique challenge for computer-based dialogue systems as it relies on open user responses, is relatively frequent and requires novel perspectives to engage users each time over long-term [45].”
BackgroundSelf-citationFreiburg Mindfulness Inventory
Walach, H., Buchheld, N., Buttenmüller, V., Kleinknecht, N., & Schmidt, S. (2006) · PsycTESTS Dataset · doi:10.1037/t04847-000 · Cited by 4
Comment on George Akerlof and Rachel Kranton: Contexts of Identity Formation
Ettlinger, N. (2010) · The Economists Voice · doi:10.2202/1553-3832.1794 · Cited by 1
Research works printed but not linked: 3
- 10.5555/2042118.2042156 · doi:10.5555/2042118.2042156
- Claudia Gama. 2001. Helping students to help themselves: a pilot experiment on the ways of increasing metacognitive awareness in problem solving. Proc. of New Technologies in Science Education.
- Hyehyun Hong. 2009. Scale development for measuring health consciousness: Re-conceptualization. In 12th annual international public relations research conference, Holiday Inn University of Miami Coral Gables, Florida. Retrieved from http://www.instituteforpr.org/wp-content/uploads/ScaleDvlpmentMeasuring.pdf
Cited by
Conversational Agents in Health Care: Scoping Review and Conceptual Analysis
Tudor Car, L., Dhinagaran, D. A., Kyaw, B. M., Kowatsch, T., Joty, S., Theng, Y.-L., & Atun, R. (2020) · Journal of Medical Internet Research · doi:10.2196/17158 · Cited by 553
The Metacognitive Demands and Opportunities of Generative AI
Tankelevitch, L., Kewenig, V., Simkute, A., Scott, A. E., Sarkar, A., Sellen, A., & Rintel, S. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642902 · Cited by 493
Zhang, J., Oh, Y. J., Lange, P., Yu, Z., & Fukuoka, Y. (2020) · Journal of Medical Internet Research · doi:10.2196/22845 · Cited by 363
The Personalization of Conversational Agents in Health Care: Systematic Review
Kocaballi, A. B., Berkovsky, S., Quiroz, J. C., Laranjo, L., Tong, H. L., Rezazadegan, D., Briatore, A., & Coiera, E. (2019) · Journal of Medical Internet Research · doi:10.2196/15360 · Cited by 332
“…narrative skills [36], symptom summaries [37], meditation practice [38], and current progress towards the goals set [39,40,46,47]; (2) reminders [37,47], warnings, and alerts [39,40,42,43]; (3) multimedia [35,46]; and (4) questions on pain [41], physical activity [46], and health status [42,43].”
BackgroundInfluentialOh, Y. J., Zhang, J., Fang, M.-L., & Fukuoka, Y. (2021) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-021-01224-6 · Cited by 278
Metadata
- Authors
- Kocielnik, R., Xiao, L., Avrahami, D., & Hsieh, G.
- Affiliations
- Human Centered Design 8 Engineering, University of Washington, Seattle, WA, USA
- University of Washington (US)
- FX Palo Alto Laboratory (US)
- ORCID
- Hsieh, Gary
- Venue
- Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies
- Published
- 2018-07-05
- Volume
- 2
- Issue
- 2
- Pages
- 1-26
- ISSN
- 2474-9567 (ISSN-L)
- OpenAlex
- W2866044803
- Cited by
- 221
- References
- 82
- Citations by year
- 2026: 33 · 2025: 37 · 2024: 37 · 2023: 32 · 2022: 29 · 2021: 26 · 2020: 16 · 2019: 10 · 2018: 1
- FWCI
- 13.22
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Physical Sciences › Computer Science › Computer Vision and Pattern Recognition › Context-Aware Activity Recognition Systems
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Keywords
- reflection, self-tracking, wearable activity trackers, reflective questions, physical activity data, behavior change, user motivation, Fitbit
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.