Let's Talk It Out: A Chatbot for Effective Study Habit Behavioral Change
The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Abstract
Research has shown study habits and skills to be correlated with academic success, calling for a deeper comprehension of these behaviors and processes to design effective interventions for struggling students. Chatbots have recently been used as a persuasive technology to help support behavioral change, making them an intriguing design space for students' study habits and skills. This paper investigated the feasibility of using chatbots for promoting behavioral change of college students majoring in Computer Science (CS). We conducted semi-structured interviews with CS peer-tutors and surveyed university freshmen to understand students' study habits and identify technical intervention opportunities. Inspired by the findings, we designed StudyBuddy, a chatbot prototype deployed in Slack that periodically sends tips, provides assessments of students' study habits via surveys, helps the students break down assignments, recommends academic resources, and sends reminders. We evaluated the usability of the prototype in-depth with 8 students (both first-year and senior students) and 5 course instructors followed by a large scale evaluative survey (n=117) using video of the prototype. Our research identified important design challenges such as building trust and preserving privacy, limiting interaction costs, and supporting both immediate and long-term sustainable support. Likewise, we proposed design recommendations that demonstrate context awareness, personalize the experience based on user preferences, and adapt over time as students mature and grow.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Chatbots can potentially enhance student engagement and retention by providing personalised recommendations, proactive reminders, and timely interventions (Tian et al., 2021).”
From Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania (2024) · cites this paper as Tian et al., 2021
In the citing paper
“Particularly, using rule-based chatbots to collect user reports may cause boredom in long-term deployments [99].”
From Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data (2024) · cites this paper as [99]
Citations
Cites
BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding
Devlin, J., Chang, M.-W., Lee, K., & Toutanova, K. (2018) · arXiv · doi:10.48550/arxiv.1810.04805 · Cited by 73,173
A behavior model for persuasive design
Fogg, B. (2009) · Proceedings of the 4th International Conference on Persuasive Technology · doi:10.1145/1541948.1541999 · Cited by 2,328 · cited 1×
“The task of getting an individual to change everyday behaviors, however, is difficult, which is why research has focused on the design of various technologies [13, 17, 24, 33, 53].”
BackgroundPersuasive technology: using computers to change what we think and do
Fogg, B. J. (2002) · Ubiquity · doi:10.1145/764008.763957 · Cited by 1,554
Vinyals, O., & Le, Q. (2015) · arXiv · doi:10.48550/arxiv.1506.05869 · Cited by 1,400
Persuasive System Design Does Matter: a Systematic Review of Adherence to Web-based Interventions
Kelders, S. M., Kok, R. N., Ossebaard, H. C., & Van Gemert-Pijnen, J. E. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.2104 · Cited by 1,308 · cited 1×
“The task of getting an individual to change everyday behaviors, however, is difficult, which is why research has focused on the design of various technologies [13, 17, 24, 33, 53].”
BackgroundInvestigating the determinants and age and gender differences in the acceptance of mobile learning
Wang, Y., Wu, M., & Wang, H. (2009) · British Journal of Educational Technology · doi:10.1111/j.1467-8535.2007.00809.x · Cited by 1,218
Chao, C.-M. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01652 · Cited by 1,041
The making of the motivated strategies for learning questionnaire.
Duncan, T. G., & McKeachie, W. J. (2005) · Educational Psychologist · doi:10.1207/s15326985ep4002_6 · Cited by 1,024
Mega, C., Ronconi, L., & De Beni, R. (2014) · Journal of Educational Psychology · doi:10.1037/a0033546 · Cited by 1,007
Interactive Robots as Social Partners and Peer Tutors for Children: A Field Trial
Kanda, T., Hirano, T., Eaton, D., & Ishiguro, H. (2004) · Human-Computer Interaction · doi:10.1207/s15327051hci1901&2_4 · Cited by 1,003
Theory-driven design strategies for technologies that support behavior change in everyday life
Consolvo, S., McDonald, D. W., & Landay, J. A. (2009) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1518701.1518766 · Cited by 592
Students’ Misconceptions and Other Difficulties in Introductory Programming: A Literature Review
Qian, Y., & Lehman, J. (2018) · ACM Transactions on Computing Education · doi:10.1145/3077618 · Cited by 529
Persuasive technology for health and wellness: State-of-the-art and emerging trends
Orji, R., & Moffatt, K. (2018) · Health Informatics Journal · doi:10.1177/1460458216650979 · Cited by 444 · cited 1×
“A common application of persuasive technology has been promoting behavior related to health and wellness, which encompasses a large portion of the literature [13, 44, 52, 53].”
BackgroundEarly Alert of Academically At-Risk Students: An Open Source Analytics Initiative
Jayaprakash, S. M., Moody, E. W., Lauría, E. J. M., Regan, J. R., & Baron, J. D. (2014) · Journal of Learning Analytics · doi:10.18608/jla.2014.11.3 · Cited by 414
(2015) · doi:10.1145/2750858.2804288 · Cited by 409
Beyer, S. (2014) · Computer Science Education · doi:10.1080/08993408.2014.963363 · Cited by 389
Understanding in-video dropouts and interaction peaks inonline lecture videos
Kim, J., Guo, P. J., Seaton, D. T., Mitros, P., Gajos, K. Z., & Miller, R. C. (2014) · Proceedings of the first ACM conference on Learning @ scale conference · doi:10.1145/2556325.2566237 · Cited by 370
Clawson, J., Pater, J. A., Miller, A. D., Mynatt, E. D., & Mamykina, L. (2015) · Proceedings of the 2015 ACM International Joint Conference on Pervasive and Ubiquitous Computing · doi:10.1145/2750858.2807554 · Cited by 307
What makes a good code example?: A study of programming Q&A in StackOverflow
Nasehi, S. M., Sillito, J., Maurer, F., & Burns, C. (2012) · 2012 28th IEEE International Conference on Software Maintenance (ICSM) · doi:10.1109/icsm.2012.6405249 · Cited by 287
Oh, K.-J., Lee, D., Ko, B., & Choi, H.-J. (2017) · 2017 18th IEEE International Conference on Mobile Data Management (MDM) · doi:10.1109/mdm.2017.64 · Cited by 285
Leite, I., Castellano, G., Pereira, A., Martinho, C., & Paiva, A. (2014) · International Journal of Social Robotics · doi:10.1007/s12369-014-0227-1 · Cited by 265
Fit4life: the design of a persuasive technology promoting healthy behavior and ideal weight
Purpura, S., Schwanda, V., Williams, K., Stubler, W., & Sengers, P. (2011) · Proceedings of the SIGCHI Conference on Human Factors in Computing Systems · doi:10.1145/1978942.1979003 · Cited by 264 · cited 2×
“A common application of persuasive technology has been promoting behavior related to health and wellness, which encompasses a large portion of the literature [13, 44, 52, 53].”
BackgroundGender differences in computer science students
Beyer, S., Rynes, K., Perrault, J., Hay, K., & Haller, S. (2003) · Proceedings of the 34th SIGCSE technical symposium on Computer science education · doi:10.1145/611892.611930 · Cited by 259
Persuasive technology in mobile applications promoting physical activity: a systematic review
Matthews, J., Win, K. T., Oinas-Kukkonen, H., & Freeman, M. (2016) · Journal of Medical Systems · doi:10.1007/s10916-015-0425-x · Cited by 239
Learning and Study Strategies Inventory (LASSI)
Weinstein, C. E., Palmer, D. R., & Schulte, A. C. (1987) · Cited by 239
Lane, N. D., Bhattacharya, S., Georgiev, P., Forlivesi, C., & Kawsar, F. (2015) · Proceedings of the 2015 International Workshop on Internet of Things towards Applications · doi:10.1145/2820975.2820980 · Cited by 228
Negotiating the Freshman Year: Challenges and Strategies Among First-Year College Students
Clark, M. R. (2005) · Journal of College Student Development · doi:10.1353/csd.2005.0022 · Cited by 219
Proceeding of the 44th ACM technical symposium on Computer science education
(2013) · doi:10.1145/2445196 · Cited by 166
Designing for Workplace Reflection: A Chat and Voice-Based Conversational Agent
Kocielnik, R., Avrahami, D., Marlow, J., Lu, D., & Hsieh, G. (2018) · Designing Interactive Systems Conference · doi:10.1145/3196709.3196784 · Cited by 154
Measuring young children's long-term relationships with social robots
Kory-Westlund, J. M., Park, H. W., Williams, R., & Breazeal, C. (2018) · ACM International Conference on Interaction Design and Children (IDC) · doi:10.1145/3202185.3202732 · Cited by 108
Coninx, A., Baxter, P., Oleari, E., Bellini, S., Bierman, B., Blanson Henkemans, O., Cañamero, L., Cosi, P., Enescu, V., Ros Espinoza, R., et al. (2015) · Journal of Human-Robot Interaction · doi:10.5898/jhri.5.1.coninx · Cited by 103
kBot: Knowledge-Enabled Personalized Chatbot for Asthma Self-Management
Kadariya, D., Venkataramanan, R., Yip, H. Y., Kalra, M., Thirunarayanan, K., & Sheth, A. (2019) · 2019 IEEE International Conference on Smart Computing (SMARTCOMP) · doi:10.1109/smartcomp.2019.00043 · Cited by 102
Huang, C.-Y., Yang, M., Huang, C.-Y., Chen, Y.-J., Wu, M.-L., & Chen, K. (2018) · IEEE International Conference on Industrial Engineering and Engineering Management (IEEM) · doi:10.1109/ieem.2018.8607399 · Cited by 99
TableChat: Mobile Food Journaling to Facilitate Family Support for Healthy Eating
Lukoff, K., Li, T., Zhuang, Y., & Lim, B. Y. (2018) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3274383 · Cited by 87
Situated Learning in Computer Science Education
Ben‐Ari, M. (2004) · Computer Science Education · doi:10.1080/08993400412331363823 · Cited by 81
Supporting Workplace Detachment and Reattachment with Conversational Intelligence
Williams, A. C., Kaur, H., Mark, G., Thompson, A. L., Iqbal, S. T., & Teevan, J. (2018) · Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems · doi:10.1145/3173574.3173662 · Cited by 79
MOOCBuddy: a Chatbot for personalized learning with MOOCs.
Holotescu, C. (2016) · RoCHI · Cited by 64
Supporting Interest in Science Learning with a Social Robot
Michaelis, J. E., & Mutlu, B. (2019) · Proceedings of the 18th ACM International Conference on Interaction Design and Children · doi:10.1145/3311927.3323154 · Cited by 64
A Graph Based Chatbot for Cancer Patients
Belfin, R. V., Shobana, A. J., Manilal, M., Mathew, A. A., & Babu, B. (2019) · 2019 5th International Conference on Advanced Computing & Communication Systems (ICACCS) · doi:10.1109/icaccs.2019.8728499 · Cited by 60
An examination of belongingness and confidence among female computer science students
Sankar, P., Gilmartin, J., & Sobel, M. (2015) · ACM SIGCAS Computers and Society · doi:10.1145/2809957.2809960 · Cited by 54
Developing, Implementing, and Assessing an Early Alert System
Tampke, D. R. (2013) · Journal of College Student Retention Research Theory & Practice · doi:10.2190/cs.14.4.e · Cited by 42
Murad, D. F., Iskandar, A. G., Fernando, E., Octavia, T. S., & Maured, D. E. (2019) · International Conference on Information Technology, Computer, and Electrical Engineering · doi:10.1109/icitacee.2019.8904311 · Cited by 22
Rick, S., Goldberg, A. P., & Weibel, N. (2019) · ACM International Conference on Intelligent User Interfaces (IUI) · doi:10.1145/3308557.3308712 · Cited by 19
Don’t be afraid! Persuasive Practices in the Wild
Dolata, M., & Schwabe, G. (2018) · Computer Supported Cooperative Work (CSCW) · doi:10.1007/s10606-018-9330-4 · Cited by 12
Validation of the Learning and Study Strategies Inventory With a Sample of Students in Nursing
Chacko, S. B., & Huba, M. E. (1991) · NACADA Journal · doi:10.12930/0271-9517-11.2.5 · Cited by 9
METHOD OF THE STUDENT’S MOTIVATION ASSESSMENT USING SMART CHATBOT
Zvereva, K., Девятков, В. В., Smirnova, E., & Manyashev, E. (2020) · INTED proceedings · doi:10.21125/inted.2020.0249 · Cited by 6
CREATING A VIRTUAL CHATBOT TO SCAFFOLD SKILLS DEVELOPMENT IN FIRST-YEAR ENGINEERING EDUCATION
Kreynin, I., Manek, M., & Variawa, C. (2019) · Proceedings of the Canadian Engineering Education Association (CEEA) · doi:10.24908/pceea.vi0.13784 · Cited by 4
Research works printed but not linked: 16
- Davide Calvaresi, Jean-Paul Calbimonte, Fabien Dubosson, Amro Najjar, and Michael Schumacher. 2019. Social Network Chatbots for Smoking Cessation: Agent and Multi-Agent Frameworks. In 2019 IEEE/WIC/ACM International Conference on Web Intelligence. IEEE, Thessaloniki, Greece, 286--292.
- S Chamundeswari, V Sridevi, and Archana Kumari. 2014. Self-Concept, Study Habit and Academic Achievement of Students. International Journal of Humanities Social Sciences and Education, Vol. 1, 10 (2014), 47--55.
- Emerson Collective. 2020. Supporting Students During COVID-19: Resources for Remote Learning. https://www.emersoncollective.com/covid19-resources-for-remote-learning Retrieved May 31, 2020 from
- 10.1111/j.1745--6924.2008.00089.x · doi:10.1111/j.1745--6924.2008.00089.x
- Benedict Du Boulay, Katerina Avramides, Rosemary Luckin, Erika Mart'inez-Mirón, Genaro Rebolledo Méndez, and Amanda Carr. 2010. Towards Systems that Care: a Conceptual Framework based on Motivation, Metacognition and Affect. International Journal of Artificial Intelligence in Education, Vol. 20, 3 (2010), 197--229.
- Andrew Emerson, Fernando J. Rodr'iguez, Bradford Mott, Andy Smith, Wookhee Min, Kristy Elizabeth Boyer, Cody Smith, Eric Wiebe, and James Lester. 2019. Predicting Early and Often: Predictive Student Modeling for Block-Based Programming Environments. In Proceedings of The 12th International Conference on Educational Data Mining (EDM 2019), Vol. 39. ERIC, 48.
- Johna Faulconer, Jayne Geissler, Diane Majewski, and John Trifilo. 2014. Adoption of an Early-Alert System to Support University Student Success. Delta Kappa Gamma Bulletin, Vol. 80, 2 (2014).
- Justin Filippou, Christopher Cheong, and France Cheong. 2016. Combining The Fogg Behavioural Model And Hook Model To Design Features In A Persuasive App To Improve Study Habits. arXiv preprint arXiv:1606.03531 (2016). · arXiv
- Ashok Goel, Brian Creeden, Mithun Kumble, Shanu Salunke, Abhinaya Shetty, and Bryan Wiltgen. 2015. Using Watson for Enhancing Human-Computer Co-Creativity. In 2015 AAAI Fall Symposium Series. AAAI 2015 Fall Symposium, Arlington, Virginia, 22--29.
- Olivier A Blanson Henkemans, Bert PB Bierman, Joris Janssen, Mark A Neerincx, Rosemarijn Looije, Hanneke van der Bosch, and Jeanine AM van der Giessen. 2013. Using a Robot to Personalise Health Education for Children with Diabetes Type 1: A Pilot Study. Patient education and counseling, Vol. 92, 2 (2013), 174--181.
- Randy A LaRose. 2009. The Relationship between Religiosity and Educational Pursuit and Perception. All Graduate Theses and Dissertations (2009).
- Carol Maher, Jillian Ryan, Christina Ambrosi, and Sarah Edney. 2017. Users' Experiences of Wearable Activity Trackers: a Cross-Sectional Study. BMC public health, Vol. 17, 1 (2017), 880.
- Joel McFarland, Bill Hussar, Jijun Zhang, Xiaolei Wang, Ke Wang, Sarah Hein, Melissa Diliberti, Emily Forrest Cataldi, Farrah Bullock Mann, and Amy Barmer. 2019. The Condition of Education 2019. NCES 2019--144. National Center for Education Statistics (2019).
- Jill M. Simons. 2011. A National Study of Student Early Alert Models at Four-Year Institutions of Higher Education. Ed.D. Arkansas State University, United States -- Arkansas. http://search.proquest.com/docview/910327556/abstract/97BE5A6AF7BB47B2PQ/1
- 10.1111/j.1467--8535.2007.00809.x · doi:10.1111/j.1467--8535.2007.00809.x
- Barry J Zimmerman. 1990. Self-Regulating Academic Learning and Achievement: The Emergence of a Social cognitive Perspective. Educational psychology review, Vol. 2, 2 (1990), 173--201.
Cited by
Use of ChatGPT in academia: Academic integrity hangs in the balance
Bin-Nashwan, S. A., Sadallah, M., & Bouteraa, M. (2023) · Technology in Society · doi:10.1016/j.techsoc.2023.102370 · Cited by 394
Dimitriadou, E., & Lanitis, A. (2023) · Smart Learning Environments · doi:10.1186/s40561-023-00231-3 · Cited by 370
Higher Education's Generative Artificial Intelligence Paradox: The Meaning of Chatbot Mania
Rudolph, J., Mohamed Ismail, F. M., & Popenici, S. (2024) · Journal of University Teaching and Learning Practice · doi:10.53761/54fs5e77 · Cited by 189
How educational chatbots support self-regulated learning? A systematic review of the literature
Guan, R., Raković, M., Chen, G., & Gašević, D. (2024) · Education and Information Technologies · doi:10.1007/s10639-024-12881-y · Cited by 220
Leveraging Large Language Models to Power Chatbots for Collecting User Self-Reported Data
Wei, J., Kim, S., Jung, H., & Kim, Y.-H. (2024) · Proceedings of the ACM on Human-Computer Interaction · doi:10.1145/3637364 · Cited by 84
Metadata
- Authors
- Tian, X., Risha, Z., Ahmed, I., Lekshmi Narayanan, A. B., & Biehl, J.
- Affiliations
- University of Florida (US)
- University of Pittsburgh (US)
- University of Pittsburgh, Pittsburgh, PA, USA
- Venue
- Proceedings of the ACM on Human-Computer Interaction
- Published
- 2021-04-13
- Volume
- 5
- Issue
- CSCW1
- Pages
- 1-32
- ISSN
- 2573-0142 (ISSN-L)
- OpenAlex
- W3158783733
- Cited by
- 37
- References
- 47
- Citations by year
- 2026: 6 · 2025: 16 · 2024: 9 · 2023: 4 · 2022: 2
- FWCI
- 1.33
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Proceedings of the ACM on Human-Computer Interaction (publishedVersion)
- Topics
- Physical Sciences › Computer Science › Artificial Intelligence › Intelligent Tutoring Systems and Adaptive Learning
- Social Sciences › Psychology › Social Psychology › Social Robot Interaction and HRI
- Physical Sciences › Computer Science › Human-Computer Interaction › Innovative Human-Technology Interaction
- Keywords
- chatbots, study habits, behavior change, persuasive technology, computer science students, Slack, peer tutoring, academic support, usability evaluation, trust and privacy, context awareness, first-year students
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.