Automated Indexing of Internet Stories for Health Behavior Change: Weight Loss Attitude Pilot Study
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Automated health behavior change interventions show promise, but suffer from high attrition and disuse. The Internet abounds with thousands of personal narrative accounts of health behavior change that could not only provide useful information and motivation for others who are also trying to change, but an endless source of novel, entertaining stories that may keep participants more engaged than messages authored by interventionists. OBJECTIVE: Given a collection of relevant personal health behavior change stories gathered from the Internet, the aim of this study was to develop and evaluate an automated indexing algorithm that could select the best possible story to provide to a user to have the greatest possible impact on their attitudes toward changing a targeted health behavior, in this case weight loss. METHODS: An indexing algorithm was developed using features informed by theories from behavioral medicine together with text classification and machine learning techniques. The algorithm was trained using a crowdsourced dataset, then evaluated in a 2×2 between-subjects randomized pilot study. One factor compared the effects of participants reading 2 indexed stories vs 2 randomly selected stories, whereas the second factor compared the medium used to tell the stories: text or animated conversational agent. Outcome measures included changes in self-efficacy and decisional balance for weight loss before and after the stories were read. RESULTS: Participants were recruited from a crowdsourcing website (N=103; 53.4%, 55/103 female; mean age 35, SD 10.8 years; 65.0%, 67/103 precontemplation; 19.4%, 20/103 contemplation for weight loss). Participants who read indexed stories exhibited a significantly greater increase in self-efficacy for weight loss compared to the control group (F1,107=5.5, P=.02). There were no significant effects of indexing on change in decisional balance (F1,97=0.05, P=.83) and no significant effects of medium on change in self-efficacy (F1,107=0.04, P=.84) or decisional balance (F1,97=0.78, P=.38). CONCLUSIONS: Personal stories of health behavior change can be harvested from the Internet and used directly and automatically in interventions to affect participant attitudes, such as self-efficacy for changing behavior. Such approaches have the potential to provide highly tailored interventions that maximize engagement and retention with minimal intervention development effort.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Does tailoring matter? Meta-analytic review of tailored print health behavior change interventions
Noar, S. M., Benac, C. N., & Harris, M. S. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.4.673 · Cited by 2,136
The general self-efficacy scale: multicultural validation studies
Luszczynska, A., Scholz, U., & Schwarzer, R. (2005) · The Journal of Psychology · doi:10.3200/jrlp.139.5.439-457 · Cited by 1,878 · cited 1×
“Weight loss self-efficacy was measured at enrollment and at the end of the intervention using a validated 10-item questionnaire [42].”
Understanding tailoring in communicating about health
Hawkins, R. P., Kreuter, M., Resnicow, K., Fishbein, M., & Dijkstra, A. (2008) · Health Education Research · doi:10.1093/her/cyn004 · Cited by 934 · cited 2×
“Tailoring is thought to work by making messages more subjectively relevant and thus increasing the likelihood that individuals will process and internalize them [36].”
Establishing the computer-patient working alliance in automated health behavior change interventions
Bickmore, T., Gruber, A., & Picard, R. (2005) · Patient Education and Counseling · doi:10.1016/j.pec.2004.09.008 · Cited by 494 · cited 1×
“…agents that simulate face-to-face counseling sessions with a health professional have been shown to be well-accepted and a good vehicle for conveying the social dimensions of health messages [15,16], and have also been used to deliver stories to users in health care interventions [17,18].”
Self-citationBickmore, T. W., Pfeifer, L. M., Byron, D., Forsythe, S., Henault, L. E., Jack, B. W., Silliman, R., & Paasche-Orlow, M. K. (2010) · Journal of Health Communication · doi:10.1080/10810730.2010.499991 · Cited by 249 · cited 1×
“…agents that simulate face-to-face counseling sessions with a health professional have been shown to be well-accepted and a good vehicle for conveying the social dimensions of health messages [15,16], and have also been used to deliver stories to users in health care interventions [17,18].”
Self-citationHealth dialog systems for patients and consumers
Bickmore, T., & Giorgino, T. (2006) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2005.12.004 · Cited by 242 · cited 1×
“Several prior studies have now demonstrated the efficacy of health interventions delivered by automated natural language dialog [14].”
Self-citationNandi, A., Glymour, M. M., & Subramanian, S. V. (2014) · Epidemiology · doi:10.1097/ede.0000000000000038 · Cited by 237
Reaching Women through Health Information Technology: The Gabby Preconception Care System
Gardiner, P., Hempstead, M. B., Ring, L., Bickmore, T., Yinusa-Nyahkoon, L., Tran, H., Paasche-Orlow, M., Damus, K., & Jack, B. (2013) · American Journal of Health Promotion · doi:10.4278/ajhp.1200113-quan-18 · Cited by 88 · cited 1×
“…agents that simulate face-to-face counseling sessions with a health professional have been shown to be well-accepted and a good vehicle for conveying the social dimensions of health messages [15,16], and have also been used to deliver stories to users in health care interventions [17,18].”
Self-citation
Cited by
Applications of Machine Learning in Real-Life Digital Health Interventions: Review of the Literature
Triantafyllidis, A. K., & Tsanas, A. (2019) · Journal of Medical Internet Research · doi:10.2196/12286 · Cited by 243
“The reviewed studies had several implications for clinical practice, such as better engagement of patients with interventions [22], the identification of risk for hospitalization [25], or the introduction of novel treatment methods [27].”
InfluentialMapping of Crowdsourcing in Health: Systematic Review
Créquit, P., Mansouri, G., Benchoufi, M., Vivot, A., & Ravaud, P. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9330 · Cited by 135
“selected for further evaluation, and 202 studies were included (182 published papers and 20 conference abstracts [3,16-216]).”
BackgroundGetting to Know Each Other: The Role of Social Dialogue in Recovery from Errors in Social Robots
Lucas, G. M., Boberg, J., Traum, D., Artstein, R., Gratch, J., Gainer, A., Johnson, E., Leuski, A., & Nakano, M. (2018) · Proceedings of the 2018 ACM/IEEE International Conference on Human-Robot Interaction · doi:10.1145/3171221.3171258 · Cited by 61
Slade, M., Rennick-Egglestone, S., Llewellyn-Beardsley, J., Yeo, C., Roe, J., Bailey, S., Smith, R. A., Booth, S., Harrison, J., Bhogal, A., et al. (2021) · JMIR Formative Research · doi:10.2196/24417 · Cited by 39
“interventions incorporating digital health narratives in relation to weight loss [11] and cancer [31], no randomized controlled trial has been conducted on the use of recorded mental health recovery narratives to benefit recipients.”
Background
Metadata
- Authors
- Manuvinakurike, R., Velicer, W. F., & Bickmore, T. W.
- Venue
- Journal of Medical Internet Research
- Publisher
- JMIR Publications Inc.
- Published
- 2014-12-09
- Volume
- 16
- Issue
- 12
- Pages
- e285
- ISSN
- 1438-8871 (ISSN-L)
- OpenAlex
- W2011960477
- Cited by
- 38
- References
- 8
- FWCI
- 42.64
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.