Toward Increasing Engagement in Substance Use Data Collection: Development of the Substance Abuse Research Assistant App and Protocol for a Microrandomized Trial Using Adolescents and Emerging Adults
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Substance use is an alarming public health issue associated with significant morbidity and mortality. Adolescents and emerging adults are at particularly high risk because substance use typically initiates and peaks during this developmental period. Mobile health apps are a promising data collection and intervention delivery tool for substance-using youth as most teens and young adults own a mobile phone. However, engagement with data collection for most mobile health applications is low, and often, large fractions of users stop providing data after a week of use. OBJECTIVE: Substance Abuse Research Assistant (SARA) is a mobile application to increase or sustain engagement of substance data collection overtime. SARA provides a variety of engagement strategies to incentivize data collection: a virtual aquarium in the app grows with fish and aquatic resources; occasionally, funny or inspirational contents (eg, memes or text messages) are provided to generate positive emotions. We plan to assess the efficacy of SARA's engagement strategies over time by conducting a micro-randomized trial, where the engagement strategies will be sequentially manipulated. METHODS: We aim to recruit participants (aged 14-24 years), who report any binge drinking or marijuana use in the past month. Participants are instructed to use SARA for 1 month. During this period, participants are asked to complete one survey and two active tasks every day between 6 pm and midnight. Through the survey, we assess participants' daily mood, stress levels, loneliness, and hopefulness, while through the active tasks, we measure reaction time and spatial memory. To incentivize and support the data collection, a variety of engagement strategies are used. First, predata collection strategies include the following: (1) at 4 pm, a push notification may be issued with an inspirational message from a contemporary celebrity; or (2) at 6 pm, a push notification may be issued reminding about data collection and incentives. Second, postdata collection strategies include various rewards such as points which can be used to grow a virtual aquarium with fishes and other treasures and modest monetary rewards (up to US $12; US $1 for each 3-day streak); also, participants may receive funny or inspirational content as memes or gifs or visualizations of prior data. During the study, the participants will be randomized every day to receive different engagement strategies. In the primary analysis, we will assess whether issuing 4 pm push-notifications or memes or gifs, respectively, increases self-reporting on the current or the following day. RESULTS: The microrandomized trial started on August 21, 2017 and the trial ended on February 28, 2018. Seventy-three participants were recruited. Data analysis is currently underway. CONCLUSIONS: To the best of our knowledge, SARA is the first mobile phone app that systematically manipulates engagement strategies in order to identify the best sequence of strategies that keep participants engaged in data collection. Once the optimal strategies to collect data are identified, future versions of SARA will use this data to provide just-in-time adaptive interventions to reduce substance use among youth. TRIAL REGISTRATION: ClinicalTrials.gov NCT03255317; https://clinicaltrials.gov/show/NCT03255317 (Archived by WebCite at http://www.webcitation.org/70raGWV0e). REGISTERED REPORT IDENTIFIER: RR1-10.2196/9850.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
A behavior model for persuasive design
Fogg, B. (2009) · Proceedings of the 4th International Conference on Persuasive Technology · doi:10.1145/1541948.1541999 · Cited by 2,328 · cited 4×
“in multiple ways for SARA, such as (1) reducing self-input burden with predictions, for example, loneliness can be measured by inferring social interactions from the phone [33]; reducing self-input burden may increase engagement [77] and (2) risky times of substance misuse can be preanticipated from sensors; we expect…”
InfluentialA survey of mobile phone sensing
Lane, N., Miluzzo, E., Lu, H., Peebles, D., Choudhury, T., & Campbell, A. (2010) · IEEE Communications Magazine · doi:10.1109/mcom.2010.5560598 · Cited by 2,292
Mobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · cited 1×
“…or baseline or daily survey or Sunday’s survey, as well as the following 2 new threads of questions: (1) a 30-day Timeline Followback calendar, which captures past-month alcohol and marijuana consumption [100] and (2) Likert-type and open-ended questions to capture user experience of SARA [101].”
Effective techniques in healthy eating and physical activity interventions: A meta-regression.
Michie, S., Abraham, C., Whittington, C., McAteer, J., & Gupta, S. (2009) · Health Psychology · doi:10.1037/a0016136 · Cited by 2,229
Rankin, C. H., Abrams, T., Barry, R. J., Bhatnagar, S., Clayton, D. F., Colombo, J., Coppola, G., Geyer, M. A., Glanzman, D. L., Marsland, S., et al. (2009) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2008.09.012 · Cited by 1,665
Toward a theory of motivational interviewing
Miller, W. R., & Rose, G. S. (2009) · American Psychologist · doi:10.1037/a0016830 · Cited by 1,603 · cited 2×
“Memes and gifs are chosen because they can generate reward value by positive emotions and encouragement [44,47,48,70].”
Reliability and Validity of a Brief Measure of Sensation Seeking
Hoyle, R. H., Stephenson, M. T., Palmgreen, P., Lorch, E. P., & Donohew, R. L. (2002) · Personality and Individual Differences · doi:10.1016/s0191-8869(01)00032-0 · Cited by 1,263
Perski, O., Blandford, A., West, R., & Michie, S. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-016-0453-1 · Cited by 1,193
Mohr, D. C., Cuijpers, P., & Lehman, K. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1602 · Cited by 1,097 · cited 2×
“Previously, financial incentives were used, often along with frequent staff contact, to increase the rates of self-reporting [39-41]; however, both these strategies are prohibitively expensive for larger studies over longer periods of time.”
Cited by
Engagement in digital interventions.
Nahum-Shani, I., Shaw, S. D., Carpenter, S. M., Murphy, S. A., & Yoon, C. (2022) · American Psychologist · doi:10.1037/amp0000983 · Cited by 177
Self-citationNahum-Shani, I., Rabbi, M., Yap, J., Philyaw-Kotov, M. L., Klasnja, P., Bonar, E. E., Cunningham, R. M., Murphy, S. A., & Walton, M. A. (2021) · Health Psychology · doi:10.1037/hea0001101 · Cited by 41
“Although people are interested in receiving personalized data (Rabbi et al., 2018; Singh et al., 2016), it is unclear whether such information reinforces mHealth self-reporting.”
BackgroundMethodInfluentialSelf-citationGoldstein, S. P., Zhang, F., Klasnja, P., Hoover, A., Wing, R. R., & Thomas, J. G. (2021) · JMIR Research Protocols · doi:10.2196/33568 · Cited by 26
“Across the field of health behavior change, MRTs remain novel; there are several MRTs in the process of optimizing JITAIs in the areas of physical activity [85,86], smoking cessation [87,88], stress management [88], mood [86], medication adherence [89], and substance use [90,91].”
Self-citationPsihogios, A. M., Li, Y., Butler, E., Hamilton, J., Daniel, L. C., Barakat, L. P., Bonafide, C. P., & Schwartz, L. A. (2019) · JMIR mhealth and uhealth · doi:10.2196/12547 · Cited by 24
“Future research can systematically test the causal effects of various message delivery schedules, as well as different engagement strategies (eg, gamification and incentives), on increasing an individual’s responsivity to text messages over time [43,50].”
Kroska, E. B., Hoel, S., Victory, A., Murphy, S. A., McInnis, M. G., Stowe, Z. N., & Cochran, A. (2020) · JMIR Research Protocols · doi:10.2196/17086 · Cited by 12
“Micro-randomized trials have evaluated physical health and substance use interventions [29-31], but they have not evaluated such interventions among bipolar individuals or distressed college students, or ones based on ACT.”
Self-citation
Metadata
- Authors
- Rabbi, M., Philyaw Kotov, M., Cunningham, R., Bonar, E. E., Nahum-Shani, I., Klasnja, P., Walton, M., & Murphy, S.
- Venue
- JMIR Research Protocols
- Publisher
- JMIR Publications Inc.
- Published
- 2018-07-18
- Volume
- 7
- Issue
- 7
- Pages
- e166
- ISSN
- 1929-0748 (ISSN-L)
- OpenAlex
- W2801888547
- Cited by
- 47
- References
- 30
- FWCI
- 8.93
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.