Toward Increasing Engagement in Substance Use Data Collection: Development of the Substance Abuse Research Assistant App and Protocol for a Microrandomized Trial Using Adolescents and Emerging Adults
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Substance use is an alarming public health issue associated with significant morbidity and mortality. Adolescents and emerging adults are at particularly high risk because substance use typically initiates and peaks during this developmental period. Mobile health apps are a promising data collection and intervention delivery tool for substance-using youth as most teens and young adults own a mobile phone. However, engagement with data collection for most mobile health applications is low, and often, large fractions of users stop providing data after a week of use. OBJECTIVE: Substance Abuse Research Assistant (SARA) is a mobile application to increase or sustain engagement of substance data collection overtime. SARA provides a variety of engagement strategies to incentivize data collection: a virtual aquarium in the app grows with fish and aquatic resources; occasionally, funny or inspirational contents (eg, memes or text messages) are provided to generate positive emotions. We plan to assess the efficacy of SARA's engagement strategies over time by conducting a micro-randomized trial, where the engagement strategies will be sequentially manipulated. METHODS: We aim to recruit participants (aged 14-24 years), who report any binge drinking or marijuana use in the past month. Participants are instructed to use SARA for 1 month. During this period, participants are asked to complete one survey and two active tasks every day between 6 pm and midnight. Through the survey, we assess participants' daily mood, stress levels, loneliness, and hopefulness, while through the active tasks, we measure reaction time and spatial memory. To incentivize and support the data collection, a variety of engagement strategies are used. First, predata collection strategies include the following: (1) at 4 pm, a push notification may be issued with an inspirational message from a contemporary celebrity; or (2) at 6 pm, a push notification may be issued reminding about data collection and incentives. Second, postdata collection strategies include various rewards such as points which can be used to grow a virtual aquarium with fishes and other treasures and modest monetary rewards (up to US $12; US $1 for each 3-day streak); also, participants may receive funny or inspirational content as memes or gifs or visualizations of prior data. During the study, the participants will be randomized every day to receive different engagement strategies. In the primary analysis, we will assess whether issuing 4 pm push-notifications or memes or gifs, respectively, increases self-reporting on the current or the following day. RESULTS: The microrandomized trial started on August 21, 2017 and the trial ended on February 28, 2018. Seventy-three participants were recruited. Data analysis is currently underway. CONCLUSIONS: To the best of our knowledge, SARA is the first mobile phone app that systematically manipulates engagement strategies in order to identify the best sequence of strategies that keep participants engaged in data collection. Once the optimal strategies to collect data are identified, future versions of SARA will use this data to provide just-in-time adaptive interventions to reduce substance use among youth. TRIAL REGISTRATION: ClinicalTrials.gov NCT03255317; https://clinicaltrials.gov/show/NCT03255317 (Archived by WebCite at http://www.webcitation.org/70raGWV0e). REGISTERED REPORT IDENTIFIER: RR1-10.2196/9850.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Using thematic analysis in psychology
Braun, V., & Clarke, V. (2006) · Qualitative Research in Psychology · doi:10.1191/1478088706qp063oa · Cited by 194,414
A behavior model for persuasive design
Fogg, B. (2009) · Proceedings of the 4th International Conference on Persuasive Technology · doi:10.1145/1541948.1541999 · Cited by 2,328 · cited 4×
“in multiple ways for SARA, such as (1) reducing self-input burden with predictions, for example, loneliness can be measured by inferring social interactions from the phone [33]; reducing self-input burden may increase engagement [77] and (2) risky times of substance misuse can be preanticipated from sensors; we expect…”
InfluentialA survey of mobile phone sensing
Lane, N., Miluzzo, E., Lu, H., Peebles, D., Choudhury, T., & Campbell, A. (2010) · IEEE Communications Magazine · doi:10.1109/mcom.2010.5560598 · Cited by 2,292
Mobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · cited 1×
“…or baseline or daily survey or Sunday’s survey, as well as the following 2 new threads of questions: (1) a 30-day Timeline Followback calendar, which captures past-month alcohol and marijuana consumption [100] and (2) Likert-type and open-ended questions to capture user experience of SARA [101].”
Effective techniques in healthy eating and physical activity interventions: A meta-regression.
Michie, S., Abraham, C., Whittington, C., McAteer, J., & Gupta, S. (2009) · Health Psychology · doi:10.1037/a0016136 · Cited by 2,229
Rankin, C. H., Abrams, T., Barry, R. J., Bhatnagar, S., Clayton, D. F., Colombo, J., Coppola, G., Geyer, M. A., Glanzman, D. L., Marsland, S., et al. (2009) · Neurobiology of Learning and Memory · doi:10.1016/j.nlm.2008.09.012 · Cited by 1,665
Toward a theory of motivational interviewing
Miller, W. R., & Rose, G. S. (2009) · American Psychologist · doi:10.1037/a0016830 · Cited by 1,603 · cited 2×
“Memes and gifs are chosen because they can generate reward value by positive emotions and encouragement [44,47,48,70].”
Reliability and Validity of a Brief Measure of Sensation Seeking
Hoyle, R. H., Stephenson, M. T., Palmgreen, P., Lorch, E. P., & Donohew, R. L. (2002) · Personality and Individual Differences · doi:10.1016/s0191-8869(01)00032-0 · Cited by 1,263
Perski, O., Blandford, A., West, R., & Michie, S. (2017) · Translational Behavioral Medicine · doi:10.1007/s13142-016-0453-1 · Cited by 1,193
Mohr, D. C., Cuijpers, P., & Lehman, K. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1602 · Cited by 1,097 · cited 2×
“Previously, financial incentives were used, often along with frequent staff contact, to increase the rates of self-reporting [39-41]; however, both these strategies are prohibitively expensive for larger studies over longer periods of time.”
Schulenberg, J., & Johnston, L. (2020) · doi:10.3998/2027.42/162576 · Cited by 1,054
Bohlmeijer, E., ten Klooster, P. M., Fledderus, M., Veehof, M., & Baer, R. (2011) · Assessment · doi:10.1177/1073191111408231 · Cited by 990 · cited 1×
“Those who report past-month binge drinking or marijuana use and have access to their mobile phone while in the Emergency Department provide written consent or assent and self-administer an approximately 20-min baseline survey with items about (1) substance use frequency, consequences, overdose, and driving under the i…”
Development and validation of the Conflict in Adolescent Dating Relationships Inventory.
Wolfe, D. A., Scott, K., Reitzel-Jaffe, D., Wekerle, C., Grasley, C., & Straatman, A.-L. (2001) · Psychological Assessment · doi:10.1037/1040-3590.13.2.277 · Cited by 796
A Smartphone Application to Support Recovery From Alcoholism: A Randomized Clinical Trial
Gustafson, D. H., McTavish, F. M., Chih, M.-Y., Atwood, A. K., Johnson, R. A., Boyle, M. G., Levy, M. S., Driscoll, H., Chisholm, S. M., Dillenburg, L., et al. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.4642 · Cited by 692 · cited 1×
“To date, there has been little work on increasing self-reporting rates of substance use data [29-31].”
BackgroundErskine, H. E., Moffitt, T. E., Copeland, W. E., Costello, E. J., Ferrari, A. J., Patton, G., Degenhardt, L., Vos, T., Whiteford, H. A., & Scott, J. G. (2015) · Psychological Medicine · doi:10.1017/s0033291714002888 · Cited by 688
Microrandomized trials: An experimental design for developing just-in-time adaptive interventions.
Klasnja, P., Hekler, E. B., Shiffman, S., Boruvka, A., Almirall, D., Tewari, A., & Murphy, S. A. (2015) · Health Psychology · doi:10.1037/hea0000305 · Cited by 671 · cited 11×
“We plan to run a 30-day MRT. Prior to the study, potential participants are screened, and eligible participants complete an in-person intake session with a study recruiter.”
InfluentialSelf-citationChassin, L., Flora, D. B., & King, K. M. (2004) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.113.4.483 · Cited by 480 · cited 1×
“Longitudinal panel studies show that, as youth develop, evolving interactions between individual, social, and community risk and protective factors can decrease or accelerate substance use trajectories [15-18].”
BackgroundBeWell: A Smartphone Application to Monitor, Model and Promote Wellbeing
Lane, N., Mohammod, M., Lin, M., Yang, X., Lu, H., Ali, S., Doryab, A., Berke, E., Choudhury, T., & Campbell, A. (2011) · Proceedings of the 5th International ICST Conference on Pervasive Computing Technologies for Healthcare · doi:10.4108/icst.pervasivehealth.2011.246161 · Cited by 409
Making Sense of Life: The Existential Self Trying to Deal with Personal Uncertainty
van den Bos, K. (2009) · Psychological Inquiry · doi:10.1080/10478400903333411 · Cited by 395
Majeed-Ariss, R., Baildam, E., Campbell, M., Chieng, A., Fallon, D., Hall, A., McDonagh, J. E., Stones, S. R., Thomson, W., & Swallow, V. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.5043 · Cited by 251
Passive and In-Situ assessment of mental and physical well-being using mobile sensors
Rabbi, M., Ali, S., Choudhury, T., & Berke, E. (2011) · Proceedings of the 13th international conference on Ubiquitous computing · doi:10.1145/2030112.2030164 · Cited by 243 · cited 2×
“in multiple ways for SARA, such as (1) reducing self-input burden with predictions, for example, loneliness can be measured by inferring social interactions from the phone [33]; reducing self-input burden may increase engagement [77] and (2) risky times of substance misuse can be preanticipated from sensors; we expect…”
Self-citationBadawy, S. M., & Kuhns, L. M. (2017) · JMIR mHealth and uHealth · doi:10.2196/mhealth.6837 · Cited by 211 · cited 1×
“However, sustaining self-reported data collection is challenging in mHealth [23,24].”
Conjoint Developmental Trajectories of Young Adult Substance Use
Jackson, K. M., Sher, K. J., & Schulenberg, J. E. (2008) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.2008.00643.x · Cited by 206 · cited 1×
“Longitudinal panel studies show that, as youth develop, evolving interactions between individual, social, and community risk and protective factors can decrease or accelerate substance use trajectories [15-18].”
Altered prefrontal and insular cortical thickness in adolescent marijuana users
Lopez-Larson, M. P., Bogorodzki, P., Rogowska, J., McGlade, E., King, J. B., Terry, J., & Yurgelun-Todd, D. (2011) · Behavioural Brain Research · doi:10.1016/j.bbr.2011.02.001 · Cited by 187 · cited 1×
“This trend is concerning because marijuana use may affect the neuro-maturational development of the brain among youth [10-12], potentially compromising decision-making and inhibitory control functioning [10-13].”
The Marijuana Treatment Project: rationale, design and participant characteristics
Stephens, R. S., Babor, T. F., Kadden, R., Miller, M., & The Marijuana Treatment Project Research Group (2002) · Addiction · doi:10.1046/j.1360-0443.97.s01.6.x · Cited by 178
Treatment engagement: a neglected aspect in the psychiatric care of suicidal patients.
Lizardi, D., & Stanley, B. (2010) · Psychiatric Services · doi:10.1176/ps.2010.61.12.1183 · Cited by 161
Assessing time-varying causal effect moderation in mobile health
Boruvka, A., Almirall, D., Witkiewitz, K., & Murphy, S. A. (2018) · Journal of the American Statistical Association · doi:10.1080/01621459.2017.1305274 · Cited by 152
Self-citationGamification of Mobile Experience Sampling Improves Data Quality and Quantity
van Berkel, N., Goncalves, J., Hosio, S., & Kostakos, V. (2017) · Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies · doi:10.1145/3130972 · Cited by 95 · cited 2×
“Previously, financial incentives were used, often along with frequent staff contact, to increase the rates of self-reporting [39-41]; however, both these strategies are prohibitively expensive for larger studies over longer periods of time.”
BackgroundCavanagh, K. (2010) · Oxford Guide to Low Intensity CBT Interventions · doi:10.1093/med:psych/9780199590117.003.0021 · Cited by 76
Gonzales, R., Ang, A., Murphy, D. A., Glik, D. C., & Anglin, M. D. (2014) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2014.01.010 · Cited by 70 · cited 1×
“To date, there has been little work on increasing self-reporting rates of substance use data [29-31].”
Cited by
Engagement in digital interventions.
Nahum-Shani, I., Shaw, S. D., Carpenter, S. M., Murphy, S. A., & Yoon, C. (2022) · American Psychologist · doi:10.1037/amp0000983 · Cited by 177
Self-citationNahum-Shani, I., Rabbi, M., Yap, J., Philyaw-Kotov, M. L., Klasnja, P., Bonar, E. E., Cunningham, R. M., Murphy, S. A., & Walton, M. A. (2021) · Health Psychology · doi:10.1037/hea0001101 · Cited by 41
“Although people are interested in receiving personalized data (Rabbi et al., 2018; Singh et al., 2016), it is unclear whether such information reinforces mHealth self-reporting.”
BackgroundMethodInfluentialSelf-citationGoldstein, S. P., Zhang, F., Klasnja, P., Hoover, A., Wing, R. R., & Thomas, J. G. (2021) · JMIR Research Protocols · doi:10.2196/33568 · Cited by 26
“Across the field of health behavior change, MRTs remain novel; there are several MRTs in the process of optimizing JITAIs in the areas of physical activity [85,86], smoking cessation [87,88], stress management [88], mood [86], medication adherence [89], and substance use [90,91].”
Self-citationPsihogios, A. M., Li, Y., Butler, E., Hamilton, J., Daniel, L. C., Barakat, L. P., Bonafide, C. P., & Schwartz, L. A. (2019) · JMIR mhealth and uhealth · doi:10.2196/12547 · Cited by 24
“Future research can systematically test the causal effects of various message delivery schedules, as well as different engagement strategies (eg, gamification and incentives), on increasing an individual’s responsivity to text messages over time [43,50].”
Kroska, E. B., Hoel, S., Victory, A., Murphy, S. A., McInnis, M. G., Stowe, Z. N., & Cochran, A. (2020) · JMIR Research Protocols · doi:10.2196/17086 · Cited by 12
“Micro-randomized trials have evaluated physical health and substance use interventions [29-31], but they have not evaluated such interventions among bipolar individuals or distressed college students, or ones based on ACT.”
Self-citation
Metadata
- Authors
- Rabbi, M., Philyaw Kotov, M., Cunningham, R., Bonar, E. E., Nahum-Shani, I., Klasnja, P., Walton, M., & Murphy, S.
- Venue
- JMIR Research Protocols
- Publisher
- JMIR Publications Inc.
- Published
- 2018-07-18
- Volume
- 7
- Issue
- 7
- Pages
- e166
- ISSN
- 1929-0748 (ISSN-L)
- OpenAlex
- W2801888547
- Cited by
- 47
- References
- 30
- FWCI
- 8.93
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.