A Smartphone Application to Support Recovery From Alcoholism: A Randomized Clinical Trial
Open accessAbstract
IMPORTANCE: Patients leaving residential treatment for alcohol use disorders are not typically offered evidence-based continuing care, although research suggests that continuing care is associated with better outcomes. A smartphone-based application could provide effective continuing care. OBJECTIVE: To determine whether patients leaving residential treatment for alcohol use disorders with a smartphone application to support recovery have fewer risky drinking days than control patients. DESIGN, SETTING, AND PARTICIPANTS: An unmasked randomized clinical trial involving 3 residential programs operated by 1 nonprofit treatment organization in the Midwestern United States and 2 residential programs operated by 1 nonprofit organization in the Northeastern United States. In total, 349 patients who met the criteria for DSM-IV alcohol dependence when they entered residential treatment were randomized to treatment as usual (n = 179) or treatment as usual plus a smartphone (n = 170) with the Addiction-Comprehensive Health Enhancement Support System (A-CHESS), an application designed to improve continuing care for alcohol use disorders. INTERVENTIONS: Treatment as usual varied across programs; none offered patients coordinated continuing care after discharge. A-CHESS provides monitoring, information, communication, and support services to patients, including ways for patients and counselors to stay in contact. The intervention and follow-up period lasted 8 and 4 months, respectively. MAIN OUTCOMES AND MEASURES: Risky drinking days--the number of days during which a patient's drinking in a 2-hour period exceeded 4 standard drinks for men and 3 standard drinks for women, with standard drink defined as one that contains roughly 14 g of pure alcohol (12 oz of regular beer, 5 oz of wine, or 1.5 oz of distilled spirits). Patients were asked to report their risky drinking days in the previous 30 days on surveys taken 4, 8, and 12 months after discharge from residential treatment. RESULTS: For the 8 months of the intervention and 4 months of follow-up, patients in the A-CHESS group reported significantly fewer risky drinking days than did patients in the control group, with a mean of 1.39 vs 2.75 days (mean difference, 1.37; 95% CI, 0.46-2.27; P = .003). CONCLUSIONS AND RELEVANCE: The findings suggest that a multifeatured smartphone application may have significant benefit to patients in continuing care for alcohol use disorders. TRIAL REGISTRATION: clinicaltrials.gov Identifier: NCT01003119.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 24 cited sources checked · 0 supported · 0 flagged
- Findingown data
A-CHESS patients were more likely than control patients to report abstinence at all three time points (P=.032).
“A-CHESS patients were also more likely than control-group patients to report abstinence at all 3 time points (P = .032).”
- Also stated in: § COMMENT · plain
“higher likelihood of consistent abstinence (51.9% vs. 39.6%; P = .032)”
Quote in the paperSubstantial claim - Also stated in: § COMMENT · plain
- Findingown data
Over the 12-month period comprising the 8-month intervention and 4-month follow-up, patients assigned to A-CHESS reported significantly fewer risky drinking days than control patients (mean 1.39 vs 2.75; P=.003; 95% CI .46 to 2.27).
“For the 8 months of the intervention and 4 months of follow-up, patients in the A-CHESS group reported significantly fewer risky drinking days than patients in the control group (M = 1.39 vs. 2.75, respectively; P = .003; 95% CI [.46, 2.27]).”
- Also stated in: § Risky Drinking Days · plain
“Patients in the A-CHESS group reported significantly fewer risky drinking days (Table 2) than patients in the control group for the intervention and follow-up period (P = .003)”
- Also stated in: § COMMENT · plain
“Patients who received treatment as usual plus A-CHESS reported a lower average number of risky drinking days (1.39 vs. 2.75; P = .003)”
Quote in the paperSubstantial claim - Also stated in: § Risky Drinking Days · plain
- Findingreasoning
In this study, 8 months of A-CHESS cost about $597 per patient.
“In this study, 8 months of A-CHESS cost about $597/patient, based on 1 hour/month of counselor time at $90/hour divided by 50 patients, 1 hour/month for system administrator time at $50/hour divided by 170 patients, $60/month for each data plan, and $100 to buy each phone.”
Quote in the paperSubstantial claim - Findingown data
Perceived competence at 4 months mediated the relationship between intervention and number of risky drinking days at 8 months.
“Of the 3 constructs, only perceived competence at 4 months was found to mediate the relationship between intervention and number of risky drinking days at 8 months (path: B [95% CI], P-value) (a: 0.219 [.004, .434], P = .046; b: −.969 [1.650, −.289], P = .005)”
- Also stated in: § COMMENT · plain
“One of self-determination theory’s 3 constructs (competence) was a significant mediator.”
Quote in the paperSubstantial claim - Also stated in: § COMMENT · plain
- Findingown data
No significant differences were found between A-CHESS and control groups overall or by month for any of the measured negative consequences of drinking.
“No significant differences were found between groups overall or by month for any of the negative consequences (not eating properly, hurting someone, having one’s status damaged, having money problems, losing a job, being arrested, having an accident, or involvement with the DCFS).”
- Also stated in: § COMMENT · plain
“but no difference in negative consequences of drinking.”
Quote in the paperSubstantial claim - Also stated in: § COMMENT · plain
- Study design and conductown data
Sensitivity analyses using 6 sets of values changed the pattern of results only when missing risky-drinking-day data were replaced with the maximum possible value.
“Sensitivity analyses were conducted using 6 sets of values. The pattern of results changed only when missing risky-drinking-day data were replaced with the maximum possible value (eTable2).”
Quote in the paperNot a substantial claim - Interpretationown data
The findings suggest that a multi-featured smartphone application may have significant benefit for patients in continuing care for AUDs.
“The findings suggest that a multi-featured smartphone application may have significant benefit to patients in continuing care for AUDs.”
Quote in the paperSubstantial claim - Study design and conductown data
The rate of survey completion was not significantly different between groups.
“The rate of survey completion was not significantly different between groups (Figure).”
Quote in the paperNot a substantial claim - Premisecitation
AUDs have relapse rates similar to those of other chronic illnesses.
“AUDs also have relapse rates similar to those of other chronic illnesses.3”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [3] McLellan AT Lewis DC O’Brien CP Kleber HD Drug dependence, a chronic medical illness: Implications for treatment, insurance, and outcomes evaluation JAMA 2000 284 1689 1695 11015800
Not checked in the free run.
- Study design and conductown data
Examining only cases with complete risky-drinking-day data produced similar results.
“Examining only cases with complete risky-drinking-day data produced similar results (Table 2).”
Quote in the paperNot a substantial claim - Premisecitation
A-CHESS was designed to improve continuing care for AUDs by offering emotional and instrumental support at almost any time and place.
“A-CHESS was designed to improve continuing care for AUDs by offering emotional and instrumental support at almost any time and place.9”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [9] Gustafson DH Shaw BR Isham A Baker T Boyle MG Levy M Explicating an evidence-based, theoretically informed, mobile technology-based system to improve outcomes for people in recovery for alcohol dependence Subst Use Misuse 2011 46 96 111 21190410 PMC3179272
Not checked in the free run.
- Premisecitation
Patients leaving treatment for AUDs are not typically offered aftercare with ongoing monitoring.
“Although evidence shows that continuing care for alcohol and drug use disorders is associated with better outcomes,5 patients leaving treatment for AUDs are not typically offered aftercare with ongoing monitoring.3,6”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [3] McLellan AT Lewis DC O’Brien CP Kleber HD Drug dependence, a chronic medical illness: Implications for treatment, insurance, and outcomes evaluation JAMA 2000 284 1689 1695 11015800
Not checked in the free run.
- cites [6] White WL Boyle M Loveland D Alcoholism/addiction as chronic disease: From rhetoric to programal reality Alcohol Treat Q 2002 20 107 129
Not checked in the free run.
- Interpretationown data
A-CHESS participation rates were high compared with usual rates of participation in aftercare for AUDs.
“Rates of patient participation in A-CHESS were high compared to usual rates of participation in aftercare for AUDs.17,29 More than 90% of patients in the A-CHESS group used the system at least once during months 1-4, and 58% of patients used the application in the last week of the 8-month intervention period. In contrast, two studies found participation in aftercare for substance use disorders to”
Quote in the paperNot a substantial claim0 of 4 sources checked- cites [17] McKay JR Lynch KG Shepard DS The effectiveness of telephone-based continuing care in the programal management of alcohol and cocaine use disorders: 12-month outcomes J Consult Clin Psychol 2004 72 967 979 15612844
Not checked in the free run.
- cites [29] McKay JR McLellan AT Alterman AI Cacciola JS Rutherford MJ O’Brien CP Predictors of participation in aftercare sessions and self-help groups following completion of intensive outpatient treatment for substance abuse J Studies Alcohol Drugs 1998 59 152 162 9500302
Not checked in the free run.
- cites [30] Lash SJ Stephens RS Burden JL Contracting, prompting, and reinforcing substance use disorder continuing care: A randomized programal trial Psychol Addict Behav 2007 21 387 397 17874889
Not checked in the free run.
- cites [28] Klein AA Slaymaker VJ Dugosh KL McKay JR Computerized continuing care support for alcohol and drug dependence: A preliminary analysis of usage and outcomes J Subst Abuse Treat 2012 42 25 34 21862275 PMC6498848
Not checked in the free run.
- Study design and conductown data
The study was an un-blinded randomized controlled trial.
“An un-blinded randomized controlled trial.”
- Also stated in: § Study Design and Participants · plain
“The A-CHESS study was an un-blinded randomized trial with 349 patients who met the criteria for DSM-IV alcohol dependence upon entering treatment at 3 residential programs operated by one nonprofit in the Midwestern US and 2 programs operated by another nonprofit in the Northeastern US.”
Quote in the paperSubstantial claim - Also stated in: § Study Design and Participants · plain
- Premisecitation
Biomarkers have been found not to add sufficiently to the accuracy of self-reported measures to warrant being used.
“We considered adding biomarkers, but they have been found not to add sufficiently to the accuracy of self-reported measures to warrant being used.14”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [14] Babor TF Steinberg K Anton R Del Boca F Talk is cheap: Measuring drinking outcomes in clinical trials J Stud Alcohol 2000 61 1 55 63 10627097
Not checked in the free run.
- Premisecitation
High-quality studies about computer-based interventions for continuing care of other chronic illnesses are rare for AUDs.
“Although high-quality studies have been published about computer-based interventions for continuing care of other chronic illnesses (e.g., diabetes and heart disease), they are rare for AUDs.28”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [28] Klein AA Slaymaker VJ Dugosh KL McKay JR Computerized continuing care support for alcohol and drug dependence: A preliminary analysis of usage and outcomes J Subst Abuse Treat 2012 42 25 34 21862275 PMC6498848
Not checked in the free run.
- Premisecitation
Continuing care for alcohol and drug use disorders is associated with better outcomes.
“Although evidence shows that continuing care for alcohol and drug use disorders is associated with better outcomes,5 patients leaving treatment for AUDs are not typically offered aftercare with ongoing monitoring.3,6”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [5] McLellan AT McKay JR Forman R Cacciola J Kemp J Reconsidering the evaluation of addiction treatment: From retrospective follow-up to concurrent recovery monitoring Addiction 2005 100 447 458 15784059
Not checked in the free run.
- May combine two claims. 24
- Classified as probably not a substantial claim. 17
May combine two claims.
Findingown dataA-CHESS patients had greater odds of reporting abstinence in the previous 30 days than control patients at months 8 and 12, but not at month 4.
“The odds of reporting abstinence in the previous 30 days (Table 3) were greater for A-CHESS than control-group patients, with significant differences at months 8 and 12 (Ps = .038, .014, respectively) but not at month 4 (P = .132).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe difference in risky drinking days between A-CHESS and control was significant at months 4 and 12 but not at month 8.
“Patients in the A-CHESS group reported significantly fewer risky drinking days (Table 2) than patients in the control group for the intervention and follow-up period (P = .003) and at months 4 (P = .020) and 12 (P =.032), but not month 8 (P = .096).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataDuring the 8-month intervention, A-CHESS patients used the system on average 40% of days (mean 97.36 days; median 103) and viewed a mean of 1,967 pages (median 1,745).
“During the 8-month intervention period, patients randomized to the A-CHESS group used the system, on average, 40% of days (mean number of days of use: 97.36; median: 103) and viewed a mean number of 1,967 pages (median: 1,745).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown data349 patients met DSM-IV alcohol dependence criteria upon entering residential treatment and were randomized, with 179 assigned to control and 170 to A-CHESS.
“349 patients who met the criteria for DSM-IV alcohol dependence when they entered residential treatment. 179 were randomized to the control group and 170 to the treatment group.”
- Also stated in: § Study Design and Participants · plain
“The A-CHESS study was an un-blinded randomized trial with 349 patients who met the criteria for DSM-IV alcohol dependence upon entering treatment at 3 residential programs operated by one nonprofit in the Midwestern US and 2 programs operated by another nonprofit in the Northeastern US.”
Quote in the paperSubstantial claim- Also stated in: § Study Design and Participants · plain
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataBaseline self-report of the number of previous times in treatment was not significant when included as a covariate in the primary analysis.
“The closest collected measure was patients’ baseline self-report of the number of previous times in treatment (mean = 4.67; SD = 9.15; range = 0 to 50), which was not significant when included as a covariate in the primary analysis.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataSignificant effects were found for the individual BAM items of keeping busy and abstinence confidence, and for the BAM protection score.
“Significant effects were found for the individual items of keeping busy and abstinence confidence, and for the BAM protection score (eTable 2).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataOn average, 20 calls were required per patient to complete 3 phone surveys.
“On average, 20 calls were required per patient to complete 3 phone surveys.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataDuring the intervention, patients completed 3,751 weekly BAMs and shared 97.0% (3,637) of them with counselors.
“During the intervention, patients completed 3,751 weekly BAMs and shared 97.0% (3,637) of these with counselors.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataOf 170 patients who received A-CHESS, 122 (71.7%) pressed the panic button at least once; 98 went beyond the panic button main page to at least one other page.
“Of the 170 patients who received A-CHESS, 122 (71.7%) pressed the panic button at least once. Because patients could press the button in error, intended use was defined as going beyond the panic button main page to at least one other page; 98 did this.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataPatients were much more willing to share their BAM results (93.5% allowed this) than to share that they had had a lapse (41.9% allowed this).
“Patients were much more willing to share their BAM results (93.5% allowed this) than that they had had a lapse (41.9% allowed this).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe closest collected measure to AUD severity was baseline self-report of the number of previous times in treatment (mean=4.67; SD=9.15; range=0 to 50).
“The closest collected measure was patients’ baseline self-report of the number of previous times in treatment (mean = 4.67; SD = 9.15; range = 0 to 50)”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataMost enrolled patients were unemployed (79%).
“Most patients were white (80%), male (61%), and unemployed (79%); most used or abused drugs in addition to alcohol (63%).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataOne counselor estimated she spent 2 hours per week to follow 120 patients.
“One counselor estimated she spent 2 hours/week to follow 120 patients.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataMean patient age was 38 years (SD=10; median=39).
“Mean patient age was 38 years (SD = 10; median = 39).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataMost enrolled patients were white (80%).
“Most patients were white (80%), male (61%), and unemployed (79%); most used or abused drugs in addition to alcohol (63%).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataMost enrolled patients were male (61%).
“Most patients were white (80%), male (61%), and unemployed (79%); most used or abused drugs in addition to alcohol (63%).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAmong A-CHESS patients, the number of risky drinking days was significantly predicted by the number of pages viewed and the number of days used, but not by the number of services used.
“The number of risky drinking days was significantly predicted by the number of pages viewed (per 100 pages: B = 0.036, P = .007, 95% CI [−0.069, −0.002) and days used (B = −0.01, P = .007, 95% CI [−0.02, −0.00], but not the number of services used (B = −0.06, P = .465, 95% CI [−0.22, 0.10]).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataMost enrolled patients used or abused drugs in addition to alcohol (63%).
“Most patients were white (80%), male (61%), and unemployed (79%); most used or abused drugs in addition to alcohol (63%).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe effects of program, month, and the group-by-month interaction on risky drinking days were not significant.
“The effects of program, month, and the group-by-month interaction were not significant (Ps = .536, .649, and .865, respectively).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationAbout 1 in 4 AUD patients remain continuously abstinent in the first year after treatment.
“It has been estimated that about 1 in 4 AUDs patients remain continuously abstinent in the first year after treatment.4”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [4] Miller WR Walters ST Bennett ME How effective is alcoholism treatment in the United States? J Stud Alcohol 2001 62 2 211 20 11327187
Not checked in the free run.
May combine two claims.
Study design and conductcitationPatients in the treatment group received a smartphone while control patients did not, and the app included a weekly self-assessment, possibly producing an assessment effect and more counselor contact than for control patients.
“Patients in the treatment group received a smartphone while those in the control group did not, and the app included a weekly self-assessment, possibly producing an assessment effect31 and more counselor contact than for those in the control group.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [31] McCambridge J Kypri K Can simply answering research questions change behaviour? Systematic review and meta analysis of brief alcohol intervention trials PLoS ONE 2011 6 10 e23748 21998626 PMC3187747
Not checked in the free run.
May combine two claims.
PremisecitationSDT was chosen because evidence suggested that its 3 constructs could be causal mechanisms affecting CHESS targets, and because SDT is broad and fundamental enough to cover a complex, multifaceted eHealth intervention such as CHESS.
“SDT was chosen because evidence suggested that SDT’s 3 constructs could be causal mechanisms that would affect CHESS targets, and because SDT is broad and fundamental enough to cover a complex, multifaceted eHealth intervention such as CHESS.12”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [12] Pingree S Hawkins R Baker T DuBenske L Roberts LJ Gustafson DH The value of theory for enhancing and understanding e-Health interventions Am J Prev Med 2010 38 1 103 109 20117565 PMC2826889
Not checked in the free run.
Classified as probably not a substantial claim.
Study design and conductnone givenPatients were included in the analysis if they provided any outcome data according to the intention-to-treat principle.
“Patients were included in the analysis if they provided any outcome data according to the intention-to-treat principle.”
Quote in the paperSubstantial claimMay combine two claims.
PremisecitationThe literature supports the effectiveness of continuing care in improving outcomes for AUDs, as well as for computer-based interventions for AUDs.
“The literature supports the effectiveness of continuing care in improving outcomes for AUDs,22 as well as for computer-based interventions for AUDs.23-27”
Quote in the paperSubstantial claim0 of 6 sources checked- cites [22] McKay JR Is there a case for extended interventions for alcohol and drug use disorders? Addiction 2005 100 1594 1610 16277622
Not checked in the free run.
- cites [23] Hester RK Squires DD Delaney HD The Drinker’s Checkup: 12-month outcomes of a controlled programal trial of a stand-alone software program for problem drinkers J Subst Abuse Treat 2005 28 159 169 15780546
Not checked in the free run.
- cites [24] Hester RK Delaney HD Campbell W Handmaker N A web application for moderation training: Initial results of a randomized programal trial J Subst Abuse Treat 2009 37 266 276 19339137 PMC2739257
Not checked in the free run.
- cites [25] Kypri K Saunders JB Williams SM Web-based screening and brief intervention for hazardous drinking: A double-blind randomized controlled trial Addiction 2004 99 1410 1417 15500594
Not checked in the free run.
- cites [26] Kypri K Langley JD Saunders JB Cashell-Smith ML Herbison P Randomized controlled trial of web-based alcohol screening and brief intervention in primary care JAMA Intern Med 2008 168 530 536 18332300
Not checked in the free run.
- cites [27] Carroll K Ball SA Martino S Nich C Babuscio TA Rounsaville BJ Enduring effects of a computer-assisted training program for cognitive behavioral therapy: A 6-month follow-up of CBT4CBT Drug Alcohol Depend 2009 100 178 181 19041197 PMC2742309
Not checked in the free run.
May combine two claims.
PremisecitationThe theoretical basis of A-CHESS is self-determination theory (SDT), which posits that meeting 3 needs contributes to adaptive functioning: being perceived as competent, feeling related to others, and feeling internally motivated and not coerced.
“The theoretical basis of A-CHESS is self-determination theory (SDT), which posits that meeting 3 needs contributes to an individual’s adaptive functioning: being perceived as competent, feeling related to others, and feeling internally motivated and not coerced in one’s actions.10,11”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [10] Ryan RM Deci EL Self-regulation and the problem of human autonomy: Does psychology need choice, self-determination, and will? J Pers 2006 74 6 1557 1586 17083658
Not checked in the free run.
- cites [11] Ryan RM Deci EL Self-determination theory and the facilitation of intrinsic motivation, social development, and well-being Am Psychol 2000 55 1 68 78 11392867
Not checked in the free run.
May combine two claims.
Premisenone givenTreatment as usual varied across programs, and none offered patients coordinated continuing care after discharge.
“Treatment as usual varied across programs; none offered patients coordinated continuing care after discharge.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductreasoningThe study involved only patient self-report, without urine testing, and each survey asked about drinking only in the past 30 days, which does not capture a complete picture and can under- or over-estimate drinking behavior.
“The study involved only patient self-report, without urine testing, and each survey asked about drinking only in the past 30 days, which does not capture a complete picture of each patient’s drinking and can under- or over-estimate drinking behavior.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataThe results were consistent when all 2- and 3-way interactions were included in the model, with significant effects of A-CHESS overall and at months 4 and 12, but not at month 8.
“The results were consistent when all 2- and 3-way interactions were included in the model, with significant effects of A-CHESS overall (main effect; P = .003) and at months 4 and 12 (simple effects; Ps = .002 and .044), but not at month 8 (P = .259) or for any other factor or interaction (all Ps > .05).”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductown dataRandomization used a computer-generated random allocation sequence with blocks of 8, implemented using sequentially numbered containers.
“Within each program, patients were randomized to control or A-CHESS in a 1:1 ratio using a computer-generated random allocation sequence with blocks of 8. Randomization was implemented using sequentially numbered containers.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductcitationThe primary outcome was analyzed with mixed-effects models that account for correlated measurements within patients, use all available data (allowing intention-to-treat rather than only complete-case analysis), and provide unbiased estimates when data are missing at random.
“The primary outcome, risky drinking days, was analyzed with mixed-effects models. These models account for correlated measurements within patients, use all available data (allowing for intention-to-treat rather than only complete-case analysis), and provide unbiased estimates when data are missing at random.18”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [18] White IR Horton NJ Carpenter J Pocock SJ Strategy for intention to treat analysis in randomised trials with missing outcome data BMJ 2011 342 d40 21300711 PMC3230114
Not checked in the free run.
- Rests on an assumption: The missing outcome data in this trial are missing at random.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataAUD severity was not collected.
“AUD severity was not collected.”
Quote in the paperNot a substantial claimMay combine two claims.
Study design and conductown dataNo patients withdrew from the study, although 21 control patients and 14 A-CHESS patients did not provide data for any of the 3 surveys.
“No patients withdrew from the study, although 21 patients in the control group and 14 patients in the A-CHESS group did not provide data for any of the 3 surveys.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenThe study was approved by the Institutional Review Board at the University of Wisconsin-Madison and registered at clinicaltrials.gov (NCT01003119).
“The study was approved by the Institutional Review Board at the University of Wisconsin – Madison and registered at clinicaltrials.gov (NCT01003119).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
PremisereasoningCompared with traditional care, technology can give personalized care while using less counselor time and be available at the moment of greatest need.
“Compared to traditional care, technology can give personalized care while using less counselor time and be available at the moment of greatest need.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationPlanned recruitment of 175 patients per group was estimated from an effect size of h=0.34, α=.05, .80 power, and 20% attrition.
“Planned recruitment of 175 patients per group was estimated from the effect size (h = 0.34) observed in a telephone-based intervention,17 α = .05, .80 power, and 20% attrition.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [17] McKay JR Lynch KG Shepard DS The effectiveness of telephone-based continuing care in the programal management of alcohol and cocaine use disorders: 12-month outcomes J Consult Clin Psychol 2004 72 967 979 15612844
Not checked in the free run.
May combine two claims.
Study design and conductown dataThe study involved only 2 treatment organizations and 5 programs, and most patients were white males in their 30s and 40s.
“The study involved only 2 treatment organizations and 5 programs, and most patients were white males in their 30s and 40s.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe promising results of this trial point to the possible value of a smartphone intervention for treating AUDs and perhaps other chronic illnesses.
“The promising results of this trial in continuing care for AUDs point to the possible value of a smartphone intervention for treating AUDs and perhaps other chronic illnesses.”
Quote in the paperSubstantial claim
The paper relies on this without support.
No other large randomized trial has been reported about the effectiveness of mobile technology for continuing care of AUDs.
“To our knowledge, no other large randomized trial has been reported about the effectiveness of mobile technology for the continuing care of AUDs.”
The paper relies on this without support.
The missing outcome data in this trial are missing at random.
“provide unbiased estimates when data are missing at random.”
The paper relies on this without support.
The modified 8-item set derived from the SIP-R adequately captures negative consequences of drinking.
“Because of these departures from the established instrument, the 8 items were examined individually rather than as a single scale.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
A-CHESS researchers partially predicted the number of days of consumption based on the level of app use by the user.
“researchers using an application designed to provide support to people with alcoholism (Addiction—Comprehensive Health Enhancement Support System or A-CHESS) were able to partially predict the number of days of consumption based on the level of use of the application by the user (i.e., number of times spent on the application, number of pages viewed) (104).”
From Mobile intervention for individuals with psychosis, dual disorders, and their common comorbidities: A literature review (2019) · cites this paper as [104]
The Results (Post-Hoc Analyses) report that pages viewed and days of A-CHESS use significantly predicted the number of risky drinking days. The citing sentence calls these days of consumption generally, whereas the paper’s outcome was specifically risky drinking days. (LLM, conf=0.86)
Experimental — accuracy not yet measuredDigital interventions for SUDs have demonstrated efficacy for screening and assessment, treatment and recovery, as stand-alone tools or as adjuncts to clinician-delivered interventions.
“Digital interventions for SUDs have demonstrated efficacy for screening and assessment 251- 253 , treatment 254,255 and recovery 250,256 , as stand- alone tools or as adjuncts to clinician- delivered in terventions.”
From Substance use disorders: a comprehensive update of classification, epidemiology, neurobiology, clinical aspects, treatment and prevention (2023) · cites this paper as [256]
A-CHESS has been previously tested in a randomized trial involving 349 study participants and found to reduce risky drinking days and improve abstinence.
“The A-CHESS mobile phone app has been previously tested in a randomized trial involving 349 study participants and found to reduce risky drinking days and improve abstinence [19].”
From Successful Organizational Strategies to Sustain Use of A-CHESS: A Mobile Intervention for Individuals With Alcohol Use Disorders (2015) · cites this paper as [19]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
A-CHESS randomization count conflicts with the group totals
MinorThe results say 179 patients were assigned to A-CHESS, while the abstract assigns 179 to control and 170 to treatment.
“Although 179 patients were randomized to the A-CHESS group”
“179 were randomized to the control group and 170 to the treatment group.”
Pages-viewed estimate falls outside its confidence interval
MinorThe reported coefficient is positive, but both confidence-interval bounds are negative.
“per 100 pages: B = 0.036”
“95% CI [−0.069, −0.002)”
Replacement reasons exceed the stated total
MinorThe four listed replacement counts sum to 117, rather than the stated 113.
Reported 113 · recomputed 117
“113 phones were replaced: 56 did not work properly, 19 were stolen, 20 were damaged by patients, and 22 were lost.”
Mediation estimate falls outside its confidence interval
MinorThe reported path-b estimate is −0.969, but its interval runs from positive 1.650 to −0.289 and does not contain that estimate.
“b: −.969”
“[1.650, −.289]”
Cites
Ryan, R. M., & Deci, E. L. (2000) · American Psychologist · doi:10.1037//0003-066x.55.1.68 · Cited by 27,815 · see citing works
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen, P., Cohen, P., West, S. G., & Aiken, L. S. (2014) · Psychology Press eBooks · doi:10.4324/9781410606266 · Cited by 20,819 · see citing works
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences.
Tufte, E. R., Cohen, J., & Cohen, P. (1979) · Journal of the American Statistical Association · doi:10.2307/2286442 · Cited by 5,214 · see citing works
Drug Dependence, a Chronic Medical Illness
McLellan, A. T., Lewis, D. C., O'Brien, C. P., & Kleber, H. D. (2000) · JAMA · doi:10.1001/jama.284.13.1689 · Cited by 2,622 · see citing works
Ryan, R. M., & Deci, E. L. (2006) · Journal of Personality · doi:10.1111/j.1467-6494.2006.00420.x · Cited by 1,642 · see citing works
Strategy for intention to treat analysis in randomised trials with missing outcome data
White, I. R., Horton, N. J., Carpenter, J. R., statistics, R. I. M. A. S., & Pocock, S. (2011) · BMJ · doi:10.1136/bmj.d40 · Cited by 849 · see citing works
Talk is cheap: measuring drinking outcomes in clinical trials.
Babor, T., Steinberg, K., Anton, R., & del Boca, F. D. (2000) · Journal of Studies on Alcohol · doi:10.15288/jsa.2000.61.55 · Cited by 493 · see citing works
How effective is alcoholism treatment in the United States?
Miller, W. R., Walters, S. T., & Bennett, M. E. (2001) · Journal of Studies on Alcohol · doi:10.15288/jsa.2001.62.211 · Cited by 434 · see citing works
McLellan, A. T., McKay, J. R., Forman, R. F., Cacciola, J., & Kemp, J. (2005) · Addiction · doi:10.1111/j.1360-0443.2005.01012.x · Cited by 389 · see citing works
McLellan, A. T., & Brown, B. S. (2003) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(03)00114-4 · Cited by 319 · see citing works
Harwood, H. J. (2000) · Medical Entomology and Zoology · Cited by 298 · see citing works
Kypri, K., Saunders, J. B., Williams, S. M., McGee, R. O., Langley, J. D., Cashell‐Smith, M. L., & Gallagher, S. J. (2004) · Addiction · doi:10.1111/j.1360-0443.2004.00847.x · Cited by 287 · see citing works
Continuing care research: What we have learned and where we are going
McKay, J. R. (2009) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2008.10.004 · Cited by 249 · see citing works
McCambridge, J., & Kypri, K. (2011) · PLoS ONE · doi:10.1371/journal.pone.0023748 · Cited by 242 · see citing works
Hester, R. K., Squires, D. D., & Delaney, H. D. (2005) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2004.12.002 · Cited by 221 · see citing works
Is there a case for extended interventions for alcohol and drug use disorders?
McKay, J. R. (2005) · Addiction · doi:10.1111/j.1360-0443.2005.01208.x · Cited by 211 · see citing works
Development and initial evaluation of the Brief Addiction Monitor (BAM)
Cacciola, J. S., Alterman, A. I., DePhilippis, D., Drapkin, M. L., Valadez, C., Fala, N. C., Oslin, D., & McKay, J. R. (2013) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2012.07.013 · Cited by 203 · see citing works
Randomized Controlled Trial of Web-Based Alcohol Screening and Brief Intervention in Primary Care
Kypri, K. (2008) · Archives of Internal Medicine · doi:10.1001/archinternmed.2007.109 · Cited by 192 · see citing works
Kiluk, B. D., Dreifuss, J. A., Weiss, R., Morgenstern, J., & Carroll, K. (2012) · Psychology of Addictive Behaviors · doi:10.1037/a0028445 · Cited by 166 · see citing works
Carroll, K. M., Ball, S. A., Martino, S., Nich, C., Babuscio, T. A., & Rounsaville, B. J. (2009) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.09.015 · Cited by 164 · see citing works
McKay, J., Lynch, K., Shepard, D., Ratichek, S. J., Morrison, R., Koppenhaver, J., & Pettinati, H. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.6.967 · Cited by 119 · see citing works
How Patients Recovering From Alcoholism Use a Smartphone Intervention
Mctavish, F. M., Chih, M., Shah, D. V., & Gustafson, D. H. (2012) · Journal of Dual Diagnosis · doi:10.1080/15504263.2012.723312 · Cited by 112 · see citing works
Self-citationGustafson, D. H., Shaw, B. R., Isham, A., Baker, T. B., Boyle, M. G., & Levy, M. S. (2010) · Substance Use & Misuse · doi:10.3109/10826084.2011.521413 · Cited by 107 · see citing works
Self-citationAlcoholism/Addiction as a Chronic Disease
White, W. L., Boyle, M., & Loveland, D. (2002) · Alcoholism Treatment Quarterly · doi:10.1300/j020v20n03_06 · Cited by 105 · see citing works
Self-citationGustafson, D. H., Wise, M. E., Bhattacharya, A., Pulvermacher, A., Shanovich, K., Phillips, B. R., Lehman, E. B., Chinchilli, V. M., Hawkins, R. P., & Kim, J.-S. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1964 · Cited by 104 · see citing works
Self-citationThe value of theory for enhancing and understanding e-health interventions
Pingree, S., Hawkins, R., Baker, T., DuBenske, L., Roberts, L. J., & Gustafson, D. H. (2010) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2009.09.035 · Cited by 103 · see citing works
Self-citationMcKay, J., Mclellan, A., Alterman, A., Cacciola, J., Rutherford, M., & O'Brien, C. (1998) · Journal of Studies on Alcohol · doi:10.15288/jsa.1998.59.152 · Cited by 96 · see citing works
Lash, S., Stephens, R., Burden, J. L., Grambow, S., DeMarce, J., Jones, M., Lozano, B., Jeffreys, A., Fearer, S. A., & Horner, R. (2007) · Psychology of Addictive Behaviors · doi:10.1037/0893-164x.21.3.387 · Cited by 53 · see citing works
Culverhouse, R., Bucholz, K. K., Crowe, R. R., Hesselbrock, V., Nurnberger, J. I., Porjesz, B., Schuckit, M. A., Reich, T., & Bierut, L. J. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.7.753 · Cited by 51 · see citing works
A web application for moderation training: Initial results of a randomized clinical trial
Hester, R. K., Delaney, H. D., Campbell, W. P., & Handmaker, N. S. (2009) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2009.03.001 · Cited by 51 · see citing works
Klein, A. A., Slaymaker, V. J., Dugosh, K. L., & McKay, J. R. (2011) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2011.07.002 · Cited by 31 · see citing works
Persistence of Addictive Disorders in a First-Offender Driving While Impaired Population
Lapham, S. C. (2011) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2011.78 · Cited by 26 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- [7]McLellan AT Carise D Kleber HD Can the national addiction treatment infrastructure support the public’s demand for quality care? J Subst Abuse Treat 2003 25 2 117 121 14680015
Cited by
Sorted by citations
Nahum-Shani, I., Smith, S. N., Spring, B. J., Collins, L. M., Witkiewitz, K., Tewari, A., & Murphy, S. A. (2018) · Annals of Behavioral Medicine · doi:10.1007/s12160-016-9830-8 · Cited by 2,171 · see citing works
Smartphone use and smartphone addiction among young people in Switzerland
Haug, S., Castro, R. P., Kwon, M., Filler, A., Kowatsch, T., & Schaub, M. P. (2015) · Journal of Behavioral Addictions · doi:10.1556/2006.4.2015.037 · Cited by 903 · see citing works
Torous, J., Kiang, M. V., Lorme, J., & Onnela, J.-P. (2016) · JMIR Mental Health · doi:10.2196/mental.5165 · Cited by 758 · see citing works
“Recent studies have collected GPS data from patients with alcohol use disorder to better support patients [21], and others”
BackgroundCan Mobile Phone Apps Influence People’s Health Behavior Change? An Evidence Review
Zhao, J., Freeman, B., & Li, M. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5692 · Cited by 618 · see citing works
Advances in the science and treatment of alcohol use disorder
Witkiewitz, K. A., Litten, R. Z., & Leggio, L. (2019) · Science Advances · doi:10.1126/sciadv.aax4043 · Cited by 599 · see citing works
Nahum-Shani, I., Hekler, E. B., & Spruijt-Metz, D. (2015) · Health Psychology · doi:10.1037/hea0000306 · Cited by 568 · see citing works
Payne, H., Lister, C., West, J. H., & Bernhardt, J. M. (2015) · JMIR mhealth and uhealth · doi:10.2196/mhealth.3335 · Cited by 525 · see citing works
Volkow, N. D., & Blanco, C. (2023) · World psychiatry · doi:10.1002/wps.21073 · Cited by 503 · see citing works
Mindfulness Meditation and Psychopathology
Wielgosz, J., Goldberg, S. B., Kral, T. R. A., Dunne, J. D., & Davidson, R. J. (2019) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-021815-093423 · Cited by 435 · see citing works
Binge drinking: Health impact, prevalence, correlates and interventions
Kuntsche, E. N., Kuntsche, S., Thrul, J., & Gmel, G. E. (2017) · Psychology and Health · doi:10.1080/08870446.2017.1325889 · Cited by 407 · see citing works
Mobile Apps for Mental Health Issues: Meta-Review of Meta-Analyses
Lecomte, T., Potvin, S., Corbière, M., Guay, S., Samson, C., Cloutier, B., Francoeur, A., Pennou, A., & Khazaal, Y. (2020) · JMIR mHealth and uHealth · doi:10.2196/17458 · Cited by 336 · see citing works
Prescribable mHealth apps identified from an overview of systematic reviews
Byambasuren, O., Sanders, S., Beller, E., & Glasziou, P. (2018) · npj Digital Medicine · doi:10.1038/s41746-018-0021-9 · Cited by 291 · see citing works
The Role of Ambulatory Assessment in Psychological Science
Trull, T. J., & Ebner-Priemer, U. (2014) · Current Directions in Psychological Science · doi:10.1177/0963721414550706 · Cited by 284 · see citing works
Smartphone Apps for Schizophrenia: A Systematic Review
Firth, J., & Torous, J. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.4930 · Cited by 268 · see citing works
Just-in-the-Moment Adaptive Interventions (JITAI): A Meta-Analytical Review
Wang, L., & Miller, L. C. (2020) · Health Communication · doi:10.1080/10410236.2019.1652388 · Cited by 264 · see citing works
A Systematic Review of the mHealth Interventions to Prevent Alcohol and Substance Abuse
Kazemi, D. M., Borsari, B., Levine, M. J., Li, S., Lamberson, K. A., & Matta, L. A. (2017) · Journal of Health Communication · doi:10.1080/10810730.2017.1303556 · Cited by 255 · see citing works
Han, M., & Lee, E. (2018) · Healthcare Informatics Research · doi:10.4258/hir.2018.24.3.207 · Cited by 247 · see citing works
Klasnja, P., Smith, S., Seewald, N. J., Lee, A., Hall, K., Luers, B., Hekler, E. B., & Murphy, S. A. (2019) · Annals of Behavioral Medicine · doi:10.1093/abm/kay067 · Cited by 241 · see citing works
Lipschitz, J. M., Pike, C. K., Hogan, T. P., Murphy, S. A., & Burdick, K. E. (2023) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-023-00297-3 · Cited by 230 · see citing works
Torous, J., Chan, S. R., Yee-Marie Tan, S., Behrens, J., Mathew, I., Conrad, E. J., Hinton, L., Yellowlees, P., & Keshavan, M. (2014) · JMIR Mental Health · doi:10.2196/mental.4004 · Cited by 228 · see citing works
Baker, T. B., Gustafson, D. H., & Shah, D. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.2925 · Cited by 221 · see citing works
Self-citationCarroll, K. M., & Kiluk, B. D. (2017) · Psychology of Addictive Behaviors · doi:10.1037/adb0000311 · Cited by 218 · see citing works
Evidence-based apps? A review of mental health mobile applications in a psychotherapy context
Lui, J. H. L., Marcus, D. K., & Barry, C. T. (2017) · Professional Psychology Research and Practice · doi:10.1037/pro0000122 · Cited by 217 · see citing works
The digital placebo effect: mobile mental health meets clinical psychiatry
Torous, J., & Firth, J. (2016) · The Lancet Psychiatry · doi:10.1016/s2215-0366(15)00565-9 · Cited by 200 · see citing works
Lab And/Or Field? Measuring Personality Processes and Their Social Consequences
Wrzus, C., & Mehl, M. R. (2015) · European Journal of Personality · doi:10.1002/per.1986 · Cited by 200 · see citing works
Lindhiem, O., Bennett, C. B., Rosen, D., & Silk, J. (2015) · Behavior Modification · doi:10.1177/0145445515595198 · Cited by 197 · see citing works
Asselbergs, J., Ruwaard, J., Ejdys, M., Schrader, N., Sijbrandij, M., & Riper, H. (2016) · Journal of Medical Internet Research · doi:10.2196/jmir.5505 · Cited by 193 · see citing works
Treatment burden and treatment fatigue as barriers to health.
Heckman, B. W., Mathew, A. R., & Carpenter, M. J. (2015) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2015.03.004 · Cited by 179 · see citing works
Sheeran, P., Wright, C. E., Avishai, A., Villegas, M. E., Lindemans, J. W., Klein, W. M. P., Rothman, A. J., Miles, E., & Ntoumanis, N. (2020) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000501 · Cited by 175 · see citing works
Realizing the Potential of Mobile Mental Health: New Methods for New Data in Psychiatry
Torous, J. B., Staples, P. C., & Onnela, J.-P. “. (2015) · Current Psychiatry Reports · doi:10.1007/s11920-015-0602-0 · Cited by 173 · see citing works
Treatment of Alcohol Use Disorder in Patients with Alcoholic Liver Disease
Leggio, L., & Lee, M. R. (2016) · The American Journal of Medicine · doi:10.1016/j.amjmed.2016.10.004 · Cited by 168 · see citing works
Emerging technologies and analytics for a new era of value-centered marketing in healthcare
Agarwal, R., Dugas, M., Gao, G. (., & Kannan, P. K. (2020) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-019-00692-4 · Cited by 175 · see citing works
Making the hard work of recovery more attractive for those with substance use disorders
McKay, J. R. (2017) · Addiction · doi:10.1111/add.13502 · Cited by 164 · see citing works
Perski, O., Hébert, E. T., Naughton, F., Hekler, E. B., Brown, J., & Businelle, M. S. (2021) · Addiction · doi:10.1111/add.15687 · Cited by 152 · see citing works
Nesvåg, S. M., & McKay, J. R. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9873 · Cited by 150 · see citing works
Using e-technologies in clinical trials
Rosa, C., Campbell, A. N. C., Miele, G. M., Brunner, M., & Winstanley, E. L. (2015) · Contemporary Clinical Trials · doi:10.1016/j.cct.2015.07.007 · Cited by 147 · see citing works
Sample size calculations for micro‐randomized trials in mHealth
Liao, P., Klasnja, P., Tewari, A., & Murphy, S. A. (2015) · Statistics in Medicine · doi:10.1002/sim.6847 · Cited by 147 · see citing works
The Ethical Use of Mobile Health Technology in Clinical Psychiatry
Torous, J. B., & Roberts, L. W. (2016) · The Journal of Nervous and Mental Disease · doi:10.1097/nmd.0000000000000596 · Cited by 147 · see citing works
Digital Technologies for Emotion-Regulation Assessment and Intervention: A Conceptual Review
Bettis, A. H., Burke, T. A., Nesi, J. L., & Liu, R. T. (2021) · Clinical Psychological Science · doi:10.1177/21677026211011982 · Cited by 147 · see citing works
DUGAS, M. A., Gao, G. G., & Agarwal, R. (2020) · Digital Health · doi:10.1177/2055207620905411 · Cited by 146 · see citing works
Prevention, screening, and treatment for heavy drinking and alcohol use disorder
Knox, J., Hasin, D. S., Larson, F. R. R., & Kranzler, H. R. (2019) · The Lancet Psychiatry · doi:10.1016/s2215-0366(19)30213-5 · Cited by 143 · see citing works
Abaza, H., & Marschollek, M. (2017) · Methods of Information in Medicine · doi:10.3414/me17-05-0003 · Cited by 138 · see citing works
Palmer, M., Sutherland, J., Barnard, S., Wynne, A., Rezel, E., Doel, A., Grigsby-Duffy, L., Edwards, S., Russell, S., Hotopf, E., et al. (2018) · PLOS ONE · doi:10.1371/journal.pone.0189801 · Cited by 136 · see citing works
Tofighi, B., Chemi, C., Ruiz-Valcarcel, J., Hein, P. N., & Hu, L. (2018) · JMIR mhealth and uhealth · doi:10.2196/11831 · Cited by 129 · see citing works
Digital Health Interventions to Enhance Prevention in Primary Care: Scoping Review
Willis, V. C., Craig, K. J. T., Jabbarpour, Y., Scheufele, E. L., Arriaga, Y. E., Ajinkya, M., Rhee, K. B. L., & Bazemore, A. (2021) · JMIR Medical Informatics · doi:10.2196/33518 · Cited by 129 · see citing works
Noorbergen, T. J., Adam, M. T. P., Teubner, T., & Collins, C. E. (2021) · JMIR mhealth and uhealth · doi:10.2196/27896 · Cited by 127 · see citing works
Fowler, L. A., Holt, S. L., & Joshi, D. (2016) · Addictive Behaviors · doi:10.1016/j.addbeh.2016.06.008 · Cited by 123 · see citing works
Perski, O., Blandford, A., Ubhi, H. K., West, R., & Michie, S. (2017) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-017-0422-8 · Cited by 123 · see citing works
Montag, C., Błaszkiewicz, K., Lachmann, B., Sariyska, R., Andone, I., Trendafilov, B., & Markowetz, A. (2015) · Behavioral Sciences · doi:10.3390/bs5040434 · Cited by 122 · see citing works
Garnett, C. V., Crane, D., West, R., Brown, J., & Michie, S. (2015) · JMIR mhealth and uhealth · doi:10.2196/mhealth.3895 · Cited by 120 · see citing works
Scott, I. A., Scuffham, P., Gupta, D., Harch, T. M., Borchi, J., & Richards, B. (2018) · Australian Health Review · doi:10.1071/ah18064 · Cited by 120 · see citing works
Trends in telemedicine use in addiction treatment
Molfenter, T. D., Boyle, M., Holloway, D., & Zwick, J. (2015) · Addiction Science & Clinical Practice · doi:10.1186/s13722-015-0035-4 · Cited by 119 · see citing works
Self-citationA Mobile Just-in-Time Adaptive Intervention for Smoking Cessation: Pilot Randomized Controlled Trial
Hébert, E. T., Ra, C. K., Alexander, A. C., Helt, A., Moisiuc, R., Kendzor, D. E., Vidrine, D. J., Funk-Lawler, R., & Businelle, M. S. (2020) · Journal of Medical Internet Research · doi:10.2196/16907 · Cited by 119 · see citing works
Im, G. Y., Mellinger, J. L., Winters, A. C., Aby, E. S., Lominadze, Z., Rice, J. P., Lucey, M. R., Arab, J. P., Goel, A., Jophlin, L., et al. (2020) · Clinical Gastroenterology and Hepatology · doi:10.1016/j.cgh.2020.10.026 · Cited by 119 · see citing works
Sex and Gender Effects in Recovery From Alcohol Use Disorder
Holzhauer, C. G. (2020) · Alcohol research · doi:10.35946/arcr.v40.3.03 · Cited by 119 · see citing works
Crane, D., Garnett, C., Michie, S., West, R., & Brown, J. (2018) · Scientific Reports · doi:10.1038/s41598-018-22420-8 · Cited by 118 · see citing works
Fostering multiple healthy lifestyle behaviors for primary prevention of cancer.
Spring, B. J., King, A. C., Pagoto, S., Horn, L. V., & Fisher, J. D. (2015) · American Psychologist · doi:10.1037/a0038806 · Cited by 116 · see citing works
Internet-delivered cognitive behavioural therapy in the treatment of psychiatric illness
Gratzer, D., & Khalid-Khan, F. (2015) · Canadian Medical Association Journal · doi:10.1503/cmaj.150007 · Cited by 111 · see citing works
Electronic Interventions for Alcohol Misuse and Alcohol Use Disorders
Dedert, E. A., McDuffie, J. R., STEIN, R. M., McNiel, J. M., Kosinski, A. S., Freiermuth, C. E., Hemminger, A., & Williams, J. W. (2015) · Annals of Internal Medicine · doi:10.7326/m15-0285 · Cited by 110 · see citing works
Carreiro, S., Newcomb, M., Leach, R., Ostrowski, S. J., Boudreaux, E. D., & Amante, D. J. (2020) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2020.108201 · Cited by 108 · see citing works
The smart therapist: A look to the future of smartphones and mHealth technologies in psychotherapy.
Clough, B. A., & Casey, L. M. (2015) · Professional Psychology Research and Practice · doi:10.1037/pro0000011 · Cited by 106 · see citing works
Danaher, B. G., Brendryen, H., Seeley, J. R., Tyler, M. S., & Woolley, T. (2015) · Internet Interventions · doi:10.1016/j.invent.2015.01.002 · Cited by 102 · see citing works
Goldberg, S. B., Imhoff-Smith, T., Bolt, D. M., Wilson-Mendenhall, C. D., Dahl, C. J., Davidson, R. J., & Rosenkranz, M. A. (2020) · JMIR Mental Health · doi:10.2196/23825 · Cited by 97 · see citing works
Developments in Mobile Health Just-in-Time Adaptive Interventions for Addiction Science
Carpenter, S. M., Menictas, M., Nahum-Shani, I. B., Wetter, D. W., & Murphy, S. A. (2020) · Current Addiction Reports · doi:10.1007/s40429-020-00322-y · Cited by 97 · see citing works
It's Time to Think about Time in Health Psychology
Scholz, U. (2019) · Applied Psychology Health and Well-Being · doi:10.1111/aphw.12156 · Cited by 96 · see citing works
Quanbeck, A., Gustafson, D. H., Marsch, L. A., Chih, M., Kornfield, R., Mctavish, F. M., Johnson, R., Brown, R., Mares, M., & Shah, D. V. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.8928 · Cited by 95 · see citing works
Self-citationSmartphone apps for managing alcohol consumption: a literature review
Colbert, S., Thornton, L. K., & RICHMOND, R. L. (2020) · Addiction Science & Clinical Practice · doi:10.1186/s13722-020-00190-x · Cited by 91 · see citing works
A New Frontier: Integrating Behavioral and Digital Technology to Promote Health Behavior
Dallery, J., Kurti, A. N., & Erb, P. (2014) · The Behavior Analyst · doi:10.1007/s40614-014-0017-y · Cited by 89 · see citing works
Smyth, J. M., & Heron, K. E. (2016) · Wireless Health · doi:10.1109/wh.2016.7764561 · Cited by 87 · see citing works
Detecting Receptivity for mHealth Interventions in the Natural Environment
Mishra, V., Künzler, F., Kramer, J.-N., Fleisch, E., Kowatsch, T., & Kotz, D. F. (2021) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3463492 · Cited by 85 · see citing works
Mobile Apps to Reduce Tobacco, Alcohol, and Illicit Drug Use: Systematic Review of the First Decade
Staiger, P. K., O’Donnell, R., Liknaitzky, P., Bush, R., & Milward, J. (2020) · Journal of Medical Internet Research · doi:10.2196/17156 · Cited by 84 · see citing works
Impact of Continuing Care on Recovery From Substance Use Disorder
McKay, J. R. (2021) · Alcohol research · doi:10.35946/arcr.v41.1.01 · Cited by 84 · see citing works
Mobile phone ownership, usage and readiness to use by patients in drug treatment
Milward, J., Day, E., Wadsworth, E., Strang, J., & Lynskey, M. T. (2014) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2014.11.001 · Cited by 84 · see citing works
Exploring the State-of-Receptivity for mHealth Interventions
Künzler, F., Mishra, V., Kramer, J.-N., Kotz, D. F., Fleisch, E., & Kowatsch, T. (2019) · Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies · doi:10.1145/3369805 · Cited by 83 · see citing works
Juarascio, A. S., Parker, M. N., Palermo, M., & Godfrey, K. M. (2018) · International Journal of Eating Disorders · doi:10.1002/eat.22924 · Cited by 82 · see citing works
Assessment of Alcohol Use in the Natural Environment
Piasecki, T. M. (2019) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.13975 · Cited by 82 · see citing works
Hildebrandt, T., Michaeledes, A., Mayhew, M., Greif, R., Sysko, R., Toro‐Ramos, T., & DeBar, L. (2020) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2019.19020184 · Cited by 81 · see citing works
Marsch, L. A., Campbell, A. N. C., Campbell, C. I., Chen-Ritzo, C.-H., Ertin, E., Ghitza, U. E., Lambert-Harris, C. A., Hassanpour, S., Holtyn, A. F., Hser, Y., et al. (2020) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2020.02.005 · Cited by 81 · see citing works
Schootman, M., Nelson, E. J., Werner, K., Shacham, E., Elliott, M., Ratnapradipa, K. L., Lian, M., & McVay, A. B. (2016) · International Journal of Health Geographics · doi:10.1186/s12942-016-0050-z · Cited by 80 · see citing works
Recommendations for the Design and Analysis of Treatment Trials for Alcohol Use Disorders
Witkiewitz, K. A., Finney, J. W., Harris, A. H. S., Kivlahan, D. R., & Kranzler, H. R. (2015) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.12800 · Cited by 79 · see citing works
Cheng, H., McGuinness, L. A., Elbers, R. G., MacArthur, G. J., Taylor, A., McAleenan, A., Dawson, S., López-López, J. A., Higgins, J. P. T., Cowlishaw, S., et al. (2020) · BMJ · doi:10.1136/bmj.m3934 · Cited by 78 · see citing works
Abrantes, A. M., Blevins, C. E., Battle, C. L., Read, J. P., Gordon, A. L., & Stein, M. D. (2017) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2017.07.006 · Cited by 78 · see citing works
Preston, K. L., Kowalczyk, W. J., Phillips, K. A., Jobes, M. L., Vahabzadeh, M., Lin, J.-L., Mezghanni, M., & Epstein, D. H. (2018) · Psychopharmacology · doi:10.1007/s00213-018-4966-9 · Cited by 77 · see citing works
Babson, K. A., Ramo, D. E., Baldini, L., Vandrey, R. G., & Bonn‐Miller, M. O. (2015) · JMIR Research Protocols · doi:10.2196/resprot.3852 · Cited by 77 · see citing works
Health App Possession Among Smartphone or Tablet Owners in Hong Kong: Population-Based Survey
Shen, C., Wang, M. P., Chu, J. T. W., Wan, A., Viswanath, K., Chan, S. S. C., & Lam, T. H. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.7628 · Cited by 77 · see citing works
Ebert, D. D., Harrer, M., Apolinário-Hagen, J., & Baumeister, H. (2019) · Advances in Experimental Medicine and Biology · doi:10.1007/978-981-32-9721-0_29 · Cited by 76 · see citing works
Mobile Health Interventions for Self-Control of Unhealthy Alcohol Use: Systematic Review
Song, T., Qian, S., & Yu, P. (2018) · JMIR mhealth and uhealth · doi:10.2196/10899 · Cited by 76 · see citing works
Recovery from addiction: Behavioral economics and value-based decision making.
Field, M., Heather, N., Murphy, J. G., Stafford, T., Tucker, J. A., & Witkiewitz, K. A. (2019) · Psychology of Addictive Behaviors · doi:10.1037/adb0000518 · Cited by 76 · see citing works
Bertz, J. W., Epstein, D. H., & Preston, K. L. (2017) · Addictive Behaviors · doi:10.1016/j.addbeh.2017.11.027 · Cited by 75 · see citing works
Varma, N., Cygankiewicz, I., Turakhia, M. P., Heidbuchel, H., Hu, Y.-F., Chen, L. Y., Couderc, J.-P., Cronin, E. M., Estep, J. D., Grieten, L., et al. (2021) · Circulation: Arrhythmia and Electrophysiology · doi:10.1161/circep.120.009204 · Cited by 74 · see citing works
Dennis, M. L., Scott, C. K., Funk, R. R., & Nicholson, L. (2014) · Substance Abuse · doi:10.1080/08897077.2014.970323 · Cited by 74 · see citing works
Torous, J., Levin, M. E., Ahern, D. K., & Oser, M. L. (2017) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2016.05.007 · Cited by 73 · see citing works
Ford II, J. H., Alagoz, E., Dinauer, S., Johnson, K. A., Pe-Romashko, K., & Gustafson, D. H. (2015) · Journal of Medical Internet Research · doi:10.2196/jmir.3965 · Cited by 73 · see citing works
Self-citationWhy Psychiatry Needs Data Science and Data Science Needs Psychiatry
Torous, J. B., & Baker, J. T. (2015) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2015.2622 · Cited by 73 · see citing works
Mobile Delivery of Treatment for Alcohol Use Disorders: A Review of the Literature
Quanbeck, A. (2014) · Alcohol research · doi:10.35946/arcr.v36.1.11 · Cited by 71 · see citing works
Ben‐Zeev, D., Kaiser, S. M., & Krzos, I. M. (2014) · Journal of Dual Diagnosis · doi:10.1080/15504263.2014.962336 · Cited by 70 · see citing works
Muench, F. J., van Stolk‐Cooke, K., Kuerbis, A., Stadler, G., Baumel, A., Shao, S., McKay, J. R., & Morgenstern, J. (2017) · PLoS ONE · doi:10.1371/journal.pone.0167900 · Cited by 70 · see citing works
Ashford, R. D., Lynch, K. G., & Curtis, B. L. (2018) · Journal of Medical Internet Research · doi:10.2196/jmir.9172 · Cited by 69 · see citing works
The Role of Technology-Based Interventions for Substance Use Disorders in Primary Care
Tofighi, B., Abrantes, A. M., & Stein, M. D. (2018) · Medical Clinics of North America · doi:10.1016/j.mcna.2018.02.011 · Cited by 69 · see citing works
Hoffman, L., Benedetto, E., Huang, H. Y., Grossman, E., Kaluma, D., Mann, Z., & Torous, J. B. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00094 · Cited by 69 · see citing works
- Authors
- Gustafson, D. H., McTavish, F. M., Chih, M.-Y., Atwood, A. K., Johnson, R. A., Boyle, M. G., Levy, M. S., Driscoll, H., Chisholm, S. M., Dillenburg, L., Isham, A., & Shah, D.
- Affiliations
- University of Wisconsin–Madison (US)
- North Shore Medical Center (US)
- Fayette Companies, Peoria, Illinois
- North Shore Community College (US)
- Corresponding author
- Gustafson, David H.
- Venue
- JAMA Psychiatry
- Publisher
- American Medical Association (AMA)
- Published
- 2014-05-01
- Volume
- 71
- Issue
- 5
- Pages
- 566
- ISSN
- 2168-622X (ISSN-L)
- PMC
- PMC4016167
- OpenAlex
- W2117046315
- Semantic Scholar
- de54f8c9ced006ca5e986e3dfc871b4effb0fed8
- Cited by
- 692
- References
- 32
- Citations by year
- 2026: 25 · 2025: 45 · 2024: 49 · 2023: 57 · 2022: 66 · 2021: 69 · 2020: 63 · 2019: 62 · 2018: 81 · 2017: 52 · 2016: 49 · 2015: 50 · 2014: 24
- FWCI
- 44.19
- Type
- journal article
- Language
- en
- Open access
- green
- europepmc.org
- Locations
- JAMA Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Alcohol Abuse and Alcoholism (R01AA017192)
- Topics
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- mobile application, alcoholism, continuing care, residential treatment, recovery support, hazardous drinking, post-discharge follow-up, mobile health
- MeSH terms
- Adult, Aftercare, Alcoholism, Female, Humans, Male, Middle Aged, Patient Compliance, Patient Education as Topic, Psychotherapy, Group, Software, Temperance, Therapy, Computer-Assisted, Midwestern United States, Cognitive Behavioral Therapy, Substance Abuse Treatment Centers, Case Management, Personal Autonomy, Cell Phone, Secondary Prevention, Motivational Interviewing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review