Adding an Internet-delivered treatment to an efficacious treatment package for opioid dependence.
Open accessAbstract
OBJECTIVE: To examine the benefit of adding an Internet-delivered behavior therapy to a buprenorphine medication program and voucher-based motivational incentives. METHOD: A block-randomized, unblinded, parallel, 12-week treatment trial was conducted with 170 opioid-dependent adult patients (mean age = 34.3 years; 54.1% male; 95.3% White). Participants received an Internet-based community reinforcement approach intervention plus contingency management (CRA+) and buprenorphine or contingency management alone (CM-alone) plus buprenorphine. The primary outcomes, measured over the course of treatment, were longest continuous abstinence, total abstinence, and days retained in treatment. RESULTS: Compared to those receiving CM-alone, CRA+ recipients exhibited, on average, 9.7 total days more of abstinence (95% confidence interval [CI = 2.3, 17.2]) and had a reduced hazard of dropping out of treatment (hazard ratio = 0.47; 95% CI [0.26, 0.85]). Prior treatment for opioid dependence significantly moderated the additional improvement of CRA+ for longest continuous days of abstinence. CONCLUSIONS: These results provide further evidence that an Internet-based CRA+ treatment is efficacious and adds clinical benefits to a contingency management/medication based program for opioid dependence.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 40 cited sources checked · 0 supported · 0 flagged
- Findingown data
In opioid-dependent adults, adding internet-delivered CRA to contingency management plus buprenorphine increased total days of abstinence by an average of 9.7 days compared with contingency management alone (95% CI 2.3 to 17.2).
“Compared to those receiving CM-alone, CRA+ recipients exhibited on average 9.7 total days more of abstinence, 95% CI: (2.3, 17.2)”
Quote in the paperSubstantial claim - Findingown data
In the same trial, participants receiving CRA+ had a lower hazard of dropping out of treatment than those receiving CM-alone (HR 0.47, 95% CI 0.26 to 0.85).
“and had a reduced hazard of dropping out of treatment, Hazard Ratio (HR)=0.47; 95% CI: (0.26, 0.85).”
Quote in the paperSubstantial claim - Findingown data
A history of prior treatment for opioid dependence significantly moderated how much CRA+ improved longest continuous days of abstinence.
“Prior treatment for opioid dependence significantly moderated the additional improvement of CRA+ for longest continuous days of abstinence.”
Quote in the paperNot a substantial claim - Findingown data
The odds ratio for completing the 12-week treatment was 2.30 favoring CRA+ (χ2[1]=5.57, p=.018).
“The odds ratio for completing the 12-week treatment was 2.30 favoring CRA+ (χ2[1]=5.57, p=.018; see Table 2).”
Quote in the paperSubstantial claim - Findingown data
Among treatment-naïve participants, the hazard of dropping out for CM-alone was 1.15 times that for CRA+ (χ2[1]=0.13, p=.718).
“For treatment-naïve participants, the hazard for CM-alone participants was 1.15 times (χ2[1] = 0.13, p=.718) that for CRA+ participants.”
Quote in the paperSubstantial claim
- Findingown data
Prior treatment status and its interaction with group produced significant interactions for LCA and TA (LCA: F[1,166]=4.03, p=.046; TA: F[1,166]=3.97, p=.048).
“Entering prior treatment status and its interaction with group into an ANOVA revealed significant interactions for each outcome (LCA: F[1, 166]=4.03, p=.046; TA: F[1, 166]=3.97, p=.048);”
Quote in the paperSubstantial claim - Findingown data
None of the changes over time on those six ASI subscales statistically differed between the two groups (all six time interactions p>.24).
“None of these changes over time statistically differed between the two groups (all six time interactions, p>.24).”
Quote in the paperSubstantial claim - Findingown data
The logistic regression of treatment completion found a significant interaction of group and prior treatment (χ2[1]=5.63, p=.018).
“The logistic regression of treatment completion found a significant interaction of group and prior treatment (χ2[1] = 5.63, p=.018).”
Quote in the paperSubstantial claim - Findingown data
Prior treatment status interacted with group in the Cox proportional hazards regression of retention (χ2[1]=5.46, p=.020).
“The Cox proportional hazards regression of retention found prior treatment interacted with group (χ2[1] = 5.46, p=.020);”
Quote in the paperSubstantial claim - Findingown data
The CRA+ group had more improvement in medication ASI scores than the CM-alone group (t[127]=2.11, p=.04).
“However, the CRA+ group had more improvement in their medication ASI scores than the CM-alone group (t[127]=2.11, p=.04).”
Quote in the paperNot a substantial claim - Findingown data
Mean longest continuous abstinence (LCA) was 55.0 days for CRA+ participants and 49.5 days for CM-alone participants (t[152.4]=1.25, p=.214).
“On average, the longest continuous abstinence (LCA) for CRA+ participants was 55.0 days compared to CM-alone participants mean of 49.5 days (t[152.4] = 1.25, p=.214).”
Quote in the paperNot a substantial claim - Findingown data
Mean total abstinence (TA) was 67.1 days for CRA+ participants and 57.3 days for CM-alone participants (t[133.4]=2.59, p=.011).
“The mean total abstinence (TA) was 67.1 days for the CRA+ group and 57.3 days for the CM-alone group (t[133.4] = 2.59, p=.011).”
- Also stated in: § DISCUSSION · plain
“Although CRA+ had equivalent longest continuous abstinence weeks as CM-alone, CRA+ participants reported greater numbers of total days abstinent than CM-alone.”
Quote in the paperSubstantial claim - Also stated in: § DISCUSSION · plain
- Findingown data
CRA+ participants were retained in treatment at a greater rate than CM-alone participants (80% vs. 64%).
“Figure 2 shows that participants in the CRA+ group are retained in treatment at a greater rate than the CM-alone condition (80% CRA+ vs. 64% CM-alone).”
Quote in the paperSubstantial claim - Findingown data
Among participants with prior treatment, the odds of not completing treatment for CM-alone was 8.03 times that for CRA+ (χ2[1]=9.37, p=.002).
“The odds of not completing treatment for CM-alone participants who had received prior treatment was 8.03 times (χ2[1] = 9.37, p=.002) that for their counterparts receiving CRA+;”
Quote in the paperSubstantial claim - Findingown data
The hazard of dropping out of treatment for CM-alone participants was 2.12 times that for CRA+ participants (χ2[1]=6.14; p=.013).
“The hazard of dropping out of treatment for CM-alone participants was 2.12 times that for the CRA+ participants (χ2[1]=6.14; p=.013; see Table 2).”
Quote in the paperSubstantial claim - Findingown data
Among treatment-naïve participants, the odds of not completing treatment for CM-alone was 1.13 times that for CRA+ (χ2[1]=0.07, p=.798).
“whereas the odds for treatment-naïve CM-alone participants was attenuated to 1.13 times (χ2[1] = 0.07, p=.798) that for their CRA+ counterparts.”
Quote in the paperSubstantial claim - Findingown data
Among participants with prior treatment, the hazard of dropping out for CM-alone was 6.57 times that for CRA+ (χ2[1]=9.01, p=.003).
“thus when we stratified prior treatment the hazard of dropping out for CM-alone participants was 6.57 times (χ2[1] = 9.01, p=.003) that for CRA+ participants.”
Quote in the paperSubstantial claim - Findingown data
Among treatment-naïve participants, the two treatment groups did not differ statistically on LCA or TA (CRA+ means 51.0 and 63.4 days; CM-alone means 53.5 and 60.1 days; LCA: t[69.6]=0.39, p=.700; TA: t[66.4]=0.59, p=.558).
“For treatment-naïve participants, the two treatment groups did not differ statistically on abstinence: the CRA+ participants had LCA and TA means of 51.0 and 63.4, respectively, and the CM-alone participants had LCA and TA means of 53.5 and 60.1, respectively (LCA: t[69.6]=0.39, p=.700; TA: t[66.4]=0.59, p=.558).”
- Also stated in: § DISCUSSION · plain
“whereas for those naïve to opioid treatment, the effects of CRA+ were attenuated.”
Quote in the paperSubstantial claim - Also stated in: § DISCUSSION · plain
- Findingown data
The two groups did not statistically differ on missed urine specimens (3.4% for CM-alone vs. 2.8% for CRA+; t[167]=0.54, p=.590).
“The two groups did not statistically differ on missed urine specimens: 3.4% for CM-alone vs. 2.8% for CRA+, t[167]=0.54, p=.590.”
Quote in the paperNot a substantial claim - Premisecitation
Internet-delivered methods need substantially less therapist time than traditional therapist-delivered methods.
“and require significantly less therapist time (Bickel, et al., 2008; Wright et al., 2005).”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Bickel, et al., 2008
Not checked in the free run.
- cites Wright et al., 2005
Not checked in the free run.
- Premisecitation
Internet-delivered methods cost less than traditional therapist-delivered methods.
“These technologically-focused methods (Bickel, Christensen, & Marsch, 2011) have advantages over traditional therapist-delivered approaches as they are more cost-effective (McCrone et al., 2004)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites McCrone et al., 2004
Not checked in the free run.
- Interpretationown data
Internet-delivered CRA+ is an efficacious treatment for opioid dependence.
“These results provide further evidence that an internet-based CRA+ treatment is efficacious”
Quote in the paperSubstantial claim - Interpretationown data
Internet-delivered CRA+ provides additional clinical benefit when added to a contingency management and medication program for opioid dependence.
“and adds clinical benefits to a contingency management/medication based program for opioid dependence.”
Quote in the paperSubstantial claim - Premisecitation
When contingency management is tied to substance-use abstinence, participants typically show better clinical outcomes, including more abstinence and better retention.
“Typically, when CM is added to a treatment suite contingent on substance use abstinence participants report improved clinical outcomes including higher rates of abstinence and program retention”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Higgins, et al., 2003
Not checked in the free run.
- Premisecitation
Low-income households have greater access to mobile phones than personal computers.
“research indicates low-income households have greater access to mobile phones than personal computers (Smith, 2010).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Smith, 2010
Not checked in the free run.
- Premisecitation
Trainee clinicians often have difficulty making accurate assessments about their interventions.
“trainee clinicians often have difficulty making accurate assessments about their interventions”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Martino et al., 2011
Not checked in the free run.
- cites Moyers et al., 2008
Not checked in the free run.
- cites J. L. Smith et al., 2012
Not checked in the free run.
- Interpretationown data
The results support the hypothesis that computer-delivered CRA+ implemented over the internet during treatment improves clinical outcomes in opioid dependence.
“These results support the hypothesis that computer-delivered CRA+ implemented over the internet during treatment improves clinical outcomes in the treatment of opioid dependence.”
Quote in the paperSubstantial claim - Premisecitation
Web-based CRA may by itself improve clinical outcomes beyond standard substance dependence treatment.
“Moreover, evidence has very recently emerged that suggests that web-based CRA may independently improve clinical outcomes.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Marsch et al. (2013)
Not checked in the free run.
- Premisecitation
Substance dependence is usually viewed as a chronic condition with relapses.
“substance dependence is typically characterized as a chronic relapsing condition”
Quote in the paperSubstantial claim0 of 1 sources checked- cites McLellan, McLellan, Lewis, O’Brien, & Kleber, 2000
Not checked in the free run.
- Premisecitation
CRA partly works therapeutically by building on skills, knowledge, and outcomes from earlier treatment experiences.
“CRA gains some of its therapeutic power from building on the skills, knowledge, and outcomes from previous therapeutic experiences”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Budney & Higgins, 1998
Not checked in the free run.
- Study design and conductown data
The study lacked a usual care/standard treatment or best practice arm.
“The most important was the lack of a “usual care/standard treatment” or “best practice” arm, although we note both groups achieved high levels of abstinence.”
Quote in the paperSubstantial claim - Study design and conductnone given
The study lacked participant data after treatment.
“In addition, another limitation is the lack of participant data post-treatment.”
Quote in the paperNot a substantial claim - Interpretationown data
CRA appears to build on previous treatment episodes.
“It indicates that CRA appears to build on previous treatment episodes despite research that suggests people who previously entered substance abuse treatment have greater drug problems, higher psychiatric co-morbidities, and suffer more life challenges than those without previous treatment experience (Claus, Mannen, & Schicht, 1999).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Claus, Mannen, & Schicht, 1999
Not checked in the free run.
- Premisecitation
Low income households are less likely to have access to the internet.
“low income households are less likely to have access to the internet (US Census Bureau, 2005)”
Quote in the paperSubstantial claim0 of 1 sources checked- cites US Census Bureau, 2005
Not checked in the free run.
- Premisecitation
Training clinicians to deliver evidence-based counseling treatments is extremely time consuming.
“previous studies have reported that training clinicians to deliver evidence-based counseling treatments is extremely time consuming”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Martino et al., 2011
Not checked in the free run.
- cites Moyers et al., 2008
Not checked in the free run.
- cites J. L. Smith et al., 2012
Not checked in the free run.
- May combine two claims. 21
- Classified as probably not a substantial claim. 20
May combine two claims.
Findingown dataThe observed differences in LCA were in the expected direction but were approximately one-third of the expected difference.
“Our differences in LCA were in the right direction, but were approximately 1/3 of the difference we expected.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataAt both mid- and end-trial, participants tended to improve from baseline on ASI subscales for opioids, drugs, alcohol, psychological issues, employment, and family issues (mid-trial all six p<.03; trial-end all six p<.01).
“At both mid- and end-trial, participants tended to show improvement from baseline levels of the ASI subscales for opioids, drugs, alcohol, psychological issues, employment, and family issues (mid-trial: all six p<.03; trial-end: all six p<.01).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataThe legal issues and medications ASI subscales did not show a change from baseline at either time point (mid-trial both p>.05; end-trial both p>.16).
“The subscales for legal issues and medications did not show a change from baseline values at either time point (mid-trial: both p>.05; end-trial both p>.16).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataIncome had no statistical effect in any analysis of treatment outcomes.
“We thus included income in analyses of treatment outcomes, but in all instances, income had no statistical effect; hence, we omit these results.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataThe CRA+ group had a lower median monthly income at baseline than the CM-alone group ($1,000 vs. $1,808; Wilcoxon-Mann-Whitney z=2.09, p=.037).
“The CRA+ group had a lower median monthly income than those in the CM-alone group: $1,000 vs. $1,808 (Wilcoxon-Mann-Whitney z=2.09, p=.037).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataFor the cocaine ASI subscale, participants showed decreases from baseline at mid-trial (t[165]=2.03, p=.04), but did not maintain a statistical difference at trial-end (t[189]=0.33, p=.74).
“For the cocaine subscale, participants showed decreases from baseline levels at mid-trial (t[165]=2.03, p=.04), but did not maintain a statistical difference at trial-end (t[189]=0.33, p=.74).”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAmong CRA+ participants with prior treatment, mean LCA and TA were 61.1 and 72.6 days, respectively, compared with CM-alone means of 46.0 and 54.8 days (LCA: t[74.6]=2.52, p=.014; TA: t[53.8]=3.70, p=.001).
“For CRA+ participants having previously undergone treatment for opioids, their mean LCA and TA were 61.1 and 72.6 days, respectively, compared to their CM-alone counterparts’ means of 46.0 and 54.8 days, respectively (LCA: t[74.6]=2.52, p=.014; TA: t[53.8]= 3.70, p=.001).”
- Also stated in: § DISCUSSION · plain
“Further, for participants who experienced prior treatment, those in the CRA+ condition had longer continuous abstinence and longer total abstinence weeks than the CM-alone group.”
Quote in the paperSubstantial claim- Also stated in: § DISCUSSION · plain
May combine two claims.
PremisecitationThe CRA plus CM package has been widely studied and shown to be efficacious for cocaine dependence.
“The CRA plus CM treatment package has been extensively researched and shown to be a demonstrably efficacious treatment for cocaine dependence”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Higgins, Bickel, & Hughes, 1994
Not checked in the free run.
- cites Higgins et al., 2003
Not checked in the free run.
- cites Van Horn & Frank, 1998
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationComputer-based and internet-delivered methods are being used more often to deliver mental health and substance abuse treatment.
“Recently, mental health and substance abuse treatments have been increasingly implemented using computer-based and internet-delivered approaches (Bickel, Marsch, Buchhalter, & Badger, 2008; Brooks, Ryder, Carise, & Kirby, 2010).”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Bickel, Marsch, Buchhalter, & Badger, 2008
Not checked in the free run.
- cites Brooks, Ryder, Carise, & Kirby, 2010
Not checked in the free run.
May combine two claims.
PremisecitationIn opioid-dependent patients, adding internet-based CRA to reduced standard treatment produced greater opioid abstinence over 12 months, both across all study weeks and across tested weeks, than standard treatment.
“Marsch et al. (2013) found that participants assigned to the CRA condition reported statistically significantly higher rates of overall study and tested weeks of opioid abstinence over 12 months than the standard treatment group.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Marsch et al. (2013)
Not checked in the free run.
May combine two claims.
PremisecitationIn that trial, CRA participants had a greater percentage of tested weeks of continuous opioid abstinence, but not of overall study weeks, than standard treatment.
“CRA participants also had a statistically significant greater percentage of tested weeks of continuous abstinence (but not overall study weeks of continuous abstinence) from opioids compared to the standard treatment group.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Marsch et al. (2013)
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationDrugs of abuse are partly potent because their reinforcing effects are more overpowering and immediate than those of more pro-social behaviors.
“Evidence from these literatures suggest that drugs of abuse are partly so potent due to their over-powering and more immediately reinforcing effects than more pro-social behaviors”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Higgins, et al., 1994
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationInternet-delivered systems are especially appropriate for behavioral treatments in which participants learn skills that can be trained to mastery through programmable methods.
“These delivery systems are particularly suited to behavioral treatments where participants learn skills that can be trained to a level of mastery using programmable methods”
Quote in the paperSubstantial claim0 of 1 sources checked- cites Bickel, et al., 2008
Not checked in the free run.
May combine two claims.
PremisecitationCRA and CRA plus CM are behavioral treatments that have shown efficacy in substance abuse treatment.
“Behavioral treatments that show efficacy in the treatment of substance abuse are the Community Reinforcement Approach (CRA: Hunt & Azrin, 1973) and CRA plus Contingency Management (CM: Higgins et al., 1993).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Hunt & Azrin, 1973
Not checked in the free run.
- cites Higgins et al., 1993
Not checked in the free run.
May combine two claims.
PremisecitationMarsch et al. found no difference between groups in drop-out but high attrition in both groups.
“However, although Marsch et al. (2013) reported no differences in drop-out between groups, they did report high attrition rates across both groups.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Marsch et al. (2013)
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationIn cocaine users, an internet-based CRA program with contingency payments for completing modules improved CRA knowledge and increased selection of CRA-style coping responses compared with a yoked control.
“Brooks et al. (2010) found participants in the CRA condition demonstrated statistically significant improvements in CRA knowledge and were significantly more likely to select CRA-style coping responses, relative to the yoked group.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Brooks et al. (2010)
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductcitationTreatment allocation used minimum likelihood allocation to balance groups on characteristics likely to affect outcomes.
“Allocation to treatment groups was based on the “minimum likelihood allocation” method (Aickin, 1982), which balances treatment groups on patient characteristics likely to influence treatment outcomes.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Aickin, 1982
Not checked in the free run.
May combine two claims.
InterpretationreasoningUsing an internet-based counseling program is likely to reduce clinician training time and increase standardization of treatment, resulting in financial savings and treatment improvements for time-poor and resource-challenged counseling services.
“The practical implications of using an internet-based counseling program are likely to be less clinician training time and greater standardization of treatment resulting in significant financial savings and treatment improvements to time-poor and resource challenged counseling services.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataThis trial randomly assigned 170 adults with opioid dependence, ages 20 to 63, to one of two 12-week treatment arms.
“Of the 206 consented, 170 participants aged 20 to 63 were randomly assigned to one of two conditions for 12 weeks of treatment.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenNo abstinence data were missing from clinic visits that participants attended.
“There were no missing abstinence data from attended clinic visits.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationImproved retention is consistent with previous contingency management effects.
“Although improved retention is consistent with previous contingency management effects (Preston et al., 1999), we believe this is the first demonstration of improved retention in an internet delivered program of CRA+ for abstinence.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Preston et al., 1999
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductnone givenIf baseline measures differed between groups, their impact on group comparisons was assessed by including them as covariates.
“If any baseline measure was found to differ between the two groups, the impact of that measure on group comparisons was assessed by entering it into the analysis as a covariate.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim. May combine two claims.
Study design and conductown dataAssignment to treatment was random, unblinded, and in a 1:1 ratio to CRA+ or CM-alone.
“Allocation to treatment groups was randomly assigned (un-blinded) by 1:1 allotment to either the CRA+ or CM-alone treatment conditions.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisecitationPeople who previously entered substance abuse treatment have greater drug problems, higher psychiatric co-morbidities, and more life challenges than those without previous treatment experience.
“research that suggests people who previously entered substance abuse treatment have greater drug problems, higher psychiatric co-morbidities, and suffer more life challenges than those without previous treatment experience (Claus, Mannen, & Schicht, 1999).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Claus, Mannen, & Schicht, 1999
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationComputer-delivered approaches have been found effective in treating a variety of substance use disorders.
“Computer-delivered approaches have now been found to be effective in treating a variety of substance use disorders (Bickel, et al., 2008; Carroll et al., 2009).”
Quote in the paperSubstantial claim0 of 2 sources checked- cites Bickel, et al., 2008
Not checked in the free run.
- cites Carroll et al., 2009
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationOpioid-dependent individuals typically report low incomes.
“as opioid-dependent individuals typically report low incomes (Marsch, et al., 2005)”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Marsch, et al., 2005
Not checked in the free run.
Classified as probably not a substantial claim.
Study design and conductreasoningTo prevent compliance from confounding the test of CRA efficacy, the internet CRA program could be accessed only at the clinic.
“Given that we wished to examine the efficacy of this program alone and not have these results confounded with issues of compliance, treatments were only accessible from the clinic site.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataCRA+ had lower drop-out rates and higher treatment completion than CM-alone, suggesting that CRA provides value additional to motivational incentives and buprenorphine.
“CRA+ was found to have lower drop-out rates and higher rates of treatment completion than CM-alone suggesting that CRA provides value to opioid-dependent participants additional to motivational incentives and buprenorphine medication.”
Quote in the paperSubstantial claimMay combine two claims.
Study design and conductown dataThe sample size was designed to detect a difference in LCA of 3 weeks (9 visits) between the two groups and might have been under-powered to detect smaller differences.
“Another was the sample size which was designed to detect a difference in LCA of 3 weeks (9 visits) between the two groups, and might have been under-powered to pick up smaller differences.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe study demonstrated increased overall abstinence and retention efficacy for internet-delivered computerized CRA+ over motivational incentives and buprenorphine, and increased continuous abstinence for CRA+ individuals with prior treatment.
“In summary, our study demonstrated increased overall abstinence and retention efficacy in an internet-delivered computerized CRA+ group over motivational incentives and buprenorphine, and increased continuous abstinence for those CRA+ individuals who engaged in prior treatment.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
Study design and conductnone givenMissed visits were counted as positive results.
“Missed visits were interpreted as positive results.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductcitationThe Addiction Severity Index has been shown to be internally consistent and valid for measuring addiction severity.
“Psychometric assessments have shown the ASI as an internally consistent and valid instrument for measuring addiction severity”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites Butler et al., 2001
Not checked in the free run.
- cites Leonhard, Mulvey, Gastfriend, & Shwartz, 2000
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductown dataRandomization was stratified by buprenorphine stabilization dose, distance from the clinic, prior opioid dependence treatment, and past-month cocaine use.
“We stratified the randomization on four characteristics:”
- Also stated in: § Procedure · plain
“receipt of previous treatment for opioid dependence (yes, no), and (4) cocaine use in the past month (yes, no).”
Quote in the paperNot a substantial claim- Also stated in: § Procedure · plain
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Study design and conductnone givenPotential confounders were examined with analysis of variance, and a known confounder was handled through stratified analyses.
“We evaluated potential confounders in an analysis of variance and accounted for an established confounder with stratified analyses.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Study design and conductreasoningThe planned sample of 170 gave 80% power to detect a 3.0-week difference between arms in mean weeks of continuous abstinence at a two-sided .05 level, assuming a within-group SD of 7.0 weeks.
“A sample size of N=170 was estimated to provide 0.80 power to detect a 3.0 week difference between treatment conditions in mean weeks of continuous abstinence using a .05 significance level on a two-sided t-test, while assuming a within-group standard deviation of 7.0 weeks based on reports from previous trials using CRA+.”
Quote in the paperNot a substantial claimMay combine two claims.
PremisecitationA growing literature suggests technology-based interventions are more reliable, provide greater program fidelity, are easier to develop, reach larger populations, are more cost-effective, and provide similar client satisfaction than traditional face-to-face therapies.
“Specifically, a growing literature suggests technology-based interventions are more reliable, provide greater program fidelity, are easier to develop, reach larger populations, are more cost-effective, and provide similar levels of client satisfaction than traditional face-to-face therapies (Craske et al., 2009; Griest, 2008; Munoz et al., 2009; Rotondi et al., 2010; Marsch et al., 2013).”
Quote in the paperSubstantial claim0 of 3 sources checked- cites Craske et al., 2009
Not checked in the free run.
- cites Griest, 2008
Not checked in the free run.
- cites Munoz et al., 2009
Not checked in the free run.
The paper relies on this without support.
The combination of CRA and CM for drug abstinence had not yet been tested with web-based delivery.
“Further, no study to our knowledge has yet to trial the combination of CRA and CM for drug abstinence using web-based approaches.”
The paper relies on this without support.
Prior CRA treatment had not been studied for its effect on clinical outcomes.
“no study has examined the effect of previous CRA treatments on clinical outcomes.”
The paper relies on this without support.
Increasing non-drug reinforcement and providing immediate abstinence incentives will outcompete drug use as the preferred behavior.
“The increased non-drug sources of reinforcement and the immediately available incentives for abstinence are then expected to successfully compete with the powerful and immediately reinforcing effects of drug use as the preferred behavior.”
The paper relies on this without support.
Participants in the trial had sufficient internet access to receive the internet-delivered CRA+ treatment.
“This study examined the benefit of adding an internet-delivered therapy to motivational incentives and buprenorphine as treatments for opioid dependence.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Two DTx that received FDA clearance as SaMD for the adjunctive treatment of opioid use and substance use disorder used TAU or reduced TAU as comparators.
“Similarly, two DTx that received FDA clearance as SaMD for the adjunctive treatment of opioid use and substance use disorder (8, 46) used TAU or reduced TAU as comparators (see Table 1 for a description of the reduced TAU versus full TAU condition) (8).”
Statistics recomputed
Every reported test result, recomputed from its test statistic and degrees of freedom. A result shows as not adding up only once an independent check has confirmed it.
- Consistentz = 2.09reported p = .037 · recomputed p = .037
“z=2.09, p = .037”
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Self-check results appear here once an independent check has confirmed them.
Cites
The Fifth Edition of the Addiction Severity Index.
Mclellan, A., Kushner, H., Metzger, D., Peters, R., Smith, I. E., Grissom, G. R., Pettinati, H., & Argeriou, M. (1992) · Journal of Substance Abuse Treatment · doi:10.1016/0740-5472(92)90062-s · Cited by 4,279 · see citing works
Drug Dependence, a Chronic Medical Illness
McLellan, A. T., Lewis, D. C., O'Brien, C. P., & Kleber, H. D. (2000) · JAMA · doi:10.1001/jama.284.13.1689 · Cited by 2,622 · see citing works
Computer and Internet Use in the United States: 2003
Day, J. C., Janus, A. L., & Davis, J. T. (2005) · Cited by 978 · see citing works
A community-reinforcement approach to alcoholism
Hunt, G. M., & Azrin, N. H. (1973) · Behaviour Research and Therapy · doi:10.1016/0005-7967(73)90072-7 · Cited by 596 · see citing works
Achieving cocaine abstinence with a behavioral approach.
Higgins, S., Budney, A., Bickel, W. K., Hughes, J., Foerg, F. E., & Badger, G. (1993) · American Journal of Psychiatry · doi:10.1176/ajp.150.5.763 · Cited by 514 · see citing works
Self-citationMcCrone, P., Knapp, M., Proudfoot, J., Ryden, C., Cavanagh, K., Shapiro, D. A., Ilson, S., Gray, J. A., Goldberg, D., Mann, A., et al. (2004) · British Journal of Psychiatry · doi:10.1192/bjp.185.1.55 · Cited by 371 · cited 2× · see citing works
“These technologically-focused methods (Bickel, Christensen, & Marsch, 2011) have advantages over traditional therapistdelivered approaches as they are more cost-effective (McCrone et al., 2004) and require significantly less therapist time (Bickel, et al., 2008; Wright et al., 2005).”
MethodWright, J. H., Wright, A. S., Albano, A. M., Basco, M. R., Goldsmith, L. J., Raffield, T., & Otto, M. W. (2005) · American Journal of Psychiatry · doi:10.1176/appi.ajp.162.6.1158 · Cited by 319 · see citing works
Have we evaluated addiction treatment correctly? Implications from a chronic care perspective
McLellan, A. T. (2002) · Addiction · doi:10.1046/j.1360-0443.2002.00127.x · Cited by 307 · see citing works
The Addiction Severity Index: a field study of internal consistency and validity.
Leonhard, C., Mulvey, K., Gastfriend, D., & Shwartz, M. (2000) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(99)00025-2 · Cited by 253 · see citing works
Community Reinforcement Therapy for Cocaine-Dependent Outpatients
Higgins, S. T., Sigmon, S. C., Wong, C. J., Heil, S. H., Badger, G. J., Donham, R., Dantona, R. L., & Anthony, S. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.9.1043 · Cited by 205 · see citing works
Computerized behavior therapy for opioid-dependent outpatients: a randomized controlled trial.
Bickel, W., Marsch, L., Buchhalter, A., & Badger, G. (2008) · Experimental and clinical psychopharmacology · doi:10.1037/1064-1297.16.2.132 · Cited by 202 · see citing works
Self-citationThe Community Reinforcement Approach
Meyers, R. J., Smith, J. E., & Lash, D. N. (2002) · Springer eBooks · doi:10.1007/0-306-47939-7_14 · Cited by 180 · see citing works
Influence of an alternative reinforcer on human cocaine self-administration
Higgins, S. T., Bickel, W. K., & Hughes, J. R. (1994) · Life Sciences · doi:10.1016/0024-3205(94)00878-7 · Cited by 175 · see citing works
Self-citationCraske, M. G., Rose, R. D., Lang, A., Welch, S. S., Campbell-Sills, L., Sullivan, G., Sherbourne, C., Bystritsky, A., Stein, M. B., & Roy-Byrne, P. P. (2009) · Depression and Anxiety · doi:10.1002/da.20542 · Cited by 170 · cited 2× · see citing works
“…provide greater program fidelity, are easier to develop, reach larger populations, are more cost-effective, and provide similar levels of client satisfaction than traditional face-to-face therapies (Craske et al., 2009; Griest, 2008; Munoz et al., 2009; Rotondi et al., 2010; Marsch et al., 2013).”
BackgroundImprovement in naltrexone treatment compliance with contingency management.
Preston, K., Silverman, K., Umbricht, A., DeJesus, A., Montoya, I., & Schuster, C. (1999) · Drug and Alcohol Dependence · doi:10.1016/s0376-8716(98)00152-5 · Cited by 167 · see citing works
Carroll, K. M., Ball, S. A., Martino, S., Nich, C., Babuscio, T. A., & Rounsaville, B. J. (2009) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.09.015 · Cited by 164 · see citing works
Rotondi, A. J., Anderson, C. M., Haas, G. L., Eack, S. M., Spring, M. B., Ganguli, R., Newhill, C., & Rosenstock, J. (2010) · Psychiatric Services · doi:10.1176/ps.2010.61.11.1099 · Cited by 158 · cited 2× · see citing works
“…provide greater program fidelity, are easier to develop, reach larger populations, are more cost-effective, and provide similar levels of client satisfaction than traditional face-to-face therapies (Craske et al., 2009; Griest, 2008; Munoz et al., 2009; Rotondi et al., 2010; Marsch et al., 2013).”
BackgroundBuprenorphine treatment of opioid dependence: A review.
Bickel, W. K., & Amass, L. (1995) · Experimental and Clinical Psychopharmacology · doi:10.1037/1064-1297.3.4.477 · Cited by 150 · see citing works
Self-citationMoyers, T. B., Manuel, J. K., Wilson, P. G., Hendrickson, S. M. L., Talcott, W. G., & Durand, P. (2007) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465807004055 · Cited by 141 · see citing works
Marsch, L. A., Guarino, H., Acosta, M., Aponte-Melendez, Y., Cleland, C., Grabinski, M., Brady, R., & Edwards, J. (2014) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2013.08.012 · Cited by 139 · see citing works
Self-citationInternational Spanish/English Internet smoking cessation trial yields 20% abstinence rates at 1 year
Muñoz, R. F., Barrera, A. Z., Delucchi, K., Penilla, C., Torres, L. D., & Pérez-Stable, E. J. (2009) · Nicotine & Tobacco Research · doi:10.1093/ntr/ntp090 · Cited by 127 · see citing works
Initial validation of a computer-administered Addiction Severity Index: The ASI–MV.
Bultler, S. F., Budman, S. H., Goldman, R. J., Newman, F. J., Beckley, K. E., Trottier, D., & Cacciola, J. S. (2001) · Psychology of Addictive Behaviors · doi:10.1037/0893-164x.15.1.4 · Cited by 127 · see citing works
Martino, S., Ball, S. A., Nich, C., Canning‐Ball, M., Rounsaville, B. J., & Carroll, K. M. (2010) · Addiction · doi:10.1111/j.1360-0443.2010.03135.x · Cited by 125 · see citing works
Buprenorphine dosing every 1, 2, or 3 days in opioid-dependent patients
Bickel, W. K., Amass, L., Crean, J. P., & Badger, G. J. (1999) · Psychopharmacology · doi:10.1007/s002130051096 · Cited by 92 · see citing works
Self-citationMarsch, L. A., Bickel, W. K., Badger, G. J., & Jacobs, E. A. (2004) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2004.08.011 · Cited by 81 · see citing works
Self-citationBickel, W. K., Christensen, D. R., & Marsch, L. A. (2010) · Substance Use & Misuse · doi:10.3109/10826084.2011.521066 · Cited by 78 · see citing works
Self-citationSmith, J. L., Carpenter, K. M., Amrhein, P. C., Brooks, A. C., Levin, D., Schreiber, E. A., Travaglini, L. A., Hu, M., & Nunes, E. V. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0028176 · Cited by 68 · see citing works
Use of contingency contracts in specialty clinics for cocaine abuse.
Anker, A. L., & Crowley, T. J. (1982) · PsycEXTRA Dataset · doi:10.1037/e470472004-001 · Cited by 54 · see citing works
Campbell, A. N. C., Nunes, E. V., Miele, G. M., Matthews, A. G., Polsky, D. E., Ghitza, U. E., Turrigiano, E., Bailey, G. L., VanVeldhuisen, P., Chapdelaine, R., et al. (2011) · Contemporary Clinical Trials · doi:10.1016/j.cct.2011.11.001 · Cited by 51 · see citing works
A program for balancing the allocation of subjects to treatment in a clinical trial
Aickin, M. G. (1982) · Computers and Biomedical Research · doi:10.1016/0010-4809(82)90014-3 · Cited by 49 · see citing works
Schottenfeld, R. S. (2000) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(99)00062-8 · Cited by 48 · see citing works
Treatment career snapshots: profiles of first treatment and previous treatment clients.
Claus, R. E., Mannen, R., & Schicht, W. W. (1999) · Addictive Behaviours · doi:10.1016/s0306-4603(98)00106-3 · Cited by 31 · see citing works
Feasibility and effectiveness of computer-based therapy in community treatment
Brooks, A. C., Ryder, D., Carise, D., & Kirby, K. C. (2010) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2010.06.003 · Cited by 25 · see citing works
A Promising Debut for Computerized Therapies
Greist, J. H. (2008) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.08040528 · Cited by 14 · see citing works
Psychotherapy for cocaine addiction.
Horn, D. H. A. V., & Frank, A. F. (1998) · Psychology of Addictive Behaviors · doi:10.1037/0893-164x.12.1.47 · Cited by 8 · see citing works
Flagged first, then by citations
1 of the 36 references couldn’t be matched to a known paper.
Research works printed but not linked: 1
- Stitzer ML Higgins ST Bloom FE Kupfer DJ Behavioral treatment of drug and alcohol abuse Psychopharmacology, The Fourth Generation of Progress 1995 New York Raven Press 1807 1819
Cited by
Sorted by citations
Erbe, D., Eichert, H.-C., Riper, H., & Ebert, D. D. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6588 · Cited by 532 · see citing works
Morgan, J. R., Schackman, B. R., Leff, J. A., Linas, B. P., & Walley, A. Y. (2018) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2017.07.001 · Cited by 332 · see citing works
Carroll, K. M., & Kiluk, B. D. (2017) · Psychology of Addictive Behaviors · doi:10.1037/adb0000311 · Cited by 218 · see citing works
The Role of Behavioral Interventions in Buprenorphine Maintenance Treatment: A Review
Carroll, K. M., & Weiss, R. D. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.16070792 · Cited by 211 · see citing works
Digital health technologies: opportunities and challenges in rheumatology
Solomon, D. H., & Rudin, R. S. (2020) · Nature Reviews Rheumatology · doi:10.1038/s41584-020-0461-x · Cited by 228 · see citing works
Petry, N. M., Alessi, S. M., Olmstead, T. A., Rash, C. J., & Zajac, K. (2017) · Psychology of Addictive Behaviors · doi:10.1037/adb0000287 · Cited by 197 · see citing works
Characteristics and challenges of the clinical pipeline of digital therapeutics
Patel, N. A., & Butte, A. J. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00370-8 · Cited by 143 · see citing works
Winhusen, T. M., Walley, A. Y., Fanucchi, L. C., Hunt, T., Lyons, M., Lofwall, M. R., Brown, J. L., Freeman, P. R., Nunes, E. V., Beers, D., et al. (2020) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2020.108325 · Cited by 133 · see citing works
Relapse to opioid use disorder after inpatient treatment: protective effect of injection naltrexone
Nunes, E. V., Gordon, M., Friedmann, P. D., Fishman, M. J., Lee, J. D., Chen, D. T., Hu, M. C., Boney, T. Y., Wilson, D., & O'Brien, C. P. (2018) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2017.04.016 · Cited by 122 · see citing works
Meyer, J. P., Isaacs, K. R., Shahawy, O. E., Burlew, A. K., & Wechsberg, W. M. (2019) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.01.017 · Cited by 123 · see citing works
Some current dimensions of the behavioral economics of health-related behavior change
Bickel, W. K., Moody, L. N., & Higgins, S. T. (2016) · Preventive Medicine · doi:10.1016/j.ypmed.2016.06.002 · Cited by 104 · see citing works
Self-citationInternet interventions for adult illicit substance users: a meta‐analysis
Boumparis, N., Karyotaki, E., Schaub, M. P., Cuijpers, P., & Riper, H. (2017) · Addiction · doi:10.1111/add.13819 · Cited by 104 · see citing works
Digital therapeutics for mental health: Is attrition the Achilles heel?
Nwosu, A., Boardman, S., Husain, M. M., & Doraiswamy, P. M. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.900615 · Cited by 101 · see citing works
Pharmacological and Behavioral Treatment of Opioid Use Disorder
Sofuoglu, M., DeVito, E. E., & Carroll, K. M. (2018) · Psychiatric Research and Clinical Practice · doi:10.1176/appi.prcp.20180006 · Cited by 96 · see citing works
Lutz, J., Offidani, E., Taraboanta, L., Lakhan, S. E., & Campellone, T. R. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.823977 · Cited by 89 · see citing works
Scale-up of Digital Innovations in Health Care: Expert Commentary on Enablers and Barriers
Schlieter, H., Marsch, L. A., Whitehouse, D., Otto, L., Londral, A. R. M., Teepe, G. W., Benedict, M., Ollier, J., Ulmer, T., Gasser, N., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/24582 · Cited by 89 · see citing works
Self-citationManhapra, A., Agbese, E., LESLIE, D. L., & Rosenheck, R. A. (2018) · Psychiatric Services · doi:10.1176/appi.ps.201700363 · Cited by 86 · see citing works
Digital therapeutics in the clinic
Phan, P., Mitragotri, S., & Zhao, Z. (2023) · Bioengineering & Translational Medicine · doi:10.1002/btm2.10536 · Cited by 90 · see citing works
Marsch, L. A., Campbell, A. N. C., Campbell, C. I., Chen-Ritzo, C.-H., Ertin, E., Ghitza, U. E., Lambert-Harris, C. A., Hassanpour, S., Holtyn, A. F., Hser, Y., et al. (2020) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2020.02.005 · Cited by 81 · see citing works
Self-citationRetention Strategies for Medications for Opioid Use Disorder in Adults: A Rapid Evidence Review
Chan, B. L., Gean, E. G., Arkhipova-Jenkins, I., Gilbert, J., Hilgart, J., Fiordalisi, C. V., Hubbard, K., Brandt, I., Stoeger, E., Paynter, R. A., et al. (2020) · Journal of Addiction Medicine · doi:10.1097/adm.0000000000000739 · Cited by 73 · see citing works
Treatment of opioid use disorder in primary care
Buresh, M. E., Stern, R. S., & Rastegar, D. A. (2021) · BMJ · doi:10.1136/bmj.n784 · Cited by 68 · see citing works
Rice, D., Corace, K., Wolfe, D., Esmaeilisaraji, L., Michaud, A., Grima, A., Austin, B., Douma, R., Barbeau, P., Butler, C., et al. (2020) · PLOS ONE · doi:10.1371/journal.pone.0244401 · Cited by 64 · see citing works
Real-world evidence for a prescription digital therapeutic to treat opioid use disorder
Maricich, Y. A., Xiong, X. R., Gerwien, R. W., Kuo, A., Velez, F. F., Imbert, B., Boyer, K., Luderer, H. F., Braun, S., & Williams, K. R. (2020) · Current Medical Research and Opinion · doi:10.1080/03007995.2020.1846023 · Cited by 54 · see citing works
Guillen, A., Reddy, M., Saadat, S., & Chakravarthy, B. (2021) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2021.0308 · Cited by 54 · see citing works
Velez, F. F., Colman, S., Kauffman, L., Ruetsch, C. R., & Anastassopoulos, K. P. (2020) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1080/14737167.2021.1840357 · Cited by 55 · see citing works
Clinical Evaluation of Digital Therapeutics: Present and Future
Huh, K. Y., Oh, J., Lee, S., & Yu, K. (2022) · Healthcare Informatics Research · doi:10.4258/hir.2022.28.3.188 · Cited by 51 · see citing works
Smartphone-based financial incentives to promote smoking cessation during pregnancy: A pilot study
Kurti, A. N., Tang, K. J., Bolívar, H. A., Evemy, C. G., Medina, N., Skelly, J. M., Nighbor, T. D., & Higgins, S. T. (2020) · Preventive Medicine · doi:10.1016/j.ypmed.2020.106201 · Cited by 50 · see citing works
Digital Mental Health for Alcohol and Substance Use Disorders
Boumparis, N., Schulte, M. H. J., & Riper, H. (2019) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-019-00190-y · Cited by 50 · see citing works
Attentional bias in opioid users: A systematic review and meta-analysis
MacLean, R. R., Sofuoglu, M., Brede, E., Robinson, C. D., & Waters, A. J. (2018) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2018.07.012 · Cited by 44 · see citing works
Mahmoud, H., Naal, H., Whaibeh, E. R., & Smith, A. J. (2022) · Current Psychiatry Reports · doi:10.1007/s11920-022-01346-z · Cited by 44 · see citing works
Harocopos, A., Allen, B., & Paone, D. (2015) · International Journal of Drug Policy · doi:10.1016/j.drugpo.2015.12.021 · Cited by 45 · see citing works
Maricich, Y. A., Bickel, W. K., Marsch, L. A., Gatchalian, K. M., Botbyl, J. D., & Luderer, H. F. (2020) · Current Medical Research and Opinion · doi:10.1080/03007995.2020.1846022 · Cited by 43 · see citing works
Self-citationToward Data-Driven Digital Therapeutics Analytics: Literature Review and Research Directions
Lee, U., Jung, G., Ma, E.-Y., Kim, J. S., Kim, H., Alikhanov, J., Noh, Y., & Kim, H. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123015 · Cited by 40 · see citing works
A Quantitative Signature of Self-Control Repair
Bickel, W. K., Landes, R. D., Kurth-Nelson, Z. L., & Redish, A. D. (2014) · Clinical Psychological Science · doi:10.1177/2167702614528162 · Cited by 37 · see citing works
Self-citationNunes, E. V., Scodes, J. M., Pavlicová, M., Lee, J. D., Novo, P., Campbell, A. N. C., & Rotrosen, J. (2021) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.20060816 · Cited by 36 · see citing works
Glass, J. E., Matson, T. E., Lim, C. Y., Hartzler, A. L., Kimbel, K. J., Lee, A. K., Beatty, T. C., Parrish, R. S., Caldeiro, R. M., McWethy, A. G., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/25866 · Cited by 31 · see citing works
Langdon, K. J., Scherzer, C. R., Ramsey, S. E., Carey, K. B., Rich, J. D., & Ranney, M. L. (2021) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2021.108538 · Cited by 30 · see citing works
Marsch, L. A. (2020) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2020.07.004 · Cited by 31 · see citing works
Self-citationThree-month outcomes from a patient-centered program to treat opioid use disorder in Iowa, USA
Lynch, A., Weber, A. N., Hedden, S., Sabbagh, S., Arndt, S. V., & Ación, L. (2021) · Substance Abuse Treatment Prevention and Policy · doi:10.1186/s13011-021-00342-5 · Cited by 28 · see citing works
Glass, J. E., Tiffany, B., Matson, T. E., Lim, C. Y., Gundersen, G., Kimbel, K. J., Hartzler, A. L., Curran, G. M., McWethy, A. G., Caldeiro, R. M., et al. (2022) · Implementation Research and Practice · doi:10.1177/26334895221135264 · Cited by 27 · see citing works
Luderer, H. F., Campbell, A. N. C., Nunes, E. V., Enman, N. M., Xiong, X. R., Gerwien, R. W., & Maricich, Y. A. (2021) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2021.108585 · Cited by 27 · see citing works
Kmiec, J. A., & Suffoletto, B. P. (2019) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2019.02.005 · Cited by 26 · see citing works
Shulman, M., Weiss, R. D., Rotrosen, J., Novo, P., Costello, E. J., & Nunes, E. V. (2021) · Addiction Science & Clinical Practice · doi:10.1186/s13722-021-00223-z · Cited by 25 · see citing works
Leveraging applied behavior analysis research and practice in the service of public health.
Normand, M. P., Dallery, J., & Slanzi, C. M. (2021) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.832 · Cited by 19 · see citing works
Kawasaki, S. S., Mills-Huffnagle, S. L., Aydinoglo, N., Maxin, H., & Nunes, E. V. (2022) · JMIR Formative Research · doi:10.2196/33073 · Cited by 23 · see citing works
Maricich, Y. A., Nunes, E. V., Campbell, A. N. C., Botbyl, J. D., & Luderer, H. F. (2022) · Substance Abuse · doi:10.1080/08897077.2022.2060425 · Cited by 26 · see citing works
Velez, F. F., Anastassopoulos, K. P., Colman, S., Shah, N., Kauffman, L., Murphy, S. M., Ruetsch, C. R., & Maricich, Y. A. (2022) · Advances in Therapy · doi:10.1007/s12325-022-02217-y · Cited by 25 · see citing works
Schuster, R., Laireiter, A., Berger, T., Moritz, S., Meyer, B., Hohagen, F., & Klein, J. P. (2020) · Journal of Affective Disorders · doi:10.1016/j.jad.2020.05.122 · Cited by 22 · see citing works
Wang, W., Lowe, N. G., Jalali, A., & Murphy, S. M. (2020) · Journal of Medical Economics · doi:10.1080/13696998.2020.1858581 · Cited by 24 · see citing works
Maricich, Y. A., Gerwien, R. W., Kuo, A., Malone, D. C., & Velez, F. F. (2021) · Hospital Practice · doi:10.1080/21548331.2021.1974243 · Cited by 22 · see citing works
Meyer, B., Utter, G.-L., & Hillman, C. (2021) · JMIR Mental Health · doi:10.2196/31173 · Cited by 22 · see citing works
Integrating addiction medicine into rural primary care: Strategies and initial outcomes.
Logan, D. E., Lavoie, A. M., Zwick, W. R., Kunz, K., Bumgardner, M. A., & Molina, Y. (2019) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000410 · Cited by 21 · see citing works
Saunders, E. C., Moore, S. K., Walsh, O., Metcalf, S. A., Budney, A. J., Cavazos‐Rehg, P. A., Scherer, E. A., & Marsch, L. A. (2021) · Addiction Science & Clinical Practice · doi:10.1186/s13722-021-00213-1 · Cited by 21 · see citing works
Self-citationXiong, X. R., Braun, S., Stitzer, M. L., Luderer, H. F., Shafai, G., Hare, B. D., Stevenson, M., & Maricich, Y. A. (2022) · American Journal on Addictions · doi:10.1111/ajad.13346 · Cited by 22 · see citing works
Glass, J. E., Dorsey, C. N., Beatty, T. C., Bobb, J. F., Wong, E. S., Palazzo, L. G., King, D., Mogk, J. M., Stefanik-Guizlo, K., Idu, A., et al. (2023) · Implementation Science · doi:10.1186/s13012-022-01258-9 · Cited by 20 · see citing works
Review of Popularity and Quality Standards of Opioid-Related Smartphone Apps
Vilardaga, R., Fisher, T., Palenski, P. E., Kumaresan, V., Mannelli, P., Sweitzer, M. M., McClernon, F. J., Engelhard, M., Sabo, P. L., & Garrison, K. A. (2020) · Current Addiction Reports · doi:10.1007/s40429-020-00344-6 · Cited by 19 · see citing works
Kiburi, S. K., Ngarachu, E., Tomita, A., Paruk, S., & Chiliza, B. (2023) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2022.108926 · Cited by 16 · see citing works
Shah, N., Velez, F. F., Colman, S., Kauffman, L., Ruetsch, C. R., Anastassopoulos, K. P., & Maricich, Y. A. (2022) · Advances in Therapy · doi:10.1007/s12325-022-02215-0 · Cited by 16 · see citing works
Velez, F. F., Ruetsch, C. R., & Maricich, Y. A. (2021) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1080/14737167.2021.1939687 · Cited by 16 · see citing works
Mogk, J. M., Idu, A., Bobb, J. F., Key, D. L., Wong, E. S., Palazzo, L. G., Stefanik-Guizlo, K., King, D., Beatty, T. C., Dorsey, C. N., et al. (2024) · JMIR Formative Research · doi:10.2196/59088 · Cited by 14 · see citing works
Velez, F. F., Luderer, H. F., Gerwien, R. W., Parcher, B., Mezzio, D. J., & Malone, D. C. (2021) · Postgraduate Medicine · doi:10.1080/00325481.2021.1884471 · Cited by 15 · see citing works
Velez, F. F., & Malone, D. C. (2021) · Journal of Market Access & Health Policy · doi:10.1080/20016689.2021.1966187 · Cited by 15 · see citing works
Sokol, R., Albanese, M., Chew, A., Early, J., Grossman, E., Roll, D., Sawin, G., Wu, D. J., & Schuman-Olivier, Z. (2019) · Addiction Science & Clinical Practice · doi:10.1186/s13722-019-0176-y · Cited by 14 · see citing works
Deady, M., Collins, D., Gayed, A., Harvey, S. B., & Bryant, R. A. (2023) · Digital Health · doi:10.1177/20552076231155680 · Cited by 14 · see citing works
Treating Opioid Use Disorder and Opioid Withdrawal in the Context of Fentanyl
Martinez, S., Ellis, J. D., Bergeria, C. L., Huhn, A. S., & Dunn, K. E. (2025) · Annual Review of Clinical Psychology · doi:10.1146/annurev-clinpsy-081423-023518 · Cited by 16 · see citing works
Kwan, I., Burchett, H., Macdowall, W. G., D’Souza, P., Stansfield, C., Kneale, D., & Sutcliffe, K. (2025) · Addiction · doi:10.1111/add.70021 · Cited by 15 · see citing works
Wu, M. S., Chen, S.-Y., Wickham, R. E., Leykin, Y., Varra, A. A., Chen, C., & Lungu, A. (2022) · Digital Health · doi:10.1177/20552076221133760 · Cited by 13 · see citing works
Budney, A. J., Marsch, L. A., Aklin, W. M., Borodovsky, J. T., Brunette, M. F., Campbell, A. T., Dallery, J., Kotz, D. F., Knapp, A. A., Lord, S., et al. (2019) · JMIR Mental Health · doi:10.2196/16751 · Cited by 13 · see citing works
Self-citationCurtis, M., Wilkinson, A. L., Dietze, P., Stewart, A. C., Kinner, S. A., Winter, R., Aitken, C. K., Walker, S., Cossar, R. D., Butler, T. G., et al. (2023) · Harm Reduction Journal · doi:10.1186/s12954-023-00773-2 · Cited by 12 · see citing works
Choi, H., Kim, B., Kim, I., Kang, J.-G., Lee, Y., Lee, H. K., & Park, M.-H. (2023) · Journal of korean Academy of Child and Adolescent Psychiatry · doi:10.5765/jkacap.230044 · Cited by 12 · see citing works
Rothman, B., Slomkowski, M., Speier, A., Rush, A. J., Trivedi, M. H., Lawson, E., Fahmy, M., Carpenter, D., Chen, D., & Forbes, A. (2024) · JMIR Research Protocols · doi:10.2196/56960 · Cited by 12 · see citing works
Prescription digital therapeutics: A new frontier for pharmacists and the future of treatment
Shafai, G., & Aungst, T. D. (2023) · Journal of the American Pharmacists Association · doi:10.1016/j.japh.2023.03.012 · Cited by 13 · see citing works
Therapeutic Content of Mobile Phone Applications for Substance Use Disorders: An Umbrella Review
Oesterle, T., Hall‐Flavin, D. K., Bormann, N. L., Loukianova, L. L., Fipps, D. C., Breitinger, S. A., Gilliam, W. P., Wu, T. E., da Costa, S. C., Arndt, S. V., et al. (2024) · Mayo Clinic Proceedings Digital Health · doi:10.1016/j.mcpdig.2024.03.004 · Cited by 12 · see citing works
Artificial intelligence in medicine and dermatology
Woźniacka, A. J., Patrzyk, S., & Mikołajczyk, M. (2021) · Advances in Dermatology and Allergology · doi:10.5114/ada.2020.101259 · Cited by 11 · see citing works
Use of Digital Health and Digital Therapeutics to Treat SUD in Criminal Justice Settings: a Review
Sawyer-Morris, G., Wilde, J. A., Molfenter, T. D., & Taxman, F. S. (2023) · Current Addiction Reports · doi:10.1007/s40429-023-00523-1 · Cited by 10 · see citing works
Rudolph, K. E., Diaz, I. M., Hejazi, N. S., van der Laan, M. J., Luo, S. X., Shulman, M., Campbell, A. N. C., Rotrosen, J., & Nunes, E. V. (2020) · Addiction · doi:10.1111/add.15377 · Cited by 9 · see citing works
Quaglio, G., Pirona, A., Esposito, G., Karapiperis, T., Brand, H., Dom, G., Bertinato, L., Montanari, L., Kiefer, F., & Carrà, G. (2018) · Drugs Education Prevention and Policy · doi:10.1080/09687637.2018.1475549 · Cited by 11 · see citing works
Kim, S.-Y., Moon, J. Y., Shin, J., Sim, J. Y., Kim, M., & Jang, J. (2022) · Yonsei Medical Journal · doi:10.3349/ymj.2022.63.s56 · Cited by 10 · see citing works
Richterman, A. G., Ghadimi, F., Teitelman, A. M., Moore, K., Acri, T., North, H., Lopez, K., Ou, V., Pelt, A. E. V., & Momplaisir, F. M. (2023) · AIDS and Behavior · doi:10.1007/s10461-023-04060-w · Cited by 9 · see citing works
Chan, B. L., Gean, E. G., Arkhipova-Jenkins, I., Gilbert, J., Hilgart, J., Fiordalisi, C. V., Hubbard, K., Brandt, I., Stoeger, E., Paynter, R. A., et al. (2020) · doi:10.23970/ahrqepcrapidmat · Cited by 9 · see citing works
Oesterle, T., Bormann, N. L., Paul, M. M., Breitinger, S. A., Lai, B., Smith, J. L., Stoppel, C. J., Arndt, S. V., & Williams, M. D. (2025) · JMIR Research Protocols · doi:10.2196/65693 · Cited by 9 · see citing works
Christensen, D., Witcher, C., Leighton, T., Hudson-Breen, R., & Ofori-dei, S. (2018) · BMJ Open · doi:10.1136/bmjopen-2017-018804 · Cited by 7 · see citing works
Self-citationOno, M., & Iwasaki, K. (2022) · Therapeutic Innovation & Regulatory Science · doi:10.1007/s43441-022-00442-9 · Cited by 7 · see citing works
Grayek, E., Krishnamurti, T., Hu, L., Babich, O., Warren, K., & Fischhoff, B. (2023) · JMIR mhealth and uhealth · doi:10.2196/46237 · Cited by 7 · see citing works
Differences in buprenorphine treatment quality across physician provider specialties
Levin, J. S., Landis, R. K., Sorbero, M., Dick, A. W., Saloner, B. K., & Stein, B. D. (2022) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2022.109510 · Cited by 8 · see citing works
Romagnoli, A., Zovi, A., Sabbatucci, M., Ferrara, F., & Vitiello, A. (2023) · Journal of Interprofessional Education & Practice · doi:10.1016/j.xjep.2023.100656 · Cited by 7 · see citing works
The Role of Behavioral Interventions in Buprenorphine Maintenance Treatment: A Review
Carroll, K. M., & Weiss, R. D. (2019) · FOCUS The Journal of Lifelong Learning in Psychiatry · doi:10.1176/appi.focus.17206 · Cited by 8 · see citing works
Chung, K., & Chung, E. (2020) · The Korean Journal of Clinical Psychology · doi:10.15842/kjcp.2020.39.4.006 · Cited by 6 · see citing works
Shulman, M., Meyers-Ohki, S. E., Novo, P., Provost, S. E., Ohrtman, K., Veldhuisen, P. C. V., Oden, N. L., Otterstatter, M. C., Bailey, G. L., Liu, D., et al. (2024) · Contemporary Clinical Trials · doi:10.1016/j.cct.2025.107816 · Cited by 6 · see citing works
Belfort, E. L., MACMILLAN, C. M., & Weigle, P. E. (2024) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2024.03.010 · Cited by 6 · see citing works
Luderer, H. F., Chiodo, L. M., Wilson, A., Brezing, C., Martinez, S., Xiong, X. R., Gerwien, R. W., Imbert, B., Deeg, M. A., Maricich, Y. A., et al. (2021) · JMIR Research Protocols · doi:10.2196/32759 · Cited by 6 · see citing works
Assessment of Co-Occurring Substance Use During Opiate Treatment Programs in the United States
Gormley, M. A., Blondino, C., Taylor, D. D. H., Lowery, E. P., Clifford, J. S., Burkart, B., Graves, W. C., Prom‐Wormley, E. C., & Lü, J. (2020) · Epidemiologic Reviews · doi:10.1093/epirev/mxaa009 · Cited by 6 · see citing works
Technological Interventions for the Treatment of Substance Use Disorders
Schulte, M. H. J., Boumparis, N., Huizink, A. C., & Riper, H. M. (2020) · Elsevier eBooks · doi:10.1016/b978-0-12-818697-8.00010-8 · Cited by 8 · see citing works
Misalignment of Stakeholder Incentives in the Opioid Crisis
Boloori, A., Arnetz, B. B., Viens, F. G., Maiti, T., & Arnetz, J. E. (2020) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph17207535 · Cited by 5 · see citing works
Tice, J. A., Whittington, M. D., Campbell, J. D., & Pearson, S. D. (2021) · Journal of Managed Care & Specialty Pharmacy · doi:10.18553/jmcp.2021.27.4.528 · Cited by 5 · see citing works
Eren, K., Schuster, J., Herschell, A. D., Loveland, D., Neimark, G. B., Mihalyo, M. J., Hurford, M. O., Houck, P. R., & Ryan, N. D. (2021) · Journal of Addiction Medicine · doi:10.1097/adm.0000000000000914 · Cited by 5 · see citing works
Velez, F. F., Colman, S., Kauffman, L., Anastassopoulos, K. P., Murphy, S. M., & Maricich, Y. A. (2021) · Hospital Practice · doi:10.1080/21548331.2021.1956256 · Cited by 5 · see citing works
French, R., Worley, J. A., Lowenstein, M., Bogner, H. R., Calderbank, T., DePhilippis, D., Forrest, A., Gibbons, M. B. C., Harris, R. A., Heywood, S., et al. (2023) · Families Systems & Health · doi:10.1037/fsh0000791 · Cited by 4 · see citing works
Romagnoli, A., Valentino, F., Zovi, A., Caprodossi, A., Vitiello, A., & Ferrara, F. (2023) · Journal of Pharmaceutical Innovation · doi:10.1007/s12247-023-09767-w · Cited by 4 · see citing works
Evolution of the substance use landscape: Implications for contingency management
Goodwin, S. R., Kirby, K. C., & Raiff, B. R. (2024) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.2911 · Cited by 4 · see citing works
- Authors
- Christensen, D. R., Landes, R. D., Jackson, L., Marsch, L. A., Mancino, M. J., Chopra, M. P., & Bickel, W. K.
- Affiliations
- University of Lethbridge (CA)
- University of Arkansas for Medical Sciences (US)
- Dartmouth College (US)
- Boston University (US)
- Venue
- Journal of Consulting and Clinical Psychology
- Published
- 2014
- Volume
- 82
- Issue
- 6
- Pages
- 964-972
- ISSN
- 0022-006X (ISSN-L)
- 1939-2117
- PMC
- PMC4244262
- OpenAlex
- W1985718825
- Cited by
- 149
- References
- 36
- Citations by year
- 2026: 5 · 2025: 14 · 2024: 9 · 2023: 24 · 2022: 19 · 2021: 24 · 2020: 24 · 2019: 10 · 2018: 6 · 2017: 6 · 2016: 5 · 2015: 2 · 2014: 1
- FWCI
- 4.58
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Consulting and Clinical Psychology (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Drug Abuse (R01 DA 12997)
- Wilbur Mills Endowment
- National Center for Advancing Translational Science (UL1TR000039)
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Opioid Use Disorder Treatment
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- opioid use disorder, internet-delivered treatment, community reinforcement approach, contingency management, buprenorphine, abstinence, treatment retention
- MeSH terms
- Adult, Aged, Analgesics, Opioid, Buprenorphine, Combined Modality Therapy, Female, Humans, Male, Middle Aged, Motivation, Narcotic Antagonists, Opioid-Related Disorders, Reinforcement, Psychology, Residence Characteristics, Cognitive Behavioral Therapy, Treatment Outcome, Internet, Opiate Substitution Treatment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-07.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-07.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review