Internet-delivered treatment for substance abuse: a multisite randomized controlled trial
Open accessAbstract
OBJECTIVE: Computer-delivered interventions have the potential to improve access to quality addiction treatment care. The objective of this study was to evaluate the effectiveness of the Therapeutic Education System (TES), an Internet-delivered behavioral intervention that includes motivational incentives, as a clinician-extender in the treatment of substance use disorders. METHOD: Adult men and women (N=507) entering 10 outpatient addiction treatment programs were randomly assigned to receive 12 weeks of either treatment as usual (N=252) or treatment as usual plus TES, with the intervention substituting for about 2 hours of standard care per week (N=255). TES consists of 62 computerized interactive modules covering skills for achieving and maintaining abstinence, plus prize-based motivational incentives contingent on abstinence and treatment adherence. Treatment as usual consisted of individual and group counseling at the participating programs. The primary outcome measures were abstinence from drugs and heavy drinking (measured by twice-weekly urine drug screens and self-report) and time to dropout from treatment. RESULTS: Compared with patients in the treatment-as-usual group, those in the TES group had a lower dropout rate (hazard ratio=0.72, 95% CI=0.57, 0.92) and a greater abstinence rate (odds ratio=1.62, 95% CI=1.12, 2.35). This effect was more pronounced among patients who had a positive urine drug or breath alcohol screen at study entry (N=228) (odds ratio=2.18, 95% CI=1.30, 3.68). CONCLUSIONS: Internet-delivered interventions such as TES have the potential to expand access and improve addiction treatment outcomes. Additional research is needed to assess effectiveness in non-specialty clinical settings and to differentiate the effects of the community reinforcement approach and contingency management components of TES.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The validation study of reSET with 507 people demonstrated that use of the application was associated with more days of abstinence and a lower rate of attrition than treatment-as-usual.
“The validation study of the application, performed with 507 people, demonstrated that the use of the application was associated with more days of abstinence and a lower rate of attrition than in the treatment-as-usual condition (98).”
From Mobile intervention for individuals with psychosis, dual disorders, and their common comorbidities: A literature review (2019) · cites this paper as [98]
The Methods and Results (page not provided) report a 507-person trial in which the Therapeutic Education System produced more abstinent half-weeks and less treatment dropout than treatment-as-usual. Our copy does not identify the intervention as reSET, and it reports half-weeks rather than days of abstinence, so it does not fully support the claim as phrased. (LLM, conf=0.87)
Experimental — accuracy not yet measuredThe reSET validation study was performed on a desktop-based intervention subsequently adapted to a mobile application format.
“It is important to mention that this study, which served as justification for the approval of the application by the FDA, was performed on a desktop-based intervention, which was subsequently adapted to the format of a mobile application (97, 98).”
From Mobile intervention for individuals with psychosis, dual disorders, and their common comorbidities: A literature review (2019) · cites this paper as [98]
The Methods section says clinics received computers for completing the Therapeutic Education System intervention, and the Introduction describes it as web-based. Our copy does not say that the intervention was subsequently adapted into a mobile application or that this study justified FDA approval; it also notes that patients could access the intervention online outside the clinic. No page numbers are available in our copy. (LLM, conf=0.85)
Experimental — accuracy not yet measuredTwo DTx that received FDA clearance as SaMD for the adjunctive treatment of opioid use and substance use disorder used TAU or reduced TAU as comparators.
“Similarly, two DTx that received FDA clearance as SaMD for the adjunctive treatment of opioid use and substance use disorder (8, 46) used TAU or reduced TAU as comparators (see Table 1 for a description of the reduced TAU versus full TAU condition) (8).”
Some studies reported the conclusion in ambiguous language, such as a treatment 'may be effective' or has 'the potential'.
“In addition, some of the studies reported the conclusion in ambiguous language, such as a treatment ‘may be effective [19, 27]’, or has ‘the potential [28]’.”
From Overstatements in abstract conclusions claiming effectiveness of interventions in psychiatry: A meta-epidemiological investigation (2017) · cites this paper as [28]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
1 retracted
Psychosocial interventions for cocaine and psychostimulant amphetamines related disorders
Knapp, W. P., Soares, B. G., Farrell, M., & de Lima, M. S. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd003023.pub2 · Cited by 178 · see citing works
RetractedRegression Models and Life-Tables
Cox, D. R. (1972) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1972.tb00899.x · Cited by 39,793 · see citing works
Regression Models and Life-Tables
Cox, D. R. (1992) · Springer Series in Statistics · doi:10.1007/978-1-4612-4380-9_37 · Cited by 26,297 · see citing works
Longitudinal data analysis using generalized linear models
LIANG, K.-Y., & ZEGER, S. L. (1986) · Biometrika · doi:10.1093/biomet/73.1.13 · Cited by 18,550 · see citing works
Sobell, L. C., & Sobell, M. B. (1992) · Measuring Alcohol Consumption · doi:10.1007/978-1-4612-0357-5_3 · Cited by 4,110 · see citing works
Partial residuals for the proportional hazards regression model
SCHOENFELD, D. (1982) · Biometrika · doi:10.1093/biomet/69.1.239 · Cited by 3,111 · see citing works
Economic costs of excessive alcohol consumption in the U.S., 2006
Bouchery, E. E., Harwood, H. J., Sacks, J. J., Simon, C. J., & Brewer, R. D. (2011) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2011.06.045 · Cited by 1,041 · cited 1× · see citing works
“Drug and alcohol abuse is one of the costliest public health problems in the United States, with illicit drug use accounting for an estimated cost to the economy of $193 billion in 2007 (1) and excessive alcohol consumption exceeding $223 billion in 2006 (2).”
Incentives Improve Outcome in Outpatient Behavioral Treatment of Cocaine Dependence
Higgins, S. T. (1994) · Archives of General Psychiatry · doi:10.1001/archpsyc.1994.03950070060011 · Cited by 806 · see citing works
The Delivery of Public Health Interventions via the Internet: Actualizing Their Potential
Bennett, G. G., & Glasgow, R. E. (2009) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.031308.100235 · Cited by 800 · see citing works
Magill, M., & Ray, L. A. (2009) · Journal of Studies on Alcohol and Drugs · doi:10.15288/jsad.2009.70.516 · Cited by 694 · cited 1× · see citing works
“In contrast, some (36), although not all (37), studies of CBT for addictions have observed that the benefits of the intervention actually increased after treatment, suggesting, as one would hope, that the patients learned skills that they continue to practice and benefit from over time.”
The illusory diffusion of innovation: An examination of assimilation gaps
Fichman, R. G., & Kemerer, C. F. (1999) · Information Systems Research · doi:10.1287/isre.10.3.255 · Cited by 633 · see citing works
Lamb, S., Greenlick, M. R., & McCarty, D. W. (2013) · Cited by 506 · see citing works
Carroll, K. M., Ball, S. A., Martino, S., Nich, C., Babuscio, T. A., Nuro, K. F., Gordon, M. A., Portnoy, G. A., & Rounsaville, B. J. (2008) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2008.07111835 · Cited by 405 · see citing works
Buck, J. A. (2011) · Health Affairs · doi:10.1377/hlthaff.2011.0480 · Cited by 390 · see citing works
Petry, N. M., Peirce, J. M., Stitzer, M. L., BLAINE, J. D., Roll, J. M., Cohen, A. J., Obert, J. L., Killeen, T. K., Saladin, M. E., Cowell, M., et al. (2005) · Archives of General Psychiatry · doi:10.1001/archpsyc.62.10.1148 · Cited by 366 · see citing works
Self-citationMcLellan, A. T., & Brown, B. S. (2003) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(03)00114-4 · Cited by 319 · see citing works
Have we evaluated addiction treatment correctly? Implications from a chronic care perspective
McLellan, A. T. (2002) · Addiction · doi:10.1046/j.1360-0443.2002.00127.x · Cited by 307 · see citing works
Can the national addiction treatment infrastructure support the public's demand for quality care?
(2003) · Journal of Substance Abuse Treatment · doi:10.1016/s0740-5472(03)00156-9 · Cited by 288 · see citing works
Kay‐Lambkin, F. J., Baker, A. L., Lewin, T. J., & Carr, V. J. (2009) · Addiction · doi:10.1111/j.1360-0443.2008.02444.x · Cited by 269 · cited 3× · see citing works
“Computerized versions of other effective treatments for substance abuse, such as cognitive-behavioral therapy for relapse prevention (CBT) (13, 14), have also shown promise in singlesite randomized trials.”
InfluentialBewick, B. M., Trusler, K., Barkham, M., Hill, A. J., Cahill, J., & Mulhern, B. (2008) · Preventive Medicine · doi:10.1016/j.ypmed.2008.01.005 · Cited by 233 · see citing works
Community Reinforcement Therapy for Cocaine-Dependent Outpatients
Higgins, S. T., Sigmon, S. C., Wong, C. J., Heil, S. H., Badger, G. J., Donham, R., Dantona, R. L., & Anthony, S. (2003) · Archives of General Psychiatry · doi:10.1001/archpsyc.60.9.1043 · Cited by 205 · see citing works
Computerized behavior therapy for opioid-dependent outpatients: a randomized controlled trial.
Bickel, W., Marsch, L., Buchhalter, A., & Badger, G. (2008) · Experimental and clinical psychopharmacology · doi:10.1037/1064-1297.16.2.132 · Cited by 202 · see citing works
Roozen, H. G., Boulogne, J. J., van Tulder, M. W., van den Brink, W., de Jong, C. A. J., & Kerkhof, A. J. F. M. (2004) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2003.12.006 · Cited by 182 · see citing works
The use of the DSM-III-R Checklist for initial diagnostic assessments
Hudziak, J. J., Helzer, J. E., Wetzel, M. W., Kessel, K. B., McGee, B. L., Janča, A., & Przybeck, T. R. (1993) · Comprehensive Psychiatry · doi:10.1016/0010-440x(93)90061-8 · Cited by 164 · see citing works
Carroll, K. M., Ball, S. A., Martino, S., Nich, C., Babuscio, T. A., & Rounsaville, B. J. (2009) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2008.09.015 · Cited by 164 · see citing works
The Economic Impact of Illicit Drug Use on American Society
(2011) · PsycEXTRA Dataset · doi:10.1037/e618422012-001 · Cited by 162 · see citing works
Computer-based interventions for drug use disorders: A systematic review
Moore, B. A., Fazzino, T. L., Garnet, B., Cutter, C. J., & Barry, D. T. (2010) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2010.11.002 · Cited by 141 · see citing works
Marsch, L. A., Guarino, H., Acosta, M., Aponte-Melendez, Y., Cleland, C., Grabinski, M., Brady, R., & Edwards, J. (2014) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2013.08.012 · Cited by 139 · see citing works
Computer-assisted Therapy in Psychiatry: Be Brave—It’s a New World
Carroll, K. M., & Rounsaville, B. J. (2010) · Current Psychiatry Reports · doi:10.1007/s11920-010-0146-2 · Cited by 105 · see citing works
Kampman, K. M., Volpicelli, J. R., Mulvaney, F. D., Rukstalis, M. R., Alterman, A. I., Pettinati, H. M., Weinrieb, R. M., & O’Brien, C. P. (2002) · Addictive Behaviors · doi:10.1016/s0306-4603(01)00171-x · Cited by 94 · see citing works
Kiluk, B. D., Sugarman, D. E., Nich, C., Gibbons, C. J., Martino, S., Rounsaville, B. J., & Carroll, K. M. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.10101443 · Cited by 84 · see citing works
Motivational incentives research in the National Drug Abuse Treatment Clinical Trials Network
Stitzer, M. L., Petry, N. M., & Peirce, J. M. (2010) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2009.12.010 · Cited by 70 · see citing works
Self-citationNunes, E. V., Pavlicová, M., Hu, M., Campbell, A. N. C., Miele, G. M., Hien, D. A., & Klein, D. F. (2011) · The American Journal of Drug and Alcohol Abuse · doi:10.3109/00952990.2011.596980 · Cited by 64 · see citing works
Self-citationCampbell, A. N. C., Nunes, E. V., Miele, G. M., Matthews, A. G., Polsky, D. E., Ghitza, U. E., Turrigiano, E., Bailey, G. L., VanVeldhuisen, P., Chapdelaine, R., et al. (2011) · Contemporary Clinical Trials · doi:10.1016/j.cct.2011.11.001 · Cited by 51 · see citing works
Self-citationChaple, M., Sacks, S., McKendrick, K., Marsch, L. A., Belenko, S. R., Leukefeld, C. G., PRENDERGAST, M. L., & French, M. T. (2013) · Journal of Experimental Criminology · doi:10.1007/s11292-013-9187-y · Cited by 36 · see citing works
Informal discussions in substance abuse treatment sessions
Martino, S., Ball, S. A., Nich, C., Frankforter, T. L., & Carroll, K. M. (2008) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2008.08.003 · Cited by 33 · see citing works
Nunes, E. V., Ball, S. A., Booth, R., Brigham, G. S., Calsyn, D. A., Carroll, K. M., Feaster, D. J., Hien, D. A., Hubbard, R. L., Ling, W. W., et al. (2010) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2010.01.012 · Cited by 25 · see citing works
Self-citationCharacteristics of an Outpatient Treatment Sample by Primary Substance of Abuse
Campbell, A. N. C., Nunes, E. V., McClure, E. A., Hu, M., Turrigiano, E., Goldman, B., & Stabile, P. Q. (2013) · Journal of Addiction Medicine · doi:10.1097/adm.0b013e31829e3971 · Cited by 13 · see citing works
Self-citation
Flagged first, then by citations
Research works printed but not linked: 1
- [35]Stitzer ML Petry NM Peirce J Motivational incentives research in the National Drug Abuse Treatment Clinical Trials Network J Subst Abuse Treat 2010 38 S1 S61 S69 20307797 PMC2866424
Cited by
Sorted by citations
Dorsey, E. R., & Topol, E. J. (2016) · New England Journal of Medicine · doi:10.1056/nejmra1601705 · Cited by 1,211 · see citing works
Erbe, D., Eichert, H.-C., Riper, H., & Ebert, D. D. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6588 · Cited by 532 · see citing works
Ebert, D. D., Van Daele, T., Nordgreen, T., Karekla, M., Compare, A., Zarbo, C., Brugnera, A., Øverland, S., Trebbi, G., Jensen, K. L., et al. (2018) · European Psychologist · doi:10.1027/1016-9040/a000318 · Cited by 437 · see citing works
The Empirical Evidence for Telemedicine Interventions in Mental Disorders
Bashshur, R. L., Shannon, G. W., Bashshur, N., & Yellowlees, P. (2015) · Telemedicine Journal and e-Health · doi:10.1089/tmj.2015.0206 · Cited by 442 · see citing works
Neurobiology, Clinical Presentation, and Treatment of Methamphetamine Use Disorder: A Review
Paulus, M. P., & Stewart, J. L. (2020) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2020.0246 · Cited by 310 · see citing works
Digital Mental Health for Young People: A Scoping Review of Ethical Promises and Challenges
Wies, B., Landers, C., & Ienca, M. (2021) · Frontiers in Digital Health · doi:10.3389/fdgth.2021.697072 · Cited by 242 · see citing works
Carroll, K. M., & Kiluk, B. D. (2017) · Psychology of Addictive Behaviors · doi:10.1037/adb0000311 · Cited by 218 · see citing works
Vickerstaff, V., Omar, R., & Ambler, G. (2019) · BMC Medical Research Methodology · doi:10.1186/s12874-019-0754-4 · Cited by 212 · see citing works
Petry, N. M., Alessi, S. M., Olmstead, T. A., Rash, C. J., & Zajac, K. (2017) · Psychology of Addictive Behaviors · doi:10.1037/adb0000287 · Cited by 197 · see citing works
Making the hard work of recovery more attractive for those with substance use disorders
McKay, J. R. (2017) · Addiction · doi:10.1111/add.13502 · Cited by 164 · see citing works
Substance use in rural Central Appalachia: Current status and treatment considerations.
Moody, L. N., Satterwhite, E., & Bickel, W. K. (2017) · Journal of Rural Mental Health · doi:10.1037/rmh0000064 · Cited by 155 · see citing works
Hermes, E. D., Lyon, A. R., Schueller, S. M., & Glass, J. E. (2019) · Journal of Medical Internet Research · doi:10.2196/11752 · Cited by 149 · see citing works
Using e-technologies in clinical trials
Rosa, C., Campbell, A. N. C., Miele, G. M., Brunner, M., & Winstanley, E. L. (2015) · Contemporary Clinical Trials · doi:10.1016/j.cct.2015.07.007 · Cited by 147 · see citing works
Self-citationCharacteristics and challenges of the clinical pipeline of digital therapeutics
Patel, N. A., & Butte, A. J. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-00370-8 · Cited by 143 · see citing works
Randomized Controlled Trial of a Dichoptic Digital Therapeutic for Amblyopia
Xiao, S., Angjeli, E., Wu, H. C., Gaier, E. D., Gomez, S., Travers, D. A., Binenbaum, G., Langer, R., Hunter, D. G., & Repka, M. X. (2021) · Ophthalmology · doi:10.1016/j.ophtha.2021.09.001 · Cited by 129 · see citing works
Meyer, J. P., Isaacs, K. R., Shahawy, O. E., Burlew, A. K., & Wechsberg, W. M. (2019) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.01.017 · Cited by 123 · see citing works
Kruse, C. S., Lee, K., Watson, J. B., Lobo, L. G., Stoppelmoor, A. G., & Oyibo, S. E. (2019) · Journal of Medical Internet Research · doi:10.2196/13252 · Cited by 114 · see citing works
Xiao, B., Imel, Z. E., Georgiou, P., Atkins, D. C., & Narayanan, S. S. (2015) · PLoS ONE · doi:10.1371/journal.pone.0143055 · Cited by 111 · see citing works
Boumparis, N., Loheide-Niesmann, L., Blankers, M., Ebert, D. D., Korf, D., Schaub, M. P., Spijkerman, R., Tait, R. J., & Riper, H. (2019) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2019.03.016 · Cited by 110 · see citing works
Some current dimensions of the behavioral economics of health-related behavior change
Bickel, W. K., Moody, L. N., & Higgins, S. T. (2016) · Preventive Medicine · doi:10.1016/j.ypmed.2016.06.002 · Cited by 104 · see citing works
Contingency Management: New Directions and Remaining Challenges for An Evidence-Based Intervention
Rash, C. J., Stitzer, M. L., & Weinstock, J. (2016) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2016.09.008 · Cited by 105 · see citing works
Self-citationInternet interventions for adult illicit substance users: a meta‐analysis
Boumparis, N., Karyotaki, E., Schaub, M. P., Cuijpers, P., & Riper, H. (2017) · Addiction · doi:10.1111/add.13819 · Cited by 104 · see citing works
“Moreover, five of the included studies applied completers’ only analyses [31,39,50,56,58], which might have induced heterogeneity in our findings, especially considering the high attrition of certain studies.”
BackgroundResultDigital therapeutics for mental health: Is attrition the Achilles heel?
Nwosu, A., Boardman, S., Husain, M. M., & Doraiswamy, P. M. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.900615 · Cited by 101 · see citing works
Psychosocial interventions for psychostimulant misuse
Minozzi, S., Saulle, R., Crescenzo, F. D., & Amato, L. (2016) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011866.pub2 · Cited by 96 · see citing works
The Use of Telepsychiatry to Provide Cost-Efficient Care During Pediatric Mental Health Emergencies
Thomas, J. F., Novins, D. K., Hosokawa, P. W., Olson, C. A., Hunter, D., Brent, A., Frunzi, G., & Libby, A. M. (2017) · Psychiatric Services · doi:10.1176/appi.ps.201700140 · Cited by 96 · see citing works
Wykes, T., & Schueller, S. M. (2019) · Journal of Medical Internet Research · doi:10.2196/12390 · Cited by 95 · see citing works
Lutz, J., Offidani, E., Taraboanta, L., Lakhan, S. E., & Campellone, T. R. (2022) · Frontiers in Digital Health · doi:10.3389/fdgth.2022.823977 · Cited by 89 · see citing works
Scale-up of Digital Innovations in Health Care: Expert Commentary on Enablers and Barriers
Schlieter, H., Marsch, L. A., Whitehouse, D., Otto, L., Londral, A. R. M., Teepe, G. W., Benedict, M., Ollier, J., Ulmer, T., Gasser, N., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/24582 · Cited by 89 · see citing works
Digital Technologies in Psychiatry: Present and Future
Hirschtritt, M. E., & Insel, T. R. (2018) · FOCUS The Journal of Lifelong Learning in Psychiatry · doi:10.1176/appi.focus.20180001 · Cited by 88 · see citing works
Integrating Mental Health and Addiction Treatment Into General Medical Care: The Role of Policy
McGinty, E. E., & Daumit, G. L. (2020) · Psychiatric Services · doi:10.1176/appi.ps.202000183 · Cited by 88 · see citing works
Christoff, A. D. O., & Boerngen-Lacerda, R. (2015) · Addictive Behaviors · doi:10.1016/j.addbeh.2015.01.019 · Cited by 87 · see citing works
Towards the Design of Ethical Standards Related to Digital Mental Health and all Its Applications
Wykes, T., Lipschitz, J. M., & Schueller, S. M. (2019) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-019-00180-0 · Cited by 84 · see citing works
Technology-based Interventions for Preventing and Treating Substance Use Among Youth
Marsch, L. A., & Borodovsky, J. T. (2016) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2016.06.005 · Cited by 75 · see citing works
Marsch, L. A., Campbell, A. N. C., Campbell, C. I., Chen-Ritzo, C.-H., Ertin, E., Ghitza, U. E., Lambert-Harris, C. A., Hassanpour, S., Holtyn, A. F., Hser, Y., et al. (2020) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2020.02.005 · Cited by 81 · see citing works
Self-citationThe ASAM/AAAP Clinical Practice Guideline on the Management of Stimulant Use Disorder
(2024) · Journal of Addiction Medicine · doi:10.1097/adm.0000000000001299 · Cited by 78 · see citing works
Technology‐Delivered Cognitive‐Behavioral Interventions for Alcohol Use: A Meta‐Analysis
Kiluk, B. D., Ray, L. A., Walthers, J., Bernstein, M. H., Tonigan, J. S., & Magill, M. (2019) · Alcoholism Clinical and Experimental Research · doi:10.1111/acer.14189 · Cited by 76 · see citing works
Song, Y.-M., Jeong, J., Reyes, A. D. D. L., Lim, D.-J., Cho, C., Yeom, J., Lee, T., Lee, J.-B., Lee, H.-J., & Kim, J. K. (2024) · EBioMedicine · doi:10.1016/j.ebiom.2024.105094 · Cited by 74 · see citing works
Computer-assisted behavioral therapy and contingency management for cannabis use disorder.
Budney, A. J., Stanger, C., Tilford, J. M., Scherer, E. A., Brown, P., Li, Z., Li, Z., & Walker, D. D. (2015) · Psychology of Addictive Behaviors · doi:10.1037/adb0000078 · Cited by 73 · see citing works
Carroll, K. M. (2014) · Annals of the New York Academy of Sciences · doi:10.1111/nyas.12501 · Cited by 70 · see citing works
The Role of Technology-Based Interventions for Substance Use Disorders in Primary Care
Tofighi, B., Abrantes, A. M., & Stein, M. D. (2018) · Medical Clinics of North America · doi:10.1016/j.mcna.2018.02.011 · Cited by 69 · see citing works
Murphy, S. M., Campbell, A. N. C., Ghitza, U. E., Kyle, T. L., Bailey, G. L., Nunes, E. V., & Polsky, D. E. (2016) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2016.01.021 · Cited by 62 · see citing works
Self-citationHammond, A. S., Sweeney, M. M., Chikosi, T. U., & Stitzer, M. L. (2021) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2021.108425 · Cited by 61 · see citing works
Self-citationWang, B., Susukida, R., Mojtabai, R., Amin‐Esmaeili, M., & Rosenblum, M. (2021) · Journal of the American Statistical Association · doi:10.1080/01621459.2021.1981338 · Cited by 60 · see citing works
Guarino, H., Acosta, M., Marsch, L., Xie, H.-Y., & Aponte-Meléndez, Y. (2015) · Psychology of Addictive Behaviors · doi:10.1037/adb0000128 · Cited by 53 · see citing works
Real-world evidence for a prescription digital therapeutic to treat opioid use disorder
Maricich, Y. A., Xiong, X. R., Gerwien, R. W., Kuo, A., Velez, F. F., Imbert, B., Boyer, K., Luderer, H. F., Braun, S., & Williams, K. R. (2020) · Current Medical Research and Opinion · doi:10.1080/03007995.2020.1846023 · Cited by 54 · see citing works
Clinical Evaluation of Digital Therapeutics: Present and Future
Huh, K. Y., Oh, J., Lee, S., & Yu, K. (2022) · Healthcare Informatics Research · doi:10.4258/hir.2022.28.3.188 · Cited by 51 · see citing works
Johansson, M., Sinadinovic, K., Gajecki, M., Lindner, P., Berman, A. H., Hermansson, U., & Andréasson, S. (2020) · Addiction · doi:10.1111/add.15270 · Cited by 52 · see citing works
McClure, E. A., Sonne, S. C., Winhusen, T. M., Carroll, K. M., Ghitza, U. E., McRae‐Clark, A. L., Matthews, A. G., Sharma, G., Veldhuisen, P. C. V., Vandrey, R. G., et al. (2014) · Contemporary Clinical Trials · doi:10.1016/j.cct.2014.08.011 · Cited by 50 · see citing works
Self-citationDeFulio, A., Rzeszutek, M. J., Furgeson, J., Ryan, S. A., & Rezania, S. (2020) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2020.108188 · Cited by 49 · see citing works
Lord, S., Moore, S. K., Ramsey, A., Dinauer, S., & Johnson, K. (2016) · JMIR Mental Health · doi:10.2196/mental.4927 · Cited by 47 · see citing works
New steps for treating alcohol use disorder
Campbell, E. J., Lawrence, A. J., & Perry, C. J. (2018) · Psychopharmacology · doi:10.1007/s00213-018-4887-7 · Cited by 47 · see citing works
Technology-Based Contingency Management in the Treatment of Substance-Use Disorders
Dallery, J., Raiff, B. R., Grabinski, M. J., & Marsch, L. A. (2019) · Perspectives on Behavior Science · doi:10.1007/s40614-019-00214-1 · Cited by 47 · see citing works
Campbell, A. N. C., Turrigiano, E., Moore, M., Miele, G. M., Rieckmann, T. R., Hu, M., Kropp, F. B., Ringor-Carty, R., & Nunes, E. V. (2014) · Community Mental Health Journal · doi:10.1007/s10597-014-9764-1 · Cited by 44 · see citing works
Self-citationKario, K., Nomura, A., Kato, A., Harada, N., Tanigawa, T., So, R., Suzuki, S., Hida, E., & Satake, K. (2021) · Journal of Clinical Hypertension · doi:10.1111/jch.14191 · Cited by 44 · see citing works
Mares, M., Gustafson, D. H., Glass, J. E., Quanbeck, A., McDowell, H., Mctavish, F. M., Atwood, A. K., Marsch, L. A., Thomas, C., Shah, D. V., et al. (2016) · BMC Medical Informatics and Decision Making · doi:10.1186/s12911-016-0365-5 · Cited by 43 · see citing works
Maricich, Y. A., Bickel, W. K., Marsch, L. A., Gatchalian, K. M., Botbyl, J. D., & Luderer, H. F. (2020) · Current Medical Research and Opinion · doi:10.1080/03007995.2020.1846022 · Cited by 43 · see citing works
Toward Data-Driven Digital Therapeutics Analytics: Literature Review and Research Directions
Lee, U., Jung, G., Ma, E.-Y., Kim, J. S., Kim, H., Alikhanov, J., Noh, Y., & Kim, H. (2023) · IEEE/CAA Journal of Automatica Sinica · doi:10.1109/jas.2023.123015 · Cited by 40 · see citing works
Generalizing randomized trial findings to a target population using complex survey population data
Ackerman, B., Lesko, C. R., Siddique, J., Susukida, R., & Stuart, E. A. (2020) · Statistics in Medicine · doi:10.1002/sim.8822 · Cited by 38 · see citing works
Chaple, M., Sacks, S., McKendrick, K., Marsch, L. A., Belenko, S. R., Leukefeld, C. G., PRENDERGAST, M. L., & French, M. T. (2013) · Journal of Experimental Criminology · doi:10.1007/s11292-013-9187-y · Cited by 36 · see citing works
Marsch, L. A., Guarino, H., Grabinski, M. J., Syckes, C., Dillingham, E. T., Xie, H., & Crosier, B. S. (2015) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2015.07.003 · Cited by 36 · see citing works
Pennou, A., Lecomte, T., Potvin, S., & Khazaal, Y. (2019) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2019.00302 · Cited by 34 · see citing works
Morie, K. P., Nich, C., Hunkele, K., Potenza, M., & Carroll, K. (2015) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2015.04.004 · Cited by 35 · see citing works
Nunes, E. V., Lee, J. D., Sisti, D. A., Segal, A. G., Caplan, A. L., Fishman, M. J., Bailey, G. L., Brigham, G. S., Novo, P., Farkas, S., et al. (2016) · Contemporary Clinical Trials · doi:10.1016/j.cct.2016.09.006 · Cited by 33 · see citing works
Self-citationUse of digital technology in addiction disorders
Chand, P., Bandawar, M., & Narasimha, V. L. (2018) · Indian Journal of Psychiatry · doi:10.4103/psychiatry.indianjpsychiatry_21_18 · Cited by 33 · see citing works
Rash, C. J., & DePhilippis, D. (2019) · Perspectives on Behavior Science · doi:10.1007/s40614-019-00204-3 · Cited by 34 · see citing works
Psychosocial interventions for stimulant use disorder
Minozzi, S., Saulle, R., Amato, L., Traccis, F., & Agabio, R. (2024) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011866.pub3 · Cited by 32 · see citing works
Glass, J. E., Matson, T. E., Lim, C. Y., Hartzler, A. L., Kimbel, K. J., Lee, A. K., Beatty, T. C., Parrish, R. S., Caldeiro, R. M., McWethy, A. G., et al. (2021) · Journal of Medical Internet Research · doi:10.2196/25866 · Cited by 31 · see citing works
The Rise of Prescription Digital Therapeutics in Behavioral Health
Brezing, C., & Brixner, D. I. (2022) · Advances in Therapy · doi:10.1007/s12325-022-02320-0 · Cited by 32 · see citing works
Kario, K., Nomura, A., Harada, N., Tanigawa, T., So, R., Nakagawa, K., Suzuki, S., Okura, A., Hida, E., & Satake, K. (2020) · Journal of Clinical Hypertension · doi:10.1111/jch.13993 · Cited by 32 · see citing works
The Future of Telepsychiatry in India
Ibrahim, F. A., Pahuja, E., Dinakaran, D., Manjunatha, N., Kumar, C. N., & Math, S. B. (2020) · Indian Journal of Psychological Medicine · doi:10.1177/0253717620959255 · Cited by 31 · see citing works
Practical Technology for Expanding and Improving Substance Use Disorder Treatment
Sweeney, M. M., Holtyn, A. F., Stitzer, M. L., & Gastfriend, D. R. (2022) · Psychiatric Clinics of North America · doi:10.1016/j.psc.2022.05.006 · Cited by 34 · see citing works
Self-citationTechnology Use Patterns Among Patients Enrolled in Inpatient Detoxification Treatment
Tofighi, B., Leonard, N. R., Greco, P. P., Hadavand, A., Acosta, M. C., & Lee, J. D. (2018) · Journal of Addiction Medicine · doi:10.1097/adm.0000000000000494 · Cited by 31 · see citing works
Marsch, L. A. (2020) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2020.07.004 · Cited by 31 · see citing works
Novel Therapeutics for Addiction: Behavioral Economic and Neuroeconomic Approaches
Bickel, W. K., Mellis, A. M., Snider, S. E., Moody, L. N., Stein, J. S., & Quisenberry, A. J. (2016) · Current Treatment Options in Psychiatry · doi:10.1007/s40501-016-0088-3 · Cited by 28 · see citing works
Ruksakulpiwat, S., Zhou, W., Niyomyart, A., Wang, T., & Kudlowitz, A. (2022) · Chronic Illness · doi:10.1177/17423953221110151 · Cited by 30 · see citing works
Glass, J. E., Tiffany, B., Matson, T. E., Lim, C. Y., Gundersen, G., Kimbel, K. J., Hartzler, A. L., Curran, G. M., McWethy, A. G., Caldeiro, R. M., et al. (2022) · Implementation Research and Practice · doi:10.1177/26334895221135264 · Cited by 27 · see citing works
Web-based treatment for substance use disorders: Differential effects by primary substance
Cochran, G., Stitzer, M. L., Campbell, A. N. C., Hu, M., Vandrey, R. G., & Nunes, E. V. (2015) · Addictive Behaviors · doi:10.1016/j.addbeh.2015.02.002 · Cited by 28 · see citing works
Self-citationMitchell, S. G., Schwartz, R. P., Alvanzo, A. A. H., Weisman, M. S., Kyle, T. L., Turrigiano, E., Gibson, M. L., Perez, L., McClure, E. A., Clingerman, S., et al. (2015) · Substance Abuse · doi:10.1080/08897077.2014.992565 · Cited by 28 · see citing works
Self-citationMcClure, E. A., Campbell, A. N. C., Pavlicová, M., Hu, M., Winhusen, T. M., Vandrey, R. G., Ruglass, L. M., Covey, L. S., Stitzer, M. L., Kyle, T. L., et al. (2014) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2014.12.007 · Cited by 27 · see citing works
Self-citationLuderer, H. F., Campbell, A. N. C., Nunes, E. V., Enman, N. M., Xiong, X. R., Gerwien, R. W., & Maricich, Y. A. (2021) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2021.108585 · Cited by 27 · see citing works
Self-citationWorkshop on Implementation Science and Digital Therapeutics for Behavioral Health
Lord, S., Campbell, A. N. C., Brunette, M. F., Cubillos, L., Bartels, S. M., Torrey, W. C., Olson, A. L., Chapman, S. H., Batsis, J. A., Polsky, D. E., et al. (2020) · JMIR Mental Health · doi:10.2196/17662 · Cited by 28 · see citing works
Self-citationMaricich, Y. A., Nunes, E. V., Campbell, A. N. C., Botbyl, J. D., & Luderer, H. F. (2022) · Substance Abuse · doi:10.1080/08897077.2022.2060425 · Cited by 26 · see citing works
Self-citationKiluk, B. D. (2019) · Perspectives on Behavior Science · doi:10.1007/s40614-019-00205-2 · Cited by 25 · see citing works
Shulman, M., Weiss, R. D., Rotrosen, J., Novo, P., Costello, E. J., & Nunes, E. V. (2021) · Addiction Science & Clinical Practice · doi:10.1186/s13722-021-00223-z · Cited by 25 · see citing works
Self-citationLeveraging applied behavior analysis research and practice in the service of public health.
Normand, M. P., Dallery, J., & Slanzi, C. M. (2021) · Journal of Applied Behavior Analysis · doi:10.1002/jaba.832 · Cited by 19 · see citing works
Velez, F. F., Anastassopoulos, K. P., Colman, S., Shah, N., Kauffman, L., Murphy, S. M., Ruetsch, C. R., & Maricich, Y. A. (2022) · Advances in Therapy · doi:10.1007/s12325-022-02217-y · Cited by 25 · see citing works
Gordon, M., Carswell, S. B., Schadegg, M. J., Mangen, K., Merkel, K., Tangires, S., & Vocci, F. J. (2017) · The American Journal of Drug and Alcohol Abuse · doi:10.1080/00952990.2017.1280816 · Cited by 25 · see citing works
Sugarman, D. E., Meyer, L. E., Reilly, M. E., & Greenfield, S. F. (2019) · Journal of Women s Health · doi:10.1089/jwh.2018.7519 · Cited by 25 · see citing works
Elison, S., Jones, A., Ward, J., Davies, G., & Dugdale, S. (2017) · Addictive Behaviors · doi:10.1016/j.addbeh.2017.05.028 · Cited by 24 · see citing works
Schramm, Z. A., Leroux, B. G., Radick, A. C., Ventura, A. S., Klein, J. W., Samet, J. H., Saxon, A. J., Kim, T. W., & Tsui, J. I. (2020) · Addiction Science & Clinical Practice · doi:10.1186/s13722-020-00203-9 · Cited by 21 · see citing works
Campbell, A. N. C., Nunes, E. V., Pavlicová, M., Hatch‐Maillette, M. A., Hu, M., Bailey, G. L., Sugarman, D. E., Miele, G. M., Rieckmann, T. R., Shores‐Wilson, K., et al. (2014) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2014.12.006 · Cited by 23 · see citing works
Self-citationA comparative study of the therapeutic education system for incarcerated substance-abusing offenders
Chaple, M., Sacks, S., McKendrick, K., Marsch, L. A., Belenko, S., Leukefeld, C., Prendergast, M., & French, M. (2016) · The Prison Journal · doi:10.1177/0032885516636858 · Cited by 22 · see citing works
Maricich, Y. A., Gerwien, R. W., Kuo, A., Malone, D. C., & Velez, F. F. (2021) · Hospital Practice · doi:10.1080/21548331.2021.1974243 · Cited by 22 · see citing works
Meyer, B., Utter, G.-L., & Hillman, C. (2021) · JMIR Mental Health · doi:10.2196/31173 · Cited by 22 · see citing works
The Evolution of Telepsychiatry for Substance Use Disorders During COVID-19: a Narrative Review
Fast, N., van Kessel, R., Humphreys, K. N., Ward, N. F., & Román-Urrestarazu, A. (2023) · Current Addiction Reports · doi:10.1007/s40429-023-00480-9 · Cited by 22 · see citing works
Campbell, A. N. C., Montgomery, L., Sanchez, K., Pavlicová, M., Hu, M., Newville, H., Weaver, L., & Nunes, E. V. (2017) · Journal of Ethnicity in Substance Abuse · doi:10.1080/15332640.2017.1300550 · Cited by 21 · see citing works
Self-citationSaiyed, A., Layton, J. F., Borsari, B. E., Cheng, J., Kanzaveli, T., Tsvetovat, M., & Satterfield, J. M. (2022) · Procedia Computer Science · doi:10.1016/j.procs.2022.09.091 · Cited by 20 · see citing works
Xiong, X. R., Braun, S., Stitzer, M. L., Luderer, H. F., Shafai, G., Hare, B. D., Stevenson, M., & Maricich, Y. A. (2022) · American Journal on Addictions · doi:10.1111/ajad.13346 · Cited by 22 · see citing works
Self-citationGlass, J. E., Dorsey, C. N., Beatty, T. C., Bobb, J. F., Wong, E. S., Palazzo, L. G., King, D., Mogk, J. M., Stefanik-Guizlo, K., Idu, A., et al. (2023) · Implementation Science · doi:10.1186/s13012-022-01258-9 · Cited by 20 · see citing works
Addiction and COVID: Issues, Challenges, and New Telehealth Approaches
Edinoff, A. N., Kaufman, S. E., Chauncy, T. M., Erwin, A. P., Russo, K. M., Nelson, M. E., Cornett, E. M., Shah-Bruce, M., Kaye, A. M., & Kaye, A. D. (2022) · Psychiatry International · doi:10.3390/psychiatryint3020014 · Cited by 19 · see citing works
- Authors
- Campbell, A. N. C., Nunes, E. V., Matthews, A. G., Stitzer, M., Miele, G. M., Polsky, D., Turrigiano, E., Walters, S., McClure, E. A., Kyle, T. L., Wahle, A., Van Veldhuisen, P., Goldman, B., Babcock, D., Stabile, P. Q., Winhusen, T., & Ghitza, U. E.
- Affiliations
- St. Luke's-Roosevelt Hospital Center (US)
- From New York State Psychiatric Institute, New York; Department of Psychiatry, Columbia University, New York; Department of Psychiatry and Behavioral Health, St. Luke’s Roosevelt Hospital Center, New York; EMMES Corporation, Rockville, Md.; Department of Psychiatry and Behavioral Sciences, Johns Hopkins University School of Medicine, Baltimore; School of Medicine, University of Pennsylvania, Philadelphia; School of Public Health, University of North Texas Health Science Center, Fort Worth; Clinical...
- ORCID
- Venue
- American Journal of Psychiatry
- Published
- 2014-06
- Volume
- 171
- Issue
- 6
- Pages
- 683-690
- ISSN
- 0002-953X (ISSN-L)
- 1535-7228
- PMC
- PMC4079279
- OpenAlex
- W1963819178
- Cited by
- 263
- References
- 38
- Citations by year
- 2026: 18 · 2025: 15 · 2024: 23 · 2023: 26 · 2022: 30 · 2021: 27 · 2020: 28 · 2019: 23 · 2018: 19 · 2017: 15 · 2016: 17 · 2015: 15 · 2014: 6 · 2013: 1
- FWCI
- 13.38
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- American Journal of Psychiatry (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (5u10da013034-15)
- National Institute on Drug Abuse (U10DA013720, U10DA013035, K24DA022412, DA013035, U10-DA013034, U10DA013732, U10DA015815, U10DA020024, U10DA013036, U10DA013714, U10DA015831, DA015831, UG1DA020024)
- National Institute on Minority Health and Health Disparities (L60 MD006644)
- National Drug Abuse Treatment Clinical Trials Network
- Topics
- Health Sciences › Medicine › Epidemiology › Substance Abuse Treatment and Outcomes
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Social Sciences › Psychology › Clinical Psychology › Gambling Behavior and Treatments
- Keywords
- internet-delivered treatment, substance use disorders, motivational incentives, abstinence, treatment discontinuation, outpatient addiction treatment, community reinforcement, contingency management, access to addiction treatment
- MeSH terms
- Adult, Behavior Therapy, Female, Humans, Male, Patient Compliance, Treatment Outcome, Telemedicine, Substance-Related Disorders, Internet
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
