The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Mobile Technology Boosts the Effectiveness of Psychotherapy and Behavioral Interventions: A Meta-Analysis
Open accessAbstract
We conducted a meta-analysis on the effects of mobile technology on treatment outcome for psychotherapy and other behavioral interventions. Our search of the literature resulted in 26 empirical articles describing 25 clinical trials testing the benefits of smartphone applications, personal digital assistants (PDAs), or text messaging systems either to supplement treatment or substitute for direct contact with a clinician. Overall, mobile technology use was associated with superior treatment outcome across all study designs and control conditions, effect size (ES) = .34, p < .0001. For the subset of 10 studies that looked specifically at the added benefit of mobile technology using a rigorous “Treatment” versus “Treatment + Mobile” design, effect sizes were only slightly more modest (ES = .27) and still significant ( p < .05). Overall, the results support the role of mobile technology for the delivery of psychotherapy and other behavioral interventions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Recent evidence indicates that the implementation of new mobile technologies, such as smartphones, may help to increase therapeutic efficacy, when applied within a blended psychotherapy approach [96–99].”
In the citing paper
“Overall, the effect size was medium, suggesting that apps can add value to existing treatments.”
From Mobile Apps for Mental Health Issues: Meta-Review of Meta-Analyses (2020) · cites this paper as [44]
In the citing paper
“However, the quality of the evidence was rated as poor to moderate (see Tables 1 and 2), given that the effects were imprecise, the samples were very heterogeneous, and the effects were indirect (no subanalyses by diagnosis or problem and all mixed together).”
From Mobile Apps for Mental Health Issues: Meta-Review of Meta-Analyses (2020) · cites this paper as [44]
In the citing paper
“As such, Lindheim et al’s meta-analysis [44] only included adjunctive and had a medium effect size, with poor to moderate quality.”
From Mobile Apps for Mental Health Issues: Meta-Review of Meta-Analyses (2020) · cites this paper as [44]
In the citing paper
“These kinds of treatments, which have until now been administered only in a clinician’s office during scheduled visits, or sometimes by desktop computer (Carroll et al. 2014) are becoming mobile— adapted for delivery when and where they are needed (Lindhiem et al. 2015; Nahum-Shani et al. 2016).”
From Context and craving during stressful events in the daily lives of drug-dependent patients (2017) · cites this paper as Lindhiem et al. 2015
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2000) · Cited by 9,198
A Fail-Safe N for Effect Size in Meta-Analysis
Orwin, R. G. (1983) · Journal of Educational Statistics · doi:10.2307/1164923 · Cited by 2,064
Generation M2 : Media in the Lives of 8- to 18-year-olds
Rideout, V. (2010) · Medical Entomology and Zoology · Cited by 2,016
Barriers to mental health treatment: results from the National Comorbidity Survey Replication
Mojtabai, R., Olfson, M., Sampson, N. A., Jin, R., Druss, B., Wang, P. S., Wells, K. B., Pincus, H. A., & Kessler, R. C. (2011) · Psychological Medicine · doi:10.1017/s0033291710002291 · Cited by 951
mHealth for mental health: Integrating smartphone technology in behavioral healthcare.
Luxton, D. D., McCann, R. A., Bush, N. E., Mishkind, M. C., & Reger, G. M. (2011) · Professional Psychology: Research and Practice · doi:10.1037/a0024485 · Cited by 809
Free, C., Knight, R., Robertson, S., Whittaker, R., Edwards, P., Zhou, W., Rodgers, A., Cairns, J., Kenward, M. G., & Roberts, I. (2011) · The Lancet · doi:10.1016/s0140-6736(11)60701-0 · Cited by 728
A Smartphone Application to Support Recovery From Alcoholism: A Randomized Clinical Trial
Gustafson, D. H., McTavish, F. M., Chih, M.-Y., Atwood, A. K., Johnson, R. A., Boyle, M. G., Levy, M. S., Driscoll, H., Chisholm, S. M., Dillenburg, L., et al. (2014) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.4642 · Cited by 692
Efficacy of text messaging-based interventions for health promotion: A meta-analysis
Head, K. J., Noar, S. M., Iannarino, N. T., & Harrington, N. G. (2013) · Social Science & Medicine · doi:10.1016/j.socscimed.2013.08.003 · Cited by 647
Mapping mHealth research: a decade of evolution
Fiordelli, M., Diviani, N., & Schulz, P. J. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2430 · Cited by 570
Kirwan, M., Vandelanotte, C., Fenning, A., & Duncan, M. J. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2588 · Cited by 343
CBT for depression: a pilot RCT comparing mobile phone vs. computer
Watts, S., Mackenzie, A., Thomas, C., Griskaitis, A., Mewton, L., Williams, A., & Andrews, G. (2013) · BMC Psychiatry · doi:10.1186/1471-244x-13-49 · Cited by 329
Burke, L. E., Conroy, M. B., Sereika, S. M., Elci, O. U., Styn, M. A., Acharya, S. D., Sevick, M. A., Ewing, L. J., & Glanz, K. (2011) · Obesity · doi:10.1038/oby.2010.208 · Cited by 329
Park, L. G., Howie‐Esquivel, J., Chung, M. L., & Dracup, K. (2013) · Patient Education and Counseling · doi:10.1016/j.pec.2013.10.027 · Cited by 223
Piasecki, T. M., Hufford, M. R., Solhan, M. B., & Trull, T. J. (2007) · Psychological Assessment · doi:10.1037/1040-3590.19.1.25 · Cited by 207
Enock, P. M., Hofmann, S. G., & McNally, R. J. (2014) · Cognitive Therapy and Research · doi:10.1007/s10608-014-9606-z · Cited by 201
Whittaker, R., Dorey, E., Bramley, D. M., Bullen, C., Denny, S., Elley, C. R., Maddison, R., McRobbie, H. J., Parag, V., Rodgers, A., et al. (2011) · Journal of Medical Internet Research · doi:10.2196/jmir.1553 · Cited by 201
Cushing, C. C., & Steele, R. G. (2010) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsq023 · Cited by 180
Kristjánsdóttir, Ó. B., Fors, E. A., Eide, E., Finset, A., Stensrud, T. L., van Dulmen, S., Wigers, S. H., & Eide, H. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2249 · Cited by 176
Yon, B. A., Johnson, R. K., Harvey-Berino, J., Gold, B. C., & Howard, A. B. (2007) · Journal of Behavioral Medicine · doi:10.1007/s10865-006-9092-1 · Cited by 175
The SmartCAT: An m-Health Platform for Ecological Momentary Intervention in Child Anxiety Treatment
Pramana, G., Parmanto, B., Kendall, P. C., & Silk, J. S. (2014) · Telemedicine and e-Health · doi:10.1089/tmj.2013.0214 · Cited by 162
Self-citationKenardy, J. A., Dow, M. G. T., Johnston, D. W., Newman, M. G., Thomson, A., & Taylor, C. B. (2003) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.71.6.1068 · Cited by 157
Duncan, M. J., Vandelanotte, C., Kolt, G. S., Rosenkranz, R. R., Caperchione, C. M., George, E. S., Ding, H., Hooker, C., Karunanithi, M., Maeder, A., et al. (2014) · Journal of Medical Internet Research · doi:10.2196/jmir.3107 · Cited by 156
Text4Diet: A randomized controlled study using text messaging for weight loss behaviors
Shapiro, J. R., Koro, T., Doran, N., Thompson, S., Sallis, J. F., Calfas, K., & Patrick, K. (2012) · Preventive Medicine · doi:10.1016/j.ypmed.2012.08.011 · Cited by 151
Hundt, N. E., Mignogna, J., Underhill, C., & Cully, J. A. (2012) · Behavior Therapy · doi:10.1016/j.beth.2012.10.001 · Cited by 143
Gentry, T., Kriner, R. E., Sima, A. P., McDonough, J., & Wehman, P. (2014) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2221-8 · Cited by 126
Haug, S., Schaub, M. P., Venzin, V., Meyer, C., & John, U. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2636 · Cited by 122
Bauer, S., Okon, E., Meermann, R., & Kordy, H. (2012) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0028030 · Cited by 119
Whalen, C. K., Henker, B. A., Jamner, L. D., Ishikawa, S. S., Floro, J. N., Swindle, R. W., Perwien, A. R., & Johnston, J. A. (2006) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-005-9008-5 · Cited by 118
Jones, D. J., Forehand, R., Cuellar, J., Parent, J. M., Honeycutt, A., Khavjou, O., Gonzalez, M., Anton, M. T., & Newey, G. A. (2013) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2013.822308 · Cited by 114
Steinberg, D., Levine, E. L., Askew, S., Foley, P. B., & Bennett, G. G. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2844 · Cited by 110
Ybarra, M. L., Holtrop, J. S., Prescott, T. L., Rahbar, M. H., & Strong, D. R. (2013) · Nicotine & Tobacco Research · doi:10.1093/ntr/nts339 · Cited by 94
Naughton, F., Jamison, J., Boase, S., Sloan, M., Gilbert, H., Prevost, A. T., Mason, D., Smith, S., Brimicombe, J., Evans, R., et al. (2014) · Addiction · doi:10.1111/add.12556 · Cited by 93
Askins, M. A., Sahler, O. J. Z., Sherman, S. A., Fairclough, D. L., Butler, R. W., Katz, E. R., Dolgin, M. J., Varni, J. W., Noll, R. B., & Phipps, S. (2008) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsn124 · Cited by 74
Gonzales, R., Ang, A., Murphy, D. A., Glik, D. C., & Anglin, M. D. (2014) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2014.01.010 · Cited by 70
Intervening on cognitions and behavior in irritable bowel syndrome: A feasibility trial using PDAs
Oerlemans, S., van Cranenburgh, O., Herremans, P.-J., Spreeuwenberg, P., & van Dulmen, S. (2011) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2010.09.018 · Cited by 67
Desensitization with minimal therapist contact.
Kahn, M., & Baker, B. L. (1968) · Journal of Abnormal Psychology · doi:10.1037/h0025866 · Cited by 66
Jones, D. J. (2014) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2013.859082 · Cited by 56
Short message service reduces dropout in childhood obesity treatment: A randomized controlled trial
de Niet, J., Timman, R., Bauer, S., van den Akker, E., de Klerk, C., Kordy, H., & Passchier, J. (2012) · Health Psychology · doi:10.1037/a0027498 · Cited by 55
Ehrenreich, B., Righter, B., Rocke, D. A., Dixon, L., & Himelhoch, S. (2011) · Journal of Nervous & Mental Disease · doi:10.1097/nmd.0b013e3182349e90 · Cited by 53
An Electronic Diary Study of Contextual Triggers and ADHD: Get Ready, Get Set, Get Mad
Whalen, C. K., Henker, B. A., Ishikawa, S. S., Jamner, L. D., Floro, J. N., Johnston, J. A., & Swindle, R. W. (2006) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/01.chi.0000189057.67902.10 · Cited by 48
Louch, G., Dalkin, S. M., Bodansky, J., & Conner, M. T. (2012) · Psychology Health & Medicine · doi:10.1080/13548506.2012.689841 · Cited by 34
Use of Telephone Calls to Increase Motivation for Treatment in Alcoholics
Koumans, A. J. R., Muller, J. J., & Miller, C. F. (1967) · Psychological Reports · doi:10.2466/pr0.1967.21.1.327 · Cited by 31
Behavioral Parent Training: Is There an "App" for That?
Jones, D. J., Forehand, R., McKee, L. G., Cuellar, J., & Kincaid, C. (2010) · PubMed · Cited by 28
Teachman, B. A. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691613512659 · Cited by 28
Lindhiem, O. J., Higa, J., Trentacosta, C. J., Herschell, A. D., & Kolko, D. J. (2013) · Clinical Child and Family Psychology Review · doi:10.1007/s10567-013-0136-0 · Cited by 27
Self-citationImpact of Daily Assessments on Distress and PTSD Symptoms in Trauma-Exposed Women
Pedersen, E. R., Kaysen, D. L., Lindgren, K. P., Blayney, J. A., & Simpson, T. L. (2013) · Journal of Interpersonal Violence · doi:10.1177/0886260513505705 · Cited by 20
Mobile Telephones and Psychotherapy: II. A Review of Empirical Research
Boschen, M. J. (2009) · Griffith Research Online · Cited by 14
Research works printed but not linked: 3
- Boschen M. J., 2009, The Behavior Therapist, 32, 175
- Jones D. J., 2010, Behavior Therapist, 33, 72
- 10.3102/10769986008002157 · DOI · Paper page
Cited by
Sorted by citations
Erbe, D., Eichert, H.-C., Riper, H., & Ebert, D. D. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6588 · Cited by 532
Ebert, D. D., Van Daele, T., Nordgreen, T., Karekla, M., Compare, A., Zarbo, C., Brugnera, A., Øverland, S., Trebbi, G., Jensen, K. L., et al. (2018) · European Psychologist · doi:10.1027/1016-9040/a000318 · Cited by 437
Using smartphones and health apps to change and manage health behaviors: a population-based survey
Ernsting, C., Dombrowski, S. U., Oedekoven, M., O´Sullivan, J. L., Kanzler, M., Kuhlmey, A., & Gellert, P. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.6838 · Cited by 400
Mobile Apps for Mental Health Issues: Meta-Review of Meta-Analyses
Lecomte, T., Potvin, S., Corbière, M., Guay, S., Samson, C., Cloutier, B., Francoeur, A., Pennou, A., & Khazaal, Y. (2020) · JMIR mHealth and uHealth · doi:10.2196/17458 · Cited by 336
Ebert, D. D., Cuijpers, P., Muñoz, R. F., & Baumeister, H. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00116 · Cited by 244
Metadata
- Authors
- Lindhiem, O., Bennett, C. B., Rosen, D., & Silk, J.
- Affiliations
- University of Pittsburgh (US)
- University of Pittsburgh Medical Center (US)
- Corresponding author
- Lindhiem, Oliver
- Venue
- Behavior Modification
- Publisher
- SAGE Publications
- Published
- 2015-07-17
- Volume
- 39
- Issue
- 6
- Pages
- 785-804
- ISSN
- 0145-4455 (ISSN-L)
- 1552-4167
- PMC
- PMC4633319
- OpenAlex
- W2180980536
- Cited by
- 197
- References
- 47
- Citations by year
- 2026: 13 · 2025: 14 · 2024: 14 · 2023: 11 · 2022: 23 · 2021: 30 · 2020: 29 · 2019: 19 · 2018: 17 · 2017: 21 · 2016: 6
- FWCI
- 23.73
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Behavior Modification (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute of Mental Health (R34MH102666, MH093508, K01MH093508)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Clinical Psychology › Psychotherapy Techniques and Applications
- Keywords
- mobile technology, psychotherapy, behavioral interventions, mobile application, personal digital assistants, text messaging, treatment outcomes, digital mental health, external beam radiotherapy
- MeSH terms
- Adolescent, Adult, Behavior Therapy, Humans, Middle Aged, Psychotherapy, Treatment Outcome, Text Messaging, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review