The DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
A review of popular smartphone apps for depression and anxiety: Assessing the inclusion of evidence-based content
Open accessPublished version of a preprint
Abstract
Smartphone applications for the treatment of depression and anxiety have acquired millions of users, yet little is known about whether they include evidence-based therapeutic content. We examined the extent to which popular mental health applications (MH apps) for depression and anxiety contain treatment elements found in empirically supported psychotherapy protocols (i.e., "common elements"). Of the 27 MH apps reviewed, 23 included at least one common element, with a median of three elements. Psychoeducation (in 52% of apps), relaxation (44%), meditation (41%), mindfulness (37%), and assessment (37%) were the most frequent elements, whereas several elements (e.g., problem solving) were not found in any apps. We also identified gaps between app content and empirically supported treatments. Cognitive restructuring was more common in depression protocols than in depression apps (75% of protocols vs. 31% of apps), as was problem solving (34% vs. 0%). For anxiety, exposure (85%, 12%), cognitive restructuring (60%, 12%), and problem solving (25%, 0%) were more common in protocols than apps. Overall, our findings highlight empirically supported treatment elements that are poorly represented in current MH apps. The absence of several core treatment elements underscores the need for future research, including randomized trials testing the effectiveness of popular MH apps.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“when the appraisal was weighted by the number of active users, the reach of specific treatment elements changed.”
From Evaluating the quality, safety, and functionality of commonly used smartphone apps for bipolar disorder mood and sleep self-management (2022) · cites this paper as Wasil et al. 2019
In the citing paper
“this technique was encountered by the largest proportion (96%) of monthly active users.”
From Evaluating the quality, safety, and functionality of commonly used smartphone apps for bipolar disorder mood and sleep self-management (2022) · cites this paper as Wasil et al. 2019
In the citing paper
“a recent review of apps for depression or anxiety reported that evidence-supported treatment components for these conditions were poorly represented (Wasil et al. 2019)”
From Evaluating the quality, safety, and functionality of commonly used smartphone apps for bipolar disorder mood and sleep self-management (2022) · cites this paper as Wasil et al. 2019
In the citing paper
“Although mindfulness exercises were present in only 37% of reviewed apps”
From Evaluating the quality, safety, and functionality of commonly used smartphone apps for bipolar disorder mood and sleep self-management (2022) · cites this paper as Wasil et al. 2019
Citations
Cites
Gulliver, A., Griffiths, K. M., & Christensen, H. (2010) · BMC Psychiatry · doi:10.1186/1471-244x-10-113 · Cited by 3,292
Defining empirically supported therapies.
Chambless, D. L., & Hollon, S. D. (1998) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.66.1.7 · Cited by 3,067
Empirically supported psychological interventions: Controversies and evidence
Chambless, D. L., & Ollendick, T. H. (2001) · Annual Review of Psychology · doi:10.1146/annurev.psych.52.1.685 · Cited by 2,097
Andrews, G., Cuijpers, P., Craske, M. G., McEvoy, P., & Titov, N. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013196 · Cited by 1,311
Barriers to mental health treatment: results from the WHO World Mental Health surveys
Andrade, L. H., Alonso, J., Mneimneh, Z., Wells, J. E., Al-Hamzawi, A., Borges, G., Bromet, E., Bruffaerts, R., de Girolamo, G., de Graaf, R., et al. (2014) · Psychological Medicine · doi:10.1017/s0033291713001943 · Cited by 1,289
Rebooting psychotherapy research and practice to reduce the burden of mental illness
Kazdin, A. E., & Blase, S. L. (2011) · Perspectives on Psychological Science · doi:10.1177/1745691610393527 · Cited by 1,254
Smartphones for smarter delivery of mental health programs: A systematic review
Donker, T., Petrie, K., Proudfoot, J., Clarke, J., Birch, M.-R., & Christensen, H. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2791 · Cited by 1,136 · cited 1×
“Headspace), yet little is known about the effectiveness of most of these commercially successful MH apps (Donker et al., 2013).”
BackgroundFirth, J., Torous, J., Nicholas, J., Carney, R., Pratap, A., Rosenbaum, S., & Sarris, J. (2017) · World Psychiatry · doi:10.1002/wps.20472 · Cited by 1,097
Cuijpers, P., Berking, M., Andersson, G., Quigley, L., Kleiboer, A., & Dobson, K. S. (2013) · The Canadian Journal of Psychiatry · doi:10.1177/070674371305800702 · Cited by 1,066
Psychotherapy for depression in adults: A meta-analysis of comparative outcome studies.
Cuijpers, P., van Straten, A., Andersson, G., & van Oppen, P. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0013075 · Cited by 1,050
Flagged first, then by citations
Cited by
Sorted by citations
Items 101–160 of 160
Lilan, S., Osborn, T. L., Mmbone, W., Kasudi, J., Otieno, B. H., Etyang, I., Tu, J.-N., Korley, E., & Wasanga, C. (2025) · JMIR Human Factors · doi:10.2196/79107 · Cited by 1
Development of a theoretically and empirically grounded emotion knowledge training for the young
Hovasapian, A., Huyghe, V. E. I., Schlegel, K., & Fontaine, J. R. J. (2022) · Open Research Europe · doi:10.12688/openreseurope.14391.1 · Cited by 1
Silva-Vásquez, P. O., Rosales-Morales, V. Y., & Benítez–Guerrero, E. (2022) · Proceedings of the Institute for System Programming of RAS · doi:10.15514/ispras-2022-34(3)-9 · Cited by 2
Raccanello, D., Vicentini, G., Rocca, E., Hall, R., & Burro, R. (2023) · Applied Psychology Health and Well-Being · doi:10.1111/aphw.12511 · Cited by 2
Psikolojik Yardım Hizmetlerindeki Mobil Uygulamalarla İlgili Bir İnceleme
Kabadayı, F., & Güven, M. (2023) · Türk Eğitim Bilimleri Dergisi · doi:10.37217/tebd.1291285 · Cited by 2
Thabrew, H., Boggiss, A. L., Hunt, P., Lim, D. H., Cavadino, A., & Serlachius, A. S. (2025) · Journal of Mental Health · doi:10.1080/09638237.2025.2460123 · Cited by 2
Okuboyejo, S. R., Han, S., Jha, S., Eneja, C., & Orji, R. (2025) · International Journal of Human-Computer Interaction · doi:10.1080/10447318.2025.2476711 · Cited by 2
Graham, A. K., Ortega, A., Rooper, I. R., & Smith, A. C. (2025) · FOCUS The Journal of Lifelong Learning in Psychiatry · doi:10.1176/appi.focus.20250001 · Cited by 2
Gao, Z., Zhao, T., Li, Y., Huang, W. D., Tang, J., Yu, X., Li, Y., & Peng, T. (2025) · Frontiers in Medicine · doi:10.3389/fmed.2025.1710291 · Cited by 2
Automatic Code Generation of User-Centered Serious Games: A Systematic Literature Review
Silva-Vásquez, P. O., Rosales-Morales, V. Y., & Benítez–Guerrero, E. (2020) · International Conference in Software Engineering Research and Innovation (CONISOFT) · doi:10.1109/conisoft50191.2020.00039 · Cited by 2
Apps for mental health problems in children and young people
Stallard, P. N. (2022) · doi:10.1093/med-psych/9780198867791.003.0027 · Cited by 2
Polhemus, A. M., Simblett, S. K., Dawe‐Lane, E., Gilpin, G., Elliott, B., Jilka, S., Novák, J. M., Nica, R. I., Temesi, G., & Wykes, T. (2022) · doi:10.2196/preprints.40133 · Cited by 2
Governmentality, Playbor, and Peak Performance
Bowman, N. D., & Condis, M. A. (2020) · Advances in information security, privacy, and ethics book series · doi:10.4018/978-1-7998-3487-8.ch008 · Cited by 1
Larsen, R. E., Hole, K., Selle, M. L., Landmark, C. J., Krogstad, T., & Holm, L. B. (2024) · Frontiers in Pharmacology · doi:10.3389/fphar.2024.1379700 · Cited by 1
Munteanu, T., Kannis‐Dymand, L., Millear, P. M. R., & Jones, M. (2024) · Cyberpsychology Journal of Psychosocial Research on Cyberspace · doi:10.5817/cp2024-4-6 · Cited by 1
Integrating a Student Wellbeing Tool for Mentors
Bergdahl, N., Sjöberg, J., & Nouri, J. (2025) · Lecture notes in computer science · doi:10.1007/978-3-031-93502-2_1 · Cited by 1
The piloting and evaluation of the graduate employability skills app
Jimoyiannis, A., Boyle, E. A., Scott, G. G., Petersen, S. A., Topolewska‐Siedzik, E., Tsiotakis, P., Abbas, A., Baxter, G. J., & Iqbal, M. (2025) · Frontiers in Computer Science · doi:10.3389/fcomp.2025.1581143 · Cited by 1
Balan, R., Dobrean, A., Poetar, C.-R., Florean, I. S., Balázsi, R., Coșa, I. M., & Månsson, K. N. T. (2026) · Acta Psychologica · doi:10.1016/j.actpsy.2026.106692 · Cited by 1
Gill, H., Hippman, C., Hanft-Robert, S., Nugent, L., Nováček, O., Kamel, M. M., Ryan, D. M., Demlová, R., Krausz, M. R., & Tabi, K. (2025) · Digital Health · doi:10.1177/20552076251325951 · Cited by 1
Rapisarda, F., Lanovaz, M. J., Guay, S., & Geoffrion, S. (2025) · International Journal of Mental Health · doi:10.1080/00207411.2025.2486084 · Cited by 1
Won, H., Kang, M., Kim, M., Lee, D., Choi, H., Kim, Y., Choi, D., Ko, M., & Han, J. (2025) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3706599.3719735 · Cited by 3
e-Mental Health and Health Informatics
Valimaki, M. A., & Hipp, K. (2022) · Springer eBooks · doi:10.1007/978-3-031-05536-2_21 · Cited by 1
Lorenzo‐Luaces, L. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/tzpd2 · Cited by 1
Weiß, T., & Strahringer, S. (2021) · Complex Systems Informatics and Modeling Quarterly · doi:10.7250/csimq.2021-28.02
P1074 就業女性の出産に関わる検討 : 周産期における環境汚染物質曝露の影響評価を意図した出生コホート調査の結果から
仲井, 邦., 鈴木, 恵., 菅原, 典., 亀尾, 聡., 村田, 勝., 黒川, 修., & 佐藤, 洋. (2005) · Sangyo Igaku
Barreto, L. D. M., Borkum, D., Gerstel, B., Kanen, R., Kola, A., & Ott, B. D. (2022) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-022-00244-8
Jesús-Romero, R. D., Wasil, A. R., & Lorenzo‐Luaces, L. (2022) · doi:10.2196/preprints.39508
Self-citationExploring the role of health apps in supporting young people with depression: a mixed methods study
Martinengo, L. (2021) · DR-NTU (Nanyang Technological University) · doi:10.32657/10356/157124
O’Daffer, A., Colt, S. F., Wasil, A. R., & Lau, N. (2022) · doi:10.2196/preprints.40924
Self-citationKosasih, F. R., Yee, V. T. S., Toh, S. H. Y., & Sündermann, O. (2022) · medRxiv · doi:10.1101/2022.07.25.22278034
A Transparency Framework for App Store Descriptions
Alhejaili, A., & Blustein, J. (2023) · Communications in computer and information science · doi:10.1007/978-3-031-35989-7_56
Fitriasari, E., Umasugi, M. T., Soulissa, F. F., Ibrahim, I., Rumbouw, N., Guilin, X., Jiao, D., & Wang, Y. (2023) · Journal of World Future Medicine Health and Nursing · doi:10.55849/health.v1i1.112
Ottinger, C., Gheith, R. H., Sharp, M. H., Davis, J. M., Lowery, R. P., & Wilson, J. M. (2024) · doi:10.2196/preprints.57232
Implementing a mental health app library in primary care: A feasibility study
Lane, J., Manceau, L. M., de Chantal, P., Chagnon, A., Cardinal, M., Lauzier‐Jobin, F., & Lanoue, S. (2024) · Evaluation and Program Planning · doi:10.1016/j.evalprogplan.2024.102413 · Cited by 1
Watkins, E. R., Warren, F. C., Newbold, A., Hulme, C. T., Cranston, T., Aas, B., Bear, H. A., Botella, C., Burkhardt, F., Ehring, T. W., et al. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4837551
Designing Smart Diary and Distraction Tasks to Manage Panic Attacks
Bartucz, A., & Sik‐Lányi, C. (2024) · Lecture notes in computer science · doi:10.1007/978-3-031-62849-8_48
Ribanszki, R., Oziel, R., Fonseca, J. A. S., & POTTS, H. W. W. (2025) · doi:10.2196/preprints.73500
de Bruijn, G., Jabeen, F., & Bosse, T. (2025) · doi:10.1002/9781394179909.ch13
ReNeuWell mental well-being app: protocol for a randomised controlled trial
Egan, L. A., & Gatt, J. M. (2025) · BMJ Open · doi:10.1136/bmjopen-2024-094557
Jonathan, G., Sung, J. Y., Arcese, H. T., Holz, P., Bentley, K. H., Bernstein, E. E., Weingarden, H. M., Greenberg, J. L., Harrison, O., & Wilhelm, S. (2025) · doi:10.2196/preprints.84030
Satani, A., & Barodia, P. (2025) · Cureus · doi:10.7759/cureus.93713
Cao, X., Yu, Y., Zhang, R., Li, H., Li, W., & Wu, P. (2025) · Health Policy and Technology · doi:10.1016/j.hlpt.2025.101128
Alvarez, M. L. R., Reyes-Aguilar, A., & Meza, I. (2025) · TIES Revista de Tecnología e Innovación en Educación Superior · doi:10.22201/dgtic.26832968e.2025.14.116
Venturo-Conerly, K. E., Osborn, T. L., Wasil, A. R., Le, H., Corrigan, E., Wasanga, C., & Weisz, J. R. (2021) · Figshare · doi:10.6084/m9.figshare.17066041
Self-citationVenturo-Conerly, K. E., Osborn, T. L., Wasil, A. R., Le, H., Corrigan, E., Wasanga, C., & Weisz, J. R. (2021) · Figshare · doi:10.6084/m9.figshare.17066050
Self-citationKarlsen, I., Svendsen, P. A., & Abildgaard, J. S. (2022) · Figshare · doi:10.6084/m9.figshare.20472400
Venturo-Conerly, K. E., Osborn, T. L., Wasil, A. R., Le, H., Corrigan, E., Wasanga, C., & Weisz, J. R. (2021) · Figshare · doi:10.6084/m9.figshare.17066047
Self-citationVenturo-Conerly, K. E., Osborn, T. L., Wasil, A. R., Le, H., Corrigan, E., Wasanga, C., & Weisz, J. R. (2021) · Figshare · doi:10.6084/m9.figshare.17066044
Self-citationVenturo-Conerly, K. E., Osborn, T. L., Wasil, A. R., Le, H., Corrigan, E., Wasanga, C., & Weisz, J. R. (2021) · Figshare · doi:10.6084/m9.figshare.17066056
Self-citationKarlsen, I., Svendsen, P. A., & Abildgaard, J. S. (2022) · Figshare · doi:10.6084/m9.figshare.20472403
Venturo-Conerly, K. E., Osborn, T. L., Wasil, A. R., Le, H., Corrigan, E., Wasanga, C., & Weisz, J. R. (2021) · Figshare · doi:10.6084/m9.figshare.17066053
Self-citationVenturo-Conerly, K. E., Osborn, T. L., Wasil, A. R., Le, H., Corrigan, E., Wasanga, C., & Weisz, J. R. (2021) · Figshare · doi:10.6084/m9.figshare.17066038
Self-citationJonathan, G., Sung, J. Y., Arcese, H., Holz, P., Bentley, K. H., Bernstein, E. E., Weingarden, H. M., Greenberg, J. L., Harrison, O., & Wilhelm, S. (2026) · Journal of Medical Internet Research · doi:10.2196/84030
Thomsen, A., Syrek, C. J., Brückner, H., de Bloom, J., Janneck, M., Domin, M., Reins, J. A., & Lehr, D. (2026) · Frontiers in Digital Health · doi:10.3389/fdgth.2026.1698339
Kaplun, T., Andriianova, O., Shpak, H., ZYMA, L., & Kuspanov, M. (2026) · ShodhKosh Journal of Visual and Performing Arts · doi:10.29121/shodhkosh.v7.i6s.2026.7506
Edan, S., & Lipsicas, C. B. (2026) · Journal of Technology in Behavioral Science · doi:10.1007/s41347-026-00665-9
Wan, M. W., Hill, F., Firth, J., & Churchman, A. (2026) · doi:10.2196/preprints.110917
Youth Digital Mental Health Training Needs in Academic and Industry Sectors
Daniel, S., Michel, A. J., & Teachman, B. A. (2026) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-026-10017-3
Williams, N., Collins, G., Brooks, E., & Green, D. D. (2026) · Journal of Medical Sciences and Interdisciplinary Research · doi:10.51847/vhc00cwojh
Ewekeye, O. A., Arubuola, A. B., ADELADAN, L. J., EWEKEYE, O. A., & Esan, D. T. (2026) · Research Square · doi:10.21203/rs.3.rs-11095490/v1
Metadata
- Authors
- Wasil, A. R., Venturo-Conerly, K. E., Shingleton, R. M., & Weisz, J. R.
- Affiliations
- Harvard University (US)
- Corresponding author
- Wasil, Akash R.
- Venue
- Behaviour Research and Therapy
- Publisher
- Elsevier BV
- Published
- 2019-12
- Volume
- 123
- Pages
- 103498
- ISSN
- 0005-7967 (ISSN-L)
- OpenAlex
- W2981909951
- Cited by
- 160
- References
- 55
- Citations by year
- 2026: 11 · 2025: 23 · 2024: 19 · 2023: 19 · 2022: 35 · 2021: 33 · 2020: 19
- FWCI
- 24.57
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- Locations
- Behaviour Research and Therapy (publishedVersion)
- PubMed (publishedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion)
- PsyArXiv (OSF Preprints) (submittedVersion, cc-by)
- Funders
- Harvard University
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- mental health apps, mobile application, depression, anxiety, evidence-based treatment, common elements, psychoeducation, relaxation, meditation, mindfulness, cognitive restructuring, exposure therapy, problem solving, digital mental health
- MeSH terms
- Smartphone, Anxiety, Depression, Humans, Evidence-Based Practice, Mobile Applications
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review