Quality of Smartphone Apps Related to Panic Disorder
Open accessAbstract
Quality of smartphone apps related to panic: smartphone apps have a growing role in health care. This study assessed the quality of English-language apps for panic disorder (PD) and compared paid and free apps. Keywords related to PD were entered into the Google Play Store search engine. Apps were assessed using the following quality indicators: accountability, interactivity, self-help score (the potential of smartphone apps to help users in daily life), and evidence-based content quality. The Brief DISCERN score and the criteria of the "Health on the Net" label were also used as content quality indicators as well as the number of downloads. Of 247 apps identified, 52 met all inclusion criteria. The content quality and self-help scores of these PD apps were poor. None of the assessed indicators were associated with payment status or number of downloads. Multiple linear regressions showed that the Brief DISCERN score significantly predicted the content quality and self-help scores. Poor content quality and self-help scores of PD smartphone apps highlight the gap between their technological potential and the overall quality of available products.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The emerging field of m-mental health is in its infancy as many available apps lack scientific evidence or show poor content quality.
“However, the emerging field of m-mental health can still be described as being in its infancy as many available apps lack scientific evidence (Donker et al., 2013; Sucala et al., 2017) or show poor content quality (Singer et al., 2015).”
From A mobile application for panic disorder and agoraphobia: Insights from a multi-methods feasibility study (2020) · cites this paper as Singer et al., 2015
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Eysenbach, G., Powell, J., Kuss, O., & Sa, E.-R. (2002) · JAMA · doi:10.1001/jama.287.20.2691 · Cited by 1,871 · see citing works
The economic burden of anxiety disorders in the 1990s
Greenberg, P. E., Sisitsky, T., Kessler, R. C., Finkelstein, S. N., Berndt, E. R., Davidson, J. R. T., Ballenger, J. C., & Fyer, A. J. (1999) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v60n0702 · Cited by 1,242 · cited 2× · see citing works
“Panic disorder (PD) is a common anxiety disorder associated with an important social and economic burden (1, 2).”
BackgroundA Systematic Review of Healthcare Applications for Smartphones
Mosa, A. S. M., Yoo, I., & Sheets, L. (2012) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-12-67 · Cited by 1,184 · see citing works
Smartphones for smarter delivery of mental health programs: A systematic review
Donker, T., Petrie, K., Proudfoot, J., Clarke, J., Birch, M.-R., & Christensen, H. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2791 · Cited by 1,136 · see citing works
Andersson, G., Cuijpers, P., Carlbring, P., Riper, H., & Hedman, E. (2014) · World Psychiatry · doi:10.1002/wps.20151 · Cited by 1,077 · see citing works
Mobile medical and health apps: state of the art, concerns, regulatory control and certification
Kamel Boulos, M. N., Brewer, A. C., Karimkhani, C., Buller, D. B., & Dellavalle, R. P. (2014) · Online Journal of Public Health Informatics · doi:10.5210/ojphi.v5i3.4814 · Cited by 659 · see citing works
Using the Internet to provide cognitive behaviour therapy
Andersson, G. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.01.010 · Cited by 560 · see citing works
Internet-administered cognitive behavior therapy for health problems: a systematic review
Cuijpers, P., van Straten, A., & Andersson, G. (2008) · Journal of Behavioral Medicine · doi:10.1007/s10865-007-9144-1 · Cited by 555 · see citing works
Martínez-Pérez, B., de la Torre-Díez, I., & López-Coronado, M. (2013) · Journal of Medical Internet Research · doi:10.2196/jmir.2600 · Cited by 550 · see citing works
Treatment of panic disorder: live therapy vs. self-help via the Internet
Carlbring, P., Nilsson-Ihrfelt, E., Waara, J., Kollenstam, C., Buhrman, M., Kaldo, V., Söderberg, M., Ekselius, L., & Andersson, G. (2005) · Behaviour Research and Therapy · doi:10.1016/j.brat.2004.10.002 · Cited by 372 · see citing works
Evidence-Based Strategies in Weight-Loss Mobile Apps
Pagoto, S., Schneider, K., Jojic, M., DeBiasse, M., & Mann, D. (2013) · American Journal of Preventive Medicine · doi:10.1016/j.amepre.2013.04.025 · Cited by 325 · see citing works
There’s an App for That: Content Analysis of Paid Health and Fitness Apps
West, J. H., Hall, P. C., Hanson, C. L., Barnes, M. D., Giraud-Carrier, C., & Barrett, J. (2012) · Journal of Medical Internet Research · doi:10.2196/jmir.1977 · Cited by 314 · see citing works
Proudfoot, J., Parker, G., Hadzi Pavlovic, D., Manicavasagar, V., Adler, E., & Whitton, A. (2010) · Journal of Medical Internet Research · doi:10.2196/jmir.1475 · Cited by 274 · see citing works
Pandey, A., Hasan, S., Dubey, D., & Sarangi, S. (2013) · Journal of Cancer Education · doi:10.1007/s13187-012-0446-9 · Cited by 213 · see citing works
Walz, L. C., Nauta, M. H., & aan het Rot, M. (2014) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2014.09.022 · Cited by 195 · cited 1× · see citing works
“Despite expectations about the potential of PD apps to improve treatments (51, 52), the apps available to users from stores to date need to be improved and to include more patterns of evidence-based information, more interactive assessments, such as ecological momentary assessments (67), and more self-help options.”
BackgroundAssessing the quality and usability of smartphone apps for pain self-management
Reynoldson, C., Stones, C., Allsop, M., Gardner, P., Bennett, M. I., Closs, S. J., Jones, R., & Knapp, P. (2014) · Pain Medicine · doi:10.1111/pme.12327 · Cited by 178 · see citing works
Shandley, K., Austin, D. W., Klein, B., Pier, C., Schattner, P., Pierce, D., & Wade, V. (2008) · Journal of Medical Internet Research · doi:10.2196/jmir.1033 · Cited by 84 · see citing works
van der Spek, N., Vos, J., van Uden-Kraan, C. F., Breitbart, W., Cuijpers, P., Knipscheer-Kuipers, K., Willemsen, V., Tollenaar, R. A., van Asperen, C. J., & Verdonck-de Leeuw, I. M. (2014) · BMC Psychiatry · doi:10.1186/1471-244x-14-22 · Cited by 52 · see citing works
Lindner, P., Ivanova, E., Ly, K. H., Andersson, G., & Carlbring, P. (2013) · Trials · doi:10.1186/1745-6215-14-437 · Cited by 39 · see citing works
Ebenfeld, L., Kleine Stegemann, S., Lehr, D., Ebert, D. D., Jazaieri, H., van Ballegooijen, W., Funk, B., Riper, H., & Berking, M. (2014) · Trials · doi:10.1186/1745-6215-15-427 · Cited by 20 · see citing works
Flagged first, then by citations
Research works printed but not linked: 44
- [1]Kessler RC Chiu WT Jin R Ruscio AM Shear K Walters EE. The epidemiology of panic attacks, panic disorder, and agoraphobia in the National Comorbidity Survey Replication. Arch Gen Psychiatry (2006) 63(4): 415– 24. 10.1001/archpsyc.63.4.415 16585471 PMC1958997 · DOI · Paper page
- [3]Association AP Practice Guideline for the Treatment of Patients with Panic Disorder. Second edition ed Washington, DC: American Psychiatric Association (2009).
- [4]Schubert JR Coles ME Heimberg RG Weiss BD. Disseminating treatment for anxiety disorders step 2: peer recommendations to seek help. J Anxiety Disord (2014) 28(7): 712– 6. 10.1016/j.janxdis.2014.07.010 25145571 PMC4160353 · DOI
- [9]Cortez NG Cohen IG Kesselheim AS. FDA regulation of mobile health technologies. N Engl J Med (2014) 371(4): 372– 9. 10.1056/NEJMhle1403384 25054722 · DOI
- [10]Codyre P. Will an app fill the gap? Innovative technology to provide point-of-care information. Front Public Health (2014) 2: 9. 10.3389/fpubh.2014.00009 24551835 PMC3914210 · DOI
- [11]Becker S Miron-Shatz T Schumacher N Krocza J Diamantidis C Albrecht UV. mHealth 2.0: experiences, possibilities, and perspectives. JMIR mHealth uHealth (2014) 2(2): e24. 10.2196/mhealth.3328 25099752 PMC4114478 · DOI · Paper page
- [13]FDA. FDA issues Final Guidance on Mobile Medical Apps. (2013). Available from: http://www.fda.gov/NewsEvents/Newsroom/PressAnnouncements/ucm369431.htm 24358515
- [14]Abroms LC Lee Westmaas J Bontemps-Jones J Ramani R Mellerson J. A content analysis of popular smartphone apps for smoking cessation. Am J Prev Med (2013) 45(6): 732– 6. 10.1016/j.amepre.2013.07.008 24237915 PMC3836190 · DOI
- [15]Abroms LC Padmanabhan N Thaweethai L Phillips T. iPhone apps for smoking cessation: a content analysis. Am J Prev Med (2011) 40(3): 279– 85. 10.1016/j.amepre.2010.10.032 21335258 PMC3395318 · DOI · Paper page
- [16]Breton ER Fuemmeler BF Abroms LC. Weight loss-there is an app for that! but does it adhere to evidence-informed practices? Transl Behav Med (2011) 1(4): 523– 9. 10.1007/s13142-011-0076-5 24073074 PMC3717669 · DOI · Paper page
- [17]Cohn AM Hunter-Reel D Hagman BT Mitchell J. Promoting behavior change from alcohol use through mobile technology: the future of ecological momentary assessment. Alcohol Clin Exp Res (2011) 35(12): 2209– 15. 10.1111/j.1530-0277.2011.01571.x 21689119 PMC3221771 · DOI
- [18]Choi J Noh GY Park DJ. Smoking cessation apps for smartphones: content analysis with the self-determination theory. J Med Internet Res (2014) 16(2): e44. 10.2196/jmir.3061 24521881 PMC3936270 · DOI
- [20]Bennett ME Toffey K Dickerson F Himelhoch S Katsafanas E Savage CLA Review of android apps for smoking cessation. J Smok Cessat (2014). 10.1017/jsc.2014.1 · DOI
- [21]Schoffman DE Turner-McGrievy G Jones SJ Wilcox S. Mobile apps for pediatric obesity prevention and treatment, healthy eating, and physical activity promotion: just fun and games? Transl Behav Med (2013) 3(3): 320– 5. 10.1007/s13142-013-0206-3 24073184 PMC3771006 · DOI
- [22]Direito A Dale LP Shields E Dobson R Whittaker R Maddison R. Do physical activity and dietary smartphone applications incorporate evidence-based behaviour change techniques? BMC Public Health (2014) 14: 646. 10.1186/1471-2458-14-646 24965805 PMC4080693 · DOI
- [24]Azar KM Lesser LI Laing BY Stephens J Aurora MS Burke LE Mobile applications for weight management: theory-based content analysis. Am J Prev Med (2013) 45(5): 583– 9. 10.1016/j.amepre.2013.07.005 24139771 · DOI · Paper page
- [25]Conroy MB Yang K Elci OU Gabriel KP Styn MA Wang J Physical activity self-monitoring and weight loss: 6-month results of the SMART trial. Med Sci Sports Exerc (2011) 43(8): 1568– 74. 10.1249/MSS.0b013e31820b9395 21200337 PMC4266405 · DOI
- [26]Conroy DE Yang CH Maher JP. Behavior change techniques in top-ranked mobile apps for physical activity. Am J Prev Med (2014) 46(6): 649– 52. 10.1016/j.amepre.2014.01.010 24842742 · DOI
- [28]Breland JY Yeh VM Yu J. Adherence to evidence-based guidelines among diabetes self-management apps. Transl Behav Med (2013) 3(3): 277– 86. 10.1007/s13142-013-0205-4 24073179 PMC3771007 · DOI · Paper page
- [29]Demidowich AP Lu K Tamler R Bloomgarden Z. An evaluation of diabetes self-management applications for android smartphones. J Telemed Telecare (2012) 18(4): 235– 8. 10.1258/jtt.2012.111002 22604278 · DOI
- [30]Huckvale K Car M Morrison C Car J. Apps for asthma self-management: a systematic assessment of content and tools. BMC Med (2012) 10: 144. 10.1186/1741-7015-10-144 23171675 PMC3523082 · DOI
- [31]Eng DS Lee JM. The promise and peril of mobile health applications for diabetes and endocrinology. Pediatr Diabetes (2013) 14(4): 231– 8. 10.1111/pedi.12034 23627878 PMC3837694 · DOI
- [32]Robustillo Cortes Mde L Cantudo Cuenca MR Morillo Verdugo R Calvo Cidoncha E. High quantity but limited quality in healthcare applications intended for HIV-infected patients. Telemed J E Health (2014) 20(8): 729– 35. 10.1089/tmj.2013.0262 24849001 · DOI
- [33]Mobasheri MH Johnston M King D Leff D Thiruchelvam P Darzi A. Smartphone breast applications – what’s the evidence? Breast (2014) 23(5): 683– 9. 10.1016/j.breast.2014.07.006 25153432 · DOI · Paper page
- [35]Pandher PS Bhullar KK. Smartphone applications for seizure management. Health Informatics J (2014). 10.1177/1460458214540906 25038202 · DOI
- [36]Behar J Roebuck A Domingos JS Gederi E Clifford GD. A review of current sleep screening applications for smartphones. Physiol Meas (2013) 34(7): R29– 46. 10.1088/0967-3334/34/7/R29 23771214 · DOI
- [39]Morel V Chatton A Cochand S Zullino D Khazaal Y. Quality of web-based information on bipolar disorder. J Affect Disord (2008) 110(3): 265– 9. 10.1016/j.jad.2008.01.007 18280578 · DOI
- [40]Zermatten A Khazaal Y Coquard O Chatton A Bondolfi G. Quality of web-based information on depression. Depress Anxiety (2010) 27(9): 852– 8. 10.1002/da.20665 20099271 · DOI
- [41]Klila H Chatton A Zermatten A Khan R Preisig M Khazaal Y. Quality of web-based information on obsessive compulsive disorder. Neuropsychiatr Dis Treat (2013) 9: 1717– 23. 10.2147/NDT.S49645 24235835 PMC3821751 · DOI
- [42]Khazaal Y Fernandez S Cochand S Reboh I Zullino D. Quality of web-based information on social phobia: a cross-sectional study. Depress Anxiety (2008) 25(5): 461– 5. 10.1002/da.20381 17960640 · DOI
- [43]Khazaal Y Chatton A Cochand S Jermann F Osiek C Bondolfi G Quality of web-based information on pathological gambling. J Gambl Stud (2008) 24(3): 357– 66. 10.1007/s10899-008-9095-7 18373182 · DOI
- [44]Khazaal Y Chatton A Zullino D Khan R. HON label and DISCERN as content quality indicators of health-related websites. Psychiatr Q (2012) 83(1): 15– 27. 10.1007/s11126-011-9179-x 21547515 · DOI
- [46]Chan DS Willicombe A Reid TD Beaton C Arnold D Ward J Relative quality of internet-derived gastrointestinal cancer information. J Cancer Educ (2012) 27(4): 676– 9. 10.1007/s13187-012-0408-2 22918796 · DOI
- [49]Carlbring P Andersson G Kaldo V. State-of-the-art treatment via the internet: an optimistic vision of the future. Cogn Behav Ther (2011) 40(2): 79– 81. 10.1080/16506073.2011.575591 25155811 · DOI
- [50]Hadjistavropoulos HD Pugh NE Nugent MM Hesser H Andersson G Ivanov M Therapist-assisted internet-delivered cognitive behavior therapy for depression and anxiety: translating evidence into clinical practice. J Anxiety Disord (2014) 28(8): 884– 93. 10.1016/j.janxdis.2014.09.018 25445078 · DOI
- [54]Eysenbach G Kohler C. How do consumers search for and appraise health information on the world wide web? qualitative study using focus groups, usability tests, and in-depth interviews. BMJ (2002) 324(7337): 573– 7. 10.1136/bmj.324.7337.573 11884321 PMC78994 · DOI
- [55]Boyer C Selby M Scherrer JR Appel RD. The health on the net code of conduct for medical and health websites. Comput Biol Med (1998) 28(5): 603– 10. 10.1016/S0010-4825(98)00037-7 9861515 · DOI
- [56]Khazaal Y Chatton A Cochand S Coquard O Fernandez S Khan R Brief DISCERN, six questions for the evaluation of evidence-based content of health-related websites. Patient Educ Couns (2009) 77(1): 33– 7. 10.1016/j.pec.2009.02.016 19372023 · DOI
- [57]Silberg WM Lundberg GD Musacchio RA. Assessing, controlling, and assuring the quality of medical information on the internet: caveant lector et viewor – let the reader and viewer beware. JAMA (1997) 277(15): 1244– 5. 10.1001/jama.1997.03540390074039 9103351 · DOI
- [58]Abbott VP. Web page quality: can we measure it and what do we find? A report of exploratory findings. J Public Health Med (2000) 22(2): 191– 7. 10.1093/pubmed/22.2.191 10912558 · DOI
- [59]eEurope. Quality criteria for health related websites. J Med Internet Res (2002) 4(3): E15. 10.2196/jmir.4.3.e15 12554546 PMC1761945 · DOI
- [60]Charnock D Shepperd S. Learning to DISCERN online: applying an appraisal tool to health websites in a workshop setting. Health Educ Res (2004) 19(4): 440– 6. 10.1093/her/cyg046 15155597 · DOI
- [65]Khazaal Y Chatton A Cochand S Zullino D. Quality of web-based information on cocaine addiction. Patient Educ Couns (2008) 72(2): 336– 41. 10.1016/j.pec.2008.03.002 18423952 · DOI
- [66]Griffiths KM Christensen H. Quality of web based information on treatment of depression: cross sectional survey. BMJ (2000) 321(7275): 1511– 5. 10.1136/bmj.321.7275.1511 11118181 PMC27555 · DOI
Cited by
Sorted by citations
Linardon, J., Cuijpers, P., Carlbring, P., Messer, M., & Fuller‐Tyszkiewicz, M. (2019) · World Psychiatry · doi:10.1002/wps.20673 · Cited by 886 · see citing works
Mobile Apps for Mental Health Issues: Meta-Review of Meta-Analyses
Lecomte, T., Potvin, S., Corbière, M., Guay, S., Samson, C., Cloutier, B., Francoeur, A., Pennou, A., & Khazaal, Y. (2020) · JMIR mHealth and uHealth · doi:10.2196/17458 · Cited by 336 · see citing works
Self-citationBakker, D., & Rickard, N. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2017.11.016 · Cited by 231 · see citing works
Criteria for assessing the quality of mHealth apps: a systematic review
Nouri, R., R Niakan Kalhori, S., Ghazisaeedi, M., Marchand, G., & Yasini, M. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy050 · Cited by 231 · see citing works
Ivanova, E., Lindner, P., Ly, K. H., Dahlin, M., Vernmark, K., Andersson, G., & Carlbring, P. (2016) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2016.09.012 · Cited by 165 · see citing works
Apolinário-Hagen, J., Drüge, M., & Fritsche, L. (2020) · Advances in Experimental Medicine and Biology · doi:10.1007/978-981-32-9705-0_17 · Cited by 100 · see citing works
Computer-Assisted Cognitive-Behavior Therapy and Mobile Apps for Depression and Anxiety
Wright, J. H., Mishkind, M., Eells, T. D., & Chan, S. R. (2019) · Current Psychiatry Reports · doi:10.1007/s11920-019-1031-2 · Cited by 93 · see citing works
Integrating technology into cognitive behavior therapy for adolescent depression: a pilot study
Kobak, K. A., Mundt, J. C., & Kennard, B. (2015) · Annals of General Psychiatry · doi:10.1186/s12991-015-0077-8 · Cited by 63 · see citing works
mHealth app for cannabis users: satisfaction and perceived usefulness
Monney, G., Penzenstadler, L., Dupraz, O., Etter, J.-F., & Khazaal, Y. (2015) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2015.00120 · Cited by 60 · see citing works
Self-citationEbenfeld, L., Kleine Stegemann, S., Lehr, D., Ebert, D. D., Funk, B., Riper, H., & Berking, M. (2020) · Internet Interventions · doi:10.1016/j.invent.2019.100296 · Cited by 20 · see citing works
- Authors
- Van Singer, M., Chatton, A., & Khazaal, Y.
- Affiliations
- University Hospital of Geneva (CH)
- University of Geneva (CH)
- Corresponding author
- Khazaal, Yasser
- Venue
- Frontiers in Psychiatry
- Publisher
- Frontiers Media SA
- Published
- 2015-07-14
- Volume
- 6
- Pages
- 96-96
- ISSN
- 1664-0640 (ISSN-L)
- PMC
- PMC4500864
- OpenAlex
- W1597488657
- Cited by
- 43
- References
- 20
- Citations by year
- 2026: 1 · 2024: 2 · 2023: 4 · 2021: 8 · 2020: 4 · 2019: 6 · 2018: 6 · 2017: 4 · 2016: 3 · 2015: 5
- FWCI
- 9.72
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Frontiers in Psychiatry (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
- Keywords
- panic disorder, mobile application, app quality, mobile health, evidence-based content, app downloads
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review