Cited by 43Digital Mental Health InterventionsMobile Health and mHealth ApplicationsHealth Literacy and Information Accessibility

Quality of Smartphone Apps Related to Panic Disorder

Open access
Van Singer, Mathias, Chatton, Anne, Khazaal, Yasser·2015·Frontiers in Psychiatry

Abstract

Quality of smartphone apps related to panic: smartphone apps have a growing role in health care. This study assessed the quality of English-language apps for panic disorder (PD) and compared paid and free apps. Keywords related to PD were entered into the Google Play Store search engine. Apps were assessed using the following quality indicators: accountability, interactivity, self-help score (the potential of smartphone apps to help users in daily life), and evidence-based content quality. The Brief DISCERN score and the criteria of the "Health on the Net" label were also used as content quality indicators as well as the number of downloads. Of 247 apps identified, 52 met all inclusion criteria. The content quality and self-help scores of these PD apps were poor. None of the assessed indicators were associated with payment status or number of downloads. Multiple linear regressions showed that the Brief DISCERN score significantly predicted the content quality and self-help scores. Poor content quality and self-help scores of PD smartphone apps highlight the gap between their technological potential and the overall quality of available products.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.3389/fpsyt.2015.00096

Cites

20 of 20 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The emerging field of m-mental health is in its infancy as many available apps lack scientific evidence or show poor content quality.

    “However, the emerging field of m-mental health can still be described as being in its infancy as many available apps lack scientific evidence (Donker et al., 2013; Sucala et al., 2017) or show poor content quality (Singer et al., 2015).”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 44

  1. [1]Kessler RC Chiu WT Jin R Ruscio AM Shear K Walters EE. The epidemiology of panic attacks, panic disorder, and agoraphobia in the National Comorbidity Survey Replication. Arch Gen Psychiatry (2006) 63(4): 415– 24. 10.1001/archpsyc.63.4.415 16585471 PMC1958997 · DOI · Paper page
  2. [3]Association AP Practice Guideline for the Treatment of Patients with Panic Disorder. Second edition ed Washington, DC: American Psychiatric Association (2009).
  3. [4]Schubert JR Coles ME Heimberg RG Weiss BD. Disseminating treatment for anxiety disorders step 2: peer recommendations to seek help. J Anxiety Disord (2014) 28(7): 712– 6. 10.1016/j.janxdis.2014.07.010 25145571 PMC4160353 · DOI
  4. [9]Cortez NG Cohen IG Kesselheim AS. FDA regulation of mobile health technologies. N Engl J Med (2014) 371(4): 372– 9. 10.1056/NEJMhle1403384 25054722 · DOI
  5. [10]Codyre P. Will an app fill the gap? Innovative technology to provide point-of-care information. Front Public Health (2014) 2: 9. 10.3389/fpubh.2014.00009 24551835 PMC3914210 · DOI
  6. [11]Becker S Miron-Shatz T Schumacher N Krocza J Diamantidis C Albrecht UV. mHealth 2.0: experiences, possibilities, and perspectives. JMIR mHealth uHealth (2014) 2(2): e24. 10.2196/mhealth.3328 25099752 PMC4114478 · DOI · Paper page
  7. [13]FDA. FDA issues Final Guidance on Mobile Medical Apps. (2013). Available from: http://www.fda.gov/NewsEvents/Newsroom/PressAnnouncements/ucm369431.htm 24358515
  8. [14]Abroms LC Lee Westmaas J Bontemps-Jones J Ramani R Mellerson J. A content analysis of popular smartphone apps for smoking cessation. Am J Prev Med (2013) 45(6): 732– 6. 10.1016/j.amepre.2013.07.008 24237915 PMC3836190 · DOI
  9. [15]Abroms LC Padmanabhan N Thaweethai L Phillips T. iPhone apps for smoking cessation: a content analysis. Am J Prev Med (2011) 40(3): 279– 85. 10.1016/j.amepre.2010.10.032 21335258 PMC3395318 · DOI · Paper page
  10. [16]Breton ER Fuemmeler BF Abroms LC. Weight loss-there is an app for that! but does it adhere to evidence-informed practices? Transl Behav Med (2011) 1(4): 523– 9. 10.1007/s13142-011-0076-5 24073074 PMC3717669 · DOI · Paper page
  11. [17]Cohn AM Hunter-Reel D Hagman BT Mitchell J. Promoting behavior change from alcohol use through mobile technology: the future of ecological momentary assessment. Alcohol Clin Exp Res (2011) 35(12): 2209– 15. 10.1111/j.1530-0277.2011.01571.x 21689119 PMC3221771 · DOI
  12. [18]Choi J Noh GY Park DJ. Smoking cessation apps for smartphones: content analysis with the self-determination theory. J Med Internet Res (2014) 16(2): e44. 10.2196/jmir.3061 24521881 PMC3936270 · DOI
  13. [20]Bennett ME Toffey K Dickerson F Himelhoch S Katsafanas E Savage CLA Review of android apps for smoking cessation. J Smok Cessat (2014). 10.1017/jsc.2014.1 · DOI
  14. [21]Schoffman DE Turner-McGrievy G Jones SJ Wilcox S. Mobile apps for pediatric obesity prevention and treatment, healthy eating, and physical activity promotion: just fun and games? Transl Behav Med (2013) 3(3): 320– 5. 10.1007/s13142-013-0206-3 24073184 PMC3771006 · DOI
  15. [22]Direito A Dale LP Shields E Dobson R Whittaker R Maddison R. Do physical activity and dietary smartphone applications incorporate evidence-based behaviour change techniques? BMC Public Health (2014) 14: 646. 10.1186/1471-2458-14-646 24965805 PMC4080693 · DOI
  16. [24]Azar KM Lesser LI Laing BY Stephens J Aurora MS Burke LE Mobile applications for weight management: theory-based content analysis. Am J Prev Med (2013) 45(5): 583– 9. 10.1016/j.amepre.2013.07.005 24139771 · DOI · Paper page
  17. [25]Conroy MB Yang K Elci OU Gabriel KP Styn MA Wang J Physical activity self-monitoring and weight loss: 6-month results of the SMART trial. Med Sci Sports Exerc (2011) 43(8): 1568– 74. 10.1249/MSS.0b013e31820b9395 21200337 PMC4266405 · DOI
  18. [26]Conroy DE Yang CH Maher JP. Behavior change techniques in top-ranked mobile apps for physical activity. Am J Prev Med (2014) 46(6): 649– 52. 10.1016/j.amepre.2014.01.010 24842742 · DOI
  19. [28]Breland JY Yeh VM Yu J. Adherence to evidence-based guidelines among diabetes self-management apps. Transl Behav Med (2013) 3(3): 277– 86. 10.1007/s13142-013-0205-4 24073179 PMC3771007 · DOI · Paper page
  20. [29]Demidowich AP Lu K Tamler R Bloomgarden Z. An evaluation of diabetes self-management applications for android smartphones. J Telemed Telecare (2012) 18(4): 235– 8. 10.1258/jtt.2012.111002 22604278 · DOI
  21. [30]Huckvale K Car M Morrison C Car J. Apps for asthma self-management: a systematic assessment of content and tools. BMC Med (2012) 10: 144. 10.1186/1741-7015-10-144 23171675 PMC3523082 · DOI
  22. [31]Eng DS Lee JM. The promise and peril of mobile health applications for diabetes and endocrinology. Pediatr Diabetes (2013) 14(4): 231– 8. 10.1111/pedi.12034 23627878 PMC3837694 · DOI
  23. [32]Robustillo Cortes Mde L Cantudo Cuenca MR Morillo Verdugo R Calvo Cidoncha E. High quantity but limited quality in healthcare applications intended for HIV-infected patients. Telemed J E Health (2014) 20(8): 729– 35. 10.1089/tmj.2013.0262 24849001 · DOI
  24. [33]Mobasheri MH Johnston M King D Leff D Thiruchelvam P Darzi A. Smartphone breast applications – what’s the evidence? Breast (2014) 23(5): 683– 9. 10.1016/j.breast.2014.07.006 25153432 · DOI · Paper page
  25. [35]Pandher PS Bhullar KK. Smartphone applications for seizure management. Health Informatics J (2014). 10.1177/1460458214540906 25038202 · DOI
  26. [36]Behar J Roebuck A Domingos JS Gederi E Clifford GD. A review of current sleep screening applications for smartphones. Physiol Meas (2013) 34(7): R29– 46. 10.1088/0967-3334/34/7/R29 23771214 · DOI
  27. [39]Morel V Chatton A Cochand S Zullino D Khazaal Y. Quality of web-based information on bipolar disorder. J Affect Disord (2008) 110(3): 265– 9. 10.1016/j.jad.2008.01.007 18280578 · DOI
  28. [40]Zermatten A Khazaal Y Coquard O Chatton A Bondolfi G. Quality of web-based information on depression. Depress Anxiety (2010) 27(9): 852– 8. 10.1002/da.20665 20099271 · DOI
  29. [41]Klila H Chatton A Zermatten A Khan R Preisig M Khazaal Y. Quality of web-based information on obsessive compulsive disorder. Neuropsychiatr Dis Treat (2013) 9: 1717– 23. 10.2147/NDT.S49645 24235835 PMC3821751 · DOI
  30. [42]Khazaal Y Fernandez S Cochand S Reboh I Zullino D. Quality of web-based information on social phobia: a cross-sectional study. Depress Anxiety (2008) 25(5): 461– 5. 10.1002/da.20381 17960640 · DOI
  31. [43]Khazaal Y Chatton A Cochand S Jermann F Osiek C Bondolfi G Quality of web-based information on pathological gambling. J Gambl Stud (2008) 24(3): 357– 66. 10.1007/s10899-008-9095-7 18373182 · DOI
  32. [44]Khazaal Y Chatton A Zullino D Khan R. HON label and DISCERN as content quality indicators of health-related websites. Psychiatr Q (2012) 83(1): 15– 27. 10.1007/s11126-011-9179-x 21547515 · DOI
  33. [46]Chan DS Willicombe A Reid TD Beaton C Arnold D Ward J Relative quality of internet-derived gastrointestinal cancer information. J Cancer Educ (2012) 27(4): 676– 9. 10.1007/s13187-012-0408-2 22918796 · DOI
  34. [49]Carlbring P Andersson G Kaldo V. State-of-the-art treatment via the internet: an optimistic vision of the future. Cogn Behav Ther (2011) 40(2): 79– 81. 10.1080/16506073.2011.575591 25155811 · DOI
  35. [50]Hadjistavropoulos HD Pugh NE Nugent MM Hesser H Andersson G Ivanov M Therapist-assisted internet-delivered cognitive behavior therapy for depression and anxiety: translating evidence into clinical practice. J Anxiety Disord (2014) 28(8): 884– 93. 10.1016/j.janxdis.2014.09.018 25445078 · DOI
  36. [54]Eysenbach G Kohler C. How do consumers search for and appraise health information on the world wide web? qualitative study using focus groups, usability tests, and in-depth interviews. BMJ (2002) 324(7337): 573– 7. 10.1136/bmj.324.7337.573 11884321 PMC78994 · DOI
  37. [55]Boyer C Selby M Scherrer JR Appel RD. The health on the net code of conduct for medical and health websites. Comput Biol Med (1998) 28(5): 603– 10. 10.1016/S0010-4825(98)00037-7 9861515 · DOI
  38. [56]Khazaal Y Chatton A Cochand S Coquard O Fernandez S Khan R Brief DISCERN, six questions for the evaluation of evidence-based content of health-related websites. Patient Educ Couns (2009) 77(1): 33– 7. 10.1016/j.pec.2009.02.016 19372023 · DOI
  39. [57]Silberg WM Lundberg GD Musacchio RA. Assessing, controlling, and assuring the quality of medical information on the internet: caveant lector et viewor – let the reader and viewer beware. JAMA (1997) 277(15): 1244– 5. 10.1001/jama.1997.03540390074039 9103351 · DOI
  40. [58]Abbott VP. Web page quality: can we measure it and what do we find? A report of exploratory findings. J Public Health Med (2000) 22(2): 191– 7. 10.1093/pubmed/22.2.191 10912558 · DOI
  41. [59]eEurope. Quality criteria for health related websites. J Med Internet Res (2002) 4(3): E15. 10.2196/jmir.4.3.e15 12554546 PMC1761945 · DOI
  42. [60]Charnock D Shepperd S. Learning to DISCERN online: applying an appraisal tool to health websites in a workshop setting. Health Educ Res (2004) 19(4): 440– 6. 10.1093/her/cyg046 15155597 · DOI
  43. [65]Khazaal Y Chatton A Cochand S Zullino D. Quality of web-based information on cocaine addiction. Patient Educ Couns (2008) 72(2): 336– 41. 10.1016/j.pec.2008.03.002 18423952 · DOI
  44. [66]Griffiths KM Christensen H. Quality of web based information on treatment of depression: cross sectional survey. BMJ (2000) 321(7275): 1511– 5. 10.1136/bmj.321.7275.1511 11118181 PMC27555 · DOI

Cited by

Sorted by citations

Authors
Van Singer, M., Chatton, A., & Khazaal, Y.
Affiliations
  • University Hospital of Geneva (CH)
  • University of Geneva (CH)
Corresponding author
Khazaal, Yasser
Venue
Frontiers in Psychiatry
Published
2015-07-14
Volume
6
Pages
96-96
ISSN
1664-0640 (ISSN-L)
OpenAlex
W1597488657
Cited by
43
References
20
Citations by year
2026: 1 · 2024: 2 · 2023: 4 · 2021: 8 · 2020: 4 · 2019: 6 · 2018: 6 · 2017: 4 · 2016: 3 · 2015: 5
FWCI
9.72
Type
journal article
Language
en
Open access
Licence
cc-by
Locations
  • Frontiers in Psychiatry (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
Topics
  • Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
  • Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
  • Health Sciences › Health Professions › General Health Professions › Health Literacy and Information Accessibility
Keywords
panic disorder, mobile application, app quality, mobile health, evidence-based content, app downloads

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review