The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index; 11 of the 15 sources its claims cite were checked for support.
Smartphone and Mobile Health Apps for Tinnitus: Systematic Identification, Analysis, and Assessment
Open accessPublished version of a preprint
Abstract
Background: Modern smartphones contain sophisticated high-end hardware features, offering high computational capabilities at extremely manageable costs and have undoubtedly become an integral part in users' daily life. Additionally, smartphones offer a well-established ecosystem that is easily discoverable and accessible via the marketplaces of differing mobile platforms, thus encouraging the development of many smartphone apps. Such apps are not exclusively used for entertainment purposes but are also commonplace in health care and medical use. A variety of those health and medical apps exist within the context of tinnitus, a phantom sound perception in the absence of any physical external source. Objective: In this paper, we shed light on existing smartphone apps addressing tinnitus by providing an up-to-date overview. Methods: Based on PRISMA guidelines, we systematically searched and identified existing smartphone apps on the most prominent app markets, namely Google Play Store and Apple App Store. In addition, we applied the Mobile App Rating Scale (MARS) to evaluate and assess the apps in terms of their general quality and in-depth user experience. Results: Our systematic search and screening of smartphone apps yielded a total of 34 apps (34 Android apps, 26 iOS apps). The mean MARS scores (out of 5) ranged between 2.65-4.60. The Tinnitus Peace smartphone app had the lowest score (mean 2.65, SD 0.20), and Sanvello-Stress and Anxiety Help had the highest MARS score (mean 4.60, SD 0.10). The interrater agreement was substantial (Fleiss κ=0.74), the internal consistency was excellent (Cronbach α=.95), and the interrater reliability was found to be both high and excellent-Guttman λ6=0.94 and intraclass correlation, ICC(2,k) 0.94 (95% CI 0.91-0.97), respectively. Conclusions: This work demonstrated that there exists a plethora of smartphone apps for tinnitus. All of the apps received MARS scores higher than 2, suggesting that they all have some technical functional value. However, nearly all identified apps were lacking in terms of scientific evidence, suggesting the need for stringent clinical validation of smartphone apps in future. To the best of our knowledge, this work is the first to systematically identify and evaluate smartphone apps within the context of tinnitus. © Muntazir Mehdi, Michael Stach, Constanze Riha, Patrick Neff, Albi Dode, Rüdiger Pryss, Winfried Schlee, Manfred Reichert, Franz J Hauck.
Overview
CoChat Summary
TL;DR
This systematic review identified and evaluated smartphone apps for tinnitus across Google Play and the Apple App Store using MARS. It found 34 apps, all scoring above 2 on MARS, but only 7 were evidence-based and most lacked scientific validation.
Key findings
- The systematic search yielded 675 apps initially (334 from Google Play, 341 from the Apple App Store), 311 after removing duplicates, 29 after title/description screening, and 34 apps after ancillary searches; all 34 were available on Android and 26 were also available on iOS.
- The 34 apps had MARS objective scores ranging from 2.65 to 4.60; the lowest mean score was Tinnitus Peace (2.65, SD 0.20) and the highest was Sanvello—Stress and Anxiety Help (4.60, SD 0.10).
- The authors report that only 7 apps were evidence-based: Tinnitus Therapy (Lite), ReSound Relief, SimplyNoise, Audio Notch, Wysa, Woebot, and MindShift.
- App types were divided into tinnitus therapy (24 apps) and cognitive behavior therapy (10 apps); within tinnitus therapy, 18 focused on sound therapy, including masking (7), habituation (4), neuromodulation (4), and distraction (3).
Methods
- Systematic review following PRISMA guidelines; searched Google Play Store and Apple App Store, then used additional Google searches and three third-party app libraries (NHS Apps Library, AppScript Library, MyHealthApps Cochrane Library).
- Included smartphone apps with English title/description that addressed tinnitus, CBT, or self-help; excluded apps with missing descriptions or misleading claims.
- Four raters from tinnitus and mobile app development backgrounds evaluated the identified apps with MARS; the paper also calculated Fleiss κ, Cronbach α, Guttman λ6, and ICC(2,k).
Limitations
- The paper states that the search was restricted to only 2 app stores, so relevant apps in other stores such as Amazon and Samsung may have been missed.
- The app inclusion process relied on inspecting app descriptions and a few top-rated comments, which the paper says is subjective and depends heavily on the inspector’s domain knowledge.
- Evident from the text: the review’s app list is time-sensitive because app availability, versions, and ratings change over time, and the paper itself notes version differences when comparing its MARS scores with earlier studies.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
8 Valid · 1 Not valid · 1 Not checked · 40 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“To the best of our knowledge, this work is the first to systematically identify and evaluate smartphone apps within the context of tinnitus.”
- Also stated in: § Literature · plain
“Specifically, in terms of the assessment of tinnitus-related smartphone apps using MARS, the reviews by Sereda et al [38], which were further extended and repeated by Smith et al [63], are the only closely related works in relation to this work.”
§ Smartphone and Mobile Health Apps for Tinnitus: Systematic Identification, Analysis, and Assessment > Abstract > Conclusions
What the sources say
- Partly supportedcites [38] sourceExperimental — accuracy not yet measured
In Strengths and Limitations, the paper calls itself the first review of tinnitus-management apps and the first to assess their quality using the MARS scale. It also explicitly says it used a bottom-up approach rather than a systematic search of app stores, so the claim that it systematically identified apps overstates the source. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites [63] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Literature · plain
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Specifically, in terms of the assessment of tinnitus-related smartphone apps using MARS, the reviews by Sereda et al [38], which were further extended and repeated by Smith et al [63], are the only closely related works in relation to this work.”
§ Smartphone and Mobile Health Apps for Tinnitus: Systematic Identification, Analysis, and Assessment > Discussion > Literature
What the sources say
- Supportedcites [38] source
The Methods section says Sereda et al. assessed tinnitus-management apps using MARS. The Strengths and Limitations section describes it as the first study to assess the quality of such apps with MARS, supporting its identification as a closely related review. (LLM, conf=0.91)
- Not checked — no full text of the sourcecites [63] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Generally, health care apps have been exhaustively discussed and reviewed in the literature [58]; however, the number of papers that focus on reviewing and evaluating tinnitus-related smartphone apps is underwhelming.”
§ Smartphone and Mobile Health Apps for Tinnitus: Systematic Identification, Analysis, and Assessment > Discussion > Literature
What the sources say
- Partly supportedcites [58] sourceExperimental — accuracy not yet measured
The Methods and Results describe a systematic review of 55 articles covering 83 healthcare smartphone applications, supporting the citation’s point that such apps have been reviewed in the literature. But the Limitations say most available apps had not been discussed in medical literature, so “exhaustively discussed” overstates the source. The sentence’s separate observation about the scarcity of tinnitus-app papers is not attributed to this citation. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The interrater agreement, as demonstrated by Fleiss κ, was merely moderate for subjective, functionality, and aesthetics scores.”
§ Smartphone and Mobile Health Apps for Tinnitus: Systematic Identification, Analysis, and Assessment > Discussion > Principal Findings The aim of this study was to systematically identify smartphone apps within the context of tinnitus. The identification process yielded a total of 34 commercially available tinnitus smartphone apps, which were divided in 2 categories: tinnitus therapy (24 apps) and cognitive behavior therapy (10 apps). In an added step, we evaluated the identified apps using MARS. From MARS objective scores (Figure 3), first, we can see that all 34 identified apps have MARS scores higher than 2, indicating that most of these apps provide some level of user experience and that they all have some functional value. Furthermore, the MARS rating process discovered that only 7 apps—Tinnitus Therapy (Lite), ReSound Relief, SimplyNoise, Audio Notch, Wysa, Woebot, and MindShift—out of 34 apps scored in the evidence-based subitem of the information category, suggesting a lack of clinical validation for most of the apps. Furthermore, the mean MARS scores (Figure 3) of all 4 raters ranged from 2.65-4.60, with Tinnitus Peace having the lowest mean score (mean 2.65, SD 0.20) and Sanvello—Stress and Anxiety Help having the highest mean score (mean 4.60, SD 0.10). On the individual-rater level, Tinnitus Notch had the lowest (score: 2.39), while, Sanvello—Stress and Anxiety Help had the highest (score: 4.69). Furthermore, some apps were rated better in comparison to the others. For instance, Beltone Tinnitus Calmer, Resound Relief, Sanvello—Stress and Anxiety Help, as well as Woebot and Youper received very good ratings, whereas Tinnitus Help, Tinnitus Notch, and Tinnitus Peace were the worst of all. The mean subjective scores presented in Figure 4 ranged from 1.44-4.69, with Relax Noise 3 having the lowest scores (mean 1.44) and Beltone Tinnitus Calmer, Woebot, and Youper having the highest scores (mean 4.69). From Figure 4, naturally, the range of the subjective scores was wider than those of the objective scores; however, it is notable that the mean subjective results were more or less in line with the mean objective results. Values from the 4 psychometric measures (Table 2) confirm the reliability and validity of our MARS rating procedures, especially for measures testing internal consistency and reliability (>0.89). The interrater agreement, as demonstrated by Fleiss κ, was merely moderate for subjective, functionality, and aesthetics scores. This is noteworthy and may be related to individual differences in the raters with regards to their backgrounds. In any case, from Figure 3, Figure 4, and Figure 5, it is evident that our rating procedures generally produced valid, reliable, and thus viable results. Interestingly, the expert ratings from both information platforms (PsyberGuide and ORCHA) and the user ratings from the app stores varied, sometimes considerably. For example, What’s Up? A Mental Health App received high ratings from its users in the app stores (Google Play Store: 4.4; Apple App Store: 4.6), whereas both expert ratings were considerably lower (PsyberGuide: credibility: 1.43, transparency: unacceptable, user experience: 3.38; ORCHA: 51%). Another app whose app store rating differed significantly from its ORCHA rating is Beltone Tinnitus Calmer (Google Play Store: 4.7; Apple App Store: 5.0; ORCHA: 54%). The ORCHA score was moderate as a result of a moderate rating for data privacy and clinical assurance; the apps hadn’t been rated by PsyberGuide. These examples illustrate that an independent rating with validated instruments is crucial for the informed selection of health apps.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“From Figure 5, it can be seen that the MARS scores in our work were more in line with those of PsyberGuide’s user experience score.”
§ Smartphone and Mobile Health Apps for Tinnitus: Systematic Identification, Analysis, and Assessment > Discussion > Principal Findings The aim of this study was to systematically identify smartphone apps within the context of tinnitus. The identification process yielded a total of 34 commercially available tinnitus smartphone apps, which were divided in 2 categories: tinnitus therapy (24 apps) and cognitive behavior therapy (10 apps). In an added step, we evaluated the identified apps using MARS. From MARS objective scores (Figure 3), first, we can see that all 34 identified apps have MARS scores higher than 2, indicating that most of these apps provide some level of user experience and that they all have some functional value. Furthermore, the MARS rating process discovered that only 7 apps—Tinnitus Therapy (Lite), ReSound Relief, SimplyNoise, Audio Notch, Wysa, Woebot, and MindShift—out of 34 apps scored in the evidence-based subitem of the information category, suggesting a lack of clinical validation for most of the apps. Furthermore, the mean MARS scores (Figure 3) of all 4 raters ranged from 2.65-4.60, with Tinnitus Peace having the lowest mean score (mean 2.65, SD 0.20) and Sanvello—Stress and Anxiety Help having the highest mean score (mean 4.60, SD 0.10). On the individual-rater level, Tinnitus Notch had the lowest (score: 2.39), while, Sanvello—Stress and Anxiety Help had the highest (score: 4.69). Furthermore, some apps were rated better in comparison to the others. For instance, Beltone Tinnitus Calmer, Resound Relief, Sanvello—Stress and Anxiety Help, as well as Woebot and Youper received very good ratings, whereas Tinnitus Help, Tinnitus Notch, and Tinnitus Peace were the worst of all. The mean subjective scores presented in Figure 4 ranged from 1.44-4.69, with Relax Noise 3 having the lowest scores (mean 1.44) and Beltone Tinnitus Calmer, Woebot, and Youper having the highest scores (mean 4.69). From Figure 4, naturally, the range of the subjective scores was wider than those of the objective scores; however, it is notable that the mean subjective results were more or less in line with the mean objective results. Values from the 4 psychometric measures (Table 2) confirm the reliability and validity of our MARS rating procedures, especially for measures testing internal consistency and reliability (>0.89). The interrater agreement, as demonstrated by Fleiss κ, was merely moderate for subjective, functionality, and aesthetics scores. This is noteworthy and may be related to individual differences in the raters with regards to their backgrounds. In any case, from Figure 3, Figure 4, and Figure 5, it is evident that our rating procedures generally produced valid, reliable, and thus viable results. Interestingly, the expert ratings from both information platforms (PsyberGuide and ORCHA) and the user ratings from the app stores varied, sometimes considerably. For example, What’s Up? A Mental Health App received high ratings from its users in the app stores (Google Play Store: 4.4; Apple App Store: 4.6), whereas both expert ratings were considerably lower (PsyberGuide: credibility: 1.43, transparency: unacceptable, user experience: 3.38; ORCHA: 51%). Another app whose app store rating differed significantly from its ORCHA rating is Beltone Tinnitus Calmer (Google Play Store: 4.7; Apple App Store: 5.0; ORCHA: 54%). The ORCHA score was moderate as a result of a moderate rating for data privacy and clinical assurance; the apps hadn’t been rated by PsyberGuide. These examples illustrate that an independent rating with validated instruments is crucial for the informed selection of health apps.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
24 more claims
Create a free account to see all 50 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 6
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · cited 1×
“In order to evaluate MARS scores from the 4 raters, we calculated the interrater agreement based on Fleiss κ [46], the internal consistency was based on Cronbach α [47], and the interrater reliability was based on Guttman λ 6 [48] as well as intraclass correlation—ICC(2,k) with 95% CI [49].”
MethodA guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709 · cited 1×
“In order to evaluate MARS scores from the 4 raters, we calculated the interrater agreement based on Fleiss κ [46], the internal consistency was based on Cronbach α [47], and the interrater reliability was based on Guttman λ 6 [48] as well as intraclass correlation—ICC(2,k) with 95% CI [49].”
MethodMaking sense of cronbach’s alpha.
Tavakol, M., & Dennick, R. (2011) · International Journal of Medical Education · doi:10.5116/ijme.4dfb.8dfd · Cited by 15,126 · cited 1×
“In order to evaluate MARS scores from the 4 raters, we calculated the interrater agreement based on Fleiss κ [46], the internal consistency was based on Cronbach α [47], and the interrater reliability was based on Guttman λ 6 [48] as well as intraclass correlation—ICC(2,k) with 95% CI [49].”
MethodPreferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2010) · International Journal of Surgery · doi:10.1016/j.ijsu.2010.02.007 · Cited by 12,156 · cited 1×
“First, based on the PRISMA guidelines [39], we systematically searched, screened, and identified smartphone apps aimed at assisting patients with tinnitus.”
MethodMobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · cited 2×
“Nonetheless, among them the Mobile Application Rating Scale (MARS) [30] is a reliable and valid instrument for the quality assessment of smartphone-based medical apps or mHealth apps.”
BackgroundMethodBaguley, D., McFerran, D., & Hall, D. (2013) · The Lancet · doi:10.1016/s0140-6736(13)60142-7 · Cited by 1,245
A Systematic Review of Healthcare Applications for Smartphones
Mosa, A. S. M., Yoo, I., & Sheets, L. (2012) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-12-67 · Cited by 1,184 · cited 1×
“Generally, health care apps have been exhaustively discussed and reviewed in the literature [58]; however, the number of papers that focus on reviewing and evaluating tinnitus-related smartphone apps is underwhelming.”
BackgroundA Basis for Analyzing Test-Retest Reliability
Guttman, L. (1945) · Psychometrika · doi:10.1007/bf02288892 · Cited by 1,122
Mobile apps in trauma education
Research, N. (2023) · PubMed · doi:10.57945/manara.23966214 · Cited by 844
Research works printed but not linked: 3
- Ventola, CL, 2014, P T, 39, 356
- Bromwich, MA, 2008, J Otolaryngol Head Neck Surg, 37, 380
- BeauvaisBRialleVSablierJMyvigi: An android application to detect fall and wandering2012In: Proceedings of the sixth International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies, UBICOMM2012Barcelona, Spain156160
Cited by
S3 Guideline: Chronic Tinnitus
Mazurek, B., Hesse, G., Sattel, H. C., Kratzsch, V., Lahmann, C., & Dobel, C. (2022) · HNO · doi:10.1007/s00106-022-01207-4 · Cited by 77
“[313] identified and evaluated 34 systematically recorded apps for tinnitus.”
BackgroundLoneliness and Social Isolation Detection Using Passive Sensing Techniques: Scoping Review
Qirtas, M. M., Zafeiridi, E., Pesch, D., & White, E. B. (2022) · JMIR mhealth and uhealth · doi:10.2196/34638 · Cited by 58
“In addition to their primary function as communication devices, modern smartphones provide a plethora of capabilities [24].”
BackgroundMethodSchoisswohl, S., Langguth, B., Schecklmann, M., Bernal-Robledano, A., Boecking, B., Cederroth, C. R., Chalanouli, D., Cima, R. F. F., Denys, S., Dettling-Papargyris, J., et al. (2021) · Trials · doi:10.1186/s13063-021-05835-z · Cited by 34
Self-citationEffectiveness of telerehabilitation interventions for self-management of tinnitus: systematic review
Demoen, S., Chalimourdas, A., Timmermans, A., Van Rompaey, V., Vanderveken, O. M., Jacquemin, L., Schlee, W., Marneffe, W., Luyten, J., Gilles, A., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/39076 · Cited by 24
“For example, in the last decade, computer platforms and smartphone apps increasingly found their way into the treatment of tinnitus, most often in the form of CBT and sound therapy [42,43].”
InfluentialSelf-citationQuality assessment of mHealth apps: a scoping review
Giebel, G. D., Speckemeier, C., Schrader, N. F., Abels, C., Plescher, F., Hillerich, V., Wiedemann, D., Börchers, K., Wasem, J., Blase, N., et al. (2024) · Frontiers in Health Services · doi:10.3389/frhs.2024.1372871 · Cited by 36
Metadata
- Authors
- Mehdi, M., Stach, M., Riha, C., Neff, P., Dode, A., Pryss, R., Schlee, W., Reichert, M., & Hauck, F. J.
- Affiliations
- Universität Ulm (DE)
- University of Zurich (CH)
- University of Würzburg (DE)
- Corresponding author
- Hauck, Franz J
- ORCID
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2020-08-18
- Volume
- 8
- Issue
- 8
- Pages
- e21767
- ISSN
- 2291-5222 (ISSN-L)
- PMC
- PMC7463412
- OpenAlex
- W3045997149
- Semantic Scholar
- 40d356be75da30c61ddb690c1262e51da4e9c833
- Cited by
- 40
- References
- 58
- Citations by year
- 2026: 6 · 2025: 5 · 2024: 8 · 2023: 5 · 2022: 9 · 2021: 6 · 2020: 1
- FWCI
- 5.48
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR mhealth and uhealth (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- European Commission (HORIZON2020)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Life Sciences › Neuroscience › Sensory Systems › Hearing, Cochlea, Tinnitus, Genetics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- tinnitus, mobile application, mobile health apps, app quality assessment, Mobile App Rating Scale, app store search, Android application, iOS app
- MeSH terms
- Smartphone, Humans, Tinnitus, Reproducibility of Results, Telemedicine, Ecosystem, Mobile Applications, Acceptance and Commitment Therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.