The DOI matches its Crossref record; 60 of the 60 references it cites were found in a registry or an index; 11 of the 15 sources its claims cite were checked for support.
Smartphone and Mobile Health Apps for Tinnitus: Systematic Identification, Analysis, and Assessment
Open accessPublished version of a preprint
Abstract
Background: Modern smartphones contain sophisticated high-end hardware features, offering high computational capabilities at extremely manageable costs and have undoubtedly become an integral part in users' daily life. Additionally, smartphones offer a well-established ecosystem that is easily discoverable and accessible via the marketplaces of differing mobile platforms, thus encouraging the development of many smartphone apps. Such apps are not exclusively used for entertainment purposes but are also commonplace in health care and medical use. A variety of those health and medical apps exist within the context of tinnitus, a phantom sound perception in the absence of any physical external source. Objective: In this paper, we shed light on existing smartphone apps addressing tinnitus by providing an up-to-date overview. Methods: Based on PRISMA guidelines, we systematically searched and identified existing smartphone apps on the most prominent app markets, namely Google Play Store and Apple App Store. In addition, we applied the Mobile App Rating Scale (MARS) to evaluate and assess the apps in terms of their general quality and in-depth user experience. Results: Our systematic search and screening of smartphone apps yielded a total of 34 apps (34 Android apps, 26 iOS apps). The mean MARS scores (out of 5) ranged between 2.65-4.60. The Tinnitus Peace smartphone app had the lowest score (mean 2.65, SD 0.20), and Sanvello-Stress and Anxiety Help had the highest MARS score (mean 4.60, SD 0.10). The interrater agreement was substantial (Fleiss κ=0.74), the internal consistency was excellent (Cronbach α=.95), and the interrater reliability was found to be both high and excellent-Guttman λ6=0.94 and intraclass correlation, ICC(2,k) 0.94 (95% CI 0.91-0.97), respectively. Conclusions: This work demonstrated that there exists a plethora of smartphone apps for tinnitus. All of the apps received MARS scores higher than 2, suggesting that they all have some technical functional value. However, nearly all identified apps were lacking in terms of scientific evidence, suggesting the need for stringent clinical validation of smartphone apps in future. To the best of our knowledge, this work is the first to systematically identify and evaluate smartphone apps within the context of tinnitus. © Muntazir Mehdi, Michael Stach, Constanze Riha, Patrick Neff, Albi Dode, Rüdiger Pryss, Winfried Schlee, Manfred Reichert, Franz J Hauck.
Overview
CoChat Summary
TL;DR
This systematic review identified and evaluated smartphone apps for tinnitus across Google Play and the Apple App Store using MARS. It found 34 apps, all scoring above 2 on MARS, but only 7 were evidence-based and most lacked scientific validation.
Key findings
- The systematic search yielded 675 apps initially (334 from Google Play, 341 from the Apple App Store), 311 after removing duplicates, 29 after title/description screening, and 34 apps after ancillary searches; all 34 were available on Android and 26 were also available on iOS.
- The 34 apps had MARS objective scores ranging from 2.65 to 4.60; the lowest mean score was Tinnitus Peace (2.65, SD 0.20) and the highest was Sanvello—Stress and Anxiety Help (4.60, SD 0.10).
- The authors report that only 7 apps were evidence-based: Tinnitus Therapy (Lite), ReSound Relief, SimplyNoise, Audio Notch, Wysa, Woebot, and MindShift.
- App types were divided into tinnitus therapy (24 apps) and cognitive behavior therapy (10 apps); within tinnitus therapy, 18 focused on sound therapy, including masking (7), habituation (4), neuromodulation (4), and distraction (3).
Methods
- Systematic review following PRISMA guidelines; searched Google Play Store and Apple App Store, then used additional Google searches and three third-party app libraries (NHS Apps Library, AppScript Library, MyHealthApps Cochrane Library).
- Included smartphone apps with English title/description that addressed tinnitus, CBT, or self-help; excluded apps with missing descriptions or misleading claims.
- Four raters from tinnitus and mobile app development backgrounds evaluated the identified apps with MARS; the paper also calculated Fleiss κ, Cronbach α, Guttman λ6, and ICC(2,k).
Limitations
- The paper states that the search was restricted to only 2 app stores, so relevant apps in other stores such as Amazon and Samsung may have been missed.
- The app inclusion process relied on inspecting app descriptions and a few top-rated comments, which the paper says is subjective and depends heavily on the inspector’s domain knowledge.
- Evident from the text: the review’s app list is time-sensitive because app availability, versions, and ratings change over time, and the paper itself notes version differences when comparing its MARS scores with earlier studies.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Figures





Verification
Claims the paper makes
8 Valid · 1 Not valid · 1 Not checked · 40 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“To the best of our knowledge, this work is the first to systematically identify and evaluate smartphone apps within the context of tinnitus.”
- Also stated in: § Literature · plain
“Specifically, in terms of the assessment of tinnitus-related smartphone apps using MARS, the reviews by Sereda et al [38], which were further extended and repeated by Smith et al [63], are the only closely related works in relation to this work.”
§ Smartphone and Mobile Health Apps for Tinnitus: Systematic Identification, Analysis, and Assessment > Abstract > Conclusions
What the sources say
- Partly supportedcites [38] sourceExperimental — accuracy not yet measured
In Strengths and Limitations, the paper calls itself the first review of tinnitus-management apps and the first to assess their quality using the MARS scale. It also explicitly says it used a bottom-up approach rather than a systematic search of app stores, so the claim that it systematically identified apps overstates the source. (LLM, conf=0.88)
- Not checked — no full text of the sourcecites [63] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Also stated in: § Literature · plain
The sources with a verdict support this claim; the rest weren’t checked yet, have no full text we could read, or their verdicts aren’t rated yet.
In the paper
“Specifically, in terms of the assessment of tinnitus-related smartphone apps using MARS, the reviews by Sereda et al [38], which were further extended and repeated by Smith et al [63], are the only closely related works in relation to this work.”
§ Smartphone and Mobile Health Apps for Tinnitus: Systematic Identification, Analysis, and Assessment > Discussion > Literature
What the sources say
- Supportedcites [38] source
The Methods section says Sereda et al. assessed tinnitus-management apps using MARS. The Strengths and Limitations section describes it as the first study to assess the quality of such apps with MARS, supporting its identification as a closely related review. (LLM, conf=0.91)
- Not checked — no full text of the sourcecites [63] source
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Generally, health care apps have been exhaustively discussed and reviewed in the literature [58]; however, the number of papers that focus on reviewing and evaluating tinnitus-related smartphone apps is underwhelming.”
§ Smartphone and Mobile Health Apps for Tinnitus: Systematic Identification, Analysis, and Assessment > Discussion > Literature
What the sources say
- Partly supportedcites [58] sourceExperimental — accuracy not yet measured
The Methods and Results describe a systematic review of 55 articles covering 83 healthcare smartphone applications, supporting the citation’s point that such apps have been reviewed in the literature. But the Limitations say most available apps had not been discussed in medical literature, so “exhaustively discussed” overstates the source. The sentence’s separate observation about the scarcity of tinnitus-app papers is not attributed to this citation. (LLM, conf=0.85)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Partly supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The interrater agreement, as demonstrated by Fleiss κ, was merely moderate for subjective, functionality, and aesthetics scores.”
§ Smartphone and Mobile Health Apps for Tinnitus: Systematic Identification, Analysis, and Assessment > Discussion > Principal Findings The aim of this study was to systematically identify smartphone apps within the context of tinnitus. The identification process yielded a total of 34 commercially available tinnitus smartphone apps, which were divided in 2 categories: tinnitus therapy (24 apps) and cognitive behavior therapy (10 apps). In an added step, we evaluated the identified apps using MARS. From MARS objective scores (Figure 3), first, we can see that all 34 identified apps have MARS scores higher than 2, indicating that most of these apps provide some level of user experience and that they all have some functional value. Furthermore, the MARS rating process discovered that only 7 apps—Tinnitus Therapy (Lite), ReSound Relief, SimplyNoise, Audio Notch, Wysa, Woebot, and MindShift—out of 34 apps scored in the evidence-based subitem of the information category, suggesting a lack of clinical validation for most of the apps. Furthermore, the mean MARS scores (Figure 3) of all 4 raters ranged from 2.65-4.60, with Tinnitus Peace having the lowest mean score (mean 2.65, SD 0.20) and Sanvello—Stress and Anxiety Help having the highest mean score (mean 4.60, SD 0.10). On the individual-rater level, Tinnitus Notch had the lowest (score: 2.39), while, Sanvello—Stress and Anxiety Help had the highest (score: 4.69). Furthermore, some apps were rated better in comparison to the others. For instance, Beltone Tinnitus Calmer, Resound Relief, Sanvello—Stress and Anxiety Help, as well as Woebot and Youper received very good ratings, whereas Tinnitus Help, Tinnitus Notch, and Tinnitus Peace were the worst of all. The mean subjective scores presented in Figure 4 ranged from 1.44-4.69, with Relax Noise 3 having the lowest scores (mean 1.44) and Beltone Tinnitus Calmer, Woebot, and Youper having the highest scores (mean 4.69). From Figure 4, naturally, the range of the subjective scores was wider than those of the objective scores; however, it is notable that the mean subjective results were more or less in line with the mean objective results. Values from the 4 psychometric measures (Table 2) confirm the reliability and validity of our MARS rating procedures, especially for measures testing internal consistency and reliability (>0.89). The interrater agreement, as demonstrated by Fleiss κ, was merely moderate for subjective, functionality, and aesthetics scores. This is noteworthy and may be related to individual differences in the raters with regards to their backgrounds. In any case, from Figure 3, Figure 4, and Figure 5, it is evident that our rating procedures generally produced valid, reliable, and thus viable results. Interestingly, the expert ratings from both information platforms (PsyberGuide and ORCHA) and the user ratings from the app stores varied, sometimes considerably. For example, What’s Up? A Mental Health App received high ratings from its users in the app stores (Google Play Store: 4.4; Apple App Store: 4.6), whereas both expert ratings were considerably lower (PsyberGuide: credibility: 1.43, transparency: unacceptable, user experience: 3.38; ORCHA: 51%). Another app whose app store rating differed significantly from its ORCHA rating is Beltone Tinnitus Calmer (Google Play Store: 4.7; Apple App Store: 5.0; ORCHA: 54%). The ORCHA score was moderate as a result of a moderate rating for data privacy and clinical assurance; the apps hadn’t been rated by PsyberGuide. These examples illustrate that an independent rating with validated instruments is crucial for the informed selection of health apps.
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“From Figure 5, it can be seen that the MARS scores in our work were more in line with those of PsyberGuide’s user experience score.”
§ Smartphone and Mobile Health Apps for Tinnitus: Systematic Identification, Analysis, and Assessment > Discussion > Principal Findings The aim of this study was to systematically identify smartphone apps within the context of tinnitus. The identification process yielded a total of 34 commercially available tinnitus smartphone apps, which were divided in 2 categories: tinnitus therapy (24 apps) and cognitive behavior therapy (10 apps). In an added step, we evaluated the identified apps using MARS. From MARS objective scores (Figure 3), first, we can see that all 34 identified apps have MARS scores higher than 2, indicating that most of these apps provide some level of user experience and that they all have some functional value. Furthermore, the MARS rating process discovered that only 7 apps—Tinnitus Therapy (Lite), ReSound Relief, SimplyNoise, Audio Notch, Wysa, Woebot, and MindShift—out of 34 apps scored in the evidence-based subitem of the information category, suggesting a lack of clinical validation for most of the apps. Furthermore, the mean MARS scores (Figure 3) of all 4 raters ranged from 2.65-4.60, with Tinnitus Peace having the lowest mean score (mean 2.65, SD 0.20) and Sanvello—Stress and Anxiety Help having the highest mean score (mean 4.60, SD 0.10). On the individual-rater level, Tinnitus Notch had the lowest (score: 2.39), while, Sanvello—Stress and Anxiety Help had the highest (score: 4.69). Furthermore, some apps were rated better in comparison to the others. For instance, Beltone Tinnitus Calmer, Resound Relief, Sanvello—Stress and Anxiety Help, as well as Woebot and Youper received very good ratings, whereas Tinnitus Help, Tinnitus Notch, and Tinnitus Peace were the worst of all. The mean subjective scores presented in Figure 4 ranged from 1.44-4.69, with Relax Noise 3 having the lowest scores (mean 1.44) and Beltone Tinnitus Calmer, Woebot, and Youper having the highest scores (mean 4.69). From Figure 4, naturally, the range of the subjective scores was wider than those of the objective scores; however, it is notable that the mean subjective results were more or less in line with the mean objective results. Values from the 4 psychometric measures (Table 2) confirm the reliability and validity of our MARS rating procedures, especially for measures testing internal consistency and reliability (>0.89). The interrater agreement, as demonstrated by Fleiss κ, was merely moderate for subjective, functionality, and aesthetics scores. This is noteworthy and may be related to individual differences in the raters with regards to their backgrounds. In any case, from Figure 3, Figure 4, and Figure 5, it is evident that our rating procedures generally produced valid, reliable, and thus viable results. Interestingly, the expert ratings from both information platforms (PsyberGuide and ORCHA) and the user ratings from the app stores varied, sometimes considerably. For example, What’s Up? A Mental Health App received high ratings from its users in the app stores (Google Play Store: 4.4; Apple App Store: 4.6), whereas both expert ratings were considerably lower (PsyberGuide: credibility: 1.43, transparency: unacceptable, user experience: 3.38; ORCHA: 51%). Another app whose app store rating differed significantly from its ORCHA rating is Beltone Tinnitus Calmer (Google Play Store: 4.7; Apple App Store: 5.0; ORCHA: 54%). The ORCHA score was moderate as a result of a moderate rating for data privacy and clinical assurance; the apps hadn’t been rated by PsyberGuide. These examples illustrate that an independent rating with validated instruments is crucial for the informed selection of health apps.
plainstates an association- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: unclear — It is unclear whether the paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
24 more claims
Create a free account to see all 50 claims and every source verdict.
- It may state two separate claims as one. 18
- Probably not a substantial claim. 6
Citations
Cites
Preferred Reporting Items for Systematic Reviews and Meta-Analyses: the PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., Altman, D. G., & for the PRISMA Group (2009) · BMJ · doi:10.1136/bmj.b2535 · Cited by 83,823
The Measurement of Observer Agreement for Categorical Data
Landis, J. R., & Koch, G. G. (1977) · Biometrics · doi:10.2307/2529310 · Cited by 81,148 · cited 1×
“In order to evaluate MARS scores from the 4 raters, we calculated the interrater agreement based on Fleiss κ [46], the internal consistency was based on Cronbach α [47], and the interrater reliability was based on Guttman λ 6 [48] as well as intraclass correlation—ICC(2,k) with 95% CI [49].”
MethodA guideline of selecting and reporting intraclass correlation coefficients for reliability research
Koo, T. K., & Li, M. Y. (2016) · Journal of Chiropractic Medicine · doi:10.1016/j.jcm.2016.02.012 · Cited by 31,709 · cited 1×
“In order to evaluate MARS scores from the 4 raters, we calculated the interrater agreement based on Fleiss κ [46], the internal consistency was based on Cronbach α [47], and the interrater reliability was based on Guttman λ 6 [48] as well as intraclass correlation—ICC(2,k) with 95% CI [49].”
MethodMaking sense of cronbach’s alpha.
Tavakol, M., & Dennick, R. (2011) · International Journal of Medical Education · doi:10.5116/ijme.4dfb.8dfd · Cited by 15,126 · cited 1×
“In order to evaluate MARS scores from the 4 raters, we calculated the interrater agreement based on Fleiss κ [46], the internal consistency was based on Cronbach α [47], and the interrater reliability was based on Guttman λ 6 [48] as well as intraclass correlation—ICC(2,k) with 95% CI [49].”
MethodPreferred reporting items for systematic reviews and meta-analyses: The PRISMA statement
Moher, D., Liberati, A., Tetzlaff, J., & Altman, D. G. (2010) · International Journal of Surgery · doi:10.1016/j.ijsu.2010.02.007 · Cited by 12,156 · cited 1×
“First, based on the PRISMA guidelines [39], we systematically searched, screened, and identified smartphone apps aimed at assisting patients with tinnitus.”
MethodMobile app rating scale: a new tool for assessing the quality of health mobile apps
Stoyanov, S. R., Hides, L., Kavanagh, D. J., Zelenko, O., Tjondronegoro, D., & Mani, M. (2015) · JMIR mHealth and uHealth · doi:10.2196/mhealth.3422 · Cited by 2,233 · cited 2×
“Nonetheless, among them the Mobile Application Rating Scale (MARS) [30] is a reliable and valid instrument for the quality assessment of smartphone-based medical apps or mHealth apps.”
BackgroundMethodBaguley, D., McFerran, D., & Hall, D. (2013) · The Lancet · doi:10.1016/s0140-6736(13)60142-7 · Cited by 1,245
A Systematic Review of Healthcare Applications for Smartphones
Mosa, A. S. M., Yoo, I., & Sheets, L. (2012) · BMC Medical Informatics and Decision Making · doi:10.1186/1472-6947-12-67 · Cited by 1,184 · cited 1×
“Generally, health care apps have been exhaustively discussed and reviewed in the literature [58]; however, the number of papers that focus on reviewing and evaluating tinnitus-related smartphone apps is underwhelming.”
BackgroundA Basis for Analyzing Test-Retest Reliability
Guttman, L. (1945) · Psychometrika · doi:10.1007/bf02288892 · Cited by 1,122
Mobile apps in trauma education
Research, N. (2023) · PubMed · doi:10.57945/manara.23966214 · Cited by 844
Tinnitus Retraining Therapy (TRT) as a Method for Treatment of Tinnitus and Hyperacusis Patients
Jastreboff, P. J., & Jastreboff, M. M. (2000) · Journal of the American Academy of Audiology · doi:10.1055/s-0042-1748042 · Cited by 510 · cited 1×
“These changes may additionally be influenced by psychosocial stress (eg, negative thoughts, stress at home, increased workload, etc), which affects not only the emotional status of the patient but also the auditory system [2,3].”
BackgroundBardus, M., van Beurden, S. B., Smith, J. R., & Abraham, C. (2016) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-016-0359-9 · Cited by 350 · cited 1×
“In addition, MARS has been diversely and widely used in evaluating smartphone-based health apps, for instance, pain management apps [31], weight management apps [32], diabetes management apps [33], and rheumatology apps [34,35].”
BackgroundEvaluation of smartphone sound measurement applications
Kardous, C. A., & Shaw, P. B. (2014) · The Journal of the Acoustical Society of America · doi:10.1121/1.4865269 · Cited by 312
Preliminary Evaluation of PTSD Coach, a Smartphone App for Post-Traumatic Stress Symptoms
Kuhn, E., Greene, C., Hoffman, J., Nguyen, T., Wald, L., Schmidt, J., Ramsey, K. M., & Ruzek, J. (2014) · Military Medicine · doi:10.7205/milmed-d-13-00271 · Cited by 289 · cited 1×
“Within the scope of this paper, such solutions can be directly applied within the context of tinnitus and other closely related health complaints, such as stress [12-15], Ménière disease [16,17], hearing loss [18-20], vertigo [21-23], and dementia [24,25].”
BackgroundEconomides, M., Martman, J., Bell, M. J., & Sanderson, B. (2018) · Mindfulness · doi:10.1007/s12671-018-0905-4 · Cited by 250 · cited 1×
“Within the scope of this paper, such solutions can be directly applied within the context of tinnitus and other closely related health complaints, such as stress [12-15], Ménière disease [16,17], hearing loss [18-20], vertigo [21-23], and dementia [24,25].”
BackgroundVan Ameringen, M., Turna, J., Khalesi, Z., Pullia, K., & Patterson, B. (2017) · Depression and Anxiety · doi:10.1002/da.22657 · Cited by 234
Criteria for assessing the quality of mHealth apps: a systematic review
Nouri, R., R Niakan Kalhori, S., Ghazisaeedi, M., Marchand, G., & Yasini, M. (2018) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocy050 · Cited by 231 · cited 1×
“Several mobile health (mHealth) app assessment tools and models are available [26-29], yet they either are focused on a particular health domain or are too time consuming and complex to employ in research.”
BackgroundA randomized controlled trial of a smartphone app for posttraumatic stress disorder symptoms.
Kuhn, E., Kanuri, N., Hoffman, J. E., Garvert, D. W., Ruzek, J. I., & Taylor, C. B. (2017) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000163 · Cited by 225
Evidence-based apps? A review of mental health mobile applications in a psychotherapy context
Lui, J. H. L., Marcus, D. K., & Barry, C. T. (2017) · Professional Psychology Research and Practice · doi:10.1037/pro0000122 · Cited by 217 · cited 2×
“Comparatively, both [61,62] list a limited number of apps and many are no longer commercially available on the app stores.”
BackgroundMethodBaumel, A., Faber, K., Mathur, N., Kane, J. M., & Muench, F. (2017) · Journal of Medical Internet Research · doi:10.2196/jmir.7270 · Cited by 206 · cited 1×
“Several mobile health (mHealth) app assessment tools and models are available [26-29], yet they either are focused on a particular health domain or are too time consuming and complex to employ in research.”
BackgroundHealth empowerment through activity trackers: An empirical smart wristband study
Nelson, E. C., Verhagen, T., & Noordzij, M. L. (2016) · Computers in Human Behavior · doi:10.1016/j.chb.2016.03.065 · Cited by 186
iWander: An Android application for dementia patients
Sposaro, F., Danielson, J., & Tyson, G. (2010) · 2010 Annual International Conference of the IEEE Engineering in Medicine and Biology · doi:10.1109/iembs.2010.5627669 · Cited by 178 · cited 1×
“Within the scope of this paper, such solutions can be directly applied within the context of tinnitus and other closely related health complaints, such as stress [12-15], Ménière disease [16,17], hearing loss [18-20], vertigo [21-23], and dementia [24,25].”
BackgroundValidated Smartphone-Based Apps for Ear and Hearing Assessments: A Review
Bright, T., & Pallawela, D. (2016) · JMIR Rehabilitation and Assistive Technologies · doi:10.2196/rehab.6074 · Cited by 170 · cited 1×
“Within the scope of this paper, such solutions can be directly applied within the context of tinnitus and other closely related health complaints, such as stress [12-15], Ménière disease [16,17], hearing loss [18-20], vertigo [21-23], and dementia [24,25].”
BackgroundSmartphone Apps to Support Self-Management of Hypertension: Review and Content Analysis
Alessa, T., Hawley, M. S., Hock, E. S., & de Witte, L. (2019) · JMIR mHealth and uHealth · doi:10.2196/13645 · Cited by 170 · cited 1×
“Additionally, MARS can be employed for rating smartphone apps for complex psychological or physiological conditions such as depression [36], hypertension [37], or tinnitus [38].”
BackgroundKnitza, J., Tascilar, K., Messner, E.-M., Meyer, M., Vossen, D., Pulla, A., Bosch, P., Kittler, J., Kleyer, A., Sewerin, P., et al. (2019) · JMIR mHealth and uHealth · doi:10.2196/14991 · Cited by 169
Grainger, R., Townsley, H., White, B., Langlotz, T., & Taylor, W. J. (2017) · JMIR mhealth and uhealth · doi:10.2196/mhealth.6956 · Cited by 162 · cited 1×
“In addition, MARS has been diversely and widely used in evaluating smartphone-based health apps, for instance, pain management apps [31], weight management apps [32], diabetes management apps [33], and rheumatology apps [34,35].”
BackgroundSalazar, A., de Sola, H., Failde, I., & Moral-Munoz, J. A. (2018) · JMIR mHealth and uHealth · doi:10.2196/10718 · Cited by 154 · cited 1×
“In addition, MARS has been diversely and widely used in evaluating smartphone-based health apps, for instance, pain management apps [31], weight management apps [32], diabetes management apps [33], and rheumatology apps [34,35].”
BackgroundProbst, T., Pryss, R. C., Langguth, B., & Schlee, W. (2016) · Scientific Reports · doi:10.1038/srep20382 · Cited by 150
Self-citationNaslund, J. A., Aschbrenner, K. A., Barre, L. K., & Bartels, S. J. (2015) · Telemedicine and e-Health · doi:10.1089/tmj.2014.0105 · Cited by 144 · cited 1×
“Interestingly in recent years, smartphones, smartphone apps, and auxiliary health devices such as heart monitors and smart wristbands have gained significant popularity by helping patients to monitor and treat their health problems [6-8].”
BackgroundA Systematic Review of Quality Assessment Methods for Smartphone Health Apps
BinDhim, N. F., Hawkey, A., & Trevena, L. (2015) · Telemedicine and e-Health · doi:10.1089/tmj.2014.0088 · Cited by 142 · cited 1×
“Several mobile health (mHealth) app assessment tools and models are available [26-29], yet they either are focused on a particular health domain or are too time consuming and complex to employ in research.”
BackgroundMeasuring the Moment-to-Moment Variability of Tinnitus: The TrackYourTinnitus Smart Phone App
Schlee, W., Pryss, R. C., Probst, T., Schobel, J., Bachmeier, A., Reichert, M., & Langguth, B. (2016) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2016.00294 · Cited by 140 · cited 1×
“This moment-to-moment variability can be captured by utilizing ecological momentary assessments [5].”
BackgroundSelf-citationBaxter, C. A., Carroll, J., Keogh, B., & Vandelanotte, C. (2020) · JMIR mhealth and uhealth · doi:10.2196/16741 · Cited by 138 · cited 1×
“These third-party mHealth app libraries are web portals that curate smartphone apps [44].”
BackgroundMazurek, B., Szczepek, A. J., & Hébert, S. (2015) · HNO · doi:10.1007/s00106-014-2973-7 · Cited by 121 · cited 1×
“These changes may additionally be influenced by psychosocial stress (eg, negative thoughts, stress at home, increased workload, etc), which affects not only the emotional status of the patient but also the auditory system [2,3].”
BackgroundFunctionality of Top-Rated Mobile Apps for Depression: Systematic Search and Evaluation
Qu, C., Sas, C., Roquet, C. D., & Doherty, G. J. (2019) · JMIR Mental Health · doi:10.2196/15321 · Cited by 105 · cited 1×
“Additionally, MARS can be employed for rating smartphone apps for complex psychological or physiological conditions such as depression [36], hypertension [37], or tinnitus [38].”
BackgroundMobile Apps for the Management of Diabetes
Chavez, S., Fedele, D., Guo, Y., Bernier, A., Smith, M., Warnick, J., & Modave, F. (2017) · Diabetes Care · doi:10.2337/dc17-0853 · Cited by 97 · cited 1×
“In addition, MARS has been diversely and widely used in evaluating smartphone-based health apps, for instance, pain management apps [31], weight management apps [32], diabetes management apps [33], and rheumatology apps [34,35].”
BackgroundHearing Tests Based on Biologically Calibrated Mobile Devices: Comparison With Pure-Tone Audiometry
Masalski, M., Grysiński, T., & Kr̨ecicki, T. (2018) · JMIR mhealth and uhealth · doi:10.2196/mhealth.7800 · Cited by 81 · cited 1×
“Within the scope of this paper, such solutions can be directly applied within the context of tinnitus and other closely related health complaints, such as stress [12-15], Ménière disease [16,17], hearing loss [18-20], vertigo [21-23], and dementia [24,25].”
BackgroundDelbaere, K., Valenzuela, T., Woodbury, A. M., Davies, T., Yeong, J. W., Steffens, D., Miles, L., Pickett, L., Zijlstra, G. A. R., Clemson, L. M., et al. (2015) · BMJ Open · doi:10.1136/bmjopen-2015-009173 · Cited by 80 · cited 1×
“Within the scope of this paper, such solutions can be directly applied within the context of tinnitus and other closely related health complaints, such as stress [12-15], Ménière disease [16,17], hearing loss [18-20], vertigo [21-23], and dementia [24,25].”
BackgroundDesign and testing of a mobile health application rating tool
Levine, D. M., Co, Z., Newmark, L. P., Groisser, A. R., Holmgren, A. J., Haas, J. S., & Bates, D. W. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0268-9 · Cited by 80 · cited 1×
“For example, recently, the THESIS app evaluation instrument was presented [64].”
MethodSchlee, W., Hall, D. A., Canlon, B., Cima, R. F. F., de Kleine, E., Hauck, F. J., Huber, A. M., Gallus, S., Kleinjung, T., Kypraios, T., et al. (2018) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2017.00447 · Cited by 78
Self-citationAndroid Root and its Providers: A Double-Edged Sword
Zhang, H., She, D., & Qian, Z. (2015) · Proceedings of the 22nd ACM SIGSAC Conference on Computer and Communications Security · doi:10.1145/2810103.2813714 · Cited by 64 · cited 1×
“This process is highly discouraged by device manufacturers and app developers as it may introduce security vulnerabilities [ 40].”
BackgroundEmotion dynamics and tinnitus: Daily life data from the “TrackYourTinnitus” application
Probst, T., Pryss, R. C., Langguth, B., & Schlee, W. (2016) · Scientific Reports · doi:10.1038/srep31166 · Cited by 61 · cited 1×
“Consequently, people with tinnitus often report that their perception of it varies, including its loudness or related distress [4].”
BackgroundSelf-citationPryss, R. C., Probst, T., Schlee, W., Schobel, J., Langguth, B., Neff, P. K. A., Spiliopoulou, M., & Reichert, M. (2018) · International Journal of Data Science and Analytics · doi:10.1007/s41060-018-0111-4 · Cited by 61 · cited 2×
“Literature A significant portion of tinnitus scientific literature [53-57] reports on different smartphone and mobile crowdsensing apps to support clinicians in better understanding tinnitus, ranging from data collection to mitigating tinnitus symptoms via therapeutic interventions.”
BackgroundMethodSelf-citationWyatt, J. C. (2018) · BMC Medicine · doi:10.1186/s12916-018-1211-7 · Cited by 61 · cited 1×
“Several mobile health (mHealth) app assessment tools and models are available [26-29], yet they either are focused on a particular health domain or are too time consuming and complex to employ in research.”
BackgroundJastreboff, P. J. (2010) · Springer eBooks · doi:10.1007/978-1-60761-145-5_73 · Cited by 57
Mobile Crowdsensing Services for Tinnitus Assessment and Patient Feedback
Pryss, R. C., Schlee, W., Langguth, B., & Reichert, M. (2017) · doi:10.1109/aims.2017.12 · Cited by 54 · cited 2×
“Literature A significant portion of tinnitus scientific literature [53-57] reports on different smartphone and mobile crowdsensing apps to support clinicians in better understanding tinnitus, ranging from data collection to mitigating tinnitus symptoms via therapeutic interventions.”
BackgroundSelf-citationWeekly, T., Walker, N., Beck, J., Akers, S., & Weaver, M. (2018) · Children · doi:10.3390/children5020016 · Cited by 53 · cited 2×
“Since the objective MARS scores calculated in this paper and PsyberGuide and ORCHA ratings (apart from PsyberGuide’s user experience) are incomparable, a separate chart (Figure 5) depicts a comparison of MARS scores from our study with those from 2 papers from literature [38,52] and with PsyberGuide’s user experience…”
MethodResultMobile Apps for Management of Tinnitus: Users’ Survey, Quality Assessment, and Content Analysis
Sereda, M., Smith, S., Newton, K., & Stockdale, D. (2019) · JMIR mHealth and uHealth · doi:10.2196/10353 · Cited by 52 · cited 7×
“In the field of tinnitus, Sereda and colleagues [38] gathered tinnitus management apps based on patient opinion via a web-based survey.”
BackgroundMethodResultInfluentialApps for Hearing Science and Care
Paglialonga, A., Tognola, G., & Pinciroli, F. (2015) · American Journal of Audiology · doi:10.1044/2015_aja-14-0093 · Cited by 49 · cited 2×
“Comparatively, both [61,62] list a limited number of apps and many are no longer commercially available on the app stores.”
BackgroundMethodThe Weather and Ménière's Disease: A Longitudinal Analysis in the UK
Schmidt, W., Sarran, C. E., Ronan, N., Barrett, G., Whinney, D., Fleming, L. E., Osborne, N. J., & Tyrrell, J. (2016) · Otology & Neurotology · doi:10.1097/mao.0000000000001270 · Cited by 49 · cited 1×
“Within the scope of this paper, such solutions can be directly applied within the context of tinnitus and other closely related health complaints, such as stress [12-15], Ménière disease [16,17], hearing loss [18-20], vertigo [21-23], and dementia [24,25].”
BackgroundProbst, T., Pryss, R. C., Langguth, B., Spiliopoulou, M., Landgrebe, M., Vesala, M., Harrison, S., Schobel, J., Reichert, M., Stach, M., et al. (2017) · Frontiers in Aging Neuroscience · doi:10.3389/fnagi.2017.00113 · Cited by 49
Self-citationInternet/smartphone-based applications for the treatment of tinnitus: a systematic review
Nagaraj, M. K., & Prabhu, P. (2019) · European Archives of Oto-Rhino-Laryngology · doi:10.1007/s00405-019-05743-8 · Cited by 40 · cited 1×
“For instance, internet-and smartphone-based solutions for treatment and management of tinnitus have been reviewed in [59], similarly, the review by Kalle et al [60] discusses internet-or smartphone-delivered cognitive behavior therapy with particular focus on self-help for tinnitus.”
BackgroundDevelopment and field testing of a smartphone “App” for tinnitus management
Henry, J. A., Thielman, E. J., Zaugg, T. L., Kaelin, C., Choma, C., Chang, B., Hahn, S., & Fuller, B. E. (2017) · International Journal of Audiology · doi:10.1080/14992027.2017.1338762 · Cited by 36 · cited 1×
“Similarly, Henry et al [54] delve into the development of an app, based on progressive tinnitus management, to support patients in learning and using coping skills for tinnitus.”
BackgroundReview of Smart Services for Tinnitus Self-Help, Diagnostics and Treatments
Kalle, S., Schlee, W., Pryss, R. C., Probst, T., Reichert, M., Langguth, B., & Spiliopoulou, M. (2018) · Frontiers in Neuroscience · doi:10.3389/fnins.2018.00541 · Cited by 28 · cited 1×
“For instance, internet-and smartphone-based solutions for treatment and management of tinnitus have been reviewed in [59], similarly, the review by Kalle et al [60] discusses internet-or smartphone-delivered cognitive behavior therapy with particular focus on self-help for tinnitus.”
BackgroundSelf-citationOrgan, B., Liu, H., & Bromwich, M. A. (2015) · The Journal of the American Board of Family Medicine · doi:10.3122/jabfm.2015.01.120295 · Cited by 25 · cited 1×
“Within the scope of this paper, such solutions can be directly applied within the context of tinnitus and other closely related health complaints, such as stress [12-15], Ménière disease [16,17], hearing loss [18-20], vertigo [21-23], and dementia [24,25].”
BackgroundReferenceable mobile crowdsensing architecture: A healthcare use case
Mehdi, M., Mühlmeier, G., Agrawal, K., et al. (2018) · Procedia Computer Science · doi:10.1016/j.procs.2018.07.185 · Cited by 25 · cited 1×
“On the other hand, these solutions can also easily be designed or tailored to assist patients in managing or mitigating the symptoms of their health problems [11].”
BackgroundSelf-citationDlugaiczyk, J., Thiemer, M., Neubert, C., Schorn, B. A., & Schick, B. (2018) · Otology & Neurotology · doi:10.1097/mao.0000000000001778 · Cited by 20 · cited 1×
“Within the scope of this paper, such solutions can be directly applied within the context of tinnitus and other closely related health complaints, such as stress [12-15], Ménière disease [16,17], hearing loss [18-20], vertigo [21-23], and dementia [24,25].”
BackgroundTowards Automated Smart Mobile Crowdsensing for Tinnitus Research
Mehdi, M., Schwager, D., Pryss, R. C., et al. (2019) · IEEE International Symposium on Computer-Based Medical Systems (CBMS) · doi:10.1109/cbms.2019.00026 · Cited by 13 · cited 1×
“For instance, on one hand, smartphone-based app solutions can be applied to monitor the ecological or environmental surroundings of patients to better understand health phenomena [9,10].”
BackgroundSelf-citationBromwich, M. A., & Parnes, L. S. (2008) · PubMed · Cited by 12
Smart mobile crowdsensing for tinnitus research
Mehdi, M. (2019) · ACM/SIGAPP Symposium on Applied Computing (SAC) · doi:10.1145/3297280.3297654 · Cited by 7
Self-citationSmartphone Apps for Tinnitus Management
Smith, S., & Sereda, M. (2020) · The Hearing Journal · doi:10.1097/01.hj.0000654928.79548.08 · Cited by 4 · cited 2×
“Both of these reviews [38,63] list tinnitus management apps based on patient opinions, gathered via a web-based survey.”
BackgroundMethod
Research works printed but not linked: 3
- Ventola, CL, 2014, P T, 39, 356
- Bromwich, MA, 2008, J Otolaryngol Head Neck Surg, 37, 380
- BeauvaisBRialleVSablierJMyvigi: An android application to detect fall and wandering2012In: Proceedings of the sixth International Conference on Mobile Ubiquitous Computing, Systems, Services and Technologies, UBICOMM2012Barcelona, Spain156160
Cited by
S3 Guideline: Chronic Tinnitus
Mazurek, B., Hesse, G., Sattel, H. C., Kratzsch, V., Lahmann, C., & Dobel, C. (2022) · HNO · doi:10.1007/s00106-022-01207-4 · Cited by 77
“[313] identified and evaluated 34 systematically recorded apps for tinnitus.”
BackgroundLoneliness and Social Isolation Detection Using Passive Sensing Techniques: Scoping Review
Qirtas, M. M., Zafeiridi, E., Pesch, D., & White, E. B. (2022) · JMIR mhealth and uhealth · doi:10.2196/34638 · Cited by 58
“In addition to their primary function as communication devices, modern smartphones provide a plethora of capabilities [24].”
BackgroundMethodSchoisswohl, S., Langguth, B., Schecklmann, M., Bernal-Robledano, A., Boecking, B., Cederroth, C. R., Chalanouli, D., Cima, R. F. F., Denys, S., Dettling-Papargyris, J., et al. (2021) · Trials · doi:10.1186/s13063-021-05835-z · Cited by 34
Self-citationEffectiveness of telerehabilitation interventions for self-management of tinnitus: systematic review
Demoen, S., Chalimourdas, A., Timmermans, A., Van Rompaey, V., Vanderveken, O. M., Jacquemin, L., Schlee, W., Marneffe, W., Luyten, J., Gilles, A., et al. (2023) · Journal of Medical Internet Research · doi:10.2196/39076 · Cited by 24
“For example, in the last decade, computer platforms and smartphone apps increasingly found their way into the treatment of tinnitus, most often in the form of CBT and sound therapy [42,43].”
InfluentialSelf-citationQuality assessment of mHealth apps: a scoping review
Giebel, G. D., Speckemeier, C., Schrader, N. F., Abels, C., Plescher, F., Hillerich, V., Wiedemann, D., Börchers, K., Wasem, J., Blase, N., et al. (2024) · Frontiers in Health Services · doi:10.3389/frhs.2024.1372871 · Cited by 36
Metadata
- Authors
- Mehdi, M., Stach, M., Riha, C., Neff, P., Dode, A., Pryss, R., Schlee, W., Reichert, M., & Hauck, F. J.
- Affiliations
- Universität Ulm (DE)
- University of Zurich (CH)
- University of Würzburg (DE)
- Corresponding author
- Hauck, Franz J
- ORCID
- Venue
- JMIR mHealth and uHealth
- Publisher
- JMIR Publications Inc.
- Published
- 2020-08-18
- Volume
- 8
- Issue
- 8
- Pages
- e21767
- ISSN
- 2291-5222 (ISSN-L)
- PMC
- PMC7463412
- OpenAlex
- W3045997149
- Semantic Scholar
- 40d356be75da30c61ddb690c1262e51da4e9c833
- Cited by
- 40
- References
- 58
- Citations by year
- 2026: 6 · 2025: 5 · 2024: 8 · 2023: 5 · 2022: 9 · 2021: 6 · 2020: 1
- FWCI
- 5.48
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- JMIR mhealth and uhealth (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- Funders
- European Commission (HORIZON2020)
- Topics
- Health Sciences › Health Professions › General Health Professions › Mobile Health and mHealth Applications
- Life Sciences › Neuroscience › Sensory Systems › Hearing, Cochlea, Tinnitus, Genetics
- Social Sciences › Psychology › Applied Psychology › Digital Mental Health Interventions
- Keywords
- tinnitus, mobile application, mobile health apps, app quality assessment, Mobile App Rating Scale, app store search, Android application, iOS app
- MeSH terms
- Smartphone, Humans, Tinnitus, Reproducibility of Results, Telemedicine, Ecosystem, Mobile Applications, Acceptance and Commitment Therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-11, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-11 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.