CoChat
Sign Up
Cited by 176Sinusitis and nasal conditionsHealth Education and ValidationHealth Systems, Economic Evaluations, Quality of Life

Patient-reported outcome measures for adult chronic rhinosinusitis: A systematic review and quality assessment

Open access
Rudmik, Luke, Hopkins, Claire, Peters, Anju, Smith, Timothy L., Schlosser, Rodney J., Soler, Zachary M.·2015·Journal of Allergy and Clinical Immunology
DOI 10.1016/j.jaci.2015.10.012
Open this paper in CoChat — free accountOpen PDF

Abstract

Background With a focus on patient-centered care, there is increasing policy interest in patient-reported outcome measures (PROMs) to inform improvements in health care delivery. Given the importance of understanding patient-reported outcomes during the management of chronic rhinosinusitis (CRS), PROMs will play an essential role in informing and tailoring the right intervention to the right patient. Objective The objective of this systematic review was to identify and assess the quality of PROMs being used for adults with CRS. Methods A systematic review of Ovid MEDLINE (R) (1947-May 2015), Embase, and the Cochrane databases was performed using the following key terms: ["chronic" AND "*sinusitis"] AND [PROM OR patient reported outcome measure* OR quality of life OR questionnaire OR survey OR valid* OR develop*]. An unlimited truncation strategy (placement of *) was used to capture all variations of terms used. The quality of each PROM was assessed and reported using standardized criteria from the COnsensus-based Standards for the selection of health status Measurement INstruments checklist. Results A total of 15 PROMs validated for use in adult patients with CRS were identified. Fourteen instruments were specific to adults with CRS, and one was a generic quality-of-life instrument (EuroQol five-dimensional questionnaire [EQ-5D]). There was significant variation in the quality of development and reporting of psychometric properties. Overall, the highest quality validated PROMs for adults with CRS were (1) the 22-item Sinonasal Outcome Test (19 points), (2) the Questionnaire of Olfactory Disorders (14 points), (3) the Sinusitis Control Test (14 points), and (4) the EQ-5D (13 points). Most of the PROMs were developed for research purposes such as determining changes in health-related quality of life or symptoms after an intervention as opposed to improving clinical decision making. Conclusions Based on quality assessment, the 22-item Sinonasal Outcome Test, the Questionnaire of Olfactory Disorders, and the Sinusitis Control Test provided the highest quality CRS-specific PROMs, whereas the EQ-5D provided the highest quality generic quality-of-life instrument. Future CRS PROMs will need to incorporate clinical domains that assess common comorbid diseases along with patient values and preferences to improve clinical decision making.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.jaci.2015.10.012

Cites

3 of 3 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • The EuroQOL-5 Dimensions (EQ-5D) is the most commonly used generic questionnaire.

    “The EuroQOL-5 Dimensions (EQ-5D) is the most commonly used generic questionnaire [88].”

    From Position Paper on Nasal Obstruction: Evaluation and Treatment (2018) · cites this paper as [88]

    The PROM characteristics for CRS section identifies EQ-5D as a generic questionnaire and the only generic instrument validated in the CRS population. Neither that section nor the Appendix’s EQ-5D description establishes that it is the most commonly used generic questionnaire; validation status is not a measure of usage. (LLM, conf=0.86)

    Experimental — accuracy not yet measured

  • SNOT-22 stands out for its usefulness in chronic rhinosinusitis, and the Rhinosinusitis Disability Index, Questionnaire of Olfactory Disorders, and Sinusitis Control Test have also been validated.

    “As for CRS (Table 4), SNOT-22 stands out because of its usefulness, although the Rhinosinusitis Disability Index, the Questionnaire of Olfactory Disorders, and the Sinusitis Control Test [88] have also been validated.”

    From Position Paper on Nasal Obstruction: Evaluation and Treatment (2018) · cites this paper as [88]

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 54

  1. Kerr EA, Hayward RA. Patient-centered performance management: enhancing value for patients and health care systems. JAMA 2013;310:137-8.
  2. Rubin R. Precision medicine: the future or simply politics? JAMA 2015;313: 1089-91.
  3. Frank L, Basch E, Selby JV. The PCORI perspective on patient-centered out- comes research. JAMA 2014;312:1513-4.
  4. Conrad DA, Grembowski D, Hernandez SE, Lau B, Marcus-Smith M. Emerging lessons from regional and state innovation in value-based payment reform: balancing collaboration and disruptive innovation. Milbank Q 2014;92:568-623.
  5. Rudmik L, Smith TL. Quality of life in patients with chronic rhinosinusitis. Curr Allergy Asthma Rep 2011;11:247-52.
  6. Rudmik L, Smith TL, Schlosser RJ, Hwang PH, Mace JC, Soler ZM. Productivity costs in patients with refractory chronic rhinosinusitis. Laryngoscope 2014;124: 2007-12.
  7. Rudmik L, Soler ZM. Medical therapies for adult chronic sinusitis: a systematic review. JAMA 2015;314:926-39.
  8. Soler ZM, Rudmik L, Hwang PH, Mace JC, Schlosser RJ, Smith TL. Patient-centered decision making in the treatment of chronic rhinosinusitis. Laryngoscope 2013;123:2341-6.
  9. DeConde AS, Mace JC, Bodner T, Bodner T, Hwang PH, Rudmik L, et al. SNOT- 22 quality of life domains differentially predict treatment modality selection in chronic rhinosinusitis. Int Forum Allergy Rhinol 2014;4:972-9.
  10. Rudmik L, Soler ZM, Mace JC, DeConde AS, Schlosser RJ, Smith TL. Using preoperative SNOT-22 score to inform patient decision for endoscopic sinus surgery. Laryngoscope 2015;125:1517-22.
  11. Hopkins C, Rudmik L, Lund VJ. The predictive value of the preoperative Sinonasal Outcome Test-22 score in patients undergoing endoscopic sinus surgery for chronic rhinosinusitis. Laryngoscope 2015;125:1779-84.
  12. Desrosiers M, Evans GA, Keith PK, Wright ED, Kaplan A, Bouchard J, et al. Ca- nadian clinical practice guidelines for acute and chronic rhinosinusitis. J Otolaryngol Head Neck Surg 2011;40:S99-193.
  13. Rosenfeld RM, Piccirillo JF, Chandrasekhar SS, Brook I, Ashok Kumar K, Kramper M, et al. Clinical practice guideline (update): adult sinusitis. Otolaryngol Head Neck Surg 2015;152:S1-39.
  14. Mokkink LB, Terwee CB, Patrick DL, Stratford PW, Alonso J, Patrick DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an interna- tional Delphi study. Qual Life Res 2010;19:539-49.
  15. Gliklich RE, Metson R. Techniques for outcomes research in chronic sinusitis. Laryngoscope 1995;105:387-90.
  16. Piccirillo JF, Edwards D, Haiduk A, Yonan C, Thawley SE. Psychometric and clinimetric validity of the 31-Item Rhinosinusitis Outcome Measure (RSOM-31). Am J Rhinol 1995;9:297-306.
  17. Benninger MS, Senior BA. The development of the Rhinosinusitis Disability Index. Arch Otolaryngol Head Neck Surg 1997;123:1175-9.
  18. Anderson ER, Murphy MP, Weymuller EA Jr. Clinimetric evaluation of the Sinonasal Outcome Test-16. Student Research Award 1998. Otolaryngol Head Neck Surg 1999;121:702-7.
  19. Piccirillo JF, Merritt MG Jr, Richards ML. Psychometric and clinimetric validity of the 20-Item Sino-Nasal Outcome Test (SNOT-20). Otolaryngol Head Neck Surg 2002;126:41-7.
  20. Bhattacharyya N. The economic burden and symptom manifestations of chronic rhinosinusitis. Am J Rhinol 2003;17:27-32.
  21. Atlas SJ, Metson RB, Singer DE, Wu YA, Gliklich RE. Validity of a new health-related quality of life instrument for patients with chronic sinusitis. Laryngoscope 2005;115:846-54.
  22. Ling FT, Kountakis SE. Rhinosinusitis Task Force symptoms versus the Sinonasal Outcomes Test in patients evaluated for chronic rhinosinusitis. Am J Rhinol 2007; 21:495-8.
  23. Hopkins C, Gillett S, Slack R, Lund VJ, Browne JP. Psychometric validity of the 22-item Sinonasal Outcome Test. Clin Otolaryngol 2009;34:447-54.
  24. Dixon AE, Sugar EA, Zinreich SJ, Slavin RG, Corren J, Naclerio RM, et al. Criteria to screen for chronic sinonasal disease. Chest 2009;136:1324-32.
  25. Simopoulos E, Katotomichelakis M, Gouveris H, Tripsianis G, Livaditis M, Danie- lides V. Olfaction-associated quality of life in chronic rhinosinusitis: adaptation and validation of an olfaction-specific questionnaire. Laryngoscope 2012;122:1450-4.
  26. Naidoo Y, Tan N, Singhal D, Wormald PJ. Chronic rhinosinusitis assessment using the Adelaide Disease Severity Score. J Laryngol Otol 2013;127:S24-8.
  27. Remenschneider AK, D'Amico L, Gray ST, Holbrook EH, Gliklich RE, Metson R. The EQ-5D: a new tool for studying clinical outcomes in chronic rhinosinusitis. Laryngoscope 2015;125:7-15.
  28. Banglawala SM, Schlosser RJ, Storck T, Morella K, Chandra R, Khetani J, et al. Qualitative development of the Sinus Control Test: a survey evaluating sinus symptom control. Int Forum Allergy Rhinol 2015 [In press].
  29. Brooks R. EuroQol: the current state of play. Health Policy 1996;37:53-72.
  30. Mortuaire G, Vandeville S, Chevalier D. Psychometric evaluation of the SinoNasal Outcome Test-16 for quality of life in chronic rhinosinusitis with nasal polyps. Eur Ann Otorhinolaryngol Head Neck Dis 2010;127:91-6.
  31. Remenschneider AK, Scangas G, Meier JC, Gray ST, Holbrook EH, Gliklich RE, et al. EQ-5D-derived health utility values in patients undergoing surgery for chronic rhinosinusitis. Laryngoscope 2015;125:1056-61.
  32. Pynnonen MA, Kim HM, Terrell JE. Validation of the Sino-Nasal Outcome Test 20 (SNOT-20) domains in nonsurgical patients. Am J Rhinol Allergy 2009;23:40-5.
  33. Lange B, Thilsing T, Baelum J, Kjeldsen AD. The Sino Nasal Outcome Test 22 score in persons without chronic rhinosinusitis. Clin Otolaryngol June 12, 2015 [E-pub ahead of print]. doi: 10.1111/coa.12481. · DOI
  34. Gregorio LL, Andrade JS, Caparroz FA, Saraceni Neto P, Kosugi EM. Influence of age and gender in the normal values of Sino Nasal Outcome Test-22. Clin Otolaryngol 2015;40:115-20.
  35. Abdalla S, Alreefy H, Hopkins C. Prevalence of Sinonasal Outcome Test (SNOT-22) symptoms in patients undergoing surgery for chronic rhinosinusitis in the England and Wales National prospective audit. Clin Otolaryngol 2012; 37:276-82.
  36. Dykewicz MS, Hamilos DL. Rhinitis and sinusitis. J Allergy Clin Immunol 2010; 125:S103-15.
  37. Bachert C, Claeys SE, Tomassen P, van Zele T, Zhang N. Rhinosinusitis and asthma: a link for asthma severity. Curr Allergy Asthma Rep 2010;10: 194-201.
  38. Ocampo CJ, Grammer LC. Chronic rhinosinusitis. J Allergy Clin Immunol Pract 2013;1:205-11, quiz 12-3.
  39. Prinsen CA, Vohra S, Rose MR, King-Jones S, Ishaque S, Bhaloo Z, et al. Core Outcome Measures in Effectiveness Trials (COMET) initiative: protocol for an international Delphi study to achieve consensus on how to select outcome mea- surement instruments for outcomes included in a 'core outcome set'. Trials 2014;15:247.
  40. McNair A, Whistance RN, Forsythe RO, Rees J, Jones JE, Pullyblank AM, et al. Synthesis and summary of patient-reported outcome measures (PROMs) to inform the development of a core outcome set in colorectal cancer surgery. Colo- rectal Dis 2015;17:O217-29.
  41. Worth A, Hammersley VS, Nurmatov U, Sheikh A. Systematic literature review and evaluation of patient reported outcome measures (PROMs) for asthma and related allergic diseases. Prim Care Respir J 2012;21:455-8. REFERENCES E1. Mokkink LB, Terwee CB, Patrick DL, Alonso J, Stratford PW, Knol DL, et al. The COSMIN checklist for assessing the methodological quality of studies on measurement properties of health status measurement instruments: an international Delphi study. Qual Life Res 2010;19:539-49.
  42. Gliklich RE, Metson R. Techniques for outcomes research in chronic sinusitis. Laryngoscope 1995;105:387-90.
  43. Piccirillo JF, Edwards D, Haiduk A, Yonan C, Thawley SE. Psychometric and clinimetric validity of the 31-Item Rhinosinusitis Outcome Measure (RSOM-31). Am J Rhinol 1995;9:297-306.
  44. Benninger MS, Senior BA. The development of the Rhinosinusitis Disability Index. Arch Otolaryngol Head Neck Surg 1997;123:1175-9.
  45. Anderson ER, Murphy MP, Weymuller EA Jr. Clinimetric evaluation of the Sinonasal Outcome Test-16. Student Research Award 1998. Otolaryngol Head Neck Surg 1999;121:702-7.
  46. Piccirillo JF, Merritt MG Jr, Richards ML. Psychometric and clinimetric validity of the 20-Item Sino-Nasal Outcome Test (SNOT-20). Otolaryngol Head Neck Surg 2002;126:41-7.
  47. Bhattacharyya N. The economic burden and symptom manifestations of chronic rhinosinusitis. Am J Rhinol 2003;17:27-32.
  48. Atlas SJ, Metson RB, Singer DE, Wu YA, Gliklich RE. Validity of a new health-related quality of life instrument for patients with chronic sinusitis. Laryngoscope 2005;115:846-54.
  49. Dixon AE, Sugar EA, Zinreich SJ, Slavin RG, Corren J, Naclerio RM, et al. Criteria to screen for chronic sinonasal disease. Chest 2009;136:1324-32. E10. Ling FT, Kountakis SE. Rhinosinusitis Task Force symptoms versus the Sinonasal Outcomes Test in patients evaluated for chronic rhinosinusitis. Am J Rhinol 2007;21:495-8.
  50. E11. Hopkins C, Gillett S, Slack R, Lund VJ, Browne JP. Psychometric validity of the 22-item Sinonasal Outcome Test. Clin Otolaryngol 2009;34:447-54. E12. Kacha S, Guillemin F, Jankowski R. Development and validity of the DyNaChron questionnaire for chronic nasal dysfunction. Eur Arch Otorhinolaryngol 2012;269:143-53.
  51. E13. Simopoulos E, Katotomichelakis M, Gouveris H, Tripsianis G, Livaditis M, Danielides V. Olfaction-associated quality of life in chronic rhinosinusitis: adap- tation and validation of an olfaction-specific questionnaire. Laryngoscope 2012; 122:1450-4.
  52. E14. Banglawala SM, Schlosser RJ, Storck T, Morella K, Chandra R, Khetani J, et al. Qualitative development of the Sinus Control Test: a survey evaluating sinus symptom control. Int Forum Allergy Rhinol 2015 [In press]. E15. Remenschneider AK, D'Amico L, Gray ST, Holbrook EH, Gliklich RE, Metson R. The EQ-5D: a new tool for studying clinical outcomes in chronic rhinosinusitis. Laryngoscope 2015;125:7-15. E16. Brooks R. EuroQol: the current state of play. Health Policy 1996;37:53-72.
  53. E17. Mortuaire G, Vandeville S, Chevalier D. Psychometric evaluation of the SinoNasal Outcome Test-16 for quality of life in chronic rhinosinusitis with nasal polyps. Eur Ann Otorhinolaryngol Head Neck Dis 2010;127:91-6.
  54. E18. Naidoo Y, Tan N, Singhal D, Wormald PJ. Chronic rhinosinusitis assess- ment using the Adelaide Disease Severity Score. J Laryngol Otol 2013; 127:S24-8.

Cited by

Sorted by citations

Authors
Rudmik, L., Hopkins, C., Peters, A., Smith, T. L., Schlosser, R. J., & Soler, Z. M.
Affiliations
  • University of Calgary (CA)
  • St Thomas' Hospital (GB)
  • Northwestern University (US)
  • Oregon Health & Science University (US)
  • Medical University of South Carolina (US)
Corresponding author
Rudmik, Luke
ORCID
Venue
Journal of Allergy and Clinical Immunology
Publisher
Elsevier BV
Published
2015-12
Volume
136
Issue
6
Pages
1532-1540.e2
ISSN
0091-6749 (ISSN-L)
DOI
10.1016/j.jaci.2015.10.012
OpenAlex
W2187272330
Cited by
176
References
3
Citations by year
2026: 8 · 2025: 16 · 2024: 14 · 2023: 18 · 2022: 20 · 2021: 25 · 2020: 23 · 2019: 15 · 2018: 11 · 2017: 14 · 2016: 12
FWCI
2.25
Type
journal article
Language
en
Open access
Licence
Locations
  • Journal of Allergy and Clinical Immunology (publishedVersion)
  • PubMed (publishedVersion)
Funders
  • National Institute on Deafness and Other Communication Disorders (005805)
  • National Institutes of Health
Topics
  • Health Sciences › Medicine › Otorhinolaryngology › Sinusitis and nasal conditions
  • Social Sciences › Education › Health Education and Validation
  • Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Health Systems, Economic Evaluations, Quality of Life
Keywords
chronic rhinosinusitis, patient-reported outcome measures, health-related quality of life, instrument validation, psychometric properties, EQ-5D, patient-centered care
MeSH terms
Chronic Disease, Humans, Quality of Life, Surveys and Questionnaires, Rhinitis, Sinusitis, Patient Outcome Assessment

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review