The DOI matches its Crossref record; 73 of the 73 references it cites were found in a registry or an index.
Understanding the Minimal Clinically Important Difference (MCID) of Patient‐Reported Outcome Measures
Abstract
Objective: The minimal clinically important difference (MCID) of a patient‐reported outcome measure (PROM) represents a threshold value of change in PROM score deemed to have an implication in clinical management. The MCID is frequently used to interpret the significance of results from clinical studies that use PROMs. However, an understanding of the many caveats of the MCID, as well as its strengths and limitations, is necessary. The objective of this article is to provide a review of the calculation, interpretation, and caveats of MCID. Data Sources: MEDLINE and PubMed Central. Review Methods: Literature search—including primary studies, review articles, and consensus statements—pertinent to the objectives of this review using PubMed. Conclusions: The MCID of a PROM may vary depending on the patients and clinical context in which the PROM is given. The primary approaches for calculating MCID are distribution‐based and anchor‐based methods. Each methodology has strengths and limitations, and the ideal determination of a PROM MCID includes synthesis of results from both approaches. The MCID of a PROM is also not perfect in detecting patients experiencing a clinically important improvement, and this is reflected in its accuracy (eg, sensitivity and specificity). Implications for Practice: Interpretation or application of MCID requires consideration of all caveats underlying the MCID, including the patients in whom it was derived, the limitations of the methodologies used to calculate it, and its accuracy for identifying patients who have experienced clinically significant improvement.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Muller, K. (1989) · Technometrics · doi:10.1080/00401706.1989.10488618 · Cited by 99,167
Coefficient Alpha and the Internal Structure of Tests
Cronbach, L. J. (1951) · Psychometrika · doi:10.1007/bf02310555 · Cited by 43,931
The magical number seven, plus or minus two: Some limits on our capacity for processing information.
Miller, G. A. (1994) · Psychological Review · doi:10.1037/0033-295x.101.2.343 · Cited by 17,161
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Jaeschke, R., Singer, J., & Guyatt, G. H. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90005-6 · Cited by 4,982
Norman, G. R., Sloan, J. A., & Wyrwich, K. W. (2003) · Medical Care · doi:10.1097/01.mlr.0000062554.74615.4c · Cited by 4,700 · cited 2×
“where SD represents the SD of baseline or pretreatment PROM scores of the patient population being studied.(21) Equation (1) was initially proposed after a systematic review of studies that calculated the MCID of PROMs found that the MCIDs of these PROMs, regardless of methodology used to calculated them, converged to…”
MethodRevicki, D., Hays, R. D., Cella, D., & Sloan, J. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.012 · Cited by 2,362
Measuring change over time: Assessing the usefulness of evaluative instruments
Guyatt, G., Walter, S., & Norman, G. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90069-5 · Cited by 1,880
Salaffi, F., Stancati, A., Silvestri, C. A., Ciapetti, A., & Grassi, W. (2004) · European Journal of Pain · doi:10.1016/j.ejpain.2003.09.004 · Cited by 1,724
Psychometric validity of the 22‐item Sinonasal Outcome Test
Hopkins, C., Gillett, S., Slack, R., Lund, V. J., & Browne, J. P. (2009) · Clinical Otolaryngology · doi:10.1111/j.1749-4486.2009.01995.x · Cited by 1,621
Relation of implicit theories to the construction of personal histories.
Ross, M. (1989) · Psychological Review · doi:10.1037//0033-295x.96.2.341 · Cited by 1,564
Methods to Explain the Clinical Significance of Health Status Measures
Guyatt, G. H., Osoba, D., Wu, A. W., Wyrwich, K. W., & Norman, G. R. (2002) · Mayo Clinic Proceedings · doi:10.4065/77.4.371 · Cited by 1,500
Defining clinically meaningful change in health-related quality of life
Crosby, R. D., Kolotkin, R. L., & Williams, G. R. (2003) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(03)00044-1 · Cited by 1,332
The clinical importance of changes in outcome scores after treatment for chronic low back pain
Hägg, O., Fritzell, P., & Nordwall, A. (2003) · European Spine Journal · doi:10.1007/s00586-002-0464-0 · Cited by 907
Standard deviations and standard errors
Altman, D. G., & Bland, J. M. (2005) · BMJ · doi:10.1136/bmj.331.7521.903 · Cited by 878
Wyrwich, K. W., Tierney, W. M., & Wolinsky, F. D. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00071-2 · Cited by 862
Smallest real difference, a link between reproducibility and responsiveness
Beckerman, H., Roebroeck, M. E., Lankhorst, G. J., Becher, J. G., Bezemer, P. D., & Verbeek, A. L. M. (2001) · Quality of Life Research · doi:10.1023/a:1013138911638 · Cited by 857
de Vet, H. C., Terwee, C. B., Ostelo, R. W., Beckerman, H., Knol, D. L., & Bouter, L. M. (2006) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-4-54 · Cited by 829
Deyo, R. A., & Centor, R. M. (1986) · Journal of Chronic Diseases · doi:10.1016/0021-9681(86)90038-x · Cited by 792
A point of minimal important difference (MID): a critique of terminology and methods
King, M. T. (2011) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/erp.11.9 · Cited by 646
Responsiveness of functional status in low back pain: a comparison of different instruments
Beurskens, A. J. H. M., de Vet, H. C. W., & Köke, A. J. A. (1996) · Pain · doi:10.1016/0304-3959(95)00149-2 · Cited by 573
Wyrwich, K. W., Nienaber, N. A., Tierney, W. M., & Wolinsky, F. D. (1999) · Medical Care · doi:10.1097/00005650-199905000-00006 · Cited by 569
Interpretation of quality of life changes
Lydick, E., & Epstein, R. S. (1993) · Quality of Life Research · doi:10.1007/bf00435226 · Cited by 527
Norman, G. R., Stratford, P., & Regehr, G. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00097-8 · Cited by 524
Beaton, D. E., Boers, M., & Wells, G. A. (2002) · Current Opinion in Rheumatology · doi:10.1097/00002281-200203000-00006 · Cited by 513
The truly remarkable universality of half a standard deviation: confirmation through another look
Norman, G. R., Sloan, J. A., & Wyrwich, K. W. (2004) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/14737167.4.5.581 · Cited by 490 · cited 3×
“A subsequent study and systematic review23 has suggested that MCID ¼ 0:3 SD, but repeat analysis of that study’s data set could also be interpreted as consistent with MCID ¼ 0:5 SD.24 Defining MCID in terms of SD can also be thought of with respect to an effect size for the change in the PROM.”
BackgroundEstimating clinically significant differences in quality of life outcomes
Wyrwich, K. W., Bullinger, M., Aaronson, N., Hays, R. D., Patrick, D. L., & Symonds, T. (2005) · Quality of Life Research · doi:10.1007/s11136-004-0705-2 · Cited by 471
Test “Reliability”: Its Meaning and Determination
Cronbach, L. J. (1947) · Psychometrika · doi:10.1007/bf02289289 · Cited by 450
Pool, J. J. M., Ostelo, R. W. J. G., Hoving, J. L., Bouter, L. M., & de Vet, H. C. W. (2007) · Spine · doi:10.1097/brs.0b013e31815cf75b · Cited by 445
Outcome measures in chronic low back pain
Maughan, E. F., & Lewis, J. S. (2010) · European Spine Journal · doi:10.1007/s00586-010-1353-6 · Cited by 438
Sensitivity to Change of the Roland-Morris Back Pain Questionnaire: Part 1
Stratford, P. W., Binkley, J. M., Riddle, D. L., & Guyatt, G. H. (1998) · Physical Therapy · doi:10.1093/ptj/78.11.1186 · Cited by 425
Carreon, L. Y., Glassman, S. D., Campbell, M. J., & Anderson, P. A. (2010) · The Spine Journal · doi:10.1016/j.spinee.2010.02.007 · Cited by 413
Schram, M. E., Spuls, P. I., Leeflang, M. M. G., Lindeboom, R., Bos, J. D., & Schmitt, J. (2012) · Allergy · doi:10.1111/j.1398-9995.2011.02719.x · Cited by 383
de Vet, H. C. W., Ostelo, R. W. J. G., Terwee, C. B., van der Roer, N., Knol, D. L., Beckerman, H., Boers, M., & Bouter, L. M. (2007) · Quality of Life Research · doi:10.1007/s11136-006-9109-9 · Cited by 383
CELLA, D., ETON, D., FAIRCLOUGH, D., BONOMI, P., HEYES, A., SILBERMAN, C., WOLF, M., & JOHNSON, D. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00477-2 · Cited by 380
Schmidt, F. L., Le, H., & Ilies, R. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.2.206 · Cited by 362 · cited 1×
“Instead, the most appropriate metric of reliability that should ideally be used to determine SEM for calculation of MCID is test-retest reliability.(33,34) Test-retest reliability is calculated by evaluating the correlation between scores on the PROM for a group of individuals at 2 Sedaghat 553”
MethodThe minimal detectable change cannot reliably replace the minimal important difference
Turner, D., Schünemann, H. J., Griffith, L. E., Beaton, D. E., Griffiths, A. M., Critch, J. N., & Guyatt, G. H. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.01.024 · Cited by 356
Mind the MIC: large variation among populations and methods
Terwee, C. B., Roorda, L. D., Dekker, J., Bierma-Zeinstra, S. M., Peat, G., Jordan, K. P., Croft, P., & de Vet, H. C. W. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.08.010 · Cited by 354
The minimum clinically important difference for EQ-5D index: a critical review
Coretti, S., Ruggeri, M., & McNamee, P. (2014) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/14737167.2014.894462 · Cited by 342
Outcomes Research: Measuring the End Results of Health Care
Clancy, C. M., & Eisenberg, J. M. (1998) · Science · doi:10.1126/science.282.5387.245 · Cited by 324
Interpreting patient-reported outcome results: US FDA guidance and emerging methods
McLeod, L. D., Coon, C. D., Martin, S. A., Fehnel, S. E., & Hays, R. D. (2011) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/erp.11.12 · Cited by 320
Willke, R. J., Burke, L. B., & Erickson, P. (2004) · Controlled Clinical Trials · doi:10.1016/j.cct.2004.09.003 · Cited by 305
A critical look at transition ratings
Guyatt, G. H., Norman, G. R., Juniper, E. F., & Griffith, L. E. (2002) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(02)00435-3 · Cited by 298
Norman, G. R., Gwadry Sridhar, F., Guyatt, G. H., & Walter, S. D. (2001) · Medical Care · doi:10.1097/00005650-200110000-00002 · Cited by 262
Hui, D., Shamieh, O., Paiva, C. E., Perez‐Cruz, P. E., Kwon, J. H., Muckaden, M. A., Park, M., Yennu, S., Kang, J. H., & Bruera, E. (2015) · Cancer · doi:10.1002/cncr.29437 · Cited by 251
Minimal important difference to infer changes in health-related quality of life—a systematic review
Jayadevappa, R., Cook, R., & Chhatre, S. (2017) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2017.06.009 · Cited by 244
Wiklund, I. (2004) · Fundamental & Clinical Pharmacology · doi:10.1111/j.1472-8206.2004.00234.x · Cited by 205
Half standard deviation estimate of the minimally important difference in HRQOL scores?
Farivar, S. S., Liu, H., & Hays, R. D. (2004) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/14737167.4.5.515 · Cited by 184
YOST, K., CELLA, D., CHAWLA, A., HOLMGREN, E., ETON, D., AYANIAN, J., & WEST, D. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.07.008 · Cited by 179
Wyrwich, K. W. (2004) · Journal of Biopharmaceutical Statistics · doi:10.1081/bip-120028508 · Cited by 178
An integrated method to determine meaningful changes in health-related quality of life
Crosby, R. D., Kolotkin, R. L., & Williams, G. R. (2004) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2004.04.004 · Cited by 165
Three ways to quantify uncertainty in individually applied “minimally important change” values
de Vet, H. C. W., Terluin, B., Knol, D. L., Roorda, L. D., Mokkink, L. B., Ostelo, R., Hendriks, E., Bouter, L. M., & Terwee, C. B. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.03.011 · Cited by 165
on behalf of the EORTC PROBE project and the Lung Cancer Group, Maringwa, J. T., Quinten, C., King, M., Ringash, J., Osoba, D., Coens, C., Martinelli, F., Vercauteren, J., Cleeland, C. S., et al. (2011) · Supportive Care in Cancer · doi:10.1007/s00520-010-1016-5 · Cited by 164
Baseline Dependency of Minimal Clinically Important Improvement
Wang, Y.-C., Hart, D. L., Stratford, P. W., & Mioduski, J. E. (2011) · Physical Therapy · doi:10.2522/ptj.20100229 · Cited by 152
The minimal detectable change should not replace the minimal important difference.
de Vet, H. D., & Terwee, C. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.12.015 · Cited by 135
Lemieux, J., Beaton, D., Hogg‐Johnson, S., Bordeleau, L. J., & Goodwin, P. J. (2006) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2006.08.006 · Cited by 110
Minimal clinically important difference in myasthenia gravis: Outcomes from a randomized trial
Katzberg, H. D., Barnett, C., Merkies, I. S. J., & Bril, V. (2013) · Muscle & Nerve · doi:10.1002/mus.23988 · Cited by 108
Phillips, K. M., Hoehle, L. P., Caradonna, D. S., Gray, S. T., & Sedaghat, A. R. (2018) · Clinical Otolaryngology · doi:10.1111/coa.13177 · Cited by 108
Self-citationDrummond, M., & O'Brienm, B. (1993) · Health Economics · doi:10.1002/hec.4730020303 · Cited by 87
Minimal clinically important difference of voice handicap index‐10 in vocal fold paralysis
Young, V. N., Jeong, K., Rothenberger, S. D., Gillespie, A. I., Smith, L. J., Gartner‐Schmidt, J. L., & Rosen, C. A. (2017) · The Laryngoscope · doi:10.1002/lary.27001 · Cited by 84
Jayadevappa, R., Malkowicz, S. B., Wittink, M. N., Wein, A. J., & Chhatre, S. (2012) · Health Services Research · doi:10.1111/j.1475-6773.2012.01395.x · Cited by 78
Effect Size Estimation: A Necessary Component of Statistical Analysis
Livingston, E. H., Elliot, A., Hynan, L. S., & Cao, J. (2009) · Archives of Surgery · doi:10.1001/archsurg.2009.150 · Cited by 65
Responsiveness and minimal clinically important difference for the EQ-5D in chronic rhinosinusitis
Hoehle, L. P., Phillips, K. M., Speth, M. M., Caradonna, D. S., Gray, S. T., & Sedaghat, A. R. (2019) · Rhinology Journal · doi:10.4193/rhin18.122 · Cited by 56
Self-citationUnderstanding global transition assessments
Wyrwich, K. W., & Tardino, V. M. S. (2006) · Quality of Life Research · doi:10.1007/s11136-006-0050-8 · Cited by 54
Ward, M. M., Marx, A. S., & Barry, N. N. (2000) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00140-7 · Cited by 45
Phillips, K. M., Hoehle, L. P., Caradonna, D. S., Gray, S. T., & Sedaghat, A. R. (2018) · International Forum of Allergy & Rhinology · doi:10.1002/alr.22269 · Cited by 42
Self-citationDefinition of clinical differences.
de Vet, H. C. W., Beckerman, H., Terwee, C. B., Terluin, B., & Bouter, L. M. (2006) · PubMed · Cited by 41
Evidence‐Based Medicine in Otolaryngology, Part 6: Patient‐Reported Outcomes in Clinical Practice
Carroll, T. L., Lee, S. E., Lindsay, R. W., Locandro, D., Randolph, G. W., & Shin, J. J. (2017) · Otolaryngology · doi:10.1177/0194599817731759 · Cited by 38
Norquist, J., Fitzpatrick, R., & Jenkinson, C. (2004) · Quality of Life Research · doi:10.1023/b:qure.0000040786.75103.3a · Cited by 25
Mather, M. W., Hamilton, D. W., Robalino, S., & Rousseau, N. S. (2018) · Clinical Otolaryngology · doi:10.1111/coa.13200 · Cited by 11
Definition of clinical differences
Vet, H. C. W. D., Beckerman, H., Terwee, C. B., et al. (2006) · Digital Academic REpository of VU University Amsterdam (Vrije Universiteit Amsterdam) · Cited by 3
(2001) · doi:10.1002/1529-0131(200108)45:4<384::aid-art352>3.0.co;2-0
(1950) · doi:10.1002/1097-0142(1950)3:1<32::aid-cncr2820030106>3.0.co;2-3
Cited by
Laigaard, J., Pedersen, C., Rønsbo, T. N., Mathiesen, O., & Karlsen, A. P. H. (2021) · British Journal of Anaesthesia · doi:10.1016/j.bja.2021.01.021 · Cited by 365
Metadata
- Authors
- Sedaghat, A. R.
- Venue
- Otolaryngology–Head and Neck Surgery
- Publisher
- Wiley
- Published
- 2019-06-04
- Volume
- 161
- Issue
- 4
- Pages
- 551-560
- ISSN
- 0161-6439 (ISSN-L)
- 0194-5998
- 1097-6817
- OpenAlex
- W2948341038
- Cited by
- 393
- References
- 73
- FWCI
- 40.21
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.