The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
A point of minimal important difference (MID): a critique of terminology and methods
Abstract
The minimal important difference (MID) is a phrase with instant appeal in a field struggling to interpret health-related quality of life and other patient-reported outcomes. The terminology can be confusing, with several terms differing only slightly in definition (e.g., minimal clinically important difference, clinically important difference, minimally detectable difference, the subjectively significant difference), and others that seem similar despite having quite different meanings (minimally detectable difference versus minimum detectable change). Often, nuances of definition are of little consequence in the way that these quantities are estimated and used. Four methods are commonly employed to estimate MIDs: patient rating of change (global transition items); clinical anchors; standard error of measurement; and effect size. These are described and critiqued in this article. There is no universal MID, despite the appeal of the notion. Indeed, for a particular patient-reported outcome instrument or scale, the MID is not an immutable characteristic, but may vary by population and context. At both the group and individual level, the MID may depend on the clinical context and decision at hand, the baseline from which the patient starts, and whether they are improving or deteriorating. Specific estimates of MIDs should therefore not be overinterpreted. For a given health-related quality-of-life scale, all available MID estimates (and their confidence intervals) should be considered, amalgamated into general guidelines and applied judiciously to any particular clinical or research context.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Toxicity and response criteria of the Eastern Cooperative Oncology Group
Oken, M. M., Creech, R. H., Tormey, D. C., Horton, J., Davis, T. E., McFadden, E. T., & Carbone, P. P. (1982) · AMERICAN JOURNAL OF CLINICAL ONCOLOGY · doi:10.1097/00000421-198212000-00014 · Cited by 11,647
SF-36 health survey: Manual and interpretation guide
Ware, J. (2003) · Medical Entomology and Zoology · Cited by 11,424
Jaeschke, R., Singer, J., & Guyatt, G. H. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90005-6 · Cited by 4,982
Norman, G. R., Sloan, J. A., & Wyrwich, K. W. (2003) · Medical Care · doi:10.1097/01.mlr.0000062554.74615.4c · Cited by 4,700
Dworkin, R. H., Turk, D. C., Wyrwich, K. W., Beaton, D., Cleeland, C. S., Farrar, J. T., Haythornthwaite, J. A., Jensen, M. P., Kerns, R. D., Ader, D. N., et al. (2008) · The Journal of Pain · doi:10.1016/j.jpain.2007.09.005 · Cited by 3,471
Interpreting the significance of changes in health-related quality-of-life scores.
Osoba, D., Rodrigues, G., Myles, J., Zee, B., & Pater, J. (1998) · Journal of Clinical Oncology · doi:10.1200/jco.1998.16.1.139 · Cited by 2,961
Effect Sizes for Interpreting Changes in Health Status
Kazis, L. E., Anderson, J. J., & Meenan, R. F. (1989) · Medical Care · doi:10.1097/00005650-198903001-00015 · Cited by 2,401
Revicki, D., Hays, R. D., Cella, D., & Sloan, J. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.03.012 · Cited by 2,362
Individual-patient monitoring in clinical practice: are available health status surveys adequate?
McHorney, C. A., & Tarlov, A. R. (1995) · Quality of Life Research · doi:10.1007/bf01593882 · Cited by 2,206
Measuring change over time: Assessing the usefulness of evaluative instruments
Guyatt, G., Walter, S., & Norman, G. (1987) · Journal of Chronic Diseases · doi:10.1016/0021-9681(87)90069-5 · Cited by 1,880
Quality of life and pharmacoeconomics in clinical trials
Spilker, B. (1996) · DigitalGeorgetown (Georgetown University Library) · Cited by 1,862
Relation of implicit theories to the construction of personal histories.
Ross, M. (1989) · Psychological Review · doi:10.1037//0033-295x.96.2.341 · Cited by 1,564
Methods to Explain the Clinical Significance of Health Status Measures
Guyatt, G. H., Osoba, D., Wu, A. W., Wyrwich, K. W., & Norman, G. R. (2002) · Mayo Clinic Proceedings · doi:10.4065/77.4.371 · Cited by 1,500
Quality of Life: Assessment, Analysis, and Interpretation
Fayers, P. M. (2000) · Medical Entomology and Zoology · Cited by 1,490
Quality of Life: The assessment, analysis and interpretation of patient-reported outcomes
Fayers, P. M., & Machin, D. (2007) · Cited by 1,419
Quality of Life: The Assessment, Analysis and Interpretation of Patient‐Reported Outcomes
Fayers, P. M., & Machin, D. (2007) · doi:10.1002/9780470024522 · Cited by 865
Wyrwich, K. W., Tierney, W. M., & Wolinsky, F. D. (1999) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(99)00071-2 · Cited by 862
Smallest real difference, a link between reproducibility and responsiveness
Beckerman, H., Roebroeck, M. E., Lankhorst, G. J., Becher, J. G., Bezemer, P. D., & Verbeek, A. L. M. (2001) · Quality of Life Research · doi:10.1023/a:1013138911638 · Cited by 857
de Vet, H. C., Terwee, C. B., Ostelo, R. W., Beckerman, H., Knol, D. L., & Bouter, L. M. (2006) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-4-54 · Cited by 829
Cella, D., Eton, D. T., Lai, J.-S., Peterman, A. H., & Merkel, D. E. (2002) · Journal of Pain and Symptom Management · doi:10.1016/s0885-3924(02)00529-8 · Cited by 808
The interpretation of scores from the EORTC quality of life questionnaire QLQ-C30
King, M. T. (1996) · Quality of Life Research · doi:10.1007/bf00439229 · Cited by 666
Self-citationCocks, K., King, M. T., Velikova, G., Martyn St-James, M., Fayers, P. M., & Brown, J. M. (2011) · Journal of Clinical Oncology · doi:10.1200/jco.2010.28.0107 · Cited by 658
Self-citationInterpretation of quality of life changes
Lydick, E., & Epstein, R. S. (1993) · Quality of Life Research · doi:10.1007/bf00435226 · Cited by 527
Norman, G. R., Stratford, P., & Regehr, G. (1997) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(97)00097-8 · Cited by 524
Beaton, D. E., Boers, M., & Wells, G. A. (2002) · Current Opinion in Rheumatology · doi:10.1097/00002281-200203000-00006 · Cited by 513
Hays, R. D., & Woolley, J. M. (2000) · PharmacoEconomics · doi:10.2165/00019053-200018050-00001 · Cited by 488
Estimating clinically significant differences in quality of life outcomes
Wyrwich, K. W., Bullinger, M., Aaronson, N., Hays, R. D., Patrick, D. L., & Symonds, T. (2005) · Quality of Life Research · doi:10.1007/s11136-004-0705-2 · Cited by 471
de Vet, H. C. W., Ostelo, R. W. J. G., Terwee, C. B., van der Roer, N., Knol, D. L., Beckerman, H., Boers, M., & Bouter, L. M. (2007) · Quality of Life Research · doi:10.1007/s11136-006-9109-9 · Cited by 383
Yost, K. J., & Eton, D. T. (2005) · Evaluation & the Health Professions · doi:10.1177/0163278705275340 · Cited by 382
Assessing the minimal important difference in symptoms: A comparison of two techniques
Redelmeier, D. A., Guyatt, G. H., & Goldstein, R. S. (1996) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(96)00206-5 · Cited by 372
The minimal detectable change cannot reliably replace the minimal important difference
Turner, D., Schünemann, H. J., Griffith, L. E., Beaton, D. E., Griffiths, A. M., Critch, J. N., & Guyatt, G. H. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.01.024 · Cited by 356
Interpreting clinically significant changes in patient‐reported outcomes
Ringash, J., O'Sullivan, B., Bezjak, A., & Redelmeier, D. A. (2007) · Cancer · doi:10.1002/cncr.22799 · Cited by 305
Adaptation to changing health: Response shift in quality-of-life research.
(2000) · American Psychological Association eBooks · doi:10.1037/10382-000 · Cited by 301
Osoba, D., Bezjak, A., Brundage, M., Zee, B., Tu, D., & Pater, J. (2005) · European Journal of Cancer · doi:10.1016/j.ejca.2004.10.017 · Cited by 288
Hays, R. D., Farivar, S. S., & Liu, H. (2005) · COPD: Journal of Chronic Obstructive Pulmonary Disease · doi:10.1081/copd-200050663 · Cited by 250
Commentary—Goodbye M(C)ID! Hello MID, Where Do You Come From?
Schünemann, H. J., & Guyatt, G. H. (2005) · Health Services Research · doi:10.1111/j.1475-6773.2005.0k375.x · Cited by 247
Assessing quality of life in clinical trials : methods and practice
Fayers, P. M., & Hays, R. D. (2005) · DigitalGeorgetown (Georgetown University Library) · Cited by 241
Beaton, D., Bombardier, C., Katz, J. N., Wright, J. G., Wells, G. A., Boers, M., Strand, V., & Shea, B. (2001) · PubMed · Cited by 237
Commentary--goodbye M(C)ID! Hello MID, where do you come from?
Schünemann, H. J., & Guyatt, G. H. (2005) · PubMed · doi:10.1111/j.1475-6773.2005.00374.x · Cited by 210
Use of patient-reported outcomes in clinical practice
Snyder, C. F., & Aaronson, N. K. (2009) · The Lancet · doi:10.1016/s0140-6736(09)61400-8 · Cited by 199
Half standard deviation estimate of the minimally important difference in HRQOL scores?
Farivar, S. S., Liu, H., & Hays, R. D. (2004) · Expert Review of Pharmacoeconomics & Outcomes Research · doi:10.1586/14737167.4.5.515 · Cited by 184
Cocks, K., King, M. T., Velikova, G., Fayers, P. M., & Brown, J. M. (2008) · European Journal of Cancer · doi:10.1016/j.ejca.2008.05.008 · Cited by 181
Self-citationYOST, K., CELLA, D., CHAWLA, A., HOLMGREN, E., ETON, D., AYANIAN, J., & WEST, D. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.07.008 · Cited by 179
Wyrwich, K. W. (2004) · Journal of Biopharmaceutical Statistics · doi:10.1081/bip-120028508 · Cited by 178
Hi! How are you? Response shift, implicit theories and differing epistemologies
Norman, G. (2003) · Quality of Life Research · doi:10.1023/a:1023211129926 · Cited by 171
Sloan, J. A., Cella, D., Frost, M. H., Guyatt, G. H., Sprangers, M. A. G., & Symonds, T. (2002) · Mayo Clinic Proceedings · doi:10.4065/77.4.367 · Cited by 171
Three ways to quantify uncertainty in individually applied “minimally important change” values
de Vet, H. C. W., Terluin, B., Knol, D. L., Roorda, L. D., Mokkink, L. B., Ostelo, R., Hendriks, E., Bouter, L. M., & Terwee, C. B. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.03.011 · Cited by 165
on behalf of the EORTC PROBE project and the Lung Cancer Group, Maringwa, J. T., Quinten, C., King, M., Ringash, J., Osoba, D., Coens, C., Martinelli, F., Vercauteren, J., Cleeland, C. S., et al. (2011) · Supportive Care in Cancer · doi:10.1007/s00520-010-1016-5 · Cited by 164
Self-citationWyrwich, K. W., Tierney, W. M., & Wolinsky, F. D. (2002) · Quality of Life Research · doi:10.1023/a:1014485627744 · Cited by 143
Deyo, R. A., Inui, T. S., Leininger, J., & Overman, S. (1982) · Archives of Internal Medicine · doi:10.1001/archinte.142.5.879 · Cited by 138
Guyatt, G. H., & Schünemann, H. J. (2007) · Quality of Life Research · doi:10.1007/s11136-007-9223-3 · Cited by 101
Interpreting differences in quality of life: The FACT-H&N in laryngeal cancer patients
Ringash, J. G., Bezjak, A., O’Sullivan, B., & Redelmeier, D. A. (2004) · Quality of Life Research · doi:10.1023/b:qure.0000021703.47079.46 · Cited by 86
King (2010) · Patient Related Outcome Measures · doi:10.2147/prom.s10621 · Cited by 68
Simple as Possible? Or Too Simple?
Beaton, D. (2003) · Medical Care · doi:10.1097/01.mlr.0000064706.35861.b4 · Cited by 64
Kvam, A. K., Fayers, P. M., & Wislöff, F. (2009) · European Journal Of Haematology · doi:10.1111/j.1600-0609.2009.01404.x · Cited by 63
King, M. T., Stockler, M. R., Cella, D. F., Osoba, D., Eton, D. T., Thompson, J., & Eisenstein, A. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.05.001 · Cited by 58
Self-citationUnderstanding global transition assessments
Wyrwich, K. W., & Tardino, V. M. S. (2006) · Quality of Life Research · doi:10.1007/s11136-006-0050-8 · Cited by 54
Knox, S. A., & King, M. T. (2009) · Quality of Life Research · doi:10.1007/s11136-009-9467-1 · Cited by 49
Self-citationDefinition of clinical differences.
de Vet, H. C. W., Beckerman, H., Terwee, C. B., Terluin, B., & Bouter, L. M. (2006) · PubMed · Cited by 41
Wyrwich, K. W., Metz, S. M., Kroenke, K., Tierney, W. M., Babu, A. N., & Wolinsky, F. D. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-006-0063-6 · Cited by 40
Identifying meaningful differences in vasomotor symptoms among menopausal women
Wyrwich, K. W., Spratt, D. I., Gass, M. L. S., Yu, H., & Bobula, J. D. (2008) · Menopause The Journal of The North American Menopause Society · doi:10.1097/gme.0b013e31815f892d · Cited by 32
Wyrwich, K. W., Metz, S. M., Kroenke, K., Tierney, W. M., Babu, A. N., & Wolinsky, F. D. (2007) · Health Services Research · doi:10.1111/j.1475-6773.2007.00733.x · Cited by 32
Interpreting Health-Related Quality of Life Scores
Wright, J. G. (2003) · Medical Care · doi:10.1097/00005650-200305000-00006 · Cited by 32
Metz, S. M., Wyrwich, K. W., Babu, A. N., Kroenke, K., Tierney, W. M., & Wolinsky, F. D. (2006) · Quality of Life Research · doi:10.1007/s11136-006-0036-6 · Cited by 16
Interpreting quality-of-life data: methods for community consensus in asthma
Wyrwich, K. W., Metz, S. M., Kroenke, K., Tierney, W. M., Babu, A. N., & Wolinsky, F. D. (2006) · Annals of Allergy Asthma & Immunology · doi:10.1016/s1081-1206(10)61345-2 · Cited by 3
(2001) · doi:10.1002/1529-0131(200108)45:4<384::aid-art352>3.0.co;2-0
Cited by
Lakens, D. (2022) · Collabra Psychology · doi:10.1525/collabra.33267 · Cited by 1,962
Calvert, M., Kyte, D., Mercieca-Bebber, R., Slade, A., Chan, A.-W., King, M. T., and the SPIRIT-PRO Group, Hunn, A., Bottomley, A., Regnault, A., et al. (2018) · JAMA · doi:10.1001/jama.2017.21903 · Cited by 814
Self-citationTerwee, C. B., Peipert, J. D., Chapman, R., Lai, J.-S., Terluin, B., Cella, D., Griffiths, P., & Mokkink, L. B. (2021) · Quality of Life Research · doi:10.1007/s11136-021-02925-y · Cited by 556
Intra-articular treatment options for knee osteoarthritis
Jones, I. A., Togashi, R., Wilson, M. L., Heckmann, N., & Vangsness, C. T. (2019) · Nature Reviews Rheumatology · doi:10.1038/s41584-018-0123-4 · Cited by 525
Meaningful changes for the Oxford hip and knee scores after joint replacement surgery
Beard, D. J., Harris, K., Dawson, J., Doll, H., Murray, D. W., Carr, A. J., & Price, A. J. (2015) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2014.08.009 · Cited by 496
Metadata
- Authors
- King, M. T.
- Venue
- Expert Review of Pharmacoeconomics & Outcomes Research
- Publisher
- Informa UK Limited
- Published
- 2011-04
- Volume
- 11
- Issue
- 2
- Pages
- 171-184
- ISSN
- 1473-7167 (ISSN-L)
- 1744-8379
- OpenAlex
- W2139006680
- Cited by
- 646
- References
- 66
- FWCI
- 46.69
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.