Mind the methods of determining minimal important differences: three critical issues to consider
Open accessThe DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Abstract
Objective: Clinical trialists, meta-analysts and clinical guideline developers are increasingly using minimal important differences (MIDs) to enhance the interpretability of patient-reported outcome measures (PROMs). Here, we elucidate three critical issues of which MID users should be aware. Improved understanding of MID concepts and awareness of common pitfalls in methodology and reporting will better inform the application of MIDs in clinical research and decision-making. Methods: We conducted a systematic review to inform the development of an inventory of anchor-based MID estimates for PROMs. We searched four electronic databases to identify primary studies empirically calculating an anchor-based MID estimate for any PROM in adolescent or adult populations across all clinical areas. Our findings are based on information from 338 studies reporting 3389 MIDs for 358 PROMs published between 1989 and 2015. Results: We identified three key issues in the MID literature that demand attention. (1) The profusion of terms representing the MID concept adds unnecessary complexity to users’ task in identifying relevant MIDs, requiring meticulous inspection of methodology to ensure estimates offered truly reflect the MID. (2) A multitude of diverse methods for MID estimation that will yield different estimates exist, and whether there are superior options remains unresolved. (3) There are serious issues of incomplete presentation and reporting of key aspects of the design, methodology and results of studies providing anchor-based MIDs, which threatens the optimal use of these estimates for interpretation of intervention effects on PROMs. Conclusions: Although the MID represents a powerful tool for enhancing the interpretability of PROMs, realising its full value will require improved understanding and reporting of its measurement fundamentals.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical Power Analysis for the Behavioral Sciences
Cohen, J. (2013) · doi:10.4324/9780203771587 · Cited by 25,373
Norman, G. R., Sloan, J. A., & Wyrwich, K. W. (2003) · Medical Care · doi:10.1097/01.mlr.0000062554.74615.4c · Cited by 4,700
U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research, U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research, & U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health (2006) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-4-79 · Cited by 2,856
Determining a minimal important change in a disease-specific quality of life questionnaire
JUNIPER, E. (1994) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)90036-1 · Cited by 1,824
Understanding the minimum clinically important difference: A review of concepts and methods
Copay, A. G., Subach, B. R., Glassman, S. D., Polly, D. W., & Schuler, T. C. (2007) · The Spine Journal · doi:10.1016/j.spinee.2007.01.008 · Cited by 1,662
Turner, L., Shamseer, L., Altman, D. G., Weeks, L., Peters, J., Kober, T., Dias, S., Schulz, K. F., Plint, A. C., & Moher, D. (2012) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000030.pub2 · Cited by 740
Jacobson, N. S., & Truax, P. (1992) · Methodological issues & strategies in clinical research. · doi:10.1037/10109-042 · Cited by 384
Speer, D. C., & Greenbaum, P. E. (1995) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.63.6.1044 · Cited by 216
Patient reported outcomes: looking beyond the label claim
Doward, L. C., Gnanasakthy, A., & Baker, M. G. (2010) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-8-89 · Cited by 162
Cited by
Guidelines for Reporting Outcomes in Trial Reports: The CONSORT-Outcomes 2022 Extension
Butcher, N. J., Monsour, A., Mew, E. J., Chan, A.-W., Moher, D., Mayo-Wilson, E., Terwee, C. B., Chee-A-Tow, A., Baba, A., Gavin, F., et al. (2022) · JAMA · doi:10.1001/jama.2022.21022 · Cited by 719
Guidelines for Reporting Outcomes in Trial Protocols: The SPIRIT-Outcomes 2022 Extension
Butcher, N. J., Monsour, A., Mew, E. J., Chan, A.-W., Moher, D., Mayo-Wilson, E., Terwee, C. B., Chee-A-Tow, A., Baba, A., Gavin, F., et al. (2022) · JAMA · doi:10.1001/jama.2022.21243 · Cited by 288
Lindvall, E., Abzhandadze, T., Quinn, T. J., Sunnerhagen, K. S., & Lundström, E. (2024) · Cerebral Circulation - Cognition and Behavior · doi:10.1016/j.cccb.2024.100222 · Cited by 61
How much is enough? Considering minimally important change in youth mental health outcomes
Krause, K. R., Hetrick, S. E., Courtney, D. B., Cost, K. T., Butcher, N. J., Offringa, M., Monga, S., Henderson, J., & Szatmari, P. (2022) · The Lancet Psychiatry · doi:10.1016/s2215-0366(22)00338-8 · Cited by 15
Metadata
- Authors
- Devji, T., Carrasco-Labra, A., & Guyatt, G.
- Venue
- Evidence Based Mental Health
- Publisher
- BMJ
- Published
- 2020-08-24
- Volume
- 24
- Issue
- 2
- Pages
- 77-81
- ISSN
- 1362-0347 (ISSN-L)
- 1468-960X
- OpenAlex
- W3080828969
- Cited by
- 72
- References
- 9
- FWCI
- 5.64
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Mind the methods of determining minimal important differences: three critical issues to consider. https://app.cochat.ai/papers/10.1136/ebmental-2020-300164
- The paper
- Devji, T., Carrasco-Labra, A., & Guyatt, G. (2021). Mind the methods of determining minimal important differences: three critical issues to consider. Evidence Based Mental Health. https://doi.org/10.1136/ebmental-2020-300164
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.