The DOI matches its Crossref record; 109 of the 109 references it cites were found in a registry or an index.
Statistical significant change versus relevant or important change in (quasi) experimental design: some conceptual and methodological problems in estimating magnitude of intervention-related change in health services research
Open accessAbstract
This paper aims to identify problems in estimating and the interpretation of the magnitude of intervention-related change over time or responsiveness assessed with health outcome measures. Responsiveness is a problematic construct and there is no consensus on how to quantify the appropriate index to estimate change over time between baseline and post-test designs. This paper gives an overview of several responsiveness indices. Thresholds for effect size (or responsiveness index) interpretation were introduced some thirty years ago by Cohen who standardised the difference-scores (d) with the pooled standard deviation (d/SD(pooled)). However, many effect sizes (ES) have been introduced since Cohen's original work and in the formula of one of these ES, the mean change scores are standardised with the SD of those change scores (d/SD(change)). When health outcome questionnaires are used, this effect size is applied on a wide scale and is represented as the Standardized Response Mean (SRM). However, its interpretation is problematic when it is used as an estimate of magnitude of change over time and interpreted with the thresholds, set by Cohen for effect size (ES) which is based on SD(pooled). Thus, in the case of using the SRM, application of these well-known cut-off points for pooled standard deviation units namely: 'trivial' (ES < 0.20), 'small' (ES > or = 0.20 < 0.50), 'moderate' (ES > or = 0.50 < 0.80), or large (ES > or = 0.80), may lead to over- or underestimation of the magnitude of intervention-related change over time due to the correlation between baseline and outcome assessments. Consequently, taking Cohen's thresholds for granted for every version of effect size indices as estimates of intervention-related magnitude of change, may lead to over- or underestimation of this magnitude of intervention-related change over time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1992) · PubMed · Cited by 33,716
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
MCHORNEY, C. A., JOHNE, W., & ANASTASIAE, R. (1993) · Medical Care · doi:10.1097/00005650-199303000-00006 · Cited by 6,681
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Measuring Health-Related Quality of Life
Guyatt, G. H., Feeny, D. H., & Patrick, D. L. (1993) · Annals of Internal Medicine · doi:10.7326/0003-4819-118-8-199304150-00009 · Cited by 3,958
Interpreting the significance of changes in health-related quality-of-life scores.
Osoba, D., Rodrigues, G., Myles, J., Zee, B., & Pater, J. (1998) · Journal of Clinical Oncology · doi:10.1200/jco.1998.16.1.139 · Cited by 2,961
Effect Sizes for Interpreting Changes in Health Status
Kazis, L. E., Anderson, J. J., & Meenan, R. F. (1989) · Medical Care · doi:10.1097/00005650-198903001-00015 · Cited by 2,401
A Critical Appraisal of the Quality of Quality-of-Life Measurements
Gill, T. M. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520080061045 · Cited by 2,208
Stewart, A. L. (1989) · JAMA · doi:10.1001/jama.262.7.907 · Cited by 2,085
Cited by
Ryan, P., & Sawin, K. J. (2009) · Nursing Outlook · doi:10.1016/j.outlook.2008.10.004 · Cited by 865
Viscosupplementation for the treatment of osteoarthritis of the knee
Bellamy, N., Campbell, J., Welch, V., Gee, T. L., Bourne, R., & Wells, G. A. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005321.pub2 · Cited by 755
Coleman, E. A., Smith, J. D., Frank, J. C., Min, S., Parry, C., & Kramer, A. M. (2004) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2004.52504.x · Cited by 645
Rosenzweig, S., Greeson, J. M., Reibel, D. K., Green, J. S., Jasser, S. A., & Beasley, D. (2010) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2009.03.010 · Cited by 517
Measuring the Psychological Outcomes of Falling: A Systematic Review
Jørstad, E. C., Hauer, K., Becker, C., Lamb, S. E., & on behalf of the ProFaNE Group (2005) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2005.53172.x · Cited by 512
Metadata
- Authors
- Middel, B., & Van Sonderen, E.
- Venue
- International Journal of Integrated Care
- Publisher
- Ubiquity Press, Ltd.
- Published
- 2002-12-17
- Volume
- 2
- Issue
- 4
- Pages
- e15-e15
- ISSN
- 1568-4156 (ISSN-L)
- OpenAlex
- W2101619031
- Cited by
- 464
- References
- 109
- FWCI
- 5.12
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Statistical significant change versus relevant or important change in (quasi) experimental design: some conceptual and methodological problems in estimating magnitude of intervention-related change in health services research. https://app.cochat.ai/papers/10.5334/ijic.65
- The paper
- Middel, B., & Van Sonderen, E. (2002). Statistical significant change versus relevant or important change in (quasi) experimental design: some conceptual and methodological problems in estimating magnitude of intervention-related change in health services research. International Journal of Integrated Care. https://doi.org/10.5334/ijic.65
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.