The DOI matches its Crossref record; 109 of the 109 references it cites were found in a registry or an index.
Statistical significant change versus relevant or important change in (quasi) experimental design: some conceptual and methodological problems in estimating magnitude of intervention-related change in health services research
Open accessAbstract
This paper aims to identify problems in estimating and the interpretation of the magnitude of intervention-related change over time or responsiveness assessed with health outcome measures. Responsiveness is a problematic construct and there is no consensus on how to quantify the appropriate index to estimate change over time between baseline and post-test designs. This paper gives an overview of several responsiveness indices. Thresholds for effect size (or responsiveness index) interpretation were introduced some thirty years ago by Cohen who standardised the difference-scores (d) with the pooled standard deviation (d/SD(pooled)). However, many effect sizes (ES) have been introduced since Cohen's original work and in the formula of one of these ES, the mean change scores are standardised with the SD of those change scores (d/SD(change)). When health outcome questionnaires are used, this effect size is applied on a wide scale and is represented as the Standardized Response Mean (SRM). However, its interpretation is problematic when it is used as an estimate of magnitude of change over time and interpreted with the thresholds, set by Cohen for effect size (ES) which is based on SD(pooled). Thus, in the case of using the SRM, application of these well-known cut-off points for pooled standard deviation units namely: 'trivial' (ES < 0.20), 'small' (ES > or = 0.20 < 0.50), 'moderate' (ES > or = 0.50 < 0.80), or large (ES > or = 0.80), may lead to over- or underestimation of the magnitude of intervention-related change over time due to the correlation between baseline and outcome assessments. Consequently, taking Cohen's thresholds for granted for every version of effect size indices as estimates of intervention-related magnitude of change, may lead to over- or underestimation of this magnitude of intervention-related change over time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(1992) · PubMed · Cited by 33,716
Statistical principles in experimental design.
Winer, B. J. (1962) · McGraw-Hill Book Company · doi:10.1037/11774-000 · Cited by 26,755
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770
MCHORNEY, C. A., JOHNE, W., & ANASTASIAE, R. (1993) · Medical Care · doi:10.1097/00005650-199303000-00006 · Cited by 6,681
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Measuring Health-Related Quality of Life
Guyatt, G. H., Feeny, D. H., & Patrick, D. L. (1993) · Annals of Internal Medicine · doi:10.7326/0003-4819-118-8-199304150-00009 · Cited by 3,958
Interpreting the significance of changes in health-related quality-of-life scores.
Osoba, D., Rodrigues, G., Myles, J., Zee, B., & Pater, J. (1998) · Journal of Clinical Oncology · doi:10.1200/jco.1998.16.1.139 · Cited by 2,961
Effect Sizes for Interpreting Changes in Health Status
Kazis, L. E., Anderson, J. J., & Meenan, R. F. (1989) · Medical Care · doi:10.1097/00005650-198903001-00015 · Cited by 2,401
A Critical Appraisal of the Quality of Quality-of-Life Measurements
Gill, T. M. (1994) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1994.03520080061045 · Cited by 2,208
Stewart, A. L. (1989) · JAMA · doi:10.1001/jama.262.7.907 · Cited by 2,085
Cited by
Ryan, P., & Sawin, K. J. (2009) · Nursing Outlook · doi:10.1016/j.outlook.2008.10.004 · Cited by 865
Viscosupplementation for the treatment of osteoarthritis of the knee
Bellamy, N., Campbell, J., Welch, V., Gee, T. L., Bourne, R., & Wells, G. A. (2006) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005321.pub2 · Cited by 755
Coleman, E. A., Smith, J. D., Frank, J. C., Min, S., Parry, C., & Kramer, A. M. (2004) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2004.52504.x · Cited by 645
Rosenzweig, S., Greeson, J. M., Reibel, D. K., Green, J. S., Jasser, S. A., & Beasley, D. (2010) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2009.03.010 · Cited by 517
Measuring the Psychological Outcomes of Falling: A Systematic Review
Jørstad, E. C., Hauer, K., Becker, C., Lamb, S. E., & on behalf of the ProFaNE Group (2005) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.2005.53172.x · Cited by 512
End-of-Life Transitions among Nursing Home Residents with Cognitive Issues
Gozalo, P., Teno, J. M., Mitchell, S. L., Skinner, J., Bynum, J., Tyler, D., & Mor, V. (2011) · New England Journal of Medicine · doi:10.1056/nejmsa1100347 · Cited by 484
Sheehan, K. H., & Sheehan, D. V. (2008) · International Clinical Psychopharmacology · doi:10.1097/yic.0b013e3282f2b4d6 · Cited by 467
Posthospital Care Transitions: Patterns, Complications, and Risk Identification
Coleman, E. A., Min, S., Chomiak, A., & Kramer, A. M. (2004) · Health Services Research · doi:10.1111/j.1475-6773.2004.00298.x · Cited by 416
Cameron, J. I., & Gignac, M. A. M. (2008) · Patient Education and Counseling · doi:10.1016/j.pec.2007.10.020 · Cited by 337
Oeffinger, D., Bagley, A., Rogers, S., Gorton, G., Kryscio, R., Abel, M., Damiano, D., Barnes, D., & Tylkowski, C. (2008) · Developmental Medicine & Child Neurology · doi:10.1111/j.1469-8749.2008.03150.x · Cited by 321
Validity of the AM-PAC “6-Clicks” Inpatient Daily Activity and Basic Mobility Short Forms
Jette, D. U., Stilphen, M., Ranganathan, V. K., Passek, S. D., Frost, F. S., & Jette, A. M. (2014) · Physical Therapy · doi:10.2522/ptj.20130199 · Cited by 311
Orr, R., Raymond, J., & Fiatarone Singh, M. (2008) · Sports Medicine · doi:10.2165/00007256-200838040-00004 · Cited by 297
Barriers to the Integration of Care in Inter-Organisational Settings: A Literature Review
Auschra, C. (2018) · International Journal of Integrated Care · doi:10.5334/ijic.3068 · Cited by 276
Effects of Exercise on Adiponectin: A Systematic Review
Simpson, K. A., & Singh, M. A. F. (2008) · Obesity · doi:10.1038/oby.2007.53 · Cited by 264
Pusic, A. L., Chen, C. M., Cano, S., Klassen, A., McCarthy, C., Collins, E. D., & Cordeiro, P. G. (2007) · Plastic and Reconstructive Surgery · doi:10.1097/01.prs.0000278162.82906.81 · Cited by 258
The Brunnsviken Brief Quality of Life Scale (BBQ): development and psychometric evaluation
Lindner, P., Frykheden, O., Forsström, D., Andersson, E., Ljótsson, B., Hedman, E., Andersson, G., & Carlbring, P. (2016) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2016.1143526 · Cited by 212
“Responsiveness to change among participants who received treatment was assessed by calculating the standardized response mean, transformed using the pre-post correlation to equal between-group effect sizes (Middel & van Sonderen, 2002).”
MethodKey attributes of integrated community-based youth service hubs for mental health: a scoping review
Settipani, C. A., Hawke, L. D., Cleverley, K., Chaim, G., Cheung, A., Mehra, K., Rice, M., Szatmari, P., & Henderson, J. (2019) · International Journal of Mental Health Systems · doi:10.1186/s13033-019-0306-7 · Cited by 172
Deyo, R. A., Ramsey, K., Buckley, D. I., Michaels, L., Kobus, A., Eckstrom, E., Forro, V., & Morris, C. (2016) · Pain Medicine · doi:10.1093/pm/pnv046 · Cited by 170
Bartels, H., Middel, B. L., van der Laan, B. F. A. M., Staal, M. J., & Albers, F. W. J. (2008) · Ear & Hearing · doi:10.1097/aud.0b013e3181888f83 · Cited by 113
Khera, R., Pandey, A., Chandar, A. K., Murad, M. H., Prokop, L. J., Neeland, I. J., Berry, J. D., Camilleri, M., & Singh, S. (2018) · Gastroenterology · doi:10.1053/j.gastro.2017.12.024 · Cited by 90
de Groot, M., & Kollen, B. J. (2013) · BMJ · doi:10.1136/bmj.f5519 · Cited by 83
Borland, E., Edgar, C., Stomrud, E., Cullen, N., Hansson, O., & Palmqvist, S. (2022) · Neurology · doi:10.1212/wnl.0000000000200817 · Cited by 83
A hybrid approach for integrated healthcare cooperative purchasing and supply chain configuration
Rego, N., Claro, J., & Pinho de Sousa, J. (2014) · Health Care Management Science · doi:10.1007/s10729-013-9262-y · Cited by 55
Health care transitions for persons living with dementia and their caregivers
Ashbourne, J., Boscart, V., Meyer, S., Tong, C. E., & Stolee, P. (2021) · BMC Geriatrics · doi:10.1186/s12877-021-02235-5 · Cited by 49
Graef, J. E., Rief, W., French, D. J., Nilges, P., & Nestoriuc, Y. (2015) · Headache The Journal of Head and Face Pain · doi:10.1111/head.12564 · Cited by 18
Metadata
- Authors
- Middel, B., & Van Sonderen, E.
- Venue
- International Journal of Integrated Care
- Publisher
- Ubiquity Press, Ltd.
- Published
- 2002-12-17
- Volume
- 2
- Issue
- 4
- Pages
- e15-e15
- ISSN
- 1568-4156 (ISSN-L)
- OpenAlex
- W2101619031
- Cited by
- 464
- References
- 109
- FWCI
- 5.12
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.