The DOI matches its Crossref record; 23 of the 23 references it cites were found in a registry or an index.
Assessing the clinical significance of change scores recorded on subjective outcome measures
Abstract
BACKGROUND: To date, clinical trials have relied almost exclusively on the statistical significance of changes in scores from outcome measures in interpreting the effectiveness of treatment interventions. It is becoming increasingly important, however, to determine the clinical rather than statistical significance of these change scores. OBJECTIVE: To determine cutoff values for change scores that distinguish patients who have clinically improved from those who have not. METHOD: Data were obtained from 165 back and 100 neck patients undergoing chiropractic treatment. Patients completed the Bournemouth Questionnaire (BQ) before treatment and the BQ and Patient's Global Impression of Change (PGIC) scale after treatment. Three statistical methods were applied to individual change scores on the BQ. These were (1) the Reliable Change Index (RCI); (2) the effect size (ES); and (3) the raw and percentage change scores. The PGIC scale was used as the "gold standard" of clinically significant change. RESULTS: The RCI, using the cutoff value of >1.96, appropriately identified clinical improvement in back patients but not in neck patients. An individual ES of approximately 0.5 had the highest sensitivity and specificity in distinguishing back and neck patients who had undergone clinically significant improvement from those who had not. In terms of raw score changes, percentage BQ change scores [(raw change score/baseline score) x 100] of 47% and 34% were identified as having the highest sensitivity and specificity in distinguishing clinically significant improvement from nonimprovement in back and neck patients, respectively. CONCLUSION: This study provides a methodological framework for identifying clinically significant change in patients. This approach has important implications in providing clinically relevant information about the effect of a treatment intervention in an individual patient.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Farrar, J. T., Young, J. P., LaMoreaux, L., Werth, J. L., & Poole, M. R. (2001) · Pain · doi:10.1016/s0304-3959(01)00349-9 · Cited by 5,808
Jaeschke, R., Singer, J., & Guyatt, G. H. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90005-6 · Cited by 4,982
Effect Sizes for Interpreting Changes in Health Status
Kazis, L. E., Anderson, J. J., & Meenan, R. F. (1989) · Medical Care · doi:10.1097/00005650-198903001-00015 · Cited by 2,401
Empirical evidence of design-related bias in studies of diagnostic tests.
Lijmer, J. G. (1999) · JAMA · doi:10.1001/jama.282.11.1061 · Cited by 1,861
Determining a minimal important change in a disease-specific quality of life questionnaire
JUNIPER, E. (1994) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)90036-1 · Cited by 1,824
Jacobson, N. S., Follette, W. C., & Revenstorf, D. (1984) · Behavior Therapy · doi:10.1016/s0005-7894(84)80002-7 · Cited by 1,294 · cited 1×
“PGIC scale* % (n) % (n) 1) No change or worse 6.1 (10) 2.0 (2) 2) Almost the same 2.4 (4) 2.0 (2) 3) A little better 7.3 (12) 5.0 (5) 4) Somewhat better 2.4 (4) 8.0 ( 8 ) 5) Moderately better 24.9 (41) 20.0 (20) 6) Better 39.4 (65) 37.0 (37) 7) A great deal better 17.6 (29) 26.0 (26)”
InfluentialDefining the clinically important difference in pain outcome measures
Farrar, J. T., Portenoy, R. K., Berlin, J. A., Kinman, J. L., & Strom, B. L. (2000) · Pain · doi:10.1016/s0304-3959(00)00339-0 · Cited by 1,071
Deyo, R. A., & Centor, R. M. (1986) · Journal of Chronic Diseases · doi:10.1016/0021-9681(86)90038-x · Cited by 792
Responsiveness of functional status in low back pain: a comparison of different instruments
Beurskens, A. J. H. M., de Vet, H. C. W., & Köke, A. J. A. (1996) · Pain · doi:10.1016/0304-3959(95)00149-2 · Cited by 573
Wyrwich, K. W., Nienaber, N. A., Tierney, W. M., & Wolinsky, F. D. (1999) · Medical Care · doi:10.1097/00005650-199905000-00006 · Cited by 569
Cited by
Freynhagen, R., Strojek, K., Griesing, T., Whalen, E., & Balkenohl, M. (2005) · Pain · doi:10.1016/j.pain.2005.02.032 · Cited by 572
Outcome measures in chronic low back pain
Maughan, E. F., & Lewis, J. S. (2010) · European Spine Journal · doi:10.1007/s00586-010-1353-6 · Cited by 438
Huntington Study Group, Frank, S., Testa, C. M., Stamler, D., Kayson, E., Davis, C., Edmondson, M. C., Kinel, S., Leavitt, B., Oakes, D., et al. (2016) · JAMA · doi:10.1001/jama.2016.8655 · Cited by 403
Cleland, J. A., Childs, J. D., Fritz, J. M., Whitman, J. M., & Eberhart, S. L. (2007) · Physical Therapy · doi:10.2522/ptj.20060155 · Cited by 318
Farrar, J. T., Troxel, A. B., Stott, C., Duncombe, P., & Jensen, M. P. (2008) · Clinical Therapeutics · doi:10.1016/j.clinthera.2008.05.011 · Cited by 252
Jensen, K. B., Kosek, E., Wicksell, R., Kemani, M., Olsson, G., Merle, J. V., Kadetoff, D., & Ingvar, M. (2012) · PAIN · doi:10.1016/j.pain.2012.04.010 · Cited by 230
Larsson, A., Palstam, A., Löfgren, M., Ernberg, M., Bjersing, J., Bileviciute-Ljungar, I., Gerdle, B., Kosek, E., & Mannerkorpi, K. (2015) · Arthritis Research & Therapy · doi:10.1186/s13075-015-0679-1 · Cited by 197
Cook, J., Hislop, J., Adewuyi, T., Harrild, K., Altman, D., Ramsay, C., Fraser, C., Buckley, B., Fayers, P., Harvey, I., et al. (2014) · Health Technology Assessment · doi:10.3310/hta18280 · Cited by 194
Measuring clinically meaningful change following mental health treatment
Eisen, S. V., Ranganathan, G., Seal, P., & Spiro, A. (2007) · The Journal of Behavioral Health Services & Research · doi:10.1007/s11414-007-9066-2 · Cited by 126
Medicinal cannabis in Australia, 2016: the Cannabis as Medicine Survey (CAMS-16)
Lintzeris, N., Driels, J., Elias, N., Arnold, J. C., McGregor, I. S., & Allsop, D. J. (2018) · Medical Journal of Australia · doi:10.5694/mja17.01247 · Cited by 101
Andias, R., Neto, M., & Silva, A. G. (2018) · Physiotherapy Theory and Practice · doi:10.1080/09593985.2018.1423590 · Cited by 99
Umezaki, Y., Badran, B. W., DeVries, W. H., Moss, J., Gonzales, T., & George, M. S. (2016) · Brain Stimulation · doi:10.1016/j.brs.2015.10.005 · Cited by 91
Internet-Delivered Exposure Therapy for Fibromyalgia: A Randomized Controlled Trial
Hedman-Lagerlöf, M., Hedman-Lagerlöf, E., Axelsson, E., Ljótsson, B., Engelbrektsson, J., Hultkrantz, S., Lundbäck, K., Björkander, D., Wicksell, R. K., Flink, I., et al. (2018) · The Clinical Journal of Pain · doi:10.1097/ajp.0000000000000566 · Cited by 79
Non-pharmacological interventions for chronic pain in multiple sclerosis
Amatya, B., Young, J., & Khan, F. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd012622.pub2 · Cited by 78
Kalamir, A., Graham, P. L., Vitiello, A. L., Bonello, R., & Pollard, H. (2013) · Chiropractic & Manual Therapies · doi:10.1186/2045-709x-21-17 · Cited by 76
Sarris, J., Perkins, D., Cribb, L., Schubert, V., Opaleye, E., Bouso, J. C., Scheidegger, M., Aicher, H., Simonova, H., Horák, M., et al. (2021) · Journal of Affective Disorders Reports · doi:10.1016/j.jadr.2021.100098 · Cited by 73
Fitzgibbon, B. M., Hoy, K. E., Knox, L. A., Guymer, E. K., Littlejohn, G., Elliot, D., Wambeek, L. E., McQueen, S., Elford, K. A., Lee, S. J., et al. (2018) · European Journal of Pain · doi:10.1002/ejp.1213 · Cited by 72
Psychological interventions influence patients' attitudes and beliefs about their chronic pain
Vanhaudenhuyse, A., Gillet, A., Malaise, N., Salamun, I., Grosdent, S., Maquet, D., Nyssen, A.-S., & Faymonville, M.-E. (2018) · Journal of Traditional and Complementary Medicine · doi:10.1016/j.jtcme.2016.09.001 · Cited by 70
Field, J., & Newell, D. (2012) · Chiropractic & Manual Therapies · doi:10.1186/2045-709x-20-17 · Cited by 61
Palermo, T. M., Slack, K., Loren, D., Eccleston, C., & Jamison, R. N. (2020) · Pain · doi:10.1097/j.pain.0000000000001772 · Cited by 42
de Jong, M., Peeters, F., Gard, T., Ashih, H., Doorley, J., Walker, R., Rhoades, L., Kulich, R. J., Kueppenbender, K. D., Alpert, J. E., et al. (2018) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.15m10160 · Cited by 39
Cannabis for Chronic Pain: A Rapid Systematic Review of Randomized Control Trials
Longo, R., Oudshoorn, A., & Befus, D. (2021) · Pain Management Nursing · doi:10.1016/j.pmn.2020.11.006 · Cited by 39
Huffman, C., Stacey, B. R., Tuchman, M., Burbridge, C., Li, C., Parsons, B., Pauer, L., Scavone, J. M., Behar, R., & Yurkewicz, L. (2015) · The Clinical Journal of Pain · doi:10.1097/ajp.0000000000000198 · Cited by 37
Lower placebo responses after long-term exposure to fibromyalgia pain
Kosek, E., Rosen, A., Carville, S., Choy, E., Gracely, R. H., Marcus, H., Petzke, F., Ingvar, M., & Jensen, K. B. (2017) · The Journal of Pain · doi:10.1016/j.jpain.2017.02.434 · Cited by 37
Toth, C., Brady, S., & Hatfield, M. (2014) · Journal of Pain Research · doi:10.2147/jpr.s56883 · Cited by 37
External Noninvasive Peripheral Nerve Stimulation Treatment of Neuropathic Pain: A Prospective Audit
Johnson, S., Ayling, H., Sharma, M., & Goebel, A. (2015) · Neuromodulation: Technology at the Neural Interface · doi:10.1111/ner.12244 · Cited by 27
Kallesøe, K. H., Schröder, A., Wicksell, R. K., Preuss, T., Jensen, J. S., & Rask, C. U. (2020) · BMC Psychiatry · doi:10.1186/s12888-020-02862-z · Cited by 24
Achey, M. A., Beck, C. A., Beran, D. B., Boyd, C. M., Schmidt, P. N., Willis, A. W., Riggare, S. S., Simone, R. B., Biglan, K. M., & Dorsey, E. R. (2014) · Trials · doi:10.1186/1745-6215-15-465 · Cited by 27
“[94] and the European Quality of Life Five Dimension Five”
BackgroundKallesøe, K. H., Schröder, A., Wicksell, R. K., Fink, P., Ørnbøl, E., & Rask, C. U. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-012743 · Cited by 23
Raskin, P., Huffman, C., Yurkewicz, L., Pauer, L., Scavone, J. M., Yang, R., & Parsons, B. (2016) · The Clinical Journal of Pain · doi:10.1097/ajp.0000000000000254 · Cited by 25
Merlot, B., Elie, V., Périgord, A., Husson, Z., Jubert, A., Chanavaz-Lacheray, I., Dennis, T., Cotty-Eslous, M., & Roman, H. (2023) · Journal of Medical Internet Research · doi:10.2196/47869 · Cited by 24
“Treatment adherence, tolerance, Patient's Global Impression of Change (PGIC) [37], and patients’ satisfaction were also assessed.”
Abbey, H., Nanke, L., & Brownhill, K. (2021) · International journal of osteopathic medicine · doi:10.1016/j.ijosm.2020.09.002 · Cited by 20
Veillette, J., Martel, M.-E., & Dionne, F. (2019) · Canadian Journal of Pain · doi:10.1080/24740527.2019.1678113 · Cited by 13
“The IMMPACT (Initiative on Methods, Measurement, and Pain Assessment in Clinical Trials) expert consensus(24) in the treatment of CP suggests using the Patient Global Impression of Change (PGIC)(25) scale to measure treatment effect.(26,27) In studies evaluating self-administered ACT tomanage CP, acceptance is the pro…”
Method
Metadata
- Authors
- Hurst, H., & Bolton, J.
- Venue
- Journal of Manipulative and Physiological Therapeutics
- Publisher
- Elsevier BV
- Published
- 2004-01
- Volume
- 27
- Issue
- 1
- Pages
- 26-35
- ISSN
- 0161-4754 (ISSN-L)
- OpenAlex
- W2086214501
- Cited by
- 702
- References
- 23
- FWCI
- 3.72
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.