The DOI matches its Crossref record; 52 of the 52 references it cites were found in a registry or an index.
Research Pearls: The Significance of Statistics and Perils of Pooling. Part 1: Clinical Versus Statistical Significance
Abstract
Patient-reported outcomes (PROs) are increasingly being used in today's rapidly evolving health care environment. The value of care provision emphasizes the highest quality of care at the lowest cost. Quality is in the eye of the beholder, with different stakeholders prioritizing different components of the value equation. At the center of the discussion are the patients and their quantification of outcome via PROs. There are hundreds of different PRO questionnaires that may ascertain an individual's overall general health, quality of life, activity level, or determine a body part-, joint-, or disease-specific outcome. As providers and patients increasingly measure outcomes, there exists greater potential to identify significant differences across time points due to an intervention. In other words, if you compare groups enough, you are bound to eventually detect a significant difference. However, the characterization of significance is not purely dichotomous, as a statistically significant outcome may not be clinically relevant. Statistical significance is the direct result of a mathematical equation, irrelevant to the patient experience. In clinical research, despite detecting statistically significant pre- and post-treatment differences, patients may or may not be able to perceive those differences. Thresholds exist to delineate whether those differences are clinically important or relevant to patients. PROs are unique, with distinct parameters of clinical importance for each outcome score. This review highlights the most common PROs in clinical research and discusses the salient pearls and pitfalls. In particular, it stresses the difference between statistical and clinical relevance and the concepts of minimal clinically important difference and patient acceptable symptom state. Researchers and clinicians should consider clinical importance in addition to statistical significance when interpreting and reporting investigation results.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hudak, P. L., Amadio, P. C., Bombardier, C., Beaton, D., Cole, D., Davis, A., Hawker, G., Katz, J. N., Makela, M., Marx, R. G., et al. (1996) · American Journal of Industrial Medicine · doi:10.1002/(sici)1097-0274(199606)29:6<602::aid-ajim4>3.0.co;2-l · Cited by 5,025
The Knee injury and Osteoarthritis Outcome Score (KOOS): from joint injury to osteoarthritis.
Roos, E. M., & Lohmander, S. L. (2003) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-1-64 · Cited by 2,525
Salaffi, F., Stancati, A., Silvestri, C. A., Ciapetti, A., & Grassi, W. (2004) · European Journal of Pain · doi:10.1016/j.ejpain.2003.09.004 · Cited by 1,724
Michener, L. A., McClure, P. W., & Sennett, B. J. (2002) · Journal of Shoulder and Elbow Surgery · doi:10.1067/mse.2002.127096 · Cited by 1,125
Briggs, K. K., Lysholm, J., Tegner, Y., Rodkey, W. G., Kocher, M. S., & Steadman, J. R. (2009) · The American Journal of Sports Medicine · doi:10.1177/0363546508330143 · Cited by 944
Franchignoni, F., Vercelli, S., Giordano, A., Sartorio, F., Bravini, E., & Ferriero, G. (2014) · Journal of Orthopaedic & Sports Physical Therapy · doi:10.2519/jospt.2014.4893 · Cited by 924
Measuring shoulder function: A systematic review of four questionnaires
Roy, J., MacDermid, J. C., & Woodhouse, L. J. (2009) · Arthritis Care & Research · doi:10.1002/art.24396 · Cited by 771
Kirkley, A., Griffin, S., McLintock, H., & Ng, L. (1998) · The American Journal of Sports Medicine · doi:10.1177/03635465980260060501 · Cited by 733
Collins, N. J., Prinsen, C. A. C., Christensen, R., Bartels, E. M., Terwee, C. B., & Roos, E. M. (2016) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2016.03.010 · Cited by 723
Tashjian, R. Z., Deloach, J., Porucznik, C. A., & Powell, A. P. (2009) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2009.03.021 · Cited by 680
Thorborg, K., Hölmich, P., Christensen, R., Petersen, J., & Roos, E. M. (2011) · British Journal of Sports Medicine · doi:10.1136/bjsm.2010.080937 · Cited by 520
Quintana, J. M., Escobar, A., Bilbao, A., Arostegui, I., Lafuente, I., & Vidaurreta, I. (2005) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2005.06.012 · Cited by 510
Scoring Systems for the Functional Assessment of the Shoulder
Kirkley, A., Griffin, S., & Dainty, K. (2003) · Arthroscopy · doi:10.1016/j.arthro.2003.10.030 · Cited by 504
Saris, D. B. F., Vanlauwe, J., Victor, J., Almqvist, K. F., Verdonk, R., Bellemans, J., & Luyten, F. P. (2009) · The American Journal of Sports Medicine · doi:10.1177/0363546509350694 · Cited by 503
The Nonarthritic Hip Score: Reliable and Validated
Christensen, C. P., Althausen, P. L., Mittleman, M. A., Lee, J.-A., & McCarthy, J. C. (2003) · Clinical Orthopaedics and Related Research · doi:10.1097/00003086-200301000-00013 · Cited by 489
Mohtadi, N. G. H., Griffin, D. R., Pedersen, M. E., Chan, D., Safran, M. R., Parsons, N., Sekiya, J. K., Kelly, B. T., Werle, J. R., Leunig, M., et al. (2012) · Arthroscopy: The Journal of Arthroscopic & Related Surgery · doi:10.1016/j.arthro.2012.03.013 · Cited by 483
Psychometric Properties of Patient-Reported Outcome Measures for Hip Arthroscopic Surgery
Kemp, J. L., Collins, N. J., Roos, E. M., & Crossley, K. M. (2013) · The American Journal of Sports Medicine · doi:10.1177/0363546513494173 · Cited by 482
Minimal Clinically Important Differences of 3 Patient-Rated Outcomes Instruments
Sorensen, A. A., Howard, D., Tan, W. H., Ketchersid, J., & Calfee, R. P. (2013) · The Journal of Hand Surgery · doi:10.1016/j.jhsa.2012.12.032 · Cited by 466
Kirkley, A., Alvarez, C., & Griffin, S. (2003) · Clinical Journal of Sport Medicine · doi:10.1097/00042752-200303000-00004 · Cited by 460
Klässbo, M., Larsson, E., & Mannevik, E. (2003) · Scandinavian Journal of Rheumatology · doi:10.1080/03009740310000409 · Cited by 457
A Short Version of the International Hip Outcome Tool (iHOT-12) for Use in Routine Clinical Practice
Griffin, D. R., Parsons, N., Mohtadi, N. G. H., & Safran, M. R. (2012) · Arthroscopy: The Journal of Arthroscopic & Related Surgery · doi:10.1016/j.arthro.2012.02.027 · Cited by 456
Kukkonen, J., Kauko, T., Vahlberg, T., Joukainen, A., & Äärimaa, V. (2013) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2013.05.002 · Cited by 449
Tashjian, R. Z., Hung, M., Keener, J. D., Bowen, R. C., McAllister, J., Chen, W., Ebersole, G., Granger, E. K., & Chamberlain, A. M. (2017) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2016.06.007 · Cited by 420
Defining Substantial Clinical Benefit Following Lumbar Spine Arthrodesis
Glassman, S. D., Copay, A. G., Berven, S. H., Polly, D. W., Subach, B. R., & Carreon, L. Y. (2008) · The Journal of Bone and Joint Surgery-American Volume · doi:10.2106/jbjs.g.01095 · Cited by 419
A Rationale for Assessing Sports Activity Levels and Limitations in Knee Disorders
Noyes, F. R., Barber, S. D., & Mooar, L. A. (1989) · Clinical Orthopaedics and Related Research · doi:10.1097/00003086-198909000-00034 · Cited by 413
Evidence of Validity for the Hip Outcome Score
Martin, R. L., Kelly, B. T., & Philippon, M. J. (2006) · Arthroscopy: The Journal of Arthroscopic & Related Surgery · doi:10.1016/j.arthro.2006.07.027 · Cited by 372
Katz, N. P., Paillard, F. C., & Ekman, E. (2015) · Journal of Orthopaedic Surgery and Research · doi:10.1186/s13018-014-0144-x · Cited by 340
Evidence of Validity for the Hip Outcome Score in Hip Arthroscopy
Martin, R. L., & Philippon, M. J. (2007) · Arthroscopy: The Journal of Arthroscopic & Related Surgery · doi:10.1016/j.arthro.2007.02.004 · Cited by 333
Hip arthroscopy in the presence of dysplasia
Byrd, J. W. T., & Jones, K. S. (2003) · Arthroscopy: The Journal of Arthroscopic & Related Surgery · doi:10.1016/j.arthro.2003.10.010 · Cited by 316
Berliner, J. L., Brodke, D. J., Chan, V., SooHoo, N. F., & Bozic, K. J. (2017) · Clinical Orthopaedics & Related Research · doi:10.1007/s11999-016-4770-y · Cited by 287
Evidence of Reliability and Responsiveness for the Hip Outcome Score
Martin, R. L., & Philippon, M. J. (2008) · Arthroscopy: The Journal of Arthroscopic & Related Surgery · doi:10.1016/j.arthro.2007.12.011 · Cited by 284
Lo, I. K. Y., Griffin, S., & Kirkley, A. (2001) · Osteoarthritis and Cartilage · doi:10.1053/joca.2001.0474 · Cited by 274
van Kampen, D. A., Willems, W., van Beers, L. W. A. H., Castelein, R. M., Scholtes, V. A. B., & Terwee, C. B. (2013) · Journal of Orthopaedic Surgery and Research · doi:10.1186/1749-799x-8-40 · Cited by 274
Greco, N. J., Anderson, A. F., Mann, B. J., Cole, B. J., Farr, J., Nissen, C. W., & Irrgang, J. J. (2010) · The American Journal of Sports Medicine · doi:10.1177/0363546509354163 · Cited by 257
Lee, W. C., Kwan, Y. H., Chong, H. C., & Yeo, S. J. (2017) · Knee Surgery, Sports Traumatology, Arthroscopy · doi:10.1007/s00167-016-4208-9 · Cited by 241
Dawson, J., Doll, H., Coffey, J., & Jenkinson, C. (2007) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2007.02.003 · Cited by 236
Eechaute, C., Vaes, P., Van Aerschot, L., Asman, S., & Duquet, W. (2007) · BMC Musculoskeletal Disorders · doi:10.1186/1471-2474-8-6 · Cited by 235
A comparison of four shoulder-specific questionnaires in primary care
Paul, A., Lewis, M., Shadforth, M. F., Croft, P. R., van der Windt, D. A. W. M., & Hay, E. M. (2004) · Annals of the Rheumatic Diseases · doi:10.1136/ard.2003.012088 · Cited by 214
Levy, D. M., Kuhns, B. D., Chahal, J., Philippon, M. J., Kelly, B. T., & Nho, S. J. (2016) · Arthroscopy: The Journal of Arthroscopic & Related Surgery · doi:10.1016/j.arthro.2016.05.014 · Cited by 205
Thorborg, K., Roos, E., Bartels, E., Petersen, J., & Hölmich, P. (2010) · British Journal of Sports Medicine · doi:10.1136/bjsm.2009.060889 · Cited by 204
Rating systems for total knee replacement
Davies, A. P. (2002) · The Knee · doi:10.1016/s0968-0160(02)00095-9 · Cited by 131
Torrens, C., Guirro, P., & Santana, F. (2015) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2015.07.020 · Cited by 105
Hinman, R. S., Dobson, F., Takla, A., O’Donnell, J., & Bennell, K. L. (2013) · British Journal of Sports Medicine · doi:10.1136/bjsports-2012-092072 · Cited by 103
Responsiveness of self-report scales in patients recovering from rotator cuff surgery
MacDermid, J. C., Drosdowech, D. S., & Faber, K. J. (2006) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2005.09.005 · Cited by 101
Kim, J. K., & Park, E. S. (2013) · Clinical Orthopaedics and Related Research · doi:10.1007/s11999-013-2843-8 · Cited by 76
Christiansen, D. H., Frost, P., Falla, D., Haahr, J. P., Frich, L. H., & Svendsen, S. W. (2015) · Journal of Orthopaedic and Sports Physical Therapy · doi:10.2519/jospt.2015.5760 · Cited by 73
Monticone, M., Ferrante, S., Salvaderi, S., et al. (2013) · American Journal of Physical Medicine & Rehabilitation · doi:10.1097/phm.0b013e31829f19d8 · Cited by 70
Coe, M. P., Sutherland, J. M., Penner, M. J., Younger, A. S. E., & Wing, K. (2015) · Journal of Bone and Joint Surgery · doi:10.2106/jbjs.n.00147 · Cited by 57
Kemp, K., Sheps, D. M., Beaupré, L. A., Styles-Tripp, F., Luciak-Corea, C., & Balyk, R. (2012) · The Scientific World JOURNAL · doi:10.1100/2012/410125 · Cited by 44
Ebert, J. R., Smith, A. J., Wood, D., & Ackland, T. R. (2013) · The American Journal of Sports Medicine · doi:10.1177/0363546513502314 · Cited by 44
Christie, A., Dagfinrud, H. S., Garratt, A., Ringen, H. O., & Hagen, K. B. (2011) · Journal of Hand Therapy · doi:10.1016/j.jht.2010.10.006 · Cited by 40
(1988) · PubMed
Cited by
Establishing clinically significant outcome after arthroscopic rotator cuff repair
Cvetanovich, G. L., Gowd, A. K., Liu, J. N., Nwachukwu, B. U., Cabarcas, B. C., Cole, B. J., Forsythe, B., Romeo, A. A., & Verma, N. N. (2019) · Journal of Shoulder and Elbow Surgery · doi:10.1016/j.jse.2018.10.013 · Cited by 294
Xiao, M., van Niekerk, M., Trivedi, N. N., Hwang, C. E., Sherman, S. L., Safran, M. R., & Abrams, G. D. (2023) · The American Journal of Sports Medicine · doi:10.1177/03635465221102420 · Cited by 99
Metadata
- Authors
- Harris, J. D., Brand, J. C., Cote, M. P., Faucett, S. C., & Dhawan, A.
- Venue
- Arthroscopy: The Journal of Arthroscopic & Related Surgery
- Publisher
- Elsevier BV
- Published
- 2017-06
- Volume
- 33
- Issue
- 6
- Pages
- 1102-1112
- ISSN
- 0749-8063 (ISSN-L)
- OpenAlex
- W2607983323
- Cited by
- 498
- References
- 52
- FWCI
- 32.98
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.