Blinding in Physical Therapy Trials and Its Association with Treatment Effects: A Meta-epidemiological Study
Open accessThe DOI matches its Crossref record; 46 of the 46 references it cites were found in a registry or an index.
Abstract
OBJECTIVE: The aim of this study was to examine whether blinding of participants, assessors, health providers, and statisticians have an effect on treatment effect estimates in physical therapy (PT) trials. DESIGN: This was a meta-epidemiological study. Randomized controlled trials in PT were identified by searching the Cochrane Database of Systematic Reviews for meta-analyses of PT interventions. Assessments of blinding in PT trials were conducted independently following established guidelines. RESULTS: Three hundred ninety-three trials and 43 meta-analyses that included 44,622 patients contributed to this study. Only a quarter of the trials were adequately blinded (n = 80; 20%). Most individual components of blinding as well as what they were blinded to were also poorly reported. Although trials with inappropriate blinding of assessors and participants tended to underestimate treatment effects when compared with trials with appropriate blinding of assessors and participants, the difference was not statistically significant (effect size, -0.07; 95% confidence interval, -0.22 to 0.08; effect size, -0.12; 95% confidence interval, -0.30 to 0.06, respectively). CONCLUSIONS: The lack of statistical significance between blinding and effect sizes should not be interpreted as meaning that an impact of blinding on effect size is not present in PT. More empirical evidence in a larger sample is needed to determine which biases are likely to influence reported effect sizes of PT trials and under which conditions.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Meta-analysis in clinical trials
DerSimonian, R., & Laird, N. (1986) · Controlled Clinical Trials · doi:10.1016/0197-2456(86)90046-2 · Cited by 39,552
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
Schulz, K. F., Altman, D. G., Moher, D., & for the CONSORT Group (2010) · BMJ · doi:10.1136/bmj.c332 · Cited by 9,329
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634 · cited 1×
“, double blinding).(6,7,15) The closest meta-epidemiological study to PTareawas performed in trials of osteoarthritis investigating several types of treatments such as drug trials and other nonpharmacological interventions.”
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560 · cited 1×
“Nevertheless, other meta-epidemiological studies found no significant association between reported blinding and treatment effects or an underestimation of treatment effects of trials with poor blinding.(15) Overestimates or underestimates of treatment effects, or bias, at the trial level, can lead to biased or inaccur…”
ResultWood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538 · cited 6×
“, mortality, laboratory results, and administrative data) may be less prone to assessment bias than subjective outcomes such as pain, which is a self-reported measure and commonly used in PT.(6) Therefore, trials evaluating effects of PT treatments such as on mortality or hospitalizations (automated data obtained from…”
InfluentialMoher, D., Hopewell, S., Schulz, K. F., Montori, V., Gøtzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2012) · International Journal of Surgery · doi:10.1016/j.ijsu.2011.10.001 · Cited by 2,345
Kjaergard, L. L., Villumsen, J., & Gluud, C. (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-135-11-200112040-00010 · Cited by 2,283
Delgado-Rodríguez, M., & Llorca, J. (2004) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2003.008466 · Cited by 1,064
Savović, J., Jones, H. E., Altman, D. G., Harris, R. J., Jüni, P., Pildal, J., Als-Nielsen, B., Balk, E. M., Gluud, C., Gluud, L. L., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-6-201209180-00537 · Cited by 1,049 · cited 1×
“Thus, the direction of the bias is not consistent for all areas of research, and more research is needed to provide more insights regarding the direction of the biases.(2,8) In addition, with lack of reporting of blinding, nonsignificant results obtained by this study may be related to insufficient power to detect dif…”
Blinding in randomised trials: hiding who got what
Schulz, K. F., & Grimes, D. A. (2002) · The Lancet · doi:10.1016/s0140-6736(02)07816-9 · Cited by 952
Cited by
Naci, H., Salcher-Konrad, M., Dias, S., Blum, M. R., Sahoo, S. A., Nunan, D., & Ioannidis, J. P. A. (2019) · British Journal of Sports Medicine · doi:10.1136/bjsports-2018-099921 · Cited by 326
“Eligibility criteria Randomised controlled trials (RCTs) of angiotensin-converting enzyme inhibitors (ACE-I), angiotensin-2 receptor blockers (ARBs), β-blockers, calcium channel blockers (CCBs) and diuretics were identified from existing Cochrane reviews.”
ResultInfluentialMoustgaard, H., Clayton, G. L., Jones, H. E., Boutron, I., Jørgensen, L., Laursen, D. R. T., Olsen, M. F., Paludan-Müller, A., Ravaud, P., Savović, J., et al. (2020) · BMJ · doi:10.1136/bmj.l6802 · Cited by 300
“7 23 Two additional recent studies partly confirmed this pattern: an analysis of physiotherapy trials 24 found little evidence of an impact of blinding of patients or of outcome assessors, and a study of oral health trials 25 found no evidence of an impact of blinding of outcome assessors, though…”
ResultCONSORT 2025 explanation and elaboration: updated guideline for reporting randomised trials
Hopewell, S., Chan, A.-W., Collins, G. S., Hróbjartsson, A., Moher, D., Schulz, K. F., Tunn, R., Aggarwal, R., Berkwits, M., Berlin, J. A., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081124 · Cited by 205
McIsaac, D. I., Kidd, G., Gillis, C., Branje, K., Al-Bayati, M., Baxi, A., Grudzinski, A. L., Boland, L., Veroniki, A.-A., Wolfe, D., et al. (2025) · BMJ · doi:10.1136/bmj-2024-081164 · Cited by 168
“60 61 Building on these insights, low risk of bias trials should aim to estimate the effectiveness of exercise, nutrition, and multicomponent interventions that include exercise.”
Matheve, T., Bogaerts, K., & Timmermans, A. (2020) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-020-00688-0 · Cited by 118
Metadata
- Authors
- Armijo-Olivo, S., Fuentes, J., da Costa, B. R., Saltaji, H., Ha, C., & Cummings, G. G.
- Venue
- American Journal of Physical Medicine & Rehabilitation
- Published
- 2017-01
- Volume
- 96
- Issue
- 1
- Pages
- 34-44
- ISSN
- 0894-9115 (ISSN-L)
- OpenAlex
- W2380126174
- Cited by
- 160
- References
- 46
- FWCI
- 5.81
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Blinding in Physical Therapy Trials and Its Association with Treatment Effects: A Meta-epidemiological Study. https://app.cochat.ai/papers/10.1097/phm.0000000000000521
- The paper
- Armijo-Olivo, S., Fuentes, J., da Costa, B. R., Saltaji, H., Ha, C., & Cummings, G. G. (2017). Blinding in Physical Therapy Trials and Its Association with Treatment Effects: A Meta-epidemiological Study. American Journal of Physical Medicine & Rehabilitation. https://doi.org/10.1097/phm.0000000000000521
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.