Many Randomized Trials of Physical Therapy Interventions Are Not Adequately Registered: A Survey of 200 Published Trials
The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Abstract
Background: Clinical trial registration has several putative benefits: prevention of selective reporting, avoidance of duplication, encouragement of participation, and facilitation of reviews. Previous surveys suggest that most trials are registered. However, these surveys examined only trials in journals with high impact factors, which may bias the results. Purpose: This study examined the completeness of clinical trial registration and the extent of selective reporting of outcomes in a random sample of published randomized trials in physical therapy. Data Sources: This was a retrospective cohort study in which 200 randomized trials of physical therapy interventions were randomly selected from those published in 2009 and indexed in the Physiotherapy Evidence Database (PEDro), regardless of the publishing journal. Data Extraction: Evidence of registration was sought for each trial in the study, on clinical trial registers, and by contacting authors. Data Synthesis: The proportion of randomized trials that were registered was 67/200 (34%). This proportion was significantly lower than among the trials in journals with high impact factors, where the proportion was 75% (odds ratio=7.4, 95% confidence interval=2.6–21.4). Unambiguous primary outcomes (ie, method and time points of measurement clearly defined in the trial registry entry) were registered for 32 trials, and registration was adequate (ie, prospective with unambiguous primary outcomes) for 5/200 (2.5%) trials. Selective outcome reporting occurred in 23 (47%) of the 49 trials in which selective reporting was assessable. Limitations: The inclusion of only English-language trials prevents generalization of the results to non–English-language trials. Conclusions: Registration of randomized trials of physical therapy interventions is rarely adequate. Consequently, the putative benefits of registration are not being fully realized.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845
Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546
The Existence of Publication Bias and Risk Factors for Its Occurrence
Dickersin, K. (1990) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1990.03440100097014 · Cited by 1,417
Clinical Trial Registration: A Statement from the International Committee of Medical Journal Editors
De Angelis, C., Drazen, J. M., Frizelle, F. A., Haug, C., Hoey, J., Horton, R., Kotzin, S., Laine, C., Marusic, A., Overbeke, A. J. P. M., et al. (2004) · New England Journal of Medicine · doi:10.1056/nejme048225 · Cited by 1,241
Publication bias in clinical trials due to statistical significance or direction of trial results
Hopewell, S., Loudon, K., Clarke, M. J., Oxman, A. D., & Dickersin, K. (2009) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000006.pub3 · Cited by 898
The ClinicalTrials.gov Results Database — Update and Key Issues
Zarin, D. A., Tse, T., Williams, R. J., Califf, R. M., & Ide, N. C. (2011) · New England Journal of Medicine · doi:10.1056/nejmsa1012065 · Cited by 838
Publication bias and clinical trials
Dickersin, K., Chan, S., Chalmersx, T. C., Sacks, H. S., & Smith, H. (1987) · Controlled Clinical Trials · doi:10.1016/0197-2456(87)90155-3 · Cited by 715
Outcome reporting bias in randomized trials funded by the Canadian Institutes of Health Research
Chan, A.-W. (2004) · Canadian Medical Association Journal · doi:10.1503/cmaj.1041086 · Cited by 444
Trial Publication after Registration in ClinicalTrials.Gov: A Cross-Sectional Analysis
Ross, J. S., Mulvey, G. K., Hines, E. M., Nissen, S. E., & Krumholz, H. M. (2009) · PLoS Medicine · doi:10.1371/journal.pmed.1000144 · Cited by 401
Macedo, L. G., Elkins, M. R., Maher, C. G., Moseley, A. M., Herbert, R. D., & Sherrington, C. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.10.005 · Cited by 362
Self-citationComparison of protocols and registry entries to published reports for randomised controlled trials
Dwan, K., Altman, D. G., Cresswell, L., Blundell, M., Gamble, C. L., & Williamson, P. R. (2011) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000031.pub2 · Cited by 243
Moseley, A. M., Elkins, M. R., Herbert, R. D., Maher, C. G., & Sherrington, C. (2009) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2008.09.018 · Cited by 202
Self-citationSelective reporting in clinical trials: analysis of trial protocols accepted by The Lancet
Al-Marzouki, S., Roberts, I., Evans, S., & Marshall, T. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61060-0 · Cited by 119
Michaleff, Z. A., Costa, L. O. P., Moseley, A. M., Maher, C. G., Elkins, M. R., Herbert, R. D., & Sherrington, C. (2011) · Physical Therapy · doi:10.2522/ptj.20100116 · Cited by 108
Self-citationHahn, S., Williamson, P. R., & Hutton, J. L. (2002) · Journal of Evaluation in Clinical Practice · doi:10.1046/j.1365-2753.2002.00314.x · Cited by 97
Moseley, A. M., Sherrington, C., Elkins, M. R., Herbert, R. D., & Maher, C. G. (2009) · Physiotherapy · doi:10.1016/j.physio.2009.01.006 · Cited by 82
Self-citationHahn, S., Williamson, P. R., Hutton, J. L., Garner, P., & Flynn, E. V. (2000) · Statistics in Medicine · doi:10.1002/1097-0258(20001230)19:24<3325::aid-sim827>3.0.co;2-d
Cited by
Increasing value and reducing waste in research design, conduct, and analysis
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62227-8 · Cited by 1,597
Parreira, P. D. C. S., Costa, L. D. C. M., Hespanhol Junior, L. C., Lopes, A. D., & Costa, L. O. P. (2014) · Journal of Physiotherapy · doi:10.1016/j.jphys.2013.12.008 · Cited by 278
Comparison of registered and published outcomes in randomized controlled trials: a systematic review
Jones, C. W., Keil, L. G., Holland, W. C., Caughey, M. C., & Platts-Mills, T. F. (2015) · BMC Medicine · doi:10.1186/s12916-015-0520-3 · Cited by 237
“a registered primary outcome [15, 19, 20, 30, 34]; for four studies the most common discrepancy was publication of an unregistered primary outcome [7, 22, 31, 36]; one study reported equal numbers of these two types of discrepancies [26]; for three studies the most commonly observed discrepancy was reporting the regis…”
BackgroundResultWager, E., Williams, P., & on behalf of the OPEN Project (Overcome failure to Publish nEgative fiNdings) Consortium (2013) · BMJ · doi:10.1136/bmj.f5248 · Cited by 139
15 years of tracking physiotherapy evidence on PEDro, where are we now?
Kamper, S. J., Moseley, A. M., Herbert, R. D., Maher, C. G., Elkins, M. R., & Sherrington, C. (2015) · British Journal of Sports Medicine · doi:10.1136/bjsports-2014-094468 · Cited by 87
Self-citation
Metadata
- Authors
- Pinto, R. Z., Elkins, M. R., Moseley, A. M., Sherrington, C., Herbert, R. D., Maher, C. G., Ferreira, P. H., & Ferreira, M. L.
- Venue
- Physical Therapy
- Publisher
- Oxford University Press (OUP)
- Published
- 2013-03-01
- Volume
- 93
- Issue
- 3
- Pages
- 299-309
- ISSN
- 0031-9023 (ISSN-L)
- 1538-6724
- OpenAlex
- W2098115169
- Cited by
- 51
- References
- 18
- FWCI
- 6.72
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.