The importance of allocation concealment and patient blinding in osteoarthritis trials: A meta‐epidemiologic study
Open accessThe DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.
Abstract
Objective: To evaluate the association of adequate allocation concealment and patient blinding with estimates of treatment benefits in osteoarthritis trials. Methods: We performed a meta‐epidemiologic study of 16 meta‐analyses with 175 trials that compared therapeutic interventions with placebo or nonintervention control in patients with hip or knee osteoarthritis. We calculated effect sizes from the differences in means of pain intensity between groups at the end of followup divided by the pooled SD and compared effect sizes between trials with and trials without adequate methodology. Results: Effect sizes tended to be less beneficial in 46 trials with adequate allocation concealment compared with 112 trials with inadequate or unclear concealment of allocation (difference −0.15; 95% confidence interval [95% CI] −0.31, 0.02). Selection bias associated with inadequate or unclear concealment of allocation was most pronounced in meta‐analyses with large estimated treatment benefits (P for interaction < 0.001), meta‐analyses with high between‐trial heterogeneity (P = 0.009), and meta‐analyses of complementary medicine (P = 0.019). Effect sizes tended to be less beneficial in 64 trials with adequate blinding of patients compared with 58 trials without (difference −0.15; 95% CI −0.39, 0.09), but differences were less consistent and disappeared after accounting for allocation concealment. Detection bias associated with a lack of adequate patient blinding was most pronounced for nonpharmacologic interventions (P for interaction < 0.001). Conclusion: Results of osteoarthritis trials may be affected by selection and detection bias. Adequate concealment of allocation and attempts to blind patients will minimize these biases.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moher, D., Pham, B., Jones, A., Cook, D. J., Jadad, A. R., Moher, M., Tugwell, P., & Klassen, T. P. (1998) · The Lancet · doi:10.1016/s0140-6736(98)01085-x · Cited by 3,560
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
Self-citationWood, L., Egger, M., Gluud, L. L., Schulz, K. F., Jüni, P., Altman, D. G., Gluud, C., Martin, R. M., Wood, A. J. G., & Sterne, J. A. C. (2008) · BMJ · doi:10.1136/bmj.39465.451748.ad · Cited by 2,538
Self-citationMeta-analyses involving cross-over trials: methodological issues
Elbourne, D. R., Altman, D. G., Higgins, J. P., Curtin, F., Worthington, H. V., & Vail, A. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.140 · Cited by 2,305
Self-citationMoher, D., Schulz, K. F., Altman, D. G., & for the CONSORT Group* (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00011 · Cited by 1,426
Self-citationEgger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181
Self-citationMeta-analysis: chronic disease self-management programs for older adults
Chodosh, J., Morton, S. C., Mojica, W., Maglione, M., Suttorp, M. J., Hilton, L., Rhodes, S., & Shekelle, P. (2005) · Annals of Internal Medicine · doi:10.7326/0003-4819-143-6-200509200-00007 · Cited by 790
Balk, E. M. (2002) · JAMA · doi:10.1001/jama.287.22.2973 · Cited by 478
Impact of allocation concealment on conclusions drawn from meta-analyses of randomized trials
Pildal, J., Hrobjartsson, A., Jorgensen, K., Hilden, J., Altman, D., & Gotzsche, P. (2007) · International Journal of Epidemiology · doi:10.1093/ije/dym087 · Cited by 472
Self-citationAquatic exercise for the treatment of knee and hip osteoarthritis
Bartels, E. M., Lund, H., Hagen, K. B., Dagfinrud, H., Christensen, R., & Danneskiold-Samsøe, B. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd005523.pub2 · Cited by 302
Cited by
Savović, J., Jones, H. E., Altman, D. G., Harris, R. J., Jüni, P., Pildal, J., Als-Nielsen, B., Balk, E. M., Gluud, C., Gluud, L. L., et al. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-6-201209180-00537 · Cited by 1,049
Self-citationViscosupplementation for Osteoarthritis of the Knee: A Systematic Review and Meta-analysis
Rutjes, A. W. S., Jüni, P., da Costa, B. R., Trelle, S., Nüesch, E., & Reichenbach, S. (2012) · Annals of Internal Medicine · doi:10.7326/0003-4819-157-3-201208070-00473 · Cited by 717
Self-citationSavović, J., Jones, H., Altman, D., Harris, R., Jűni, P., Pildal, J., Als-Nielsen, B., Balk, E., Gluud, C., Gluud, L., et al. (2012) · Health Technology Assessment · doi:10.3310/hta16350 · Cited by 668
Self-citationSmall study effects in meta-analyses of osteoarthritis trials: meta-epidemiological study
Nuesch, E., Trelle, S., Reichenbach, S., Rutjes, A. W. S., Tschannen, B., Altman, D. G., Egger, M., & Juni, P. (2010) · BMJ · doi:10.1136/bmj.c3515 · Cited by 559
Self-citationBurr, J., Mowatt, G., Hernández, R., Siddiqui, M., Cook, J., Lourenco, T., Ramsay, C., Vale, L., Fraser, C., Azuara-Blanco, A., et al. (2007) · Health Technology Assessment · doi:10.3310/hta11410 · Cited by 549
Hrobjartsson, A., Thomsen, A. S. S., Emanuelsson, F., Tendal, B., Hilden, J., Boutron, I., Ravaud, P., & Brorson, S. (2012) · BMJ · doi:10.1136/bmj.e1119 · Cited by 483
Hróbjartsson, A., Emanuelsson, F., Skou Thomsen, A. S., Hilden, J., & Brorson, S. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu115 · Cited by 462
“The randomization of patients to blind and nonblind conditions avoided confounding by differences in patient prognosis and outcomes or unknown factors—a challenge for meta-epidemiological studies.(7,9) In addition, selection bias was minimized as all trials had adequate allocation concealment and were generally large.”
BackgroundResultSavović, J., Turner, R. M., Mawdsley, D., Jones, H. E., Beynon, R., Higgins, J. P. T., & Sterne, J. A. C. (2018) · American Journal of Epidemiology · doi:10.1093/aje/kwx344 · Cited by 382
Blinding and expectancy confounds in psychedelic randomized controlled trials
Muthukumaraswamy, S. D., Forsyth, A., & Lumley, T. (2021) · Expert Review of Clinical Pharmacology · doi:10.1080/17512433.2021.1933434 · Cited by 324
Dexamethasone as an adjuvant to peripheral nerve block
Pehora, C., Pearson, A. M., Kaushal, A., Crawford, M. W., & Johnston, B. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd011770.pub2 · Cited by 299
Page, M. J., Higgins, J. P. T., Clayton, G., Sterne, J. A. C., Hróbjartsson, A., & Savović, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0159267 · Cited by 284
“90; I(2) 0%; 4 meta-epidemiological studies [21,33,37,44]), and in trials of complementary and alternative medicine interventions (CAM) (Dsmd -0.”
BackgroundResultInfluentialMoustgaard, H., Clayton, G. L., Jones, H. E., Boutron, I., Jørgensen, L., Laursen, D. R. T., Olsen, M. F., Paludan-Müller, A., Ravaud, P., Savović, J., et al. (2020) · BMJ · doi:10.1136/bmj.l6802 · Cited by 300
Zou, L., Yeung, A., Li, C., Wei, G.-X., Chen, K. W., Kinser, P. A., Chan, J. S. M., & Ren, Z. (2018) · Journal of Clinical Medicine · doi:10.3390/jcm7080195 · Cited by 188
Risk of selection bias in randomised trials
Kahan, B. C., Rehal, S., & Cro, S. (2015) · Trials · doi:10.1186/s13063-015-0920-x · Cited by 180
da Costa, B. R., Nüesch, E., Rutjes, A. W., Johnston, B. C., Reichenbach, S., Trelle, S., Guyatt, G. H., & Jüni, P. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2013.03.009 · Cited by 148
Self-citationda Costa, B. R., Rutjes, A. W., Johnston, B. C., Reichenbach, S., Nüesch, E., Tonia, T., Gemperli, A., Guyatt, G. H., & Jüni, P. (2012) · International Journal of Epidemiology · doi:10.1093/ije/dys124 · Cited by 145
Self-citationBafeta, A., Dechartres, A., Trinquart, L., Yavchitz, A., Boutron, I., & Ravaud, P. (2012) · BMJ · doi:10.1136/bmj.e813 · Cited by 129
PEDro's bias: summary quality scores should not be used in meta-analysis
da Costa, B. R., Hilfiker, R., & Egger, M. (2013) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2012.08.003 · Cited by 86
Empirical evaluation of which trial characteristics are associated with treatment effect estimates
Dechartres, A., Trinquart, L., Faber, T., & Ravaud, P. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.04.005 · Cited by 85
Wang, Y., Parpia, S., Couban, R., Wang, Q., Armijo-Olivo, S., Bassler, D., Briel, M., Brignardello-Petersen, R., Gluud, L. L., Keitz, S. A., et al. (2024) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2023.11.001 · Cited by 58
Saltaji, H., Armijo-Olivo, S., Cummings, G. G., Amin, M., da Costa, B. R., & Flores-Mir, C. (2018) · Journal of Dental Research · doi:10.1177/0022034517725049 · Cited by 40
The impact of blinding on trial results: A systematic review and meta‐analysis
(2023) · doi:10.1002/cesm.12015 · Cited by 35
Blinding and expectancy confounds in psychedelic randomised controlled trials
Muthukumaraswamy, S., Forsyth, A., & Lumley, T. (2021) · doi:10.31234/osf.io/q2hzm · Cited by 15
Metadata
- Authors
- Nüesch, E., Reichenbach, S., Trelle, S., Rutjes, A. W. S., Liewald, K., Sterchi, R., Altman, D. G., & Jüni, P.
- Venue
- Arthritis Care & Research
- Publisher
- Wiley
- Published
- 2009-11-30
- Volume
- 61
- Issue
- 12
- Pages
- 1633-1641
- ISSN
- 0893-7524 (ISSN-L)
- 1529-0123
- OpenAlex
- W2023725091
- Cited by
- 150
- References
- 11
- FWCI
- 8.76
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.