The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Empirical Evidence of Bias in the Design of Experimental Stroke Studies: A Metaepidemiologic Approach
Open accessAbstract
Background and Purpose— At least part of the failure in the transition from experimental to clinical studies in stroke has been attributed to the imprecision introduced by problems in the design of experimental stroke studies. Using a metaepidemiologic approach, we addressed the effect of randomization, blinding, and use of comorbid animals on the estimate of how effectively therapeutic interventions reduce infarct size. Methods— Electronic and manual searches were performed to identify meta-analyses that described interventions in experimental stroke. For each meta-analysis thus identified, a reanalysis was conducted to estimate the impact of various quality items on the estimate of efficacy, and these estimates were combined in a meta–meta-analysis to obtain a summary measure of the impact of the various design characteristics. Results— Thirteen meta-analyses that described outcomes in 15 635 animals were included. Studies that included unblinded induction of ischemia reported effect sizes 13.1% (95% CI, 26.4% to 0.2%) greater than studies that included blinding, and studies that included healthy animals instead of animals with comorbidities overstated the effect size by 11.5% (95% CI, 21.2% to 1.8%). No significant effect was found for randomization, blinded outcome assessment, or high aggregate CAMARADES quality score. Conclusions— We provide empirical evidence of bias in the design of studies, with studies that included unblinded induction of ischemia or healthy animals overestimating the effectiveness of the intervention. This bias could account for the failure in the transition from bench to bedside of stroke therapies.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Schulz (1995) · doi:10.1001/jama.1995.03520290060030 · Cited by 5,634
Assessing the quality of controlled clinical trials
Jüni, P., Altman, D. G., & Egger, M. (2001) · BMJ · doi:10.1136/bmj.323.7303.42 · Cited by 3,309
The Hazards of Scoring the Quality of Clinical Trials for Meta-analysis
Jüni, P. (1999) · JAMA · doi:10.1001/jama.282.11.1054 · Cited by 1,981
Comparison of Treatment Effects between Animal Experiments and Clinical Trials: Systematic Review
Perel, P., Roberts, I., Sena, E., Wheble, P., Briscoe, C., Sandercock, P., Macleod, M., Mignini, L. E., Jayaram, P., & Khan, K. S. (2007) · BMJ · doi:10.1136/bmj.39048.407928.be · Cited by 827
Self-citationGreenland, S. (1994) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a117250 · Cited by 150
Cited by
The Mass Production of Redundant, Misleading, and Conflicted Systematic Reviews and Meta‐analyses
IOANNIDIS, J. P. A. (2016) · The Milbank Quarterly · doi:10.1111/1468-0009.12210 · Cited by 1,483
Can Animal Models of Disease Reliably Inform Human Studies?
van der Worp, H. B., Howells, D. W., Sena, E. S., Porritt, M. J., Rewell, S., O'Collins, V., & Macleod, M. R. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000245 · Cited by 1,354
Self-citationUpdate of the Stroke Therapy Academic Industry Roundtable Preclinical Recommendations
Fisher, M., Feuerstein, G., Howells, D. W., Hurn, P. D., Kent, T. A., Savitz, S. I., & Lo, E. H. (2009) · Stroke · doi:10.1161/strokeaha.108.541128 · Cited by 1,352
A call for transparent reporting to optimize the predictive value of preclinical research
Landis, S. C., Amara, S. G., Asadullah, K., Austin, C. P., Blumenstein, R., Bradley, E. W., Crystal, R. G., Darnell, R. B., Ferrante, R. J., Fillit, H., et al. (2012) · Nature · doi:10.1038/nature11556 · Cited by 1,196
Self-citationMeta-analysis of data from animal studies: A practical guide
Vesterinen, H. M., Sena, E. S., Egan, K. J., Hirst, T. C., Churolov, L., Currie, G. L., Antonic, A., Howells, D. W., & Macleod, M. R. (2014) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2013.09.010 · Cited by 488
Self-citationKleinschnitz, C., Grund, H., Wingler, K., Armitage, M. E., Jones, E., Mittal, M., Barit, D., Schwarz, T., Geis, C., Kraft, P., et al. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000479 · Cited by 447
Pound, P., & Ritskes-Hoitinga, M. (2018) · Journal of Translational Medicine · doi:10.1186/s12967-018-1678-1 · Cited by 419
Risk of bias in reports of in vivo research: a focus for improvement
Macleod, M. R., Lawson McLean, A., Kyriakopoulou, A., Serghiou, S., de Wilde, A., Sherratt, N., Hirst, T., Hemblade, R., Bahor, Z., Nunes-Fonseca, C., et al. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002273 · Cited by 358
Self-citationGood Laboratory Practice: Preventing Introduction of Bias at the Bench
Macleod, M. R., Fisher, M., O'Collins, V., Sena, E. S., Dirnagl, U., Bath, P. M. W., Buchan, A., van der Worp, H. B., Traystman, R., Minematsu, K., et al. (2009) · Stroke · doi:10.1161/strokeaha.108.525386 · Cited by 331
Self-citationMacleod, M. R., van der Worp, H. B., Sena, E. S., Howells, D. W., Dirnagl, U., & Donnan, G. A. (2008) · Stroke · doi:10.1161/strokeaha.108.515957 · Cited by 319
Self-citationHenderson, V. C., Kimmelman, J., Fergusson, D., Grimshaw, J. M., & Hackam, D. G. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001489 · Cited by 302
Evaluation of excess significance bias in animal studies of neurological diseases
Tsilidis, K. K., Panagiotou, O. A., Sena, E. S., Aretouli, E., Evangelou, E., Howells, D. W., Salman, R. A.-S., Macleod, M. R., & Ioannidis, J. P. A. (2013) · PLoS Biology · doi:10.1371/journal.pbio.1001609 · Cited by 295
Self-citationThe need for randomization in animal trials: an overview of systematic reviews
Hirst, J. A., Howick, J., Aronson, J. K., Roberts, N., Perera, R., Koshiaris, C., & Heneghan, C. (2014) · PLoS ONE · doi:10.1371/journal.pone.0098856 · Cited by 294
Sena, E. S., Currie, G. L., McCann, S. K., Macleod, M. R., & Howells, D. W. (2014) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.2014.28 · Cited by 264
Self-citationEvidence of experimental bias in the life sciences: why we need blind data recording
Holman, L., Head, M. L., Lanfear, R., & Jennions, M. D. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002190 · Cited by 263
Cannabinoids, the endocannabinoid system, and pain: a review of preclinical studies
Finn, D. P., Haroutounian, S., Hohmann, A. G., Krane, E., Soliman, N., & Rice, A. S. C. (2021) · Pain · doi:10.1097/j.pain.0000000000002268 · Cited by 254
Llovera, G., Hofmann, K., Roth, S., Salas-Pérdomo, A., Ferrer-Ferrer, M., Perego, C., Zanier, E. R., Mamrak, U., Rex, A., Party, H., et al. (2015) · Science Translational Medicine · doi:10.1126/scitranslmed.aaa9853 · Cited by 253
Self-citationMeta-analysis of preclinical studies of mesenchymal stromal cells for ischemic stroke
Vu, Q., Xie, K., Eckert, M., Zhao, W., & Cramer, S. C. (2014) · Neurology · doi:10.1212/wnl.0000000000000278 · Cited by 235
Systematic reviews of animal models: methodology versus epistemology
Greek, R., & Menache, A. (2013) · International Journal of Medical Sciences · doi:10.7150/ijms.5529 · Cited by 207
de Vries, R. B. M., Wever, K. E., Avey, M. T., Stephens, M. L., Sena, E. S., & Leenaars, M. (2014) · ILAR Journal · doi:10.1093/ilar/ilu043 · Cited by 165
Self-citationRamirez, F. D., Motazedian, P., Jung, R. G., Di Santo, P., MacDonald, Z. D., Moreland, R., Simard, T., Clancy, A. A., Russo, J. J., Welch, V. A., et al. (2017) · Circulation Research · doi:10.1161/circresaha.117.310628 · Cited by 138
Extrapolating from animals to humans
Ioannidis, J. P. A. (2012) · Science Translational Medicine · doi:10.1126/scitranslmed.3004631 · Cited by 124
Reis, D. J., Ilardi, S. S., & Punt, S. E. W. (2018) · PLOS ONE · doi:10.1371/journal.pone.0199041 · Cited by 123
Can animal data predict human outcome? Problems and pitfalls of translational animal research
Martić-Kehl, M. I., Schibli, R., & Schubiger, P. A. (2012) · European Journal of Nuclear Medicine and Molecular Imaging · doi:10.1007/s00259-012-2175-z · Cited by 110
Experimental models of multiple sclerosis
Pachner, A. R. (2011) · Current Opinion in Neurology · doi:10.1097/wco.0b013e328346c226 · Cited by 90
Empirical evaluation of which trial characteristics are associated with treatment effect estimates
Dechartres, A., Trinquart, L., Faber, T., & Ravaud, P. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.04.005 · Cited by 85
The Stroke Preclinical Assessment Network: Rationale, Design, Feasibility, and Stage 1 Results
Lyden, P. D., Bosetti, F., Diniz, M. A., Rogatko, A., Koenig, J. I., Lamb, J., Nagarkatti, K. A., Cabeen, R. P., Hess, D. C., Kamat, P. K., et al. (2022) · Stroke · doi:10.1161/strokeaha.121.038047 · Cited by 73
Peake, S. L., Davies, A. R., Deane, A. M., Lange, K., Moran, J. L., O’Connor, S. N., Ridley, E. J., Williams, P. J., & Chapman, M. J. (2014) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.114.086322 · Cited by 71
Effects of MVA85A vaccine on tuberculosis challenge in animals: systematic review
Kashangura, R., Sena, E. S., Young, T., & Garner, P. (2015) · International Journal of Epidemiology · doi:10.1093/ije/dyv142 · Cited by 46
Self-citationRice, A. S. C., Morland, R., Huang, W., Currie, G. L., Sena, E. S., & Macleod, M. R. (2013) · Scandinavian Journal of Pain · doi:10.1016/j.sjpain.2013.02.002 · Cited by 42
Self-citationBero, L., Anglemyer, A., Vesterinen, H., & Krauth, D. (2016) · Environment International · doi:10.1016/j.envint.2015.10.011 · Cited by 41
Krauth, D., Anglemyer, A., Philipps, R., & Bero, L. (2014) · PLoS Biology · doi:10.1371/journal.pbio.1001770 · Cited by 36
van der Naald, M., Chamuleau, S. A. J., Menon, J. M. L., de Leeuw, W., de Haan, J., Duncker, D. J., & Wever, K. E. (2022) · BMJ Open Science · doi:10.1136/bmjos-2021-100259 · Cited by 26
How our approaches to assessing benefits and harms can be improved
Sena, E., & Currie, G. (2019) · Animal Welfare · doi:10.7120/09627286.28.1.107 · Cited by 23
Self-citationAbdel‐Sattar, M., Krauth, D., Anglemyer, A., & Bero, L. (2014) · Evidence-based Preclinical Medicine · doi:10.1002/ebm2.5 · Cited by 14
Modeling Risk Factors and Confounding Effects in Stroke
McColl, B., Howells, D., Rothwell, N., & Denes, A. (2010) · Neuromethods · doi:10.1007/978-1-60761-750-1_9 · Cited by 3
Metadata
- Authors
- Crossley, N. A., Sena, E., Goehler, J., Horn, J., van der Worp, B., Bath, P. M. W., Macleod, M., & Dirnagl, U.
- Venue
- Stroke
- Published
- 2008-03
- Volume
- 39
- Issue
- 3
- Pages
- 929-934
- ISSN
- 0039-2499 (ISSN-L)
- 1524-4628
- OpenAlex
- W2036966527
- Cited by
- 234
- References
- 5
- FWCI
- 16.48
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.