Evidence for the Efficacy of NXY-059 in Experimental Focal Cerebral Ischaemia Is Confounded by Study Quality
Open accessAbstract
Background and Purpose— The neutral results of the SAINT II trial have again highlighted difficulties translating neuroprotective efficacy from bench to bedside. Animal studies are susceptible to study quality biases, which may lead to overstatement of efficacy. We report the impact of study quality on published estimates of the efficacy of NXY-059 in animal models of stroke. Methods— We conducted a systematic review and stratified meta-analysis of published studies describing the efficacy of NXY-059 in experimental focal cerebral ischemia. Results— Overall, NXY-059 improved infarct volume by 43.3% (95% CI, 34.7 to 52.8). Only 2 of 9 publications reported randomization, concealment of treatment allocation, and blinded outcome assessment. Studies not reporting these quality items gave substantially higher estimates of efficacy than did higher-quality studies. Conclusions— The reported efficacy of NXY-059 in animal models of stroke is confounded by low study quality. The failure of SAINT II highlights the need for substantial improvements in the design, conduct, and reporting of animal studies; journals can play an important role in this by adopting standards for animal studies similar to those agreed over 10 years ago for clinical trials.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Study quality is inversely related to effect size in animal model studies.
“study quality is inversely related to effect size [79][80][81][82]”
From Power failure: why small sample size undermines the reliability of neuroscience (2013) · cites this paper as [81]
The Results report that estimated efficacy was highest in lower-quality studies of NXY-059 in animal models of stroke. This supports the inverse relationship in the studies analyzed, but does not establish it across animal model studies generally. (LLM, conf=0.84)
Experimental — accuracy not yet measuredCompelling data from systematic reviews show that nonblinded outcome assessment leads to treatment effects being overestimated.
“There are, however, compelling data from systematic reviews showing that nonblinded outcome assessment leads to the treatment effects being overestimated, and the lack of bias-reducing measures such as randomisation and blinding can contribute to as much as 30%–45% inflation of effect sizes [67,68,85].”
From Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0 (2020) · cites this paper as [85]
The Discussion says efficacy may have been overstated by methodological flaws and identifies blinded outcome assessment as a measure that might reduce bias. But Potential Weaknesses says the impact of blinded outcome assessment is not yet clear, so the source does not establish the claim’s categorical causal conclusion. The Results report lower efficacy estimates with randomization and allocation concealment, but do not substantiate the cited sentence’s 30%–45% inflation figure. (LLM, conf=0.86)
Experimental — accuracy not yet measuredLack of bias-reducing measures such as randomisation and blinding can contribute to as much as 30%-45% inflation of effect sizes.
“There are, however, compelling data from systematic reviews showing that nonblinded outcome assessment leads to the treatment effects being overestimated, and the lack of bias-reducing measures such as randomisation and blinding can contribute to as much as 30%–45% inflation of effect sizes [67,68,85].”
From Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0 (2020) · cites this paper as [85]
The Results report higher estimated NXY-059 efficacy in animal studies that did not report randomization or allocation concealment, supporting the general concern about bias. They do not report 30%–45% inflation of effect sizes, and they found no significant effect of reported blinded outcome assessment. The Discussion describes methodological flaws as a possible reason efficacy was overstated. (LLM, conf=0.88)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Roundtable, S. T. A. I. (1999) · Stroke · doi:10.1161/01.str.30.12.2752 · Cited by 1,258 · see citing works
Comparison of Treatment Effects between Animal Experiments and Clinical Trials: Systematic Review
Perel, P., Roberts, I., Sena, E., Wheble, P., Briscoe, C., Sandercock, P., Macleod, M., Mignini, L. E., Jayaram, P., & Khan, K. S. (2007) · BMJ · doi:10.1136/bmj.39048.407928.be · Cited by 827 · see citing works
Self-citationNXY-059 for the Treatment of Acute Ischemic Stroke
Shuaib, A. M., Lees, K. R., Lyden, P. D., Grotta, J. C., Dávalos, A., Davis, S. M., Diener, H., Ashwood, T. J., Wasiewski, W. W., & Emeribe, U. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa070240 · Cited by 733 · see citing works
Pooling of Animal Experimental Data Reveals Influence of Study Design and Publication Bias
Macleod, M., O'Collins, T., Howells, D., & Donnan, G. (2004) · Stroke · doi:10.1161/01.str.0000125719.25853.20 · Cited by 692 · see citing works
Self-citationNXY-059 for Acute Ischemic Stroke
Lees, K. R., Zivin, J. A., Ashwood, T., Davalos, A., Davis, S. M., Diener, H.-C., Grotta, J., Lyden, P., Shuaib, A., Hårdemark, H.-G., et al. (2006) · New England Journal of Medicine · doi:10.1056/nejmoa052980 · Cited by 660 · see citing works
Hypothermia in animal models of acute ischaemic stroke: a systematic review and meta-analysis.
van der Worp, H. B., Sena, E., Donnan, G., Howells, D., & Macleod, M. (2007) · Brain : a journal of neurology · doi:10.1093/brain/awm083 · Cited by 520 · see citing works
Self-citationHow can we improve the pre-clinical development of drugs for stroke?
Sena, E. S., van der Worp, H. B., Howells, D. W., & Macleod, M. R. (2007) · Trends in Neurosciences · doi:10.1016/j.tins.2007.06.009 · Cited by 365 · see citing works
Self-citationBench to Bedside: The Quest for Quality in Experimental Stroke Research
Dirnagl, U. (2006) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/sj.jcbfm.9600298 · Cited by 348 · see citing works
Self-citationKuroda, S., Tsuchidate, R., Smith, M., Maples, K. R., & Siesjö, B. K. (1999) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1097/00004647-199907000-00008 · Cited by 247 · see citing works
Empirical Evidence of Bias in the Design of Experimental Stroke Studies
Crossley, N. A., Sena, E. S., Göhler, J., Horn, J., van der Worp, H. B., Bath, P. M., Macleod, M. R., & Dirnagl, U. (2008) · Stroke · doi:10.1161/strokeaha.107.498725 · Cited by 231 · see citing works
Self-citationBenedek, A., Móricz, K., Jurányi, Z., Gigler, G., Lévay, G. I., Hársing, L. G., Mátyus, P., Szénási, G., & Albert, M. (2006) · Brain Research · doi:10.1016/j.brainres.2006.07.123 · Cited by 192 · see citing works
Marshall, J. W. B., Duffin, K. J., Green, A. R., & Ridley, R. M. (2001) · Stroke · doi:10.1161/01.str.32.1.190 · Cited by 181 · see citing works
Türeyen, K., Vemuganti, R., Sailor, K. A., & Dempsey, R. J. (2004) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2004.04.029 · Cited by 180 · see citing works
Green, A. R. (2007) · British Journal of Pharmacology · doi:10.1038/sj.bjp.0707594 · Cited by 179 · see citing works
Sydserff, S. G., Borelli, A., Green, A. R., & Cross, A. J. (2002) · British Journal of Pharmacology · doi:10.1038/sj.bjp.0704449 · Cited by 154 · see citing works
Systematic review and meta‐analysis of the efficacy of melatonin in experimental stroke
Macleod, M. R., O'Collins, T., Horky, L. L., Howells, D., & Donnan, G. A. (2005) · Journal of Pineal Research · doi:10.1111/j.1600-079x.2004.00172.x · Cited by 137 · see citing works
Self-citationSavitz, S. T. (2007) · Experimental Neurology · doi:10.1016/j.expneurol.2007.03.003 · Cited by 134 · see citing works
Marshall, J. W. B., Cummings, R. M., Bowes, L. J., Ridley, R. M., & Green, A. R. (2003) · Stroke · doi:10.1161/01.str.0000087790.79851.a8 · Cited by 132 · see citing works
Feuerstein, G., Zaleska, M. M., Krams, M., Wang, X., Day, M., Rutkowski, J., Finklestein, S. P., Pangalos, M. N., Poole, M., Stiles, G. L., et al. (2007) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/sj.jcbfm.9600516 · Cited by 121 · see citing works
Lapchak, P. A., Araujo, D. M., Song, D., Wei, J., & Zivin, J. A. (2002) · Stroke · doi:10.1161/01.str.0000015346.00054.8b · Cited by 111 · see citing works
Zhao, Z., Cheng, M., Maples, K. R., Jing, Y., & Buchan, A. M. (2001) · Brain Research · doi:10.1016/s0006-8993(01)02618-x · Cited by 103 · see citing works
Systematic Review and Meta-Analysis of the Efficacy of Tirilazad in Experimental Stroke
Sena, E. S., Wheble, P. C. R., Sandercock, P. A., & Macleod, M. R. (2007) · Stroke · doi:10.1161/01.str.0000254462.75851.22 · Cited by 95 · see citing works
Self-citationLapchak, P. A., Araujo, D. M., Song, D., Wei, J., Purdy, R. H., & Zivin, J. A. (2002) · Stroke · doi:10.1161/01.str.0000017145.22806.aa · Cited by 86 · see citing works
Lapchak, P. A., Song, D., Wei, J., & Zivin, J. A. (2004) · Experimental Neurology · doi:10.1016/j.expneurol.2004.02.005 · Cited by 48 · see citing works
Nitrone derivatives of trolox as neuroprotective agents
Balogh, G. T., Vukics, K., Könczöl, Á., Kis-Varga, Á., Gere, A., & Fischer, J. (2005) · Bioorganic & Medicinal Chemistry Letters · doi:10.1016/j.bmcl.2005.04.043 · Cited by 41 · see citing works
Yoshimoto, T., Kristián, T., Hu, B. R., Ouyang, Y., & Siesjö, B. K. (2002) · Brain Research · doi:10.1016/s0006-8993(02)02286-2 · Cited by 35 · see citing works
NXY-059 maintains Akt activation and inhibits release of cytochrome C after focal cerebral ischemia
Yoshimoto, T., Kanakaraj, P., Jing, Y., Cheng, M., Kerr, I., Malaiyandi, L. M., Watson, J. A., Siesjö, B. K., & Maples, K. R. (2002) · Brain Research · doi:10.1016/s0006-8993(02)02922-0 · Cited by 34 · see citing works
SAINT-I Worked, But the Neuroprotectant Is Not NXY-059
Proctor, P. H., & Tamborello, L. P. (2007) · Stroke · doi:10.1161/strokeaha.107.489161 · Cited by 19 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641 · see citing works
Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0
Percie du Sert, N., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000411 · Cited by 2,677 · see citing works
Self-citationCan Animal Models of Disease Reliably Inform Human Studies?
van der Worp, H. B., Howells, D. W., Sena, E. S., Porritt, M. J., Rewell, S., O'Collins, V., & Macleod, M. R. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000245 · Cited by 1,354 · see citing works
Self-citationUpdate of the Stroke Therapy Academic Industry Roundtable Preclinical Recommendations
Fisher, M., Feuerstein, G., Howells, D. W., Hurn, P. D., Kent, T. A., Savitz, S. I., & Lo, E. H. (2009) · Stroke · doi:10.1161/strokeaha.108.541128 · Cited by 1,352 · see citing works
Self-citationA call for transparent reporting to optimize the predictive value of preclinical research
Landis, S. C., Amara, S. G., Asadullah, K., Austin, C. P., Blumenstein, R., Bradley, E. W., Crystal, R. G., Darnell, R. B., Ferrante, R. J., Fillit, H., et al. (2012) · Nature · doi:10.1038/nature11556 · Cited by 1,196 · see citing works
Self-citationChamorro, Á., Dirnagl, U., Urra, X., & Planas, A. M. (2016) · The Lancet Neurology · doi:10.1016/s1474-4422(16)00114-9 · Cited by 1,198 · see citing works
Self-citationKilkenny, C., Parsons, N., Kadyszewski, E., Festing, M. F. W., Cuthill, I. C., Fry, D., Hutton, J., & Altman, D. G. (2009) · PLoS ONE · doi:10.1371/journal.pone.0007824 · Cited by 860 · see citing works
Publication bias in reports of animal stroke studies leads to major overstatement of efficacy
Sena, E. S., van der Worp, H. B., Bath, P. M. W., Howells, D. W., & Macleod, M. R. (2010) · PLoS Biology · doi:10.1371/journal.pbio.1000344 · Cited by 600 · see citing works
“It is now clear that certain aspects of experimental design (particularly randomisation, allocation concealment, and the blinded assessment of outcome) can have a substantial impact on the reported outcome of experiments [14].”
BackgroundSelf-citationReporting animal research: Explanation and Elaboration for the ARRIVE guidelines 2019Preprint
du Sert, N. P., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/703355 · Cited by 557 · see citing works
Self-citationMeta-analysis of data from animal studies: A practical guide
Vesterinen, H. M., Sena, E. S., Egan, K. J., Hirst, T. C., Churolov, L., Currie, G. L., Antonic‐Baker, A., Howells, D. W., & Macleod, M. R. (2013) · Journal of Neuroscience Methods · doi:10.1016/j.jneumeth.2013.09.010 · Cited by 477 · see citing works
Self-citationPublication and other reporting biases in cognitive sciences: detection, prevalence, and prevention
Ioannidis, J. P. A., Munafò, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.02.010 · Cited by 471 · see citing works
Johnson, P. I., Sutton, P., Atchley, D. S., Koustas, E., Lam, J., Sen, S., Robinson, K. A., Axelrad, D. A., & Woodruff, T. J. (2014) · Environmental Health Perspectives · doi:10.1289/ehp.1307893 · Cited by 449 · see citing works
Woodruff, T. J., & Sutton, P. (2014) · Environmental Health Perspectives · doi:10.1289/ehp.1307175 · Cited by 427 · see citing works
Pathophysiologic Cascades in Ischemic Stroke
Xing, C., Arai, K., Lo, E. H., & Hommel, M. (2012) · International Journal of Stroke · doi:10.1111/j.1747-4949.2012.00839.x · Cited by 421 · see citing works
Koustas, E., Lam, J., Sutton, P., Johnson, P. I., Atchley, D. S., Sen, S., Robinson, K. A., Axelrad, D. A., & Woodruff, T. J. (2014) · Environmental Health Perspectives · doi:10.1289/ehp.1307177 · Cited by 349 · see citing works
Good Laboratory Practice: Preventing Introduction of Bias at the Bench
Macleod, M. R., Fisher, M., O'Collins, V., Sena, E. S., Dirnagl, U., Bath, P. M. W., Buchan, A., van der Worp, H. B., Traystman, R., Minematsu, K., et al. (2009) · Stroke · doi:10.1161/strokeaha.108.525386 · Cited by 331 · see citing works
Self-citationEvaluation of excess significance bias in animal studies of neurological diseases
Tsilidis, K. K., Panagiotou, O. A., Sena, E. S., Aretouli, E., Evangelou, E., Howells, D. W., Salman, R. A.-S., Macleod, M. R., & Ioannidis, J. P. A. (2013) · PLoS Biology · doi:10.1371/journal.pbio.1001609 · Cited by 295 · see citing works
Self-citationThe need for randomization in animal trials: an overview of systematic reviews
Hirst, J. A., Howick, J., Aronson, J. K., Roberts, N., Perera, R., Koshiaris, C., & Heneghan, C. (2014) · PLoS ONE · doi:10.1371/journal.pone.0098856 · Cited by 294 · see citing works
What exactly is ‘N’ in cell culture and animal experiments?
Lazic, S. E., Clarke-Williams, C. J., & Munafò, M. R. (2018) · PLOS Biology · doi:10.1371/journal.pbio.2005282 · Cited by 291 · see citing works
Howells, D. W., Porritt, M. J., Rewell, S. S., O'Collins, V., Sena, E. S., van der Worp, H. B., Traystman, R. J., & Macleod, M. R. (2010) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.2010.66 · Cited by 309 · see citing works
Self-citationSena, E. S., Currie, G. L., McCann, S. K., Macleod, M. R., & Howells, D. W. (2014) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.2014.28 · Cited by 264 · see citing works
Self-citationNeuroprotection for Ischaemic Stroke: Translation from the Bench to the Bedside
Sutherland, B. A., Minnerup, J., Balami, J. S., Arba, F., Buchan, A. M., & Kleinschnitz, C. (2012) · International Journal of Stroke · doi:10.1111/j.1747-4949.2012.00770.x · Cited by 259 · see citing works
Evidence of experimental bias in the life sciences: why we need blind data recording
Holman, L., Head, M. L., Lanfear, R., & Jennions, M. D. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002190 · Cited by 263 · see citing works
The blood–brain barrier endothelium: a target for pro-inflammatory cytokines
Rochfort, K. D., & Cummins, P. M. (2015) · Biochemical Society Transactions · doi:10.1042/bst20140319 · Cited by 246 · see citing works
Neuroprotection for ischaemic stroke: Current status and challenges
Moretti, A., Ferrari, F., & Villa, R. F. (2014) · Pharmacology & Therapeutics · doi:10.1016/j.pharmthera.2014.09.003 · Cited by 242 · see citing works
Meta-analysis of preclinical studies of mesenchymal stromal cells for ischemic stroke
Vu, Q., Xie, K., Eckert, M., Zhao, W., & Cramer, S. C. (2014) · Neurology · doi:10.1212/wnl.0000000000000278 · Cited by 235 · see citing works
Garner, J. P. (2014) · ILAR Journal · doi:10.1093/ilar/ilu047 · Cited by 225 · see citing works
Pathobiology of injury after stroke: the neurovascular unit and beyond
Dirnagl, U. (2012) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2012.06691.x · Cited by 208 · see citing works
Self-citationNeuroprotection for Stroke: Current Status and Future Perspectives
Minnerup, J., Sutherland, B. A., Buchan, A. M., & Kleinschnitz, C. (2012) · International Journal of Molecular Sciences · doi:10.3390/ijms130911753 · Cited by 209 · see citing works
Progress in using systematic reviews of animal studies to improve translational research
Hooijmans, C. R., & Ritskes-Hoitinga, M. (2013) · PLoS Medicine · doi:10.1371/journal.pmed.1001482 · Cited by 195 · see citing works
Dirnagl, U., & Endres, M. (2014) · Stroke · doi:10.1161/strokeaha.113.004075 · Cited by 194 · see citing works
Self-citationUrsolic acid promotes the neuroprotection by activating Nrf2 pathway after cerebral ischemia in mice
Li, L., Zhang, X., Cui, L., Wang, L., Liu, H., Ji, H., & Du, Y. (2012) · Brain Research · doi:10.1016/j.brainres.2012.12.032 · Cited by 192 · see citing works
Carbone, L., & Austin, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0155001 · Cited by 191 · see citing works
The IMPROVE Guidelines (Ischaemia Models: Procedural Refinements Of in Vivo Experiments)
du Sert, N. P., Alfieri, A., Allan, S. M., Carswell, H. V. O., Deuchar, G. A., Farr, T. D., Flecknell, P. A., Gallagher, L., Gibson, C. L., Haley, M., et al. (2017) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1177/0271678x17709185 · Cited by 190 · see citing works
Self-citationImproving the translation of analgesic drugs to the clinic: animal models of neuropathic pain
du Sert, N. P., & Rice, A. S. C. (2014) · British Journal of Pharmacology · doi:10.1111/bph.12645 · Cited by 188 · see citing works
Leung, V., Rousseau-Blass, F., Beauchamp, G., & Pang, D. S. J. (2018) · PLOS ONE · doi:10.1371/journal.pone.0197882 · Cited by 172 · see citing works
Improving the translational hit of experimental treatments in multiple sclerosis
Vesterinen, H. M., Sena, E. S., ffrench-Constant, C., Williams, A., Chandran, S., & Macleod, M. R. (2010) · Multiple Sclerosis Journal · doi:10.1177/1352458510379612 · Cited by 182 · see citing works
Self-citationde Vries, R. B. M., Wever, K. E., Avey, M. T., Stephens, M. L., Sena, E. S., & Leenaars, M. (2014) · ILAR Journal · doi:10.1093/ilar/ilu043 · Cited by 165 · see citing works
Self-citationKrauth, D., Woodruff, T. J., & Bero, L. (2013) · Environmental Health Perspectives · doi:10.1289/ehp.1206389 · Cited by 160 · see citing works
Provencher, S., Archer, S. L., Ramirez, F. D., Hibbert, B. M., Paulin, R., Boucherat, O., Lacasse, Y., & Bonnet, S. (2018) · Circulation Research · doi:10.1161/circresaha.117.312579 · Cited by 137 · see citing works
Ramirez, F. D., Motazedian, P., Jung, R. G., Di Santo, P., MacDonald, Z. D., Moreland, R., Simard, T., Clancy, A. A., Russo, J. J., Welch, V. A., et al. (2017) · Circulation Research · doi:10.1161/circresaha.117.310628 · Cited by 138 · see citing works
“described candidate therapies that have advanced to testing in humans despite irreproducible or inconsistent results in animals.(8,20,21) Since the mid-1990s, pharmaceutical research and devel-”
An Enriched Environment Improves Sensorimotor Function Post-Ischemic Stroke
Janssen, H., Bernhardt, J., Collier, J., Sena, E., McElduff, P., Attia, J., Pollack, M., Howells, D., Nilsson, M., Calford, M., et al. (2010) · Neurorehabilitation and Neural Repair · doi:10.1177/1545968310372092 · Cited by 143 · see citing works
Self-citationAnimal models of bone cancer pain: Systematic review and meta-analyses
Currie, G. L., Delaney, A., Bennett, M., Dickenson, A. H., Egan, K. J., Vesterinen, H. M., Sena, E. S., Macleod, M. R., Colvin, L., & Fallon, M. (2013) · Pain · doi:10.1016/j.pain.2013.02.033 · Cited by 133 · see citing works
Self-citationBringing rigour to translational medicine
Howells, D. W., Sena, E. S., & Macleod, M. R. (2014) · Nature Reviews Neurology · doi:10.1038/nrneurol.2013.232 · Cited by 130 · see citing works
Self-citationThe devil is in the details: incomplete reporting in preclinical animal research
Avey, M. T., Moher, D., Sullivan, K. J., Fergusson, D., Griffin, G., Grimshaw, J. M., Hutton, B., Lalu, M. M., Macleod, M., Marshall, J., et al. (2016) · PLOS ONE · doi:10.1371/journal.pone.0166733 · Cited by 130 · see citing works
Self-citationRochester, J. R., Bolden, A. L., & Kwiatkowski, C. F. (2018) · Environment International · doi:10.1016/j.envint.2017.12.028 · Cited by 130 · see citing works
Michel, M. C., Murphy, T. J., & Motulsky, H. J. (2020) · Molecular Pharmacology · doi:10.1124/mol.119.118927 · Cited by 127 · see citing works
Effects of NXY‐059 in experimental stroke: an individual animal meta‐analysis
Bath, P. M., Gray, L. J., Bath, A. J. G., Buchan, A. M., Miyata, T., & Green, A. R. (2009) · British Journal of Pharmacology · doi:10.1111/j.1476-5381.2009.00196.x · Cited by 122 · see citing works
Predictive validity in drug discovery: what it is, why it matters and how to improve it
Scannell, J. W., Bosley, J., Hickman, J. A., Dawson, G. R., Truebel, H., Ferreira, G. S., Richards, D. B., & Treherne, J. M. (2022) · Nature Reviews Drug Discovery · doi:10.1038/s41573-022-00552-x · Cited by 122 · see citing works
Batchelor, P., Wills, T. E., Skeers, P., Battistuzzo, C. R., Macleod, M. R., Howells, D. W., & Sena, E. S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0072659 · Cited by 115 · see citing works
Self-citationLalu, M. M., Sullivan, K., Mei, S. H. J., Moher, D., Straus, A., Fergusson, D. A., Stewart, D. J., Jazi, M., Macleod, M. R., Winston, B. W., et al. (2016) · eLife · doi:10.7554/elife.17850 · Cited by 116 · see citing works
Self-citationKorevaar, D. A., Hooft, L., & ter Riet, G. (2011) · Laboratory Animals · doi:10.1258/la.2011.010121 · Cited by 110 · see citing works
Similar Effect of Autologous and Allogeneic Cell Therapy for Ischemic Heart Disease
Lorkeers, S. J. J. O., Eding, J., Vesterinen, H. M., van der Spoel, T. I. G., Sena, E. S., Duckers, H. J., Doevendans, P. A., Macleod, M. R., & Chamuleau, S. A. J. (2014) · Circulation Research · doi:10.1161/circresaha.116.304872 · Cited by 108 · see citing works
Self-citationPundik, S., Xu, K., & Sundararajan, S. (2012) · Neurology · doi:10.1212/wnl.0b013e3182695a14 · Cited by 107 · see citing works
Dimethyl Fumarate and Monomethyl Fumarate Promote Post-Ischemic Recovery in Mice
Yao, Y., Miao, W., Liu, Z., Han, W., Shi, K., Shen, Y., Li, H., Liu, Q., Fu, Y., Huang, D., et al. (2016) · Translational Stroke Research · doi:10.1007/s12975-016-0496-0 · Cited by 108 · see citing works
Introducing Therioepistemology: the study of how knowledge is gained from animal research
Garner, J. P., Gaskill, B. N., Weber, E. M., Dallaire, J. A., & Pritchett‐Corning, K. R. (2017) · Lab Animal · doi:10.1038/laban.1224 · Cited by 106 · see citing works
Reproducibility and Rigor in Animal-Based Research
Macleod, M., & Mohan, S. (2019) · ILAR Journal · doi:10.1093/ilar/ilz015 · Cited by 104 · see citing works
Self-citationMesenchymal Stem Cell-Based Therapy for Stroke: Current Understanding and Challenges
Li, W., Shi, L., Hu, B., Hong, Y., Zhang, H., Li, X., & Zhang, Y. (2021) · Frontiers in Cellular Neuroscience · doi:10.3389/fncel.2021.628940 · Cited by 104 · see citing works
Did a change in Nature journals’ editorial policy for life sciences research improve reporting?
The NPQIP Collaborative group, Study steering committee, Macleod, M., Sena, E., Howells, D., Macleod, M., Sena, E., Howells, D., Kiermer, V., Swaminathan, S., et al. (2019) · BMJ Open Science · doi:10.1136/bmjos-2017-000035 · Cited by 102 · see citing works
Self-citationSoftware Tools for Literature Screening in Systematic Reviews in Biomedical Research
van der Mierden, S. (2019) · ALTEX · doi:10.14573/altex.1902131 · Cited by 99 · see citing works
General Principles of Preclinical Study Design
Huang, W., du Sert, N. P., Vollert, J., & Rice, A. S. C. (2019) · Handbook of experimental pharmacology · doi:10.1007/164_2019_277 · Cited by 106 · see citing works
Wang, H., Zhou, Q., Xu, M.-B., Zhou, X., & Zheng, G. (2017) · Oxidative Medicine and Cellular Longevity · doi:10.1155/2017/8424326 · Cited by 92 · see citing works
Stem Cells as an Emerging Paradigm in Stroke 4
Boltze, J., Modo, M., Mays, R. W., Taguchi, A., Jolkkonen, J., Savitz, S. I., Participants, F. T. S. 4., Bates, D., Bath, P. M., Carmichael, S. T., et al. (2019) · Stroke · doi:10.1161/strokeaha.119.025436 · Cited by 92 · see citing works
Michel, M. C., Murphy, T. J., & Motulsky, H. J. (2019) · Journal of Pharmacology and Experimental Therapeutics · doi:10.1124/jpet.119.264143 · Cited by 92 · see citing works
Behavioral outcome measures to improve experimental stroke research
Balkaya, M., Trueman, R. C., Boltze, J., Corbett, D., & Jolkkonen, J. (2017) · Behavioural Brain Research · doi:10.1016/j.bbr.2017.07.039 · Cited by 91 · see citing works
Watzlawick, R., Sena, E. S., Dirnagl, U., Brommer, B., Kopp, M. A., Macleod, M. R., Howells, D. W., & Schwab, J. M. (2013) · JAMA Neurology · doi:10.1001/jamaneurol.2013.4684 · Cited by 97 · see citing works
Self-citationAnimal models of stroke: translational potential at present and in 2050
Herson, P., & Traystman, R. (2014) · Future Neurology · doi:10.2217/fnl.14.44 · Cited by 69 · see citing works
The Efficacy of Erythropoietin and Its Analogues in Animal Stroke Models
Minnerup, J., Heidrich, J., Rogalewski, A., Schäbitz, W., & Wellmann, J. (2009) · Stroke · doi:10.1161/strokeaha.109.555789 · Cited by 87 · see citing works
O'Collins, V. E., Macleod, M., Cox, S. F., van Raay, L., Aleksoska, E., Donnan, G., & Howells, D. (2011) · Journal of Cerebral Blood Flow and Metabolism · doi:10.1038/jcbfm.2010.184 · Cited by 95 · see citing works
Self-citationAnimal Models of Neurological Disorders
Chesselet, M., & Carmichael, S. T. (2012) · Neurotherapeutics · doi:10.1007/s13311-012-0118-9 · Cited by 85 · see citing works
Currie, G. L., Angel-Scott, H. N., Colvin, L., Cramond, F., Hair, K., Khandoker, L., Liao, J., Macleod, M. R., McCann, S., Morland, R., et al. (2019) · PLoS Biology · doi:10.1371/journal.pbio.3000243 · Cited by 80 · see citing works
Self-citationBath, P. M. W., Macleod, M. R., & Green, A. (2009) · International Journal of Stroke · doi:10.1111/j.1747-4949.2009.00386.x · Cited by 83 · see citing works
Self-citationNovel Approaches to Neuroprotection Trials in Acute Ischemic Stroke
Tymianski, M. (2013) · Stroke · doi:10.1161/strokeaha.113.000731 · Cited by 79 · see citing works
Dopamine agonists in animal models of Parkinson’s disease: A systematic review and meta-analysis
Rooke, E. D., Vesterinen, H. M., Sena, E. S., Egan, K. J., & Macleod, M. R. (2011) · Parkinsonism & Related Disorders · doi:10.1016/j.parkreldis.2011.02.010 · Cited by 78 · see citing works
Self-citationLochhead, J. J., Ronaldson, P. T., & Davis, T. P. (2024) · Biochemical Pharmacology · doi:10.1016/j.bcp.2024.116186 · Cited by 80 · see citing works
Dirnagl, U., & Macleod, M. R. (2009) · British Journal of Pharmacology · doi:10.1111/j.1476-5381.2009.00211.x · Cited by 76 · see citing works
Self-citationMcCann, S., Cramond, F., Macleod, M. R., & Sena, E. S. (2016) · Translational Stroke Research · doi:10.1007/s12975-016-0489-z · Cited by 75 · see citing works
Self-citationReflections of an aging free radical
Halliwell, B. (2020) · Free Radical Biology and Medicine · doi:10.1016/j.freeradbiomed.2020.10.010 · Cited by 75 · see citing works
Preclinical animal studies in ischemic stroke: Challenges and some solutions
Narayan, S. K., Cherian, S. G., Babu, P. P., Chidambaram, S. B., Vasanthi, H. R., & Arumugam, M. (2021) · Animal Models and Experimental Medicine · doi:10.1002/ame2.12166 · Cited by 74 · see citing works
Liu, J., Zhang, C., Tao, W., & Liu, M. (2012) · International Journal of Neuroscience · doi:10.3109/00207454.2012.749255 · Cited by 74 · see citing works
Authorization of Animal Experiments Is Based on Confidence Rather than Evidence of Scientific Rigor
Vogt, L., Reichlin, T., Nathues, C., & Würbel, H. (2016) · PLoS Biology · doi:10.1371/journal.pbio.2000598 · Cited by 71 · see citing works
The researchers’ view of scientific rigor—survey on the conduct and reporting of in vivo research
Reichlin, T. S., Vogt, L., & Würbel, H. (2016) · PLOS ONE · doi:10.1371/journal.pone.0165999 · Cited by 72 · see citing works
Chioua, M., Sucunza, D., Soriano, E., Hadjipavlou‐Litina, D., Alcázar, A., Ayuso, M. I., Oset‐Gasque, M. J., González, M. P., Monjas, L., Rodrı́guez-Franco, M. I., et al. (2011) · Journal of Medicinal Chemistry · doi:10.1021/jm201105a · Cited by 70 · see citing works
Pharmacological intervention studies using mouse models of the inflammatory bowel diseases
Koboziev, I., Karlsson, F. J., Zhang, S., & Grisham, M. B. (2011) · Inflammatory Bowel Diseases · doi:10.1002/ibd.21557 · Cited by 70 · see citing works
Ibogaine and addiction in the animal model, a systematic review and meta-analysis
Belgers, M., Leenaars, M., Homberg, J. R., Ritskes-Hoitinga, M. J., Schellekens, A., & Hooijmans, C. R. (2016) · Translational Psychiatry · doi:10.1038/tp.2016.71 · Cited by 66 · see citing works
Cui, H., He, H., Yang, A., Zhou, H.-J., Wang, C., Luo, J., Lin, Y., & Tang, T. (2015) · PLoS ONE · doi:10.1371/journal.pone.0127256 · Cited by 68 · see citing works
Lim, W. Q. M., Messow, C., & Berry, C. (2011) · British Journal of Pharmacology · doi:10.1111/j.1476-5381.2011.01691.x · Cited by 67 · see citing works
Reprint: Good laboratory practice: preventing introduction of bias at the bench
Macleod, M., Fisher, M., O'Collins, V. E., Sena, E., Dirnagl, U., Bath, P., Buchan, A., van der Worp, H. B., Traystman, R., Minematsu, K., et al. (2008) · Journal of Cerebral Blood Flow and Metabolism · doi:10.1038/jcbfm.2008.101 · Cited by 404 · see citing works
Self-citationLalu, M. M., Montroy, J. R., Dowlatshahi, D. D., Hutton, B., Juneau, P., Wesch, N. L., Zhang, S. Y., McGinn, R. N., Corbett, D., Stewart, D. J., et al. (2019) · Translational Stroke Research · doi:10.1007/s12975-019-00736-5 · Cited by 64 · see citing works
Scientific productivity: An exploratory study of metrics and incentives
Lindner, M. D., Torralba, K. D., & Khan, N. A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0195321 · Cited by 58 · see citing works
Rapamycin in ischemic stroke: Old drug, new tricks?
Hadley, G., Beard, D. J., Couch, Y., Neuhaus, A., Adriaanse, B. A., DeLuca, G., Sutherland, B. A., & Buchan, A. (2018) · Journal of Cerebral Blood Flow and Metabolism · doi:10.1177/0271678x18807309 · Cited by 53 · see citing works
Vollert, J., Schenker, E., Macleod, M. R., Bespalov, A., Würbel, H., Michel, M. C., Dirnagl, U., Potschka, H., Waldron, A., Wever, K. E., et al. (2020) · BMJ Open Science · doi:10.1136/bmjos-2019-100046 · Cited by 61 · see citing works
Self-citationFluri, F., Grünstein, D., Cam, E., Ungethuem, U., Hatz, F., Schäfer, J., Samnick, S., Israel, I., Kleinschnitz, C., Orts‐Gil, G., et al. (2015) · Experimental Neurology · doi:10.1016/j.expneurol.2015.01.005 · Cited by 58 · see citing works
Wei, R., Teng, H.-J., Yin, B., Xu, Y., Du, Y., He, F.-P., Chu, K., Luo, B., & Zheng, G. (2013) · Evidence-based Complementary and Alternative Medicine · doi:10.1155/2013/138484 · Cited by 58 · see citing works
Batchelor, P., Skeers, P., Antonic‐Baker, A., Wills, T. E., Howells, D. W., Macleod, M. R., & Sena, E. S. (2013) · PLoS ONE · doi:10.1371/journal.pone.0071317 · Cited by 58 · see citing works
Self-citationBespalov, A., Wicke, K. M., & Castagné, V. (2019) · Handbook of experimental pharmacology · doi:10.1007/164_2019_279 · Cited by 58 · see citing works
McCann, S., & Roulston, C. L. (2013) · Brain Sciences · doi:10.3390/brainsci3020561 · Cited by 57 · see citing works
Evaluation of Combination Therapy in Animal Models of Cerebral Ischemia
O’Collins, V. E., Macleod, M. R., Donnan, G. A., & Howells, D. W. (2012) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.2011.203 · Cited by 55 · see citing works
Self-citationImproving the Efficiency of the Development of Drugs for Stroke
Howells, D., Sena, E., O'Collins, V. E., & Macleod, M. (2012) · International Journal of Stroke · doi:10.1111/j.1747-4949.2012.00805.x · Cited by 55 · see citing works
Self-citationAccelerating Biomedical Discoveries through Rigor and Transparency
Hewitt, J., Brown, L. L., Murphy, S. J., Grieder, F. B., & Silberberg, S. D. (2017) · ILAR Journal · doi:10.1093/ilar/ilx011 · Cited by 53 · see citing works
- Authors
- Macleod, M. R., van der Worp, H. B., Sena, E. S., Howells, D. W., Dirnagl, U., & Donnan, G. A.
- Affiliations
- University Medical Center Utrecht (NL)
- From Clinical Neurosciences (M.R.M., E.S.S.), University of Edinburgh, Scotland, UK; the Department of Neurology (H.B.v.d.W.), Rudolf Magnus Institute of Neuroscience, University Medical Centre, Utrecht, The Netherlands; the National Stroke Research Institute (E.S.S., D.W.H., G.A.D.), Melbourne, Australia; and the Department Neurology (U.D.), Charite Hospital, Berlin, Germany.
- Venue
- Stroke
- Published
- 2008-10
- Volume
- 39
- Issue
- 10
- Pages
- 2824-2829
- ISSN
- 0039-2499 (ISSN-L)
- 1524-4628
- OpenAlex
- W2168672683
- Cited by
- 319
- References
- 28
- Citations by year
- 2026: 4 · 2025: 12 · 2024: 11 · 2023: 12 · 2022: 16 · 2021: 15 · 2020: 17 · 2019: 33 · 2018: 11 · 2017: 18 · 2016: 26 · 2015: 19 · 2014: 28 · 2013: 26 · 2012: 19
- FWCI
- 12.87
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Stroke (publishedVersion)
- PubMed (publishedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (publishedVersion)
- University of Groningen research database (University of Groningen / Centre for Information Technology) (submittedVersion)
- Topics
- Health Sciences › Medicine › Epidemiology › Acute Ischemic Stroke Management
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Life Sciences › Neuroscience › Neurology › Neurological Disorders and Treatments
- Keywords
- NXY-059, focal cerebral ischemia, animal models of stroke, study quality bias, infarct size, neuroprotection, translational research
- MeSH terms
- Animals, Benzenesulfonates, Cardiovascular Agents, Brain Ischemia, Clinical Trials as Topic, Research Design, Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review