The DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Avoidable Waste in the Production and Reporting of Research Evidence
Abstract
TEST 02 - Elsevier's Scopus, the largest abstract and citation database of peer-reviewed literature. Search and access research from the science, technology, medicine, social sciences and arts and humanities fields.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Systematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546
Full publication of results initially presented in abstracts.
Scherer, R. W., Langenberg, P., & von Elm, E. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000005.pub3 · Cited by 997
What is missing from descriptions of treatment in trials and reviews?
Glasziou, P., Meats, E., Heneghan, C., & Shepperd, S. (2008) · BMJ · doi:10.1136/bmj.39590.732037.47 · Cited by 614
Self-citationEvidence of bias and variation in diagnostic accuracy studies
Rutjes, A. W. S., Reitsma, J. B., Di Nisio, M., Smidt, N., van Rijn, J. C., & Bossuyt, P. M. M. (2006) · Canadian Medical Association Journal · doi:10.1503/cmaj.050090 · Cited by 611
The Relation between Funding by the National Institutes of Health and the Burden of Disease
Gross, C. P., Anderson, G. F., & Powe, N. R. (1999) · New England Journal of Medicine · doi:10.1056/nejm199906173402406 · Cited by 509
Relative Citation Impact of Various Study Designs in the Health Sciences
Patsopoulos, N. A. (2005) · JAMA · doi:10.1001/jama.293.19.2362 · Cited by 498
Relation between agendas of the research community and the research consumer
Tallon, D., Chard, J., & Dieppe, P. (2000) · The Lancet · doi:10.1016/s0140-6736(00)02351-5 · Cited by 416
Patients and professionals as research partners: Challenges, practicalities, and benefits
Hewlett, S., Wit, M. D., Richards, P., Quest, E., Hughes, R., Heiberg, T., & Kirwan, J. (2006) · Arthritis Care & Research · doi:10.1002/art.22091 · Cited by 272
Time to publication for results of clinical trials
Hopewell, S., Clarke, M. J., Stewart, L., & Tierney, J. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000011.pub2 · Cited by 243
Putting clinical trials into context
Young, C., & Horton, R. (2005) · The Lancet · doi:10.1016/s0140-6736(05)66846-8 · Cited by 185
Cited by
Hoffmann, T. C., Glasziou, P. P., Boutron, I., Milne, R., Perera, R., Moher, D., Altman, D. G., Barbour, V., Macdonald, H., Johnston, M., et al. (2014) · BMJ · doi:10.1136/bmj.g1687 · Cited by 10,548
Self-citationRadiomics: Images Are More than Pictures, They Are Data
Gillies, R. J., Kinahan, P. E., & Hricak, H. (2016) · Radiology · doi:10.1148/radiol.2015151169 · Cited by 8,421
Improving bioscience research reporting: The ARRIVE guidelines for reporting animal research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2010) · Journal of Pharmacology and Pharmacotherapeutics · doi:10.4103/0976-500x.72351 · Cited by 6,277
Skivington, K., Matthews, L., Simpson, S. A., Craig, P., Baird, J., Blazeby, J. M., Boyd, K. A., Craig, N., French, D. P., McIntosh, E., et al. (2021) · BMJ · doi:10.1136/bmj.n2061 · Cited by 5,808
SPIRIT 2013 explanation and elaboration: guidance for protocols of clinical trials
Chan, A.-W., Tetzlaff, J. M., Gotzsche, P. C., Altman, D. G., Mann, H., Berlin, J. A., Dickersin, K., Hrobjartsson, A., Schulz, K. F., Parulekar, W. R., et al. (2013) · BMJ · doi:10.1136/bmj.e7586 · Cited by 6,251
Moons, K. G. M., Altman, D. G., Reitsma, J. B., Ioannidis, J. P. A., Macaskill, P., Steyerberg, E. W., Vickers, A. J., Ransohoff, D. F., & Collins, G. S. (2015) · Annals of Internal Medicine · doi:10.7326/m14-0698 · Cited by 5,147
Boutron, I., Altman, D. G., Moher, D., Schulz, K. F., Ravaud, P., & for the CONSORT NPT Group* (2017) · Annals of Internal Medicine · doi:10.7326/m17-0046 · Cited by 1,538
“I reporting is responsible for a great deal of avoidable waste in research (1, 2).”
BackgroundHow to increase value and reduce waste when research priorities are set
Chalmers, I., Bracken, M. B., Djulbegovic, B., Garattini, S., Grant, J., Gülmezoglu, A. M., Howells, D. W., Ioannidis, J. P. A., & Oliver, S. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62229-1 · Cited by 1,436
Self-citationReducing waste from incomplete or unusable reports of biomedical research
Glasziou, P., Altman, D. G., Bossuyt, P., Boutron, I., Clarke, M., Julious, S., Michie, S., Moher, D., & Wager, E. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62228-x · Cited by 1,319
Self-citationResearch co-design in health: a rapid overview of reviews
Slattery, P., Saeri, A. K., & Bragge, P. (2020) · Health Research Policy and Systems · doi:10.1186/s12961-020-0528-9 · Cited by 1,313
Seventy-five trials and eleven systematic reviews a day: how will we ever keep up?
Bastian, H., Glasziou, P., & Chalmers, I. (2010) · PLoS Medicine · doi:10.1371/journal.pmed.1000326 · Cited by 1,188
Self-citationPrinsen, C. A. C., Vohra, S., Rose, M. R., Boers, M., Tugwell, P., Clarke, M., Williamson, P. R., & Terwee, C. B. (2016) · Trials · doi:10.1186/s13063-016-1555-2 · Cited by 1,106
A catalogue of reporting guidelines for health research
Simera, I., Moher, D., Hoey, J., Schulz, K. F., & Altman, D. G. (2010) · European Journal of Clinical Investigation · doi:10.1111/j.1365-2362.2009.02234.x · Cited by 1,047
Collins, G. S., Dhiman, P., Andaur Navarro, C. L., Ma, J., Hooft, L., Reitsma, J. B., Logullo, P., Beam, A. L., Peng, L., Van Calster, B., et al. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-048008 · Cited by 852
Collins, G. S., de Groot, J. A., Dutton, S., Omar, O., Shanyinde, M., Tajar, A., Voysey, M., Wharton, R., Yu, L.-M., Moons, K. G., et al. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-40 · Cited by 729
“This clearly points to considerable waste in research (including monetary and scientific) [10].”
BackgroundTurner, L., Shamseer, L., Altman, D. G., Schulz, K. F., & Moher, D. (2012) · Systematic Reviews · doi:10.1186/2046-4053-1-60 · Cited by 628
“of RCTs published in CONSORT-endorsing journals before and after e resources that fund health research [14].”
BackgroundIncreasing value and reducing waste in biomedical research regulation and management
Salman, R. A.-S., Beller, E., Kagan, J., Hemminki, E., Phillips, R. S., Savulescu, J., Macleod, M., Wisely, J., & Chalmers, I. (2014) · The Lancet · doi:10.1016/s0140-6736(13)62297-7 · Cited by 534
Self-citationSystematic review automation technologies
Tsafnat, G., Glasziou, P., Choong, M. K., Dunn, A., Galgani, F., & Coiera, E. (2014) · Systematic Reviews · doi:10.1186/2046-4053-3-74 · Cited by 472
“Task description The resources and time required to produce a systematic review are so great that independently creating a duplicate of an existing review is both wasteful and avoidable [26].”
BackgroundSelf-citationIncreasing value and reducing waste in biomedical research: who's listening?
Moher, D., Glasziou, P., Chalmers, I., Nasser, M., Bossuyt, P. M. M., Korevaar, D. A., Graham, I. D., Ravaud, P., & Boutron, I. (2016) · The Lancet · doi:10.1016/s0140-6736(15)00307-4 · Cited by 462
Self-citationImproving bioscience research reporting: the ARRIVE guidelines for reporting animal research
Kilkenny, C., Browne, W. J., Cuthill, I. C., Emerson, M., & Altman, D. G. (2012) · Osteoarthritis and Cartilage · doi:10.1016/j.joca.2012.02.010 · Cited by 728
Woodruff, T. J., & Sutton, P. (2014) · Environmental Health Perspectives · doi:10.1289/ehp.1307175 · Cited by 427
Joseph, P. D., Craig, J. C., & Caldwell, P. H. Y. (2015) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.12305 · Cited by 393
Sala, E., Mema, E., Himoto, Y., Veeraraghavan, H., Brenton, J. D., Snyder, A., Weigelt, B., & Vargas, H. A. (2017) · Clinical Radiology · doi:10.1016/j.crad.2016.09.013 · Cited by 369
Patient involvement in clinical research: why, when, and how
Sacristan, J. A., Aguaron, A., Avendaño, C., Garrido, P., Carrion, J., Gutierrez, A., Kroes, R., & Flores, A. (2016) · Patient Preference and Adherence · doi:10.2147/ppa.s104259 · Cited by 363
Choosing Important Health Outcomes for Comparative Effectiveness Research: A Systematic Review
Gargon, E., Gurung, B., Medley, N., Altman, D. G., Blazeby, J. M., Clarke, M., & Williamson, P. R. (2014) · PLoS ONE · doi:10.1371/journal.pone.0099111 · Cited by 337
Bleijenberg, N., de Man-van Ginkel, J. M., Trappenburg, J. C. A., Ettema, R. G. A., Sino, C. G., Heim, N., Hafsteindóttir, T. B., Richards, D. A., & Schuurmans, M. J. (2018) · International Journal of Nursing Studies · doi:10.1016/j.ijnurstu.2017.12.001 · Cited by 334
Systematic review adherence to methodological or reporting quality
Pussegoda, K., Turner, L., Garritty, C., Mayhew, A., Skidmore, B., Stevens, A., Boutron, I., Sarkis-Onofre, R., Bjerre, L. M., Hróbjartsson, A., et al. (2017) · Systematic Reviews · doi:10.1186/s13643-017-0527-2 · Cited by 322
“Poorly conducted SRs can lead to inaccurate estimates of treatment effectiveness, misleading conclusions, and reduced applicability, all of which are a waste of limited resources [4].”
Toye, F., Seers, K., Allcock, N., Briggs, M., Carr, E., & Barker, K. (2014) · BMC Medical Research Methodology · doi:10.1186/1471-2288-14-80 · Cited by 322
Urquhart-Secord, R., Craig, J. C., Hemmelgarn, B., Tam-Tham, H., Manns, B., Howell, M., Polkinghorne, K. R., Kerr, P. G., Harris, D. C., Thompson, S., et al. (2016) · American Journal of Kidney Diseases · doi:10.1053/j.ajkd.2016.02.037 · Cited by 305
Lewinski, A. A., Crowley, M. J., Miller, C., Bosworth, H. B., Jackson, G. L., Steinhauser, K., White-Clark, C., McCant, F., & Zullig, L. L. (2021) · Medical Care · doi:10.1097/mlr.0000000000001553 · Cited by 296
“a priori areas of interest in which to obtain information as we designed TECNO Care: (1) How should we identify VHA sites in which to implement TECNO Care? [Inner setting]—We identified contextual factors and the ways in which TECNO Care could supplement current VHA programs addressing care coordination.”
BackgroundMethodInfluentialPublication bias: what is it? How do we measure it? How do we avoid it?
Song, F., Hooper, & Loke, Y. (2013) · Open Access Journal of Clinical Trials · doi:10.2147/oajct.s34419 · Cited by 275
European Resuscitation Council Guidelines 2021: Ethics of resuscitation and end of life decisions
Mentzelopoulos, S. D., Couper, K., Voorde, P. V. D., Druwé, P., Blom, M., Perkins, G. D., Lulic, I., Djakow, J., Raffay, V., Lilja, G., et al. (2021) · Resuscitation · doi:10.1016/j.resuscitation.2021.02.017 · Cited by 246
Vinkers, C. H., Tijdink, J. K., & Otte, W. M. (2015) · BMJ · doi:10.1136/bmj.h6467 · Cited by 237
Gagnier, J. J., Moher, D., Boon, H., Beyene, J., & Bombardier, C. (2012) · BMC Medical Research Methodology · doi:10.1186/1471-2288-12-111 · Cited by 222
Hardwicke, T. E., Wallach, J. D., Kidwell, M. C., Bendixen, T., Crüwell, S., & Ioannidis, J. P. A. (2020) · Royal Society Open Science · doi:10.1098/rsos.190806 · Cited by 217
Are Peer Reviewers Encouraged to Use Reporting Guidelines? A Survey of 116 Health Research Journals
Hirst, A., & Altman, D. G. (2012) · PLoS ONE · doi:10.1371/journal.pone.0035621 · Cited by 200
“This is unethical, wasteful of scarce resources and even potentially harmful [1,2].”
BackgroundTitles versus titles and abstracts for initial screening of articles for systematic reviews
Mateen, F., Oh, Tergas, Bhayani, & Kamdar (2013) · Clinical Epidemiology · doi:10.2147/clep.s43118 · Cited by 202
“Cutting corners to minimize these financial and time investments may lead to lower quality systematic reviews and meta analyses that fail to identify all relevant studies.(2) In contrast, there is increasing recognition of unfinished and unpublished projects that could be beneficial if finalized.”
InfluentialMethodological quality of COVID-19 clinical research
Jung, R. G., Di Santo, P., Clifford, C., Prosperi-Porta, G., Skanes, S., Hung, A., Parlow, S., Visintini, S., Ramirez, F. D., Simard, T., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-21220-5 · Cited by 189
“Specifically, we undertook a systematic review to identify COVID-19 clinical literature and matched them to historical controls to formally evaluate the following: (1) the methodological quality of COVID-19 studies using established quality tools and checklists, (2) the methodological quality of COVID-19 studies, stra…”
BackgroundMethodScoping review on interventions to improve adherence to reporting guidelines in health research
Blanco, D., Altman, D., Moher, D., Boutron, I., Kirkham, J. J., & Cobo, E. (2019) · BMJ Open · doi:10.1136/bmjopen-2018-026589 · Cited by 154
“bACkgrOunD Approximately 85% of all biomedical research today is estimated to be wasted, due, in part, to incomplete or inaccurate reporting.(1) The past two decades have given rise to a number of changes in an effort to help authors and the broader scientific community properly report research methods and findings, w…”
BackgroundBarnes, C., Boutron, I., Giraudeau, B., Porcher, R., Altman, D. G., & Ravaud, P. (2015) · BMC Medicine · doi:10.1186/s12916-015-0460-y · Cited by 135
“Background Inadequate reporting is a frequent cause of waste in research [1, 2].”
BackgroundRole of feasibility and pilot studies in randomised controlled trials: a cross-sectional study
Blatch-Jones, A. J., Pek, W., Kirkpatrick, E., & Ashton-Key, M. (2018) · BMJ Open · doi:10.1136/bmjopen-2018-022233 · Cited by 139
Bringing rigour to translational medicine
Howells, D. W., Sena, E. S., & Macleod, M. R. (2014) · Nature Reviews Neurology · doi:10.1038/nrneurol.2013.232 · Cited by 130
How to prove that your therapy is effective, even when it is not: a guideline
Cuijpers, P., & Cristea, I. A. (2016) · Epidemiology and Psychiatric Sciences · doi:10.1017/s2045796015000864 · Cited by 122
“It was claimed that most published research findings are false (Ioannidis, 2005) and that up to 85% of biomedical research is wasted (Chalmers & Glasziou, 2009) despite attempts to pin down wrong attitudes of researchers (see, for example, www.alltrials.net) and guidelines on how to conduct…”
BackgroundClarifying differences between reviews within evidence ecosystems
Gough, D., Thomas, J., & Oliver, S. (2019) · Systematic Reviews · doi:10.1186/s13643-019-1089-2 · Cited by 115
Reporting guidelines: doing better for readers
Moher, D. (2018) · BMC Medicine · doi:10.1186/s12916-018-1226-0 · Cited by 107
“Chalmers and Glasziou [4] reminded us of the substantial and avoidable fiscal waste associated with a plethora of problems of biomedical research, including inadequate reporting.”
BackgroundBaudard, M., Yavchitz, A., Ravaud, P., Perrodeau, E., & Boutron, I. (2017) · BMJ · doi:10.1136/bmj.j448 · Cited by 107
Reproducibility and Rigor in Animal-Based Research
Macleod, M., & Mohan, S. (2019) · ILAR Journal · doi:10.1093/ilar/ilz015 · Cited by 104
Tricco, A. C., Zarin, W., Rios, P., Nincic, V., Khan, P. A., Ghassemi, M., Diaz, S., Pham, B., Straus, S. E., & Langlois, E. V. (2018) · Implementation Science · doi:10.1186/s13012-018-0717-x · Cited by 100
Systematic Evaluation of the Patient-Reported Outcome (PRO) Content of Clinical Trial Protocols
Kyte, D., Duffy, H., Fletcher, B., Gheorghe, A., Mercieca-Bebber, R., King, M., Draper, H., Ives, J., Brundage, M., Blazeby, J., et al. (2014) · PLoS ONE · doi:10.1371/journal.pone.0110229 · Cited by 82
Empirical evaluation of which trial characteristics are associated with treatment effect estimates
Dechartres, A., Trinquart, L., Faber, T., & Ravaud, P. (2016) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2016.04.005 · Cited by 85
Outcome Discrepancies and Selective Reporting: Impacting the Leading Journals?
Fleming, P. S., Koletsi, D., Dwan, K., & Pandis, N. (2015) · PLOS ONE · doi:10.1371/journal.pone.0127495 · Cited by 80
“Despite the adoption, promotion and endorsement of reporting guidelines, there remain significant shortcomings [2].”
BackgroundTrial unpredictability yields predictable therapy gains
Djulbegovic, B., Kumar, A., Glasziou, P., Miladinovic, B., & Chalmers, I. (2013) · Nature · doi:10.1038/500395a · Cited by 66
Self-citationBiomedical text mining for research rigor and integrity: tasks, challenges, directions
Kilicoglu, H. (2017) · Briefings in Bioinformatics · doi:10.1093/bib/bbx057 · Cited by 61
Systematic review and meta-analyses of studies analysing instructions to authors from 1987 to 2017.
Malički, M., Jerončić, A., Aalbersberg, I. J., Bouter, L., & ter Riet, G. (2021) · Nature Communications · doi:10.1038/s41467-021-26027-y · Cited by 53
“South Korea 2 (1) 0 (0) 0 (0) 0 (0) 1 (3) 0 (0) 2 (4) Other (1 per country)b 12 (8) 5 (20) 6 (17) 0 (0) 4 (13) 2 (18) 5 (11)”
Wallace, S. J., Worrall, L., Rose, T., & Le Dorze, G. (2014) · Aphasiology · doi:10.1080/02687038.2014.930262 · Cited by 57
Stephens, R., & Staniszewska, S. (2015) · Research Involvement and Engagement · doi:10.1186/s40900-015-0005-8 · Cited by 50
Speich, B., Schroter, S., Briel, M., Moher, D., Puebla, I., Clark, A., Maia Schlüssel, M., Ravaud, P., Boutron, I., & Hopewell, S. (2020) · BMJ Open · doi:10.1136/bmjopen-2019-035114 · Cited by 35
Toward assessing clinical trial publications for reporting transparency
Kilicoglu, H., Rosemblat, G., Hoang, L., Wadhwa, S., Peng, Z., Malički, M., Schneider, J., & ter Riet, G. (2021) · Journal of Biomedical Informatics · doi:10.1016/j.jbi.2021.103717 · Cited by 34
Systemic challenges in bipolar disorder management: A patient‐centered approach
Nestsiarovich, A., Hurwitz, N. G., Nelson, S. J., Crisanti, A. S., Kerner, B., Kuntz, M. J., Smith, A. N., Volesky, E., Schroeter, Q. L., DeShaw, J. L., et al. (2017) · Bipolar Disorders · doi:10.1111/bdi.12547 · Cited by 30
Examining the predictive validity of NIH peer review scores
Lindner, M. D., & Nakamura, R. K. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126938 · Cited by 24
Hua, F., Sun, Q., Zhao, T., Chen, X., & He, H. (2019) · BMJ Open · doi:10.1136/bmjopen-2019-029270 · Cited by 20
Pandis, N., Fleming, P. S., Koletsi, D., & Hopewell, S. (2016) · Trials · doi:10.1186/s13063-016-1713-6 · Cited by 18
Morgan, B., Hejdenberg, J., Kuleszewicz, K., Armstrong, D., & Ziebland, S. (2021) · Pilot and Feasibility Studies · doi:10.1186/s40814-021-00931-y · Cited by 16
Hoang, L., Jiang, L., & Kilicoglu, H. (2021) · doi:10.1101/2021.09.14.21263586 · Cited by 5
“RCTs are time-consuming and expensive, and if inadequately designed, conducted, or reported, they lead to poor health outcomes and significant research waste 3 .”
Background
Metadata
- Authors
- Chalmers, I., & Glasziou, P.
- Venue
- Obstetrics & Gynecology
- Published
- 2009-12
- Volume
- 114
- Issue
- 6
- Pages
- 1341-1345
- ISSN
- 0029-7844 (ISSN-L)
- OpenAlex
- W2330575852
- Cited by
- 600
- References
- 22
- FWCI
- 19.90
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.