How to increase value and reduce waste when research priorities are set
Open accessThe DOI matches its Crossref record; 109 of the 110 references it cites were found in a registry or an index.
Abstract
The increase in annual global investment in biomedical research--reaching US$240 billion in 2010--has resulted in important health dividends for patients and the public. However, much research does not lead to worthwhile achievements, partly because some studies are done to improve understanding of basic mechanisms that might not have relevance for human health. Additionally, good research ideas often do not yield the anticipated results. As long as the way in which these ideas are prioritised for research is transparent and warranted, these disappointments should not be deemed wasteful; they are simply an inevitable feature of the way science works. However, some sources of waste cannot be justified. In this report, we discuss how avoidable waste can be considered when research priorities are set. We have four recommendations. First, ways to improve the yield from basic research should be investigated. Second, the transparency of processes by which funders prioritise important uncertainties should be increased, making clear how they take account of the needs of potential users of research. Third, investment in additional research should always be preceded by systematic assessment of existing evidence. Fourth, sources of information about research that is in progress should be strengthened and developed and used by researchers. Research funders have primary responsibility for reductions in waste resulting from decisions about what research to do.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“there is accumulating evidence of the deleterious impacts of low power and small sample sizes, ignoring null results, failures of transparency of methodology, failing to publish all experimental data collected, and questionable research practices such as p-hacking on the inflation of false positives in the published literature”
From Investigating the replicability of preclinical cancer biology (2021) · cites this paper as Chalmers et al., 2014
In the citing paper
“Low-quality biomedical research implies a tremendous waste of resources [48] and explicitly affects patients’ lives.”
From Tools used to assess the quality of peer review reports: A methodological systematic review (2019) · cites this paper as [48]
In the citing paper
“Similarly, human clinical trials initiated based on insufficient or misleading animal research evidence increase research waste and negatively influence the risk-benefit balance for research participants [229,232].”
From Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0 (2020) · cites this paper as [232]
In the citing paper
“Akin to the approach taken for clinical trials, protocol registration has emerged as a mechanism that is likely to improve the transparency of animal research [232,237,238].”
From Reporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0 (2020) · cites this paper as [232]
In the citing paper
“Failure to review the cumulative evidence can lead to unnecessary and wasteful duplication of research148”
From SPIRIT 2025 explanation and elaboration: updated guideline for protocols of randomised trials (2025) · cites this paper as [148]
Citations
Cites
Barnett, K., Mercer, S. W., Norbury, M., Watt, G., Wyke, S., & Guthrie, B. (2012) · The Lancet · doi:10.1016/s0140-6736(12)60240-2 · Cited by 6,972
The answer is 17 years, what is the question: understanding time lags in translational research
Morris, Z. S., Wooding, S., & Grant, J. (2011) · Journal of the Royal Society of Medicine · doi:10.1258/jrsm.2011.110180 · Cited by 3,340
Self-citationInhibition of Cell Division in Escherichia coli by Electrolysis Products from a Platinum Electrode
ROSENBERG, B., VAN CAMP, L., & KRIGAS, T. (1965) · Nature · doi:10.1038/205698a0 · Cited by 3,049
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979
Systematic Reviews in Health Care : Meta-Analysis in Context
Egger, M., Smith, G. D., & Altman, D. G. (2000) · Cited by 2,401
Avoidable waste in the production and reporting of research evidence
Chalmers, I., & Glasziou, P. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60329-9 · Cited by 2,208
Self-citationPasteur's Quadrant: Basic Science and Technological Innovation
Tierney, W. G., Stokes, D. E., & Abbott, A. (2005) · Academe · doi:10.2307/40253438 · Cited by 2,077
Believe it or not: how much can we rely on published data on potential drug targets?
Prinz, F., Schlange, T., & Asadullah, K. (2011) · Nature Reviews Drug Discovery · doi:10.1038/nrd3439-c1 · Cited by 1,888
Pasteur's Quadrant: Basic science and technological innovation
Brandl, J. E. (1998) · Journal of Policy Analysis and Management · doi:10.1002/(sici)1520-6688(199823)17:4<734::aid-pam10>3.0.co;2-g · Cited by 1,836
Developing core outcome sets for clinical trials: issues to consider
Williamson, P. R., Altman, D. G., Blazeby, J. M., Clarke, M., Devane, D., Gargon, E., & Tugwell, P. (2012) · Trials · doi:10.1186/1745-6215-13-132 · Cited by 1,661
Cited by
Kyu, H. H., Abate, D., Abate, K. H., Abay, S. M., Abbafati, C., Abbasi, N., Abbastabar, H., Abd-Allah, F., Abdela, J., Abdelalim, A., et al. (2018) · The Lancet · doi:10.1016/s0140-6736(18)32335-3 · Cited by 4,081
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Self-citationReporting animal research: Explanation and elaboration for the ARRIVE guidelines 2.0
Percie du Sert, N., Ahluwalia, A., Alam, S., Avey, M. T., Baker, M., Browne, W. J., Clark, A., Cuthill, I. C., Dirnagl, U., Emerson, M., et al. (2020) · PLOS Biology · doi:10.1371/journal.pbio.3000411 · Cited by 2,677
Self-citationKassebaum, N. J., Arora, M., Barber, R. M., Bhutta, Z. A., Brown, J., Carter, A., Casey, D. C., Charlson, F. J., Coates, M. M., Coggeshall, M., et al. (2016) · The Lancet · doi:10.1016/s0140-6736(16)31460-x · Cited by 2,163
Hay, S. I., Abajobir, A. A., Abate, K. H., Abbafati, C., Abbas, K. M., Abd-Allah, F., Abdulkader, R. S., Abdulle, A. M., Abebo, T. A., Abera, S. F., et al. (2017) · The Lancet · doi:10.1016/s0140-6736(17)32130-x · Cited by 2,083
Metadata
- Authors
- Chalmers, I., Bracken, M. B., Djulbegovic, B., Garattini, S., Grant, J., Gülmezoglu, A. M., Howells, D. W., Ioannidis, J. P. A., & Oliver, S.
- Affiliations
- Yale University (US)
- Mario Negri Institute for Pharmacological Research (IT)
- RAND Europe (GB)
- World Health Organization (CH)
- Florey Institute of Neuroscience and Mental Health (AU)
- Stanford Medicine (US)
- University of London (GB)
- Corresponding author
- Chalmers, Iain
- Venue
- The Lancet
- Publisher
- Elsevier BV
- Published
- 2014-01
- Volume
- 383
- Issue
- 9912
- Pages
- 156-165
- ISSN
- 0099-5355 (ISSN-L)
- 0140-6736
- OpenAlex
- W2044591801
- Cited by
- 1,436
- References
- 110
- Citations by year
- 2026: 57 · 2025: 83 · 2024: 108 · 2023: 94 · 2022: 112 · 2021: 148 · 2020: 127 · 2019: 149 · 2018: 135 · 2017: 138 · 2016: 120 · 2015: 109 · 2014: 54
- FWCI
- 139.01
- Type
- journal article
- Language
- en
- Open access
- green
- figshare.com
- Licence
- cc-by
- Locations
- The Lancet (publishedVersion)
- PubMed (publishedVersion)
- eCite Digital Repository (University of Tasmania) (submittedVersion)
- UCL Discovery (University College London) (submittedVersion)
- Figshare (submittedVersion, cc-by)
- Research Portal (King's College London) (submittedVersion)
- Funders
- World Health Organization
- National Institutes of Health
- Topics
- Health Sciences › Medicine › Public Health, Environmental and Occupational Health › Health and Medical Research Impacts
- Social Sciences › Business, Management and Accounting › Management of Technology and Innovation › Research, Science, and Academia
- Health Sciences › Health Professions › General Health Professions › Healthcare cost, quality, practices
- Keywords
- research prioritization, research waste, biomedical research funding, evidence evaluation
- MeSH terms
- Capital Financing, Research, Research Design, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: How to increase value and reduce waste when research priorities are set. https://app.cochat.ai/papers/10.1016/s0140-6736(13)62229-1
- The paper
- Chalmers, I., Bracken, M. B., Djulbegovic, B., Garattini, S., Grant, J., Gülmezoglu, A. M., Howells, D. W., Ioannidis, J. P. A., & Oliver, S. (2014). How to increase value and reduce waste when research priorities are set. The Lancet. https://doi.org/10.1016/s0140-6736(13)62229-1
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.