CoChat

Increasing value and reducing waste in research design, conduct, and analysis

Open access

The DOI matches its Crossref record; 104 of the 105 references it cites were found in a registry or an index.

Abstract

Correctable weaknesses in the design, conduct, and analysis of biomedical and public health research studies can produce misleading results and waste valuable resources. Small effects can be difficult to distinguish from bias introduced by study design and analyses. An absence of detailed written protocols and poor documentation of research is common. Information obtained might not be useful or important, and statistical precision or power is often too low or used in a misleading way. Insufficient consideration might be given to both previous and continuing studies. Arbitrary choice of analyses and an overemphasis on random extremes might affect the reported findings. Several problems relate to the research workforce, including failure to involve experienced statisticians and methodologists, failure to train clinical researchers and laboratory scientists in research methods and design, and the involvement of stakeholders with conflicts of interest. Inadequate emphasis is placed on recording of research decisions and on reproducibility of research. Finally, reward systems incentivise quantity more than quality, and novelty more than reliability. We propose potential solutions for these problems, including improvements in protocols and documentation, consideration of evidence from studies in progress, standardisation of research efforts, optimisation and training of an experienced and non-conflicted scientific workforce, and reconsideration of scientific reward systems.

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/s0140-6736(13)62227-8

Cites

104 of 104 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 104 references

Research works printed but not linked: 1

  1. Greenland, 2008, Bias analysis. Chapter 19, 345

Cited by

See all 1,597

Metadata

Authors
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R.
Affiliations
  • Stanford Medicine (US)
  • University of California, Los Angeles (US)
  • Centers for Disease Control and Prevention (US)
  • University of Edinburgh (GB)
  • University of Ottawa (CA)
  • University of North Carolina at Chapel Hill (US)
  • Stanford University (US)
Corresponding author
Ioannidis, John P A
Venue
The Lancet
Publisher
Elsevier BV
Published
2014-01
Volume
383
Issue
9912
Pages
166-175
ISSN
  • 0099-5355 (ISSN-L)
  • 0140-6736
OpenAlex
W1975130349
Cited by
1,597
References
105
Citations by year
2026: 68 · 2025: 91 · 2024: 134 · 2023: 106 · 2022: 133 · 2021: 160 · 2020: 169 · 2019: 137 · 2018: 141 · 2017: 156 · 2016: 138 · 2015: 102 · 2014: 59
FWCI
148.59
Type
journal article
Language
en
Open access
Locations
  • The Lancet (publishedVersion)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
  • eScholarship (California Digital Library) (submittedVersion)
Funders
  • National Centre for the Replacement, Refinement and Reduction of Animals in Research (NC/L000970/1)
  • National Institutes of Health (CC999999)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
  • Health Sciences › Nursing › Research and Theory › Methodologies in Health Research and Practice
Keywords
research waste, study design flaws, research bias, statistical power, research documentation, reproducibility, conflicts of interest
MeSH terms
Research Design, Research Personnel, Reward, Statistics as Topic, Reproducibility of Results

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Increasing value and reducing waste in research design, conduct, and analysis. https://app.cochat.ai/papers/10.1016/s0140-6736(13)62227-8
The paper
Ioannidis, J. P. A., Greenland, S., Hlatky, M. A., Khoury, M. J., Macleod, M. R., Moher, D., Schulz, K. F., & Tibshirani, R. (2014). Increasing value and reducing waste in research design, conduct, and analysis. The Lancet. https://doi.org/10.1016/s0140-6736(13)62227-8

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.