CoChat

Negative Controls: A Tool for Detecting Confounding and Bias in Observational Studies

Open access
Lipsitch, Marc, Tchetgen Tchetgen, Eric, Cohen, Ted · 2010 · Epidemiology

The DOI matches its Crossref record; 24 of the 25 references it cites were found in a registry or an index.

Abstract

Noncausal associations between exposures and outcomes are a threat to validity of causal inference in observational studies. Many techniques have been developed for study design and analysis to identify and eliminate such errors. Such problems are not expected to compromise experimental studies, where careful standardization of conditions (for laboratory work) and randomization (for population studies) should, if applied properly, eliminate most such noncausal associations. We argue, however, that a routine precaution taken in the design of biologic laboratory experiments--the use of "negative controls"--is designed to detect both suspected and unsuspected sources of spurious causal inference. In epidemiology, analogous negative controls help to identify and resolve confounding as well as other sources of error, including recall bias or analytic flaws. We distinguish 2 types of negative controls (exposure controls and outcome controls), describe examples of each type from the epidemiologic literature, and identify the conditions for the use of such negative controls to detect confounding. We conclude that negative controls should be more commonly employed in observational studies, and that additional work is needed to specify the conditions under which negative controls will be sensitive detectors of other sources of error in observational studies.

Overview

Integrity signals

Registry

Crossref · 10.1097/ede.0b013e3181d61eeb

Cites

24 of 24 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

We couldn’t retrieve this paper’s full text, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Cited by

See all 1,583

Metadata

Authors
Lipsitch, M., Tchetgen Tchetgen, E., & Cohen, T.
Affiliations
  • Harvard University (US)
  • Brigham and Women's Hospital (US)
Corresponding author
Lipsitch, Marc
Venue
Epidemiology
Published
2010-05
Volume
21
Issue
3
Pages
383-388
ISSN
1044-3983 (ISSN-L)
OpenAlex
W2009428399
Cited by
1,583
References
25
Citations by year
2026: 278 · 2025: 215 · 2024: 183 · 2023: 138 · 2022: 153 · 2021: 132 · 2020: 107 · 2019: 75 · 2018: 72 · 2017: 71 · 2016: 56 · 2015: 32 · 2014: 26 · 2013: 25 · 2012: 11
FWCI
11.64
Type
journal article
Language
en
Open access
Locations
  • Epidemiology (publishedVersion)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
  • Digital Access to Scholarship at Harvard (DASH) (Harvard University) (submittedVersion, cc-by)
Funders
  • National Institutes of Health (5u01gm076497-03, 1dp2od006663-01)
  • National Institute of General Medical Sciences (U54GM088558, U01GM076497, 5U01GM076497)
  • National Institute of Environmental Health Sciences (T32ES007142)
Topics
  • Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
  • Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords
negative control, confounding, spurious association, exposure control, outcome control, observational study validity, recall bias, experimental design, causal inference
MeSH terms
Humans, Bias, Causality, Confounding Factors, Epidemiologic, Observation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.