CoChat

Commentary: A structural approach to Berkson’s fallacy and a guide to a history of opinions about it

Open access
Snoep, Jaapjan D, Morabia, Alfredo, Hernández-Díaz, Sonia, Hernán, Miguel A, Vandenbroucke, Jan P · 2014 · International Journal of Epidemiology
Cited by 51

The DOI matches its Crossref record; 11 of the 11 references it cites were found in a registry or an index.

Abstract

In 1946, the physician and statistician Joseph Berkson (1899–1982) pointed out that two diseases that are independent in the general population may become ‘spuriously associated’ in hospital-based case-control studies.1 This spurious association was later referred to, often in lively debates,2–14 as Berkson’s fallacy, Berkson’s paradox or Berkson’s bias. Some authors restricted the interpretation of Berkson’s fallacy to disease-disease associations,2,5,7,8 whereas others thought that the fallacy would also apply to exposure-disease associations in hospital-based case-control studies.10–15 In this article we use directed acyclic graphs (DAGs) to describe the structure of Berkson’s fallacy, first for disease-disease associations and then for exposure-disease associations. This permits us to understand the contentious debates and strongly differing opinions about Berkson’s fallacy, and has practical implications for study design and interpretation (see Box 1). The fallacy that became eponymous for Berkson caused controversy from its initial formulation onwards. Some held that it biased all case-control studies in hospitals; others maintained that it was only pertinent for associations between prevalent diseases, and did not exist for exposure-disease associations. The DAG analyses in this paper show that Berkson’s fallacy can exist when studying exposure-disease associations, be it only in an ‘indirect’ form and in exceptional circumstances: when in a hospital-based case-control study persons with a prevalent diagnosis are enrolled who were hospitalized for another disease that is associated with this exposure. The DAG of the problem that Berkson originally described has the same structure of all biases due to conditioning on a collider, but cannot be endowed with a causal interpretation since it was formulated and worked out as a problem of the association of prevalent diseases. When using incident cases in hospital-based case-control studies, Berkson’s fallacy becomes highly unlikely for exposure-disease associations, unless there are many people who have developed two different new diseases more or less at the same time and are hospitalized for the other disease, i.e. the disease that is not the subject of the case-control study. When incident cases in a case-control study consist only of people who have been hospitalized for that disease, Berkson’s fallacy is not possible. It is likely that Berkson’s fallacy has had very limited, if any, impact on the findings of epidemiological studies. In 1946 Berkson considered the following problem.1 Suppose a hospital wants to estimate the association between the prevalences of cholecystitis (disease 1 or D1) and diabetes mellitus (disease 2 or D2). To do so, a case-control study is conducted in which hospitalized individuals are included as cases if they have diabetes and as controls if they have ophthalmological refractive errors (disease 3 or D3). The association between cholecystitis and diabetes is then estimated by comparing the prevalence of cholecystitis D1 between cases with diabetes D2 and controls with refractive errors D3. Berkson constructed his example so that, in the source population, the D1-D2 and D1-D3 associations were null and the probabilities of hospitalization for each of the three diseases were independent. Yet, the D1-D2 association was not null in hospitalized individuals. In the Appendix (available as Supplementary data at IJE online) we numerically work out the example Berkson used in his paper, and we discuss the strength and direction of the association in hospitalized individuals. Intuitively, this association arises because persons with two or more diseases have a higher probability of being hospitalized than persons with only one disease—even if these reasons are independent. In the case-control study considered by Berkson, a D1-D2 association cannot generally be endowed with a causal interpretation, even in the absence of confounding and measurement error. Berkson used prevalent cases, which may lead to selection bias,15 and disregarded the timing of D1 and D2 (e.g. diabetes could predate cholecystitis), which may lead to reverse causation bias. Because the study design does not target a causal association, we refrain from referring to the spurious association among the hospitalized as a bias. Instead, in this paper we use the term Berkson’s fallacy to refer to the wrong estimation of a prevalence difference. Most modern case-control studies attempt to use incident, rather than prevalent, cases, but there is no indication that Berkson was aware of this distinction. The use of incident cases reduces both the danger of selection bias and the potential for Berkson’s fallacy, as we explain below. Berkson’s fallacy can be visualized by the DAG presented in Figure 1a. The nodes D1, D2 and D3 represent dichotomous variables (1: yes, 0: no) for each of the diseases described above. The node H represents a dichotomous variable (1: yes, 0 no) f

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1093/ije/dyu026

Cites

11 of 11 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 11 references

Cited by

See all 51

Metadata

Authors
Snoep, J. D., Morabia, A., Hernández-Díaz, S., Hernán, M. A., & Vandenbroucke, J. P.
Venue
International Journal of Epidemiology
Published
2014-02-28
Volume
43
Issue
2
Pages
515-521
ISSN
  • 0300-5771 (ISSN-L)
  • 1464-3685
OpenAlex
W2150533355
Cited by
51
References
11
Type
journal article
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Commentary: A structural approach to Berkson’s fallacy and a guide to a history of opinions about it. https://app.cochat.ai/papers/10.1093/ije/dyu026
The paper
Snoep, J. D., Morabia, A., Hernández-Díaz, S., Hernán, M. A., & Vandenbroucke, J. P. (2014). Commentary: A structural approach to Berkson’s fallacy and a guide to a history of opinions about it. International Journal of Epidemiology. https://doi.org/10.1093/ije/dyu026

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.