Epidemiology, Public Health, and the Rhetoric of False Positives
Open accessThe DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
BACKGROUND: As an observational science, epidemiology is regarded by some researchers as inherently flawed and open to false results. In a recent paper, Boffetta et al. [Boffetta P, McLaughlin JK, LaVecchia C, Tarone RE, Lipworth L, Blot WJ. False-positive results in cancer epidemiology: a plea for epistemological modesty. J Natl Cancer Inst 100:988-995 (2008)] argued that "epidemiology is particularly prone to the generation of false-positive results." They also said "the tendency to emphasize and over-interpret what appear to be new findings is commonplace, perhaps in part because of a belief that the findings provide information that may ultimately improve public health" and that "this tendency to hype new findings increases the likelihood of downplaying inconsistencies within the data or any lack of concordance with other sources of evidence." The authors supported these serious charges against epidemiology and epidemiologists with few examples. Although we acknowledge that false positives do occur, we view the position of Boffetta and colleagues on false positives as unbalanced and potentially harmful to public health. OBJECTIVE: We aim to provide a more balanced evaluation of epidemiology and its contribution to public health discourse. DISCUSSION: Boffetta and colleagues ignore the fact that false negatives may arise from the very processes that they tout as generating false-positive results. We further disagree with their proposition that false-positive results from a single study will lead to faulty decision making in matters of public health importance. In practice, such public health evaluations are based on all the data available from all relevant disciplines and never to our knowledge on a single study. CONCLUSIONS: The lack of balance by Boffetta and colleagues in their evaluation of the impact of false-positive findings on epidemiology, the charge that "methodological vigilance is often absent" in epidemiologists' interpretation of their own results, and the false characterization of how epidemiologic findings are used in societal decision making all undermine a major source of information regarding disease risks. We reaffirm the importance of epidemiologic evidence as a critical component of the foundation of public health protection.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The Impact of Residual and Unmeasured Confounding in Epidemiologic Studies: A Simulation Study
Fewell, Z., Davey Smith, G., & Sterne, J. A. C. (2007) · American Journal of Epidemiology · doi:10.1093/aje/kwm165 · Cited by 734
Blair, A., Stewart, P., Lubin, J. H., & Forastiere, F. (2007) · American Journal of Industrial Medicine · doi:10.1002/ajim.20281 · Cited by 251
Self-citation
Cited by
The False-positive to False-negative Ratio in Epidemiologic Studies
Ioannidis, J. P. A., Tarone, R., & McLaughlin, J. K. (2011) · Epidemiology · doi:10.1097/ede.0b013e31821b506e · Cited by 321
“However, erroneous inferences from any study include not only false positives, but also false negatives.(3) In this study, the ratio of false positives to false negatives (FP:FN ratio) has been explored.”
BackgroundCobo, E., Cortes, J., Ribera, J. M., Cardellach, F., Selva-O'Callaghan, A., Kostov, B., Garcia, L., Cirugeda, L., Altman, D. G., Gonzalez, J. A., et al. (2011) · BMJ · doi:10.1136/bmj.d6783 · Cited by 290
IARC Monographs: 40 years of evaluating carcinogenic hazards to humans
Pearce, N., Blair, A., Vineis, P., Ahrens, W., Andersen, A., Anto, J. M., Armstrong, B. K., Baccarelli, A. A., Beland, F. A., Berrington, A., et al. (2015) · Environmental Health Perspectives · doi:10.1289/ehp.1409149 · Cited by 146
“Some of the criticisms of the IARC process have occurred in the context of more general criticisms of epidemiology as a science (Kabat 2008); these were discussed in detail by Blair et al. (2009).”
InfluentialSelf-citation
Metadata
- Authors
- Blair, A., Saracci, R., Vineis, P., Cocco, P., Forastiere, F., Grandjean, P., Kogevinas, M., Kriebel, D., McMichael, A., Pearce, N., Porta, M., Samet, J., Sandler, D. P., Costantini, A. S., & Vainio, H.
- Venue
- Environmental Health Perspectives
- Publisher
- American Chemical Society (ACS)
- Published
- 2009-12
- Volume
- 117
- Issue
- 12
- Pages
- 1809-1813
- ISSN
- 0091-6765 (ISSN-L)
- 1552-9924
- OpenAlex
- W2132917963
- Cited by
- 51
- References
- 2
- FWCI
- 7.38
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.