The DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Estimating causal effects
Open accessAbstract
Although one goal of aetiologic epidemiology is to estimate ‘the true effect’ of an exposure on disease occurrence, epidemiologists usually do not precisely specify what ‘true effect’ they want to estimate. We describe how the counterfactual theory of causation, originally developed in philosophy and statistics, can be adapted to epidemiological studies to provide precise answers to the questions ‘What is a cause?’, ‘How should we measure effects?’ and ‘What effect measure should epidemiologists estimate in aetiologic studies?’ We also show that the theory of counterfactuals (1) provides a general framework for designing and analysing aetiologic studies; (2) shows that we must always depend on a substitution step when estimating effects, and therefore the validity of our estimate will always depend on the validity of the substitution; (3) leads to precise definitions of effect measure, confounding, confounder, and effect-measure modification; and (4) shows why effect measures should be expected to vary across populations whenever the distribution of causal factors varies across the populations. Imagine that the creator of the universe appears to you in a dream and grants you the answer to one public-health question. The conversation might go as follows: You: What is the true effect of (your exposure here, denoted by E) on the occurrence of (your disease here, denoted by D)? Creator: What do you mean by ‘the true effect’? The true value of what parameter? You: The true relative risk. Creator: Epidemiologists use the term relative risk for several different parameters. Which do you mean? You: The ratio of average risk with and without exposure—what some call the risk ratio1 and others call the incidence proportion ratio.2 Creator: Which incidence proportion ratio? You: Pardon? Creator: Do you want a ratio of average disease risk in two different groups of people with different exposure levels? You: Yes. Creator: So you want a descriptive incidence proportion ratio? You: No, not descriptive. Causal. An incidence proportion ratio that isolates the effect of E on D from all other causal factors. Creator: By ‘isolate’, you mean a measure that applies to a single population under different possible exposure scenarios? You: Yes, that's what I mean. Creator: OK. Which causal incidence proportion ratio? You: Pardon? Creator: For what population, and for what time period? The true value of a causal incidence proportion ratio can be different for different groups of people and for different time periods. It's not necessarily a biological constant, you know. You: Yes, of course. For population (your population here, denoted by P) between the years (your study time period here, denoted by t0 to t1). Creator: By population P, do you mean: (1) everyone in population P, or (2) the people in population P who have a specific set of characteristics? You: Pardon? Creator: As I just said, the true value of a causal incidence proportion ratio is not necessarily a biological constant. It can be different for subgroups of a population. You: Of course. Everyone in population P. Creator: OK. Comparing what two exposure levels? You: Exposed and unexposed. Creator: What do you mean by exposed and unexposed? Exposed for how long, to how much, and during what time period? There are many different ways you could define exposed and unexposed, and each of the corresponding possible ratios can have a different true value, you know. You: Of course. Ever exposed to any amount of E versus never exposed to E. Creator: The incidence proportion ratio for the causal effect on D of ever E compared to never E in population P during the study time period t0 to t1 is (your causal incidence-proportion-ratio parameter value here). The point of the above is that, while one goal of etiologic epidemiology is to estimate ‘the true effect’ of an exposure on disease frequency, we usually do not precisely specify what ‘true effect’ we want to estimate. We may not be able to do so. For example, before reading this paper would you have required less prompting than in the dialog above? How many published papers explicitly state what the authors mean by ‘true’ relative risk or odds ratio, or whether the estimated measure of association is intended to have a descriptive or causal interpretation? How many papers explicitly define the population or time period of interest? How many etiologic papers over-emphasize results that cannot be given a causal interpretation, such as significance tests, P-values, correlation coefficients, or proportion of variance ‘explained’? In this paper we discuss the questions ‘What is a cause?’, ‘How should we measure effects?’ and ‘What effect measure should epidemiologists estimate in etiologic studies?’ We begin by adapting the counterfactual approach to causation, originally developed in philosophy and in statistics,3,4 to epidemiological studies. In the process, we give precise answers to these questions, and we describe how these an
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
Causal Diagrams for Epidemiologic Research
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00008 · Cited by 3,728
Air Pollution and Hospital Admissions for Heart Disease in Eight U.S. Counties
Schwartz, J. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00005 · Cited by 3,038
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503
Causal diagrams for empirical research
PEARL, J. (1995) · Biometrika · doi:10.1093/biomet/82.4.669 · Cited by 2,355
Stalnaker, R. C. (1968) · IFS · doi:10.1007/978-94-009-9117-0_2 · Cited by 2,220
Lewis, D. (1973) · The Journal of Philosophy · doi:10.2307/2025310 · Cited by 1,914
Maternal Pesticide Exposure from Multiple Sources and Selected Congenital Anomalies
Shaw, G. M., Wasserman, C. R., OʼMalley, C. D., Nelson, V., & Jackson, R. J. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00011 · Cited by 1,784
Confounding and Collapsibility in Causal Inference
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Statistical Science · doi:10.1214/ss/1009211805 · Cited by 933
Self-citation
Cited by
Selected major risk factors and global and regional burden of disease
Ezzati, M., Lopez, A. D., Rodgers, A., Vander Hoorn, S., & Murray, C. J. (2002) · The Lancet · doi:10.1016/s0140-6736(02)11403-6 · Cited by 3,594
Global Burden of Disease and Risk Factors
(2006) · World Bank, Washington, DC eBooks · doi:10.1596/978-0-8213-6262-4 · Cited by 2,605
Delgado-Rodríguez, M., & Llorca, J. (2004) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2003.008466 · Cited by 1,064
Comparative quantification of health risks conceptual framework and methodological issues
Murray, C. J., Ezzati, M., Lopez, A. D., Rodgers, A., & Vander Hoorn, S. (2003) · Population Health Metrics · doi:10.1186/1478-7954-1-1 · Cited by 887
Behavioral science at the crossroads in public health: Extending horizons, envisioning the future
Glass, T. A., & McAtee, M. J. (2006) · Social Science & Medicine · doi:10.1016/j.socscimed.2005.08.044 · Cited by 821
Muller, C. J., & MacLehose, R. F. (2014) · International Journal of Epidemiology · doi:10.1093/ije/dyu029 · Cited by 775
The (mis)estimation of neighborhood effects: causal inference for a practicable social epidemiology
Oakes, J. M. (2004) · Social Science & Medicine · doi:10.1016/j.socscimed.2003.08.004 · Cited by 760
Effectiveness of Influenza Vaccine in the Community-Dwelling Elderly
Nichol, K. L., Nordin, J. D., Nelson, D. B., Mullooly, J. P., & Hak, E. (2007) · New England Journal of Medicine · doi:10.1056/nejmoa070844 · Cited by 656
Gerberich, S. G., Church, T. R., McGovern, P. M., Hansen, H. E., Nachreiner, N. M., Geisser, M. S., Ryan, A. D., Mongin, S. J., & Watt, G. D. (2004) · Occupational and Environmental Medicine · doi:10.1136/oem.2003.007294 · Cited by 537
Daru, J., Zamora, J., Fernández-Félix, B. M., Vogel, J., Oladapo, O. T., Morisaki, N., Tunçalp, Ö., Torloni, M. R., Mittal, S., Jayaratne, K., et al. (2018) · The Lancet Global Health · doi:10.1016/s2214-109x(18)30078-0 · Cited by 436
Causal thinking and complex system approaches in epidemiology
Galea, S., Riddle, M., & Kaplan, G. A. (2010) · International Journal of Epidemiology · doi:10.1093/ije/dyp296 · Cited by 426
Cost-of-Illness Studies: A Guide to Critical Evaluation
Larg, A., & Moss, J. R. (2011) · PharmacoEconomics · doi:10.2165/11588380-000000000-00000 · Cited by 404
Proceeding From Observed Correlation to Causal Inference: The Use of Natural Experiments
Rutter, M. (2007) · Perspectives on Psychological Science · doi:10.1111/j.1745-6916.2007.00050.x · Cited by 395
The Bradford Hill considerations on causality: a counterfactual perspective
Höfler, M. (2005) · Emerging Themes in Epidemiology · doi:10.1186/1742-7622-2-11 · Cited by 340
Auchincloss, A. H., & Diez Roux, A. V. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn118 · Cited by 334
Transportability of Trial Results Using Inverse Odds of Sampling Weights
Westreich, D., Edwards, J. K., Lesko, C. R., Stuart, E., & Cole, S. R. (2017) · American Journal of Epidemiology · doi:10.1093/aje/kwx164 · Cited by 321
Imai, K., King, G., & Nall, C. (2009) · Statistical Science · doi:10.1214/08-sts274 · Cited by 291
Chaix, B. (2009) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.031308.100158 · Cited by 281
Effects of Kindergarten Retention Policy on Children’s Cognitive Growth in Reading and Mathematics
Hong, G., & Raudenbush, S. W. (2005) · Educational Evaluation and Policy Analysis · doi:10.3102/01623737027003205 · Cited by 280
Cole, S. R. (2003) · American Journal of Epidemiology · doi:10.1093/aje/kwg206 · Cited by 270
Generalizing Study Results: A Potential Outcomes Perspective
Lesko, C. R., Buchanan, A. L., Westreich, D., Edwards, J. K., Hudgens, M. G., & Cole, S. R. (2017) · Epidemiology · doi:10.1097/ede.0000000000000664 · Cited by 269
Causal Inference About the Effects of Interventions From Observational Studies in Medical Journals
Dahabreh, I. J., & Bibbins-Domingo, K. (2024) · JAMA · doi:10.1001/jama.2024.7741 · Cited by 242
Formalizing the role of agent-based modeling in causal inference and epidemiology
Marshall, B. D. L., & Galea, S. (2015) · American Journal of Epidemiology · doi:10.1093/aje/kwu274 · Cited by 192
Quantifying and Reporting Uncertainty from Systematic Errors
Phillips, C. V. (2003) · Epidemiology · doi:10.1097/01.ede.0000072106.65262.ae · Cited by 168
Target Validity and the Hierarchy of Study Designs
Westreich, D., Edwards, J. K., Lesko, C. R., Cole, S. R., & Stuart, E. A. (2019) · American Journal of Epidemiology · doi:10.1093/aje/kwy228 · Cited by 165
Messer, L. C., Oakes, J. M., & Mason, S. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwp435 · Cited by 161
The role of causal criteria in causal inferences: Bradford Hill's "aspects of association"
Ward, A. C. (2009) · Epidemiologic Perspectives & Innovations · doi:10.1186/1742-5573-6-2 · Cited by 120
“Expressed in a counterfactual framework, the danger is that while the causal contrast we want to measure is that between a target population under one exposure and, counterfactually, that same population under a different exposure, the observable substitute we use for the target population under the counterfactual con…”
Oakes, J. M. (2006) · International Journal of Epidemiology · doi:10.1093/ije/dyl054 · Cited by 115
Extreme weather-driven disasters and children's health
Garcia, D. M., & Sheehan, M. C. (2016) · International Journal of Health Services · doi:10.1177/0020731415625254 · Cited by 98
Vitamin D and the evolution of human depigmentation
Chaplin, G., & Jablonski, N. G. (2009) · American Journal of Physical Anthropology · doi:10.1002/ajpa.21079 · Cited by 87
For and Against Methodologies: Some Perspectives on Recent Causal and Statistical Inference Debates
Greenland, S. (2017) · European Journal of Epidemiology · doi:10.1007/s10654-017-0230-6 · Cited by 86
Self-citationEpidemiologic measures and policy formulation: lessons from potential outcomes
Greenland, S. (2005) · Emerging Themes in Epidemiology · doi:10.1186/1742-7622-2-5 · Cited by 76
Self-citationIn defense of “biological interaction”
Rajaleid, K., Janszky, I., & Hallqvist, J. (2011) · Epidemiology · doi:10.1097/ede.0b013e31820932ac · Cited by 6
Metadata
- Authors
- Maldonado, G.
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2002-04-01
- Volume
- 31
- Issue
- 2
- Pages
- 422-438
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W2103873563
- Cited by
- 399
- References
- 41
- FWCI
- 18.00
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.