Epidemiologic measures and policy formulation: lessons from potential outcomes
Open accessThe DOI matches its Crossref record; 48 of the 49 references it cites were found in a registry or an index.
Abstract
This paper provides a critique of the common practice in the health-policy literature of focusing on hypothetical outcome removal at the expense of intervention analysis. The paper begins with an introduction to measures of causal effects within the potential-outcomes framework, focusing on underlying conceptual models, definitions and drawbacks of special relevance to policy formulation based on epidemiologic data. It is argued that, for policy purposes, one should analyze intervention effects within a multivariate-outcome framework to capture the impact of major sources of morbidity and mortality. This framework can clarify what is captured and missed by summary measures of population health, and shows that the concept of summary measure can and should be extended to multidimensional indices.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The identification of likely causes does not necessarily translate into recommendations for interventions [102].”
From COSMOS-E: Guidance on conducting systematic reviews and meta-analyses of observational studies of etiology (2019) · cites this paper as [102]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Causality: Models, Reasoning, and Inference
Pearl, J. (2009) · doi:10.1017/cbo9780511803161 · Cited by 11,653
The Statistical Analysis of Failure Time Data.
Aitkin, M., Kalbfleisch, J. D., & Prentice, R. L. (1981) · Biometrics · doi:10.2307/2530581 · Cited by 9,877
A treatise of human nature (1739-40)
Hume, D. (1996) · The Sublime · doi:10.1017/cbo9780511620409.040 · Cited by 9,842
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293
CAUSALITY: MODELS, REASONING AND INFERENCE
Hitchcock, C. (2001) · The Philosophical Review · doi:10.1215/00318108-110-4-639 · Cited by 4,741
Causal Diagrams for Epidemiologic Research
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00008 · Cited by 3,728
Self-citationAir Pollution and Hospital Admissions for Heart Disease in Eight U.S. Counties
Schwartz, J. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00005 · Cited by 3,038
Causality: models, reasoning, and inference
(2000) · Choice Reviews Online · doi:10.5860/choice.38-1494a · Cited by 2,873
Causal diagrams for empirical research
PEARL, J. (1995) · Biometrika · doi:10.1093/biomet/82.4.669 · Cited by 2,355 · cited 1×
“These models also originated in path analysis, but were not fully developed until the early 1990s [9-11].”
Lewis, D. (1973) · The Journal of Philosophy · doi:10.2307/2025310 · Cited by 1,914
Identifiability and exchangeability for direct and indirect effects
Robins, J. M., & Greenland, S. (1992) · Epidemiology · doi:10.1097/00001648-199203000-00013 · Cited by 1,793 · cited 1×
“Further details of counterfactual theory for health science research are described elsewhere [12,14-26].”
Self-citationMaternal Pesticide Exposure from Multiple Sources and Selected Congenital Anomalies
Shaw, G. M., Wasserman, C. R., OʼMalley, C. D., Nelson, V., & Jackson, R. J. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00011 · Cited by 1,784
An Inquiry concerning human understanding
Hume, D. (1955) · Cited by 1,775
An Enquiry concerning Human Understanding
Hume, D. (1748) · The Clarendon Edition of the Works of David Hume: An Enquiry concerning Human Understanding · doi:10.1093/oseo/instance.00032980 · Cited by 1,595
Latent Variables Analysis: Applications for Developmental Research.
AA, Eye, A. V., & Clogg, C. C. (1995) · Journal of the American Statistical Association · doi:10.2307/2291370 · Cited by 1,376
The Statistical Analysis of Failure Time Data.
Cohen, A. C., Kalbfleisch, J. D., & Prentice, R. L. (1982) · Journal of the American Statistical Association · doi:10.2307/2287285 · Cited by 958
Confounding and Collapsibility in Causal Inference
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Statistical Science · doi:10.1214/ss/1009211805 · Cited by 933 · cited 1×
“2) The counterfactual approach is not inherently deterministic in either the classical or quantum-mechanical sense [15,34].”
Self-citationTHE ESTIMATION OF CAUSAL EFFECTS FROM OBSERVATIONAL DATA
Winship, C., & Morgan, S. L. (1999) · Annual Review of Sociology · doi:10.1146/annurev.soc.25.1.659 · Cited by 890 · cited 1×
“Related counterfactual models have also received much attention in philosophy [5,6], and potential outcome models are now common in social sciences [7,8] and epidemiology (see citations below) as well as in statistics.”
Correlated Binary Regression with Covariates Specific to Each Binary Observation
Prentice, R. L. (1988) · Biometrics · doi:10.2307/2531733 · Cited by 856
Little, R. J., & Rubin, D. B. (2000) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.21.1.121 · Cited by 721
Identifiability, Exchangeability, and Epidemiological Confounding
GREENLAND, S., & ROBINS, J. M. (1986) · International Journal of Epidemiology · doi:10.1093/ije/15.3.413 · Cited by 686 · cited 1×
“Further details of counterfactual theory for health science research are described elsewhere [12,14-26].”
Self-citationRubin, D. B. (1990) · Statistical Science · doi:10.1214/ss/1177012032 · Cited by 665
INTERPRETATION AND CHOICE OF EFFECT MEASURES IN EPIDEMIOLOGIC ANALYSES1
GREENLAND, S. (1987) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a114593 · Cited by 543 · cited 2×
“Further details of counterfactual theory for health science research are described elsewhere [12,14-26].”
Self-citationMultiple-bias modelling for analysis of observational data
Greenland, S. (2005) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2004.00349.x · Cited by 497
CONCEPTUAL PROBLEMS IN THE DEFINITION AND INTERPRETATION OF ATTRIBUTABLE FRACTIONS
GREENLAND, S., & ROBINS, J. M. (1988) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a115073 · Cited by 414 · cited 1×
“Further details of counterfactual theory for health science research are described elsewhere [12,14-26].”
Self-citationAn overview of relations among causal modelling methods
Greenland, S., & Brumback, B. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.5.1030 · Cited by 406 · cited 1×
“Greenland and Poole [12] and Greenland and Brumback [13] describe the connections between potential outcome models and the sufficient-component cause models familiar to epidemiologists, and Greenland [14] discusses potential outcome models in relation to more traditional approaches to causal inference.”
Self-citationMaldonado, G. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.2.422 · Cited by 399
Self-citationConfounding in Health Research
Greenland, S., & Morgenstern, H. (2001) · Annual Review of Public Health · doi:10.1146/annurev.publhealth.22.1.189 · Cited by 388 · cited 1×
“Further details of counterfactual theory for health science research are described elsewhere [12,14-26].”
Self-citationRandomization, Statistics, and Causal Inference
Greenland, S. (1990) · Epidemiology · doi:10.1097/00001648-199011000-00003 · Cited by 385 · cited 1×
“Further details of counterfactual theory for health science research are described elsewhere [12,14-26].”
Self-citationOxford Textbook of Public Health
(2009) · doi:10.1093/med/9780199218707.001.0001 · Cited by 378
Causal Inference without Counterfactuals
Dawid, A. P. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10474210 · Cited by 347
Causal Inference without Counterfactuals
Dawid, A. P. (2001) · Applied Logic Series · doi:10.1007/978-94-017-1586-7_3 · Cited by 338
Semi-Automated Sensitivity Analysis to Assess Systematic Errors in Observational Data
Lash, T. L., & Fink, A. K. (2003) · Epidemiology · doi:10.1097/01.ede.0000071419.41011.cf · Cited by 250 · cited 1×
“Equally important is quantitative accounting for study biases in estimating effects; see Greenland [28,29], Lash and Fink [30], and Phillips [31] for recent developments in that topic.”
(2006) · Matched Sampling for Causal Effects · doi:10.1017/cbo9780511810725.033 · Cited by 211 · cited 1×
“For details on its relation to missing-data models, see Rubin [27].”
Rubin, D. B. (1991) · Biometrics · doi:10.2307/2532381 · Cited by 202
Quantifying and Reporting Uncertainty from Systematic Errors
Phillips, C. V. (2003) · Epidemiology · doi:10.1097/01.ede.0000072106.65262.ae · Cited by 168 · cited 1×
“Equally important is quantitative accounting for study biases in estimating effects; see Greenland [28,29], Lash and Fink [30], and Phillips [31] for recent developments in that topic.”
The Probability of Causation under a Stochastic Model for Individual Risk
Robins, J., & Greenland, S. (1989) · Biometrics · doi:10.2307/2531765 · Cited by 167
Self-citationCorrection for non-compliance in equivalence trials
Robins, J. M. (1998) · Statistics in Medicine · doi:10.1002/(sici)1097-0258(19980215)17:3<371::aid-sim768>3.0.co;2-o · Cited by 167
Simon, H. A., & Rescher, N. (1966) · Philosophy of Science · doi:10.1086/288105 · Cited by 158 · cited 1×
“Related counterfactual models have also received much attention in philosophy [5,6], and potential outcome models are now common in social sciences [7,8] and epidemiology (see citations below) as well as in statistics.”
Applied Bayesian Modeling And Causal Inference From Incomplete-Data Perspectives
Gelman, A., & Xiaoli, M. (2014) · Cited by 156
Invariants and noninvariants in the concept of interdependent effects.
Greenland, S., & Poole, C. (1988) · Scandinavian Journal of Work, Environment & Health · doi:10.5271/sjweh.1945 · Cited by 150 · cited 2×
“Further details of counterfactual theory for health science research are described elsewhere [12,14-26].”
Self-citationGreenland, S. (2003) · Journal of the American Statistical Association · doi:10.1198/01621450338861905 · Cited by 141 · cited 4×
“Two naïve extreme reactions to this limitation have been common: one that denies it is meaningful to talk of causes that are not actions and so restricts "causes" to interventions [33], and one that rejects counterfactual theory outright (see the discussion of Maldonado and Greenland [23]).”
InfluentialSelf-citationSummary Measures of Population Health
(2012) · Springer eBooks · doi:10.1007/springerreference_84762 · Cited by 125
Causal Analysis in the Health Sciences
Greenland, S. (2000) · Journal of the American Statistical Association · doi:10.1080/01621459.2000.10473924 · Cited by 61 · cited 2×
“Further details of counterfactual theory for health science research are described elsewhere [12,14-26].”
Self-citationLai, D., & Hardy, R. (1999) · International Journal of Epidemiology · doi:10.1093/ije/28.5.894 · Cited by 60 · cited 2×
“removal of a particular ICD9 cause of death [1]), rather than an action that brings about outcome reduction, may not be useful for program planning.”
Estimating the causal effect of compliance on binary outcome in randomized controlled trials
Goetghebeur, E. J. T., MOLENBERGHS, G., & KATZ, J. (1998) · Ghent University Academic Bibliography (Ghent University) · doi:10.1002/(sici)1097-0258(19980215)17:3<341::aid-sim766>3.0.co;2-x · Cited by 38
An Overview of Methods for Causal Inference from Observational Studies
Greenland, S. (2004) · Wiley series in probability and statistics · doi:10.1002/0470090456.ch1 · Cited by 27
Self-citationGoetghebeur, E. J. T. (1998) · Statistics in Medicine · Cited by 10
Research works printed but not linked: 3
- Rothman KJ, Greenland S: Modern epidemiology. Philadelphia: Lippincott-Raven; 1998
- Penrose R: Shadows of the mind. New York: Oxford University Press; 1994
- Goetghebeur E, van Houwelingen H: Analyzing non-compliance in clinical trials. Stat Med. 1998, 17:. · doi:10.1002/(sici)1097-0258(19980215)17:3<341::aid-sim766>3.0.co;2-x
Cited by
Dekkers, O. M., Vandenbroucke, J. P., Cevallos, M., Renehan, A. G., Altman, D. G., & Egger, M. (2019) · PLOS Medicine · doi:10.1371/journal.pmed.1002742 · Cited by 525
Does obesity shorten life? The importance of well-defined interventions to answer causal questions
Hernán, M. A., & Taubman, S. L. (2008) · International Journal of Obesity · doi:10.1038/ijo.2008.82 · Cited by 384
Causality and causal inference in epidemiology: the need for a pluralistic approach
Vandenbroucke, J. P., Broadbent, A., & Pearce, N. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyv341 · Cited by 327
“Thus, for example, Greenland uses an earthquake as an example of an event that is not an intervention, on the basis that it cannot be brought about by humans.(27) In contrast, for an in-principle interventionist such as James Woodward, it is easy to imagine an earthquake as part of a counterfactual causal history.”
BackgroundStatistical Foundations for Model-Based Adjustments
Greenland, S., & Pearce, N. (2015) · Annual Review of Public Health · doi:10.1146/annurev-publhealth-031914-122559 · Cited by 274
Self-citationDoes water kill? A call for less casual causal inferences
Hernán, M. A. (2016) · Annals of Epidemiology · doi:10.1016/j.annepidem.2016.08.016 · Cited by 219
Metadata
- Authors
- Greenland, S.
- Affiliations
- University of California, Los Angeles (US)
- Corresponding author
- Greenland, Sander
- ORCID
- Greenland, Sander
- Venue
- Emerging Themes in Epidemiology
- Published
- 2005-05-27
- Volume
- 2
- Issue
- 1
- Pages
- 5-5
- ISSN
- 1742-7622 (ISSN-L)
- PMC
- PMC1180843
- OpenAlex
- W1588056417
- Cited by
- 76
- References
- 49
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 3 · 2023: 2 · 2022: 1 · 2021: 4 · 2020: 1 · 2019: 4 · 2018: 4 · 2017: 9 · 2016: 6 · 2015: 6 · 2014: 2 · 2013: 3 · 2012: 4
- FWCI
- 4.15
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Emerging Themes in Epidemiology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- eScholarship (California Digital Library) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Epidemiology
- Keywords
- potential outcomes framework, causal inference, intervention effects, health policy formulation, morbidity and mortality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.