The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
External Validity: From Do-Calculus to Transportability Across Populations
Open accessAbstract
The generalizability of empirical findings to new environments, settings or populations, often called “external validity,” is essential in most scientific explorations. This paper treats a particular problem of generalizability, called “transportability,” defined as a license to transfer causal effects learned in experimental studies to a new population, in which only observational studies can be conducted. We introduce a formal representation called “selection diagrams” for expressing knowledge about differences and commonalities between populations of interest and, using this representation, we reduce questions of transportability to symbolic derivations in the do-calculus. This reduction yields graph-based procedures for deciding, prior to observing any data, whether causal effects in the target population can be inferred from experimental findings in the study population. When the answer is affirmative, the procedures identify what experimental and observational findings need be obtained from the two populations, and how they can be combined to ensure bias-free transport.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Sample Selection Bias as a Specification Error
Heckman, J. J. (1979) · Econometrica · doi:10.2307/1912352 · Cited by 28,779
Data Analysis Using Regression and Multilevel/Hierarchical Models
Gelman, A., & Hill, J. (2006) · doi:10.1017/cbo9780511790942 · Cited by 13,597
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890
Causation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (2001) · doi:10.7551/mitpress/1754.001.0001 · Cited by 4,521
A structural approach to selection bias
Hernán, M. A., Hernández-Díaz, S., & Robins, J. M. (2004) · Epidemiology · doi:10.1097/01.ede.0000135174.63482.43 · Cited by 2,844 · cited 1×
“Manski (2007) defines “external validity” as follows: “An experiment is said to have “external validity” if the distribution of outcomes realized by a treatment group is the same as the distribution of outcome that would be realized in an actual program.”
BackgroundRobins, J. (1986) · Mathematical Modelling · doi:10.1016/0270-0255(86)90088-6 · Cited by 2,451
Causal diagrams for empirical research
PEARL, J. (1995) · Biometrika · doi:10.1093/biomet/82.4.669 · Cited by 2,355
Self-citationCausal inference in statistics: An overview
Pearl, J. (2009) · Statistics Surveys · doi:10.1214/09-ss057 · Cited by 2,336
Self-citationSurrogate endpoints in clinical trials: Definition and operational criteria
Prentice, R. L. (1989) · Statistics in Medicine · doi:10.1002/sim.4780080407 · Cited by 2,057
Limitations of the Application of Fourfold Table Analysis to Hospital Data
Berkson, J. (1946) · Biometrics Bulletin · doi:10.2307/3002000 · Cited by 1,810 · cited 1×
“paradox (Berkson, 1946), whereby observations on a common consequence of two independent causes render those causes dependent.”
BackgroundWriting meta-analytic reviews.
Rosenthal, R. (1995) · Psychological Bulletin · doi:10.1037/0033-2909.118.2.183 · Cited by 1,108
The Statistical Implications of a System of Simultaneous Equations
Haavelmo, T. (1943) · Econometrica · doi:10.2307/1905714 · Cited by 966
Eight Myths About Causality and Structural Equation Models
Bollen, K. A., & Pearl, J. (2013) · Handbooks of Sociology and Social Research · doi:10.1007/978-94-007-6094-3_15 · Cited by 645
Self-citationGeneralizing Evidence From Randomized Clinical Trials to Target Populations: The ACTG 320 Trial
Cole, S. R., & Stuart, E. A. (2010) · American Journal of Epidemiology · doi:10.1093/aje/kwq084 · Cited by 486
Causal Networks: Semantics and Expressiveness
(1990) · Machine Intelligence and Pattern Recognition · doi:10.1016/b978-0-444-88650-7.50011-1 · Cited by 357
The Causal Foundations of Structural Equation Modeling
Pearl, J. (2012) · doi:10.21236/ada557445 · Cited by 344
Self-citationAnalysis of Covariance and Standardization as Instances of Prediction
Lane, P. W., & Nelder, J. A. (1982) · Biometrics · doi:10.2307/2530043 · Cited by 311
Compound Treatments and Transportability of Causal Inference
Hernán, M. A., & VanderWeele, T. J. (2011) · Epidemiology · doi:10.1097/ede.0b013e3182109296 · Cited by 297
Strotz, R. H., & Wold, H. O. A. (1960) · Econometrica · doi:10.2307/1907731 · Cited by 291
[Bayesian Analysis in Expert Systems]: Comment: Graphical Models, Causality and Intervention
Pearl, J. (1993) · Statistical Science · doi:10.1214/ss/1177010894 · Cited by 258
Self-citationInfluence Diagrams for Causal Modelling and Inference
Dawid, A. P. (2002) · International Statistical Review · doi:10.1111/j.1751-5823.2002.tb00354.x · Cited by 230
A General Algorithm for Deciding Transportability of Experimental Results
Bareinboim, E., & Pearl, J. (2013) · Journal of Causal Inference · doi:10.1515/jci-2012-0004 · Cited by 208
Self-citationEstimation and extrapolation of optimal treatment and testing strategies
Robins, J., Orellana, L., & Rotnitzky, A. (2008) · Statistics in Medicine · doi:10.1002/sim.3301 · Cited by 208
A general identification condition for causal effects
(2002) · eScholarship (California Digital Library) · doi:10.5555/777092.777180 · Cited by 203
Self-citationRelated Causal Frameworks for Surrogate Outcomes
Joffe, M. M., & Greene, T. (2009) · Biometrics · doi:10.1111/j.1541-0420.2008.01106.x · Cited by 203
Markov Properties for Acyclic Directed Mixed Graphs
RICHARDSON, T. (2003) · Scandinavian Journal of Statistics · doi:10.1111/1467-9469.00323 · Cited by 189
Surrogate endpoints in clinical trials: Cancer
Ellenberg, S. S., & Hamilton, J. M. (1989) · Statistics in Medicine · doi:10.1002/sim.4780080404 · Cited by 166
Linear Models: A Useful "Microscope" for Causal Analysis
Pearl, J. (2013) · Journal of Causal Inference · doi:10.1515/jci-2013-0003 · Cited by 132
Self-citationPearl's D-Separation: One More Step Into Causal Thinking
Hayduk, L. A., Cummings, G. G., Stratkotter, R., Nimmo, M., Grygoryev, K., Dosman, D., Gillespie, M. W., Pazderka, H., & Boadu, K. (2003) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1207/s15328007sem1002_8 · Cited by 102
Recovering from Selection Bias in Causal and Statistical Inference
Bareinboim, E., Tian, J. W., & Pearl, J. (2014) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v28i1.9074 · Cited by 101
Self-citationAdelman, L. (1991) · IEEE Transactions on Systems Man and Cybernetics · doi:10.1109/21.87078 · Cited by 99
Karl Pearson’s meta-analysis revisited
Owen, A. B. (2009) · The Annals of Statistics · doi:10.1214/09-aos697 · Cited by 98
Transportability of Causal Effects: Completeness Results
Bareinboim, E., & Pearl, J. (2012) · Defense Technical Information Center (DTIC) · doi:10.21236/ada557446 · Cited by 84
Self-citationIdentification of Conditional Interventional DistributionsPreprint
Shpitser, I., & Pearl, J. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1206.6876 · Cited by 82
Self-citationCounterfactuals and Policy Analysis in Structural ModelsPreprint
Balke, A., & Pearl, J. (2013) · arXiv (Cornell University) · doi:10.48550/arxiv.1302.4929 · Cited by 79
Self-citationTransportability Across Studies: A Formal Approach
Pearl, J., & Bareinboim, E. (2011) · Defense Technical Information Center (DTIC) · doi:10.21236/ada557437 · Cited by 70
Self-citationTRYGVE HAAVELMO AND THE EMERGENCE OF CAUSAL CALCULUS
Pearl, J. (2014) · Econometric Theory · doi:10.1017/s0266466614000231 · Cited by 66
Self-citationOn Some Points Relating to Vital Statistics, More Especially Statistics of Occupational Mortality
Yule, G. U. (1934) · Journal Of The Royal Statistical Society · doi:10.2307/2342014 · Cited by 59
Settable Systems: An Extension of Pearl’s Causal Model with Optimization, Equilibrium, and Learning
White, H., & Chalak, K. (2008) · Cited by 50
Compound Treatments, Transportability, and the Structural Causal Model
Petersen, M. L. (2011) · Epidemiology · doi:10.1097/ede.0b013e3182126127 · Cited by 47
Meta-Transportability of Causal Effects: A Formal Approach
Bareinboim, E., & Pearl, J. (2013) · Cited by 35
Self-citationCausal Effects In Psychotherapy: Counterfactuals Counteract Overgeneralization
Höfler, M., Gloster, A. T., & Hoyer, J. (2010) · Psychotherapy Research · doi:10.1080/10503307.2010.501041 · Cited by 32
Local Characterizations of Causal Bayesian Networks
Bareinboim, E., de Brito, C. E. F., & Pearl, J. (2012) · Lecture notes in computer science · doi:10.1007/978-3-642-29449-5_1 · Cited by 30
Self-citationCausal Transportability with Limited Experiments
Bareinboim, E., & Pearl, J. (2013) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v27i1.8692 · Cited by 26
Self-citationThe structural theory of causation
Pearl, J. (2011) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199574131.003.0033 · Cited by 18
Self-citationPearl, J. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2343866 · Cited by 9
Self-citation
Cited by
Using Big Data to Emulate a Target Trial When a Randomized Trial Is Not Available: Table 1.
Hernán, M. A., & Robins, J. M. (2016) · American Journal of Epidemiology · doi:10.1093/aje/kwv254 · Cited by 3,115
Understanding and misunderstanding randomized controlled trials
Deaton, A., & Cartwright, N. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.12.005 · Cited by 1,841
MTurk Research: Review and Recommendations
Aguinis, H., Villamor, I., & Ramani, R. S. (2021) · Journal of Management · doi:10.1177/0149206320969787 · Cited by 984
The seven tools of causal inference, with reflections on machine learning
Pearl, J. (2019) · Communications of the ACM · doi:10.1145/3241036 · Cited by 659
Self-citationCausal inference and the data-fusion problem
Bareinboim, E., & Pearl, J. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1510507113 · Cited by 621
Self-citation
Metadata
- Authors
- Pearl, J., & Bareinboim, E.
- Venue
- Statistical Science
- Publisher
- Institute of Mathematical Statistics
- Published
- 2014-11-01
- Volume
- 29
- Issue
- 4
- Pages
- 579-595
- ISSN
- 0883-4237 (ISSN-L)
- OpenAlex
- W1994094188
- Cited by
- 345
- References
- 47
- FWCI
- 13.06
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.