The Estimation of Causal Effects by Difference-in-Difference Methods
Open accessThe DOI matches its Crossref record; 41 of the 41 references it cites were found in a registry or an index.
Abstract
This survey gives a brief overview of the literature on the difference-indifference (DiD) estimation strategy and discusses major issues using a treatment effects perspective. In this sense, this survey gives a somewhat different view on DiD than the standard textbook discussion of the DiD model, but it will not be as complete as the latter. It contains some extensions of the literature, for example, a discussion of, and suggestions for nonlinear DiD estimators as well as DiD estimators based on propensity-score type matching methods.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Together, no anticipation and SUTVA allow us to link the potential outcomes to the observed outcomes as follows, which is also sometimes referred to as consistency [44]:”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [44]
In the citing paper
“If there is a difference in the changes between the treatment group and the control group, then a treatment effect is found (Lechner, 2011;Meyer, 1995).”
From Randomized controlled trial of social interaction police training (2020) · cites this paper as Lechner, 2011
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2009) · doi:10.1515/9781400829828 · Cited by 9,467
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2008) · doi:10.2307/j.ctvcm4j72 · Cited by 5,051
Recent Developments in the Econometrics of Program Evaluation
Imbens, G. W., & Wooldridge, J. M. (2009) · Journal of Economic Literature · doi:10.1257/jel.47.1.5 · Cited by 4,926
Interaction terms in logit and probit models
Ai, C., & Norton, E. C. (2003) · Economics Letters · doi:10.1016/s0165-1765(03)00032-6 · Cited by 4,599 · cited 2×
“11 For different ways to estimate “causal” parameters from these models, see the papers by Ai and Norton (2003) and Puhani (2008).”
BackgroundSemiparametric Difference-in-Differences Estimators
Abadie, A. (2005) · The Review of Economic Studies · doi:10.1111/0034-6527.00321 · Cited by 2,286
Characterizing Selection Bias Using Experimental Data
Heckman, J., Ichimura, H., Smith, J., & Todd, P. (1998) · Econometrica · doi:10.2307/2999630 · Cited by 2,286 · cited 3×
“, Card and Krueger, 1994), the effects of training and other active labor market programmes for unemployed on labor market outcomes (e.g., Ashenfelter, 1978; Ashenfelter and Card, 1985; Heckman and Robb, 1986; Heckman and Hotz, 1989; Heckman et al., 1998; Blundell et al., 2004), the effect of immigration on the local…”
BackgroundMethodInfluentialWorms: Identifying Impacts on Education and Health in the Presence of Treatment Externalities
Miguel, E., & Kremer, M. (2004) · Econometrica · doi:10.1111/j.1468-0262.2004.00481.x · Cited by 2,268 · cited 1×
“Miguel and Kremer (2004) is an early study analyzing this phenomenon of spill-over effects or treatment externalities.”
BackgroundDuflo, E. (2001) · American Economic Review · doi:10.1257/aer.91.4.795 · Cited by 1,940
The Impact of the Mariel Boatlift on the Miami Labor Market
Card, D. (1990) · ILR Review · doi:10.1177/001979399004300205 · Cited by 1,704 · cited 1×
“…market outcomes (e.g., Ashenfelter, 1978; Ashenfelter and Card, 1985; Heckman and Robb, 1986; Heckman and Hotz, 1989; Heckman et al., 1998; Blundell et al., 2004), the effect of immigration on the local labor market (e.g., Card, 1990), or the analysis of labor supply (e.g., Blundell et al., 1998).”
BackgroundEmpirical Strategies in Labor Economics
Angrist, J. D., & Krueger, A. B. (1999) · Handbook of Labor Economics · doi:10.1016/s1573-4463(99)03004-7 · Cited by 1,628
Autor, D. H. (2003) · Journal of Labor Economics · doi:10.1086/344122 · Cited by 1,534 · cited 2×
“They base their estimators on local linear kernel estimators, as do Bergemann et al. (2009). Acemoglu and Angrist (2001), whose empirical analysis is based on a very large sample and a fairly small number of discrete covariates, compute the respective means within the cells defined by the covariates and then weight th…”
BackgroundEstimating the Effect of Training Programs on Earnings
Ashenfelter, O. (1978) · The Review of Economics and Statistics · doi:10.2307/1924332 · Cited by 1,515 · cited 3×
“As another example, it has been observed by Ashenfelter (1978) that trainees from public training programmes suffer a larger drop in earnings prior to training than nontrainees. Suppose these drops are due to negative “idiosyncratic temporary shocks.” The temporary nature of these shocks implies that individuals who r…”
InfluentialInference with Difference-in-Differences and Other Panel Data
Donald, S. G., & Lang, K. (2007) · Review of Economics and Statistics · doi:10.1162/rest.89.2.221 · Cited by 1,324
Assignment to Treatment Group on the Basis of a Covariate
Rubin, D. B. (1977) · Journal of Educational Statistics · doi:10.3102/10769986002001001 · Cited by 1,155 · cited 1×
“This assumption, sometimes called the observation rule, follows from the so-called Stable Unit Treatment Value assumption (SUTVA; Rubin (1977)).”
MethodNatural and Quasi-Experiments in Economics
Meyer, B. D. (1995) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1995.10524589 · Cited by 1,100
Identification and Inference in Nonlinear Difference-in-Differences Models
Athey, S., & Imbens, G. W. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00668.x · Cited by 1,084
Using the Longitudinal Structure of Earnings to Estimate the Effect of Training Programs
Ashenfelter, O., & Card, D. (1985) · The Review of Economics and Statistics · doi:10.2307/1924810 · Cited by 1,023
Consequences of Employment Protection? The Case of the Americans with Disabilities Act
Acemoglu, D., & Angrist, J. D. (2001) · Journal of Political Economy · doi:10.1086/322836 · Cited by 742 · cited 6×
“Acemoglu and Angrist (2001), whose empirical analysis is based on a very large sample and a fairly small number of discrete covariates, compute the respective means within the cells defined by the covariates and then weight the resulting differences with the probability of the particular cell in the population.”
BackgroundMethodInfluentialInference with “Difference in Differences” with a Small Number of Policy Changes
Conley, T. G., & Taber, C. R. (2011) · Review of Economics and Statistics · doi:10.1162/rest_a_00049 · Cited by 633 · cited 2×
“1 The already mentioned paper by Donald and Lang (2007) is also particularly interested in the case of a small number of treated and controls, while the study by Conley and Taber (2011) mentioned above provides an alternative analysis that is geared to the intermediate case of a larger number of nontreated and a small…”
BackgroundPuhani, P. A. (2012) · Economics Letters · doi:10.1016/j.econlet.2011.11.025 · Cited by 621
Heckman, J. J., & Hotz, V. J. (1989) · Journal of the American Statistical Association · doi:10.1080/01621459.1989.10478848 · Cited by 515
Waldfogel, J. (1998) · Journal of Labor Economics · doi:10.1086/209897 · Cited by 504 · cited 2×
“5 For example, Yelowitz (1995) analyzes the effects of losing public health insurance on labor market decisions in the United States by using Medicaid eligibility that varies over time, state and age (of the child in the household).”
BackgroundEvaluating the Employment Impact of a Mandatory Job Search Program
Blundell, R., Dias, M. C., Meghir, C., & van Reenen, J. (2004) · Journal of the European Economic Association · doi:10.1162/1542476041423368 · Cited by 500 · cited 2×
“, Card and Krueger, 1994), the effects of training and other active labor market programmes for unemployed on labor market outcomes (e.g., Ashenfelter, 1978; Ashenfelter and Card, 1985; Heckman and Robb, 1986; Heckman and Hotz, 1989; Heckman et al., 1998; Blundell et al., 2004), the effect of immigration on the local…”
Estimating Labor Supply Responses Using Tax Reforms
Blundell, R., Duncan, A., & Meghir, C. (1998) · Econometrica · doi:10.2307/2999575 · Cited by 398
Alternative Approaches to Evaluation in Empirical Microeconomics
Blundell, R., & Costa Dias, M. (2009) · Journal of Human Resources · doi:10.1353/jhr.2009.0009 · Cited by 394
Hansen, C. B. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.07.011 · Cited by 389
The Effect of Unemployment Compensation on Unemployment Duration in Germany
Hunt, J. (1995) · Journal of Labor Economics · doi:10.1086/298369 · Cited by 332 · cited 1×
“When applying nonlinear models in a DiD framework, researchers typically use a linear index structure together with a nonlinear link function (e.g., Hunt, 1995; Gruber and Poterba, 1994).”
MethodThe Medicaid Notch, Labor Supply, and Welfare Participation: Evidence from Eligibility Expansions
Yelowitz, A. S. (1995) · The Quarterly Journal of Economics · doi:10.2307/2946644 · Cited by 330
The Effect of Liquor Taxes on Heavy Drinking
Cook, P. J., & Tauchen, G. (1982) · The Bell Journal of Economics · doi:10.2307/3003461 · Cited by 318 · cited 1×
“1 The already mentioned paper by Donald and Lang (2007) is also particularly interested in the case of a small number of treated and controls, while the study by Conley and Taber (2011) mentioned above provides an alternative analysis that is geared to the intermediate case of a larger number of nontreated and a small…”
BackgroundTax Incentives and the Decision to Purchase Health Insurance: Evidence from the Self-Employed
Gruber, J., & Poterba, J. (1994) · The Quarterly Journal of Economics · doi:10.2307/2118419 · Cited by 303
Asymptotic properties of a robust variance matrix estimator for panel data when is large
Hansen, C. B. (2007) · Journal of Econometrics · doi:10.1016/j.jeconom.2006.10.009 · Cited by 293
Heckman, J. J., & Robb, R. (1986) · Drawing Inferences from Self-Selected Samples · doi:10.1007/978-1-4612-4976-4_7 · Cited by 285 · cited 2×
“…of training and other active labor market programmes for unemployed on labor market outcomes (e.g., Ashenfelter, 1978; Ashenfelter and Card, 1985; Heckman and Robb, 1986; Heckman and Hotz, 1989; Heckman et al., 1998; Blundell et al., 2004), the effect of immigration on the local labor market…”
BackgroundA Note on the Common Support Problem in Applied Evaluation Studies
LECHNER (2008) · Annales d Économie et de Statistique · doi:10.2307/27917246 · Cited by 141
An evaluation of public employment programmes in the East German State of Sachsen-Anhalt
Eichler, M., & Lechner, M. (2002) · Labour Economics · doi:10.1016/s0927-5371(02)00039-8 · Cited by 114 · cited 2×
“41 Eichler and Lechner (2002) use simple propensity score matching methods while Blundell, Meghir, Costa Dias, and van Reenen (2004) use a time specific and cross-section specific propensity score in their matching methods (see also Blundell and Costa Dias, 2009). Ravallion, Galasso, Lazo, and Philipp (2005) use prope…”
MethodSelf-citationBergemann, A., Fitzenberger, B., & Speckesser, S. (2009) · Journal of Applied Econometrics · doi:10.1002/jae.1054 · Cited by 82
A note on endogenous control variables in causal studies
Lechner, M. (2007) · Statistics & Probability Letters · doi:10.1016/j.spl.2007.05.019 · Cited by 68
Self-citationBonhomme, S., & Sauder, U. (2011) · Review of Economics and Statistics · doi:10.1162/rest_a_00164 · Cited by 58 · cited 3×
“2 Recently, Bonhomme and Sauder (2011) extended the DiD logic to the distribution of the outcome variables using characteristic functions.”
BackgroundStability in the Absence of Treatment
Rosenbaum, P. R. (2001) · Journal of the American Statistical Association · doi:10.1198/016214501750333072 · Cited by 43
The Price Elasticity of Liquor in the U.S. and a Simple Method of Determination
Simon, J. L. (1966) · Econometrica · doi:10.2307/1909863 · Cited by 41
Needed Research on the Mediation of Labor Disputes
Rose, A. M. (1952) · Personnel Psychology · doi:10.1111/j.1744-6570.1952.tb01011.x · Cited by 14 · cited 9×
“Later on, the DiD type of approach became relevant also for other fields, like psychology, for example, Rose (1952) investigated the effects of a regime of ‘mandatory mediation’ on work stoppages by a DiD design. The following quote from his article reveals the key issues: “To test the effectiveness of mandatory media…”
BackgroundResultInfluential
Research works printed but not linked: 21
- Abadie, 2007, Synthetic control methods for comparative case studies: Estimating the effect of California’s tobacco control program
- Bertrand, 2004, How much should we trust differences-in-differences estimates, 249
- Besley, 2004, Can labor regulation hinder economic performance? Evidence from India, 91
- Bühler, 2011, Trade liberalization and growth: Plant-level evidence from Switzerland
- Card, 1994, Minimum wages and employment: A case study of the fast-food industry in New Jersey and Pennsylvania, The American Economic Review, 84, 772
- Chabe-Ferret, 2010, To Control or Not to Control? Bias of Simple Matching vs Difference-In-Difference Matching in a Dynamic Framework.
- Cook, 1979, Quasi-Experimentation.
- Eissa, 1996, Labor supply and the economic recovery act of 1981, 5
- Havnes, 2010, Is universal child care leveling the playing field? Evidence from a nonlinear difference-in-difference approach
- Heckman, 1996, Comment on eissa: Labor supply and the economic recovery act of 1981, 5
- Heckman, 1999, Handbook of Labour Economics, 1865
- Huber, 2010, Department of Economics
- Lai, 2011, London cholera and the blind-spot of an epidemiology theory, 82
- Lester, 1946, Shortcomings of marginal analysis for the wage-employment problems, American Economic Review, 36, 63
- Manski, 2011, Department of Economics and Institute for Policy Research
- Meyer, 1995, Workers’ compensation and injury duration: Evidence from a natural experiment, American Economic Review, 85, 322
- Obenauer, 1915, Bulletin of the U.S. Bureau of Labor Statistics
- Ravallion, 2005, What can ex-participants reveal about a program’s impact, Journal of Human Ressources, 40, 208
- Shadish, 2002, Experimental and Quasi-Experimental Designs for Generalized Causal Inference.
- Snow, 1854, The cholera near golden square, and at deptford, Medical Times and Gazette, 9, 321
- Snow, 1855, On the Mode of Communication of Cholera.
Cited by
Long-term cardiovascular outcomes of COVID-19
Xie, Y., Xu, E., Bowe, B., & Al-Aly, Z. (2022) · Nature Medicine · doi:10.1038/s41591-022-01689-3 · Cited by 2,029
Cai, X., Lu, Y., Wu, M., & Yu, L. (2016) · Journal of Development Economics · doi:10.1016/j.jdeveco.2016.08.003 · Cited by 1,264
The triple difference estimator
Olden, A., & Møen, J. (2022) · The Econometrics Journal · doi:10.1093/ectj/utac010 · Cited by 432
Shao, S., Tian, Z., & Yang, L. (2017) · Journal of Transport Geography · doi:10.1016/j.jtrangeo.2017.08.019 · Cited by 410
Big Data as a Governance Mechanism
Zhu, C. (2019) · The Review of Financial Studies · doi:10.1093/rfs/hhy081 · Cited by 381
Metadata
- Authors
- Lechner, M.
- Affiliations
- University of St.Gallen (CH)
- Corresponding author
- Lechner, Michael
- ORCID
- Lechner, Michael
- Venue
- Foundations and Trends® in Econometrics
- Publisher
- Emerald
- Published
- 2011-11-15
- Volume
- 4
- Issue
- 3
- Pages
- 165-224
- ISSN
- 1551-3076 (ISSN-L)
- 1551-3084
- OpenAlex
- W4205641472
- Cited by
- 935
- References
- 39
- Citations by year
- 2026: 61 · 2025: 101 · 2024: 99 · 2023: 99 · 2022: 114 · 2021: 103 · 2020: 104 · 2019: 68 · 2018: 60 · 2017: 43 · 2016: 38 · 2015: 24 · 2014: 13 · 2013: 4 · 2012: 4
- FWCI
- 5.87
- Type
- journal article
- Language
- en
- Open access
- diamond
- doi.org
- Locations
- Foundations and Trends® in Econometrics (publishedVersion)
- Alexandria (UniSG) (University of St.Gallen) (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Economics, Econometrics and Finance › Economics and Econometrics › Spatial and Panel Data Analysis
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Keywords
- difference-in-differences, causal effect estimation, treatment effects, propensity score matching, policy evaluation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.