Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme
The DOI matches its Crossref record; 31 of the 32 references it cites were found in a registry or an index.
Abstract
This paper considers whether it is possible to devise a nonexperimental procedure for evaluating a prototypical job training programme. Using rich nonexperimental data, we examine the performance of a two-stage evaluation methodology that (a) estimates the probability that a person participates in a programme and (b) uses the estimated probability in extensions of the classical method of matching. We decompose the conventional measure of programme evaluation bias into several components and find that bias due to selection on unobservables, commonly called selection bias in econometrics, is empirically less important than other components, although it is still a sizeable fraction of the estimated programme impact. Matching methods applied to comparison groups located in the same labour markets as participants and administered the same questionnaire eliminate much of the bias as conventionally measured, but the remaining bias is a considerable fraction of experimentally-determined programme impact estimates. We test and reject the identifying assumptions that justify the classical method of matching. We present a nonparametric conditional difference-in-differences extension of the method of matching that is consistent with the classical index-sufficient sample selection model and is not rejected by our tests of identifying assumptions. This estimator is effective in eliminating bias, especially when it is due to temporally-invariant omitted variables.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For the OR approach, the consistency of the ATT estimator (2.2) relies on the estimators of md , t ( · ) , ̂ µ d , t ( · ) , being correctly specified, whereas the IPW estimator (2.4) relies on the propensity score estimator ̂ π ( · ) of p ( · ) being correctly specified.”
From Doubly robust difference-in-differences estimators (2020) · cites this paper as Heckman et al. (1997)
In the citing paper
“These fall into two main categories, which we denote trajectory modeling [28, 29, 86, 88, 95] and propensity score weighting [17, 30].”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“Doubly robust (DR) estimators combine trajectory modeling and propensity score estimation and produce consistent estimates if either the trajectory model or the propensity score model is correctly specified: [29]”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“The OR, IPW and DR estimands respectively generalize Heckman et al. (1997), Abadie (2005) and Sant'Anna and Zhao (2020) estimands for the two groups, two periods DiD setup to the staggered DiD setup with multiple periods and multiple groups.”
From Difference-in-Differences with multiple time periods (2021) · cites this paper as Heckman et al. (1997)
In the citing paper
“CS also derives estimators that are consistent for AT T (g, τ ) under more general conditions, such as when the parallel-trends assumption holds conditionally on covariates, including an outcome-regression-based estimator”
From How Much Should We Trust Staggered Difference-in-Differences Estimates? (2022) · cites this paper as Heckman et al., 1997
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,796
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774
SOME THOUGHTS ON THE DISTRIBUTION OF EARNINGS 1
ROY, A. D. (1951) · Oxford Economic Papers · doi:10.1093/oxfordjournals.oep.a041827 · Cited by 2,958
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503
Estimating the Effect of Training Programs on Earnings
Ashenfelter, O. (1978) · The Review of Economics and Statistics · doi:10.2307/1924332 · Cited by 1,515
Design-adaptive Nonparametric Regression
Fan, J. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10476255 · Cited by 1,268
The Estimation of Choice Probabilities from Choice Based Samples
Manski, C. F., & Lerman, S. R. (1977) · Econometrica · doi:10.2307/1914121 · Cited by 1,208
Cited by
Difference-in-Differences with multiple time periods
Callaway, B., & Sant’Anna, P. H. C. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.12.001 · Cited by 9,126
SOME PRACTICAL GUIDANCE FOR THE IMPLEMENTATION OF PROPENSITY SCORE MATCHING
Caliendo, M., & Kopeinig, S. (2008) · Journal of Economic Surveys · doi:10.1111/j.1467-6419.2007.00527.x · Cited by 6,238
“Heckman et al. (1997a) and Dehejia and Wahba (1999) show that omitting important variables can seriously increase bias in resulting estimates.”
BackgroundMethodInfluentialEstimating dynamic treatment effects in event studies with heterogeneous treatment effects
Sun, L., & Abraham, S. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.09.006 · Cited by 5,518
Matching Methods for Causal Inference: A Review and a Look Forward
Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478
“Heckman, Hidehiko and Todd (1997), Heckman et al. (1998) and Heckman, Ichimura and Todd (1998) describe a local linear matching estimator”
BackgroundRecent Developments in the Econometrics of Program Evaluation
Imbens, G. W., & Wooldridge, J. M. (2009) · Journal of Economic Literature · doi:10.1257/jel.47.1.5 · Cited by 4,926
Propensity Score-Matching Methods for Nonexperimental Causal Studies
Dehejia, R. H., & Wahba, S. (2002) · Review of Economics and Statistics · doi:10.1162/003465302317331982 · Cited by 4,846
Causal Inference for Statistics, Social, and Biomedical Sciences: An Introduction
Imbens, G. W., & Rubin, D. B. (2015) · doi:10.1017/cbo9781139025751 · Cited by 4,210
Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference
Ho, D. E., Imai, K., King, G., & Stuart, E. A. (2007) · Political Analysis · doi:10.1093/pan/mpl013 · Cited by 4,205
Matching As An Econometric Evaluation Estimator
Heckman, J. J., Ichimura, H., & Todd, P. (1998) · Review of Economic Studies · doi:10.1111/1467-937x.00044 · Cited by 3,807
Self-citationCausal Inference without Balance Checking: Coarsened Exact Matching
Iacus, S. M., King, G., & Porro, G. (2012) · Political Analysis · doi:10.1093/pan/mpr013 · Cited by 3,563
Does matching overcome lalonde’s critique of nonexperimental estimators?
A. Smith, J., & E. Todd, P. (2005) · Journal of Econometrics · doi:10.1016/j.jeconom.2004.04.011 · Cited by 3,176
Self-citationHow Much Should We Trust Staggered Difference-in-Differences Estimates?
Baker, A. C., Larcker, D. F., & Wang, C. C. Y. (2022) · Journal of Financial Economics · doi:10.1016/j.jfineco.2022.01.004 · Cited by 3,149
The Economics and Econometrics of Active Labor Market Programs
Heckman, J. J., Lalonde, R. J., & Smith, J. A. (1999) · Handbook of Labor Economics · doi:10.1016/s1573-4463(99)03012-6 · Cited by 3,059
Self-citationNonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
Large sample properties of matching estimators for average treatment effects
Abadie, A., & Imbens, G. W. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00655.x · Cited by 2,908
Estimation of Average Treatment Effects Based on Propensity Scores
Becker, S. O., & Ichino, A. (2002) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0200200403 · Cited by 2,754
Causal effects in nonexperimental studies: Reevaluating the evaluation of training programs
Dehejia, R. H., & Wahba, S. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10473858 · Cited by 2,395
Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score
Hirano, K., Imbens, G. W., & Ridder, G. (2003) · Econometrica · doi:10.1111/1468-0262.00442 · Cited by 2,355
Semiparametric Difference-in-Differences Estimators
Abadie, A. (2005) · The Review of Economic Studies · doi:10.1111/0034-6527.00321 · Cited by 2,286
“This is the case for the 4Using experimental data, Heckman et al. (1997, 1998) have shown the plausibility of this identifying assumption in the context of the evaluation of a subsidized training program.”
BackgroundMethodCharacterizing Selection Bias Using Experimental Data
Heckman, J., Ichimura, H., Smith, J., & Todd, P. (1998) · Econometrica · doi:10.2307/2999630 · Cited by 2,286
Self-citationWhat's trending in difference-in-differences? A synthesis of the recent econometrics literature
Roth, J., Sant’Anna, P. H. C., Bilinski, A., & Poe, J. (2023) · Journal of Econometrics · doi:10.1016/j.jeconom.2023.03.008 · Cited by 2,027
“An alternative approach to allow for covariate-specific trends in DiD settings is the regression adjustment procedure proposed by Heckman et al. (1997) and Heckman et al. (1998).”
Understanding and misunderstanding randomized controlled trials
Deaton, A., & Cartwright, N. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.12.005 · Cited by 1,841
Why Propensity Scores Should Not Be Used for Matching
King, G., & Nielsen, R. (2019) · Political Analysis · doi:10.1017/pan.2019.11 · Cited by 1,706
Cem: Coarsened Exact Matching in Stata
Blackwell, M., Iacus, S., King, G., & Porro, G. (2009) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0900900402 · Cited by 1,689
Corporate social responsibility and stakeholder value maximization: Evidence from mergers
Deng, X., Kang, J.-K., & Low, B. S. (2013) · Journal of Financial Economics · doi:10.1016/j.jfineco.2013.04.014 · Cited by 1,647
“To select control firms, we use a propensity score matching approach (Heckman, Ichimura, and Todd, 1997, 1998).”
Empirical Strategies in Labor Economics
Angrist, J. D., & Krueger, A. B. (1999) · Handbook of Labor Economics · doi:10.1016/s1573-4463(99)03004-7 · Cited by 1,628
Bias-Corrected Matching Estimators for Average Treatment Effects
Abadie, A., & Imbens, G. W. (2011) · Journal of Business & Economic Statistics · doi:10.1198/jbes.2009.07333 · Cited by 1,416
Selection Models in Accounting Research
Lennox, C. S., Francis, J. R., & Wang, Z. (2012) · The Accounting Review · doi:10.2308/accr-10195 · Cited by 1,406
Lending Relationships and Loan Contract Terms
Bharath, S. T., Dahiya, S., Saunders, A., & Srinivasan, A. (2011) · Review of Financial Studies · doi:10.1093/rfs/hhp064 · Cited by 1,277
“We employ the Propensity Score Matching (PSM) technique described by Heckman et al. (1997, 1998).”
Do exports generate higher productivity? Evidence from Slovenia
De Loecker, J. (2007) · Journal of International Economics · doi:10.1016/j.jinteco.2007.03.003 · Cited by 1,256
“Table 5 presents the results for the different sectors and for the manufacturing as a whole for productivity level and productivity growth.(25)”
BackgroundUsing Randomization in Development Economics Research: A Toolkit
Duflo, E., Glennerster, R., & Kremer, M. (2006) · National Bureau of Economic Research · doi:10.3386/t0333 · Cited by 1,191
Corporate misreporting and bank loan contracting☆
GRAHAM, J., LI, S., & QIU, J. (2008) · Journal of Financial Economics · doi:10.1016/j.jfineco.2007.08.005 · Cited by 1,188
Bayesian Nonparametric Modeling for Causal Inference
Hill, J. L. (2011) · Journal of Computational and Graphical Statistics · doi:10.1198/jcgs.2010.08162 · Cited by 1,139
“While some competing parametric methods have been shown to be consistent under appropriate conditions (for instance, Rosenbaum 1987; Robins and Rotnitzky 1995; Heckman, Ichimura, and Todd 1997), this requires correct specification of the parametric model.”
MethodAn Evaluation of the Swedish System of Active Labor Market Programs in the 1990s
Sianesi, B. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023723 · Cited by 1,053
Doubly robust difference-in-differences estimators
Sant’Anna, P. H. C., & Zhao, J. (2020) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.06.003 · Cited by 1,047
“the causal inference literature. First, our methodological results are intrinsically related to other DID papers; for an overview, see e.g. Section 6.5 of Imbens and Wooldridge (2009). For instance, Heckman et al. (1997) propose kernel-based DID matching estimators, and Abadie (2005) proposes (nonparametric) DID IPW e…”
InfluentialHirano, K., & Imbens, G. W. (2001) · Health Services and Outcomes Research Methodology · doi:10.1023/a:1020371312283 · Cited by 1,039
“Some rely on estimating the conditional regression function of the outcomes given covariates (e.g., Robins, Rotnitzky and Zhao, 1995; Robins and Rotnitzky, 1995; Hahn, 1998; Heckman, Ichimura and Todd, 1997, 1998).”
Decomposition Methods in Economics
Fortin, N., Lemieux, T., & Firpo, S. (2011) · Handbook of Labor Economics · doi:10.1016/s0169-7218(11)00407-2 · Cited by 1,029
Lawrence, A., Minutti-Meza, M., & Zhang, P. (2011) · The Accounting Review · doi:10.2308/accr.00000009 · Cited by 1,021
Dealing with limited overlap in estimation of average treatment effects
Crump, R. K., Hotz, V. J., Imbens, G. W., & Mitnik, O. A. (2009) · Biometrika · doi:10.1093/biomet/asn055 · Cited by 1,007
“In empirical applications, there is often concern about the overlap assumption (e.g., Dehejia and Wahba, 1999; Heckman, Ichimura, and Todd, 1997).”
Evaluation Methods for Non‐Experimental Data
Blundell, R., & Costa Dias, M. (2000) · Fiscal Studies · doi:10.1111/j.1475-5890.2000.tb00031.x · Cited by 1,003
Panel Models in Sociological Research: Theory into Practice
Halaby, C. N. (2004) · Annual Review of Sociology · doi:10.1146/annurev.soc.30.012703.110629 · Cited by 946
Best Practices in Quantitative Methods
Osborne, J. (2008) · Sage eBooks · doi:10.4135/9781412995627 · Cited by 942
Semiparametric instrumental variable estimation of treatment response models
Abadie, A. (2003) · Journal of Econometrics · doi:10.1016/s0304-4076(02)00201-4 · Cited by 901
THE ESTIMATION OF CAUSAL EFFECTS FROM OBSERVATIONAL DATA
Winship, C., & Morgan, S. L. (1999) · Annual Review of Sociology · doi:10.1146/annurev.soc.25.1.659 · Cited by 890
“…(or, more accurately, the methods that they use) simply assume that the treatment effect is constant in the population, even when common sense dictates that the assumption is clearly implausible (Heckman 1997, Heckman et al. 1997b, Heckman & Robb 1985, 1986, 1988; JJ Heckman, unpublished paper).”
BackgroundMethodInfluentialMethods for Constructing and Assessing Propensity Scores
Garrido, M. M., Kelley, A. S., Paris, J., Roza, K., Meier, D. E., Morrison, R. S., & Aldridge, M. D. (2014) · Health Services Research · doi:10.1111/1475-6773.12182 · Cited by 882
Alternative approaches to evaluation in empirical microeconomics
Blundell, R., & Costa Dias, M. (2008) · doi:10.1920/wp.cem.2008.2608 · Cited by 881
The economic impact of Special Economic Zones: Evidence from Chinese municipalities
Wang, J. (2013) · Journal of Development Economics · doi:10.1016/j.jdeveco.2012.10.009 · Cited by 880
Water For Life: The impact of the privatization of water services on child mortality
Galiani, S., Gertler, P., & Schargrodsky, E. (2005) · Journal of Political Economy · doi:10.1086/426041 · Cited by 877
“8 Heckman et al. (1997) suggests that, in practice, the first of these two sources of bias is likely to be the most severe.”
InfluentialMatching on the Estimated Propensity Score
Abadie, A., & Imbens, G. W. (2016) · Econometrica · doi:10.3982/ecta11293 · Cited by 875
Chief Executive Officer Equity Incentives and Accounting Irregularities
ARMSTRONG, C. S., JAGOLINZER, A. D., & LARCKER, D. F. (2010) · Journal of Accounting Research · doi:10.1111/j.1475-679x.2009.00361.x · Cited by 875
Angrist, J. (2000) · National Bureau of Economic Research · doi:10.3386/t0248 · Cited by 870
Angrist, J. D. (2001) · Journal of Business & Economic Statistics · doi:10.1198/07350010152472571 · Cited by 846
Heckman, J. (1997) · The Journal of Human Resources · doi:10.2307/146178 · Cited by 825
Self-citationCausal Effects in Non-Experimental Studies: Re-Evaluating the Evaluation of Training Programs
Dehejia, R., & Wahba, S. (1998) · National Bureau of Economic Research · doi:10.3386/w6586 · Cited by 805
Harder, V. S., Stuart, E. A., & Anthony, J. C. (2010) · Psychological Methods · doi:10.1037/a0019623 · Cited by 802
“N IH -PA Author M anuscript N IH -PA Author M anuscript N IH -PA Author M anuscript of the PS for the other group (outside the region of “common support”; Heckman et al., 1997, 1998).”
BackgroundOn the Failure of the Bootstrap for Matching Estimators
(2008) · Econometrica · doi:10.3982/ecta6474 · Cited by 798
“…errors includes Agodini and Dynarski (2004), Dehejia and Wahba (1999, 2002), Galasso and Ravaillon (2003), Guarcello, Mealli, and Rosati (2003), Heckman, Ichimura and Todd (1997), Ichino and Becker (2002), Imai (2005), Jalan and Ravallion (1999), Lechner (2002), Myers, Olsen, Seftor, Young,…”
BackgroundMethodElectoral Rules and Corruption
Persson, T., Tabellini, G., & Trebbi, F. (2003) · Journal of the European Economic Association · doi:10.1162/154247603322493203 · Cited by 782
Language Proficiency and Labour Market Performance of Immigrants in the UK
Dustmann, C., & Fabbri, F. (2003) · The Economic Journal · doi:10.1111/1468-0297.t01-1-00151 · Cited by 779
“who have a common support in x). If, for instance, there are values of xi where only proficient individuals are observed ‐ in other words, P(xi) ¼ 1 for some values of xi ‐t he conditional expectation of Eðy0 i jli ¼ 0; xiÞ is not defined. Heckman et al. (1997)”
Pretest with Caution: Event-Study Estimates after Testing for Parallel Trends
Roth, J. (2022) · American Economic Review: Insights · doi:10.1257/aeri.20210236 · Cited by 769
“…of this form (under suitable regularity conditions) include dynamic TWFE estimators, the GMM estimator of Freyaldenhoven, Hansen and Shapiro (2019), and methods for difference-in-differences conditional on covariates (Abadie, 2005; Heckman, Ichimura and Todd, 1997; Sant’Anna and Zhao, 2020).”
MethodUsing matching, instrumental variables and control functions to estimate economic choice models
Heckman, J., & Navarro-Lozano, S. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023660 · Cited by 768
Self-citationPolitical connections and the cost of equity capital
Boubakri, N., Guedhami, O., Mishra, D., & Saffar, W. (2012) · Journal of Corporate Finance · doi:10.1016/j.jcorpfin.2012.02.005 · Cited by 761
Does Diversification Cause the 'Diversification Discount'?
Villalonga, B. (2000) · SSRN Electronic Journal · doi:10.2139/ssrn.227828 · Cited by 737
Decomposition Methods in Economics
Fortin, N., Lemieux, T., & Firpo, S. (2010) · National Bureau of Economic Research · doi:10.3386/w16045 · Cited by 736
Propensity Score Matching Methods for Non-Experimental Causal Studies
Dehejia, R. H., & Wahba, S. (2002) · SSRN Electronic Journal · doi:10.2139/ssrn.1084955 · Cited by 735
Van Der Klaauw, W. (2002) · International Economic Review · doi:10.1111/1468-2354.t01-1-00055 · Cited by 722
“8 For discussions of such approaches and the identifiability of treatment effects, see Rosenbaum and Rubin (1983), Heckman and Robb (1985), Heckman and Hotz (1989), Heckman (1990), Manski (1990), Imbens and Angrist (1994), and Heckman et al. (1997).”
Two-Way Fixed Effects, the Two-Way Mundlak Regression, and Difference-in-Differences Estimators
Wooldridge, J. M. (2021) · SSRN / The Econometrics Journal · doi:10.2139/ssrn.3906345 · Cited by 714
“Another important algebraic equivalence involving the FE estimator, usually invoked in microeconometric settings, is the equivalence between the FE estimator that removes unit-specific effects – the one-way FE estimator (OWFE) – and the Mundlak (1978) device, which includes unit-specific time averages of time-varying…”
Lechner, M. (2001) · ZEW Economic Studies · doi:10.1007/978-3-642-57615-7_3 · Cited by 710
Political Connections and the Cost of Bank Loans
HOUSTON, J. F., JIANG, L., LIN, C., & MA, Y. (2014) · Journal of Accounting Research · doi:10.1111/1475-679x.12038 · Cited by 705
Optimal Full Matching and Related Designs via Network Flows
Hansen, B. B., & Klopfer, S. O. (2006) · Journal of Computational and Graphical Statistics · doi:10.1198/106186006x137047 · Cited by 703
“…in this example are common in propensity-score matching, since in fitting the propensity score prior to matching, one in effect does one’s best to separate treated and controls groups on a linear covariate index; see, for instance, Heckman, Ichimura, and Todd (1997) or Dehejia and Wahba (1999).”
BackgroundExecutive board composition and bank risk taking
Berger, A. N., Kick, T., & Schaeck, K. (2014) · Journal of Corporate Finance · doi:10.1016/j.jcorpfin.2013.11.006 · Cited by 682
Earnings Losses of Displaced Workers Revisited
Couch, K. A., & Placzek, D. W. (2010) · American Economic Review · doi:10.1257/aer.100.1.572 · Cited by 676
Micro Data, Heterogeneity, and the Evaluation of Public Policy: Nobel Lecture
Heckman, J. J. (2001) · Journal of Political Economy · doi:10.1086/322086 · Cited by 675
Self-citationHow robust is the evidence on the effects of college quality? Evidence from matching
Black, D. A., & Smith, J. A. (2004) · Journal of Econometrics · doi:10.1016/j.jeconom.2003.10.006 · Cited by 673
“2 See the discussions in Heckman et al. (1997, 1998b) , Heckman et al. (1998a), Heckman et al. (1999),”
BackgroundHow Much Should We Trust Staggered Difference-In-Differences Estimates?
Baker, A., Larcker, D. F., & Wang, C. C. Y. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.3794018 · Cited by 670
The Experimental Approach to Development Economics
Banerjee, A. V., & Duflo, E. (2009) · Annual Review of Economics · doi:10.1146/annurev.economics.050708.143235 · Cited by 654
Grandstanding, certification and the underpricing of venture capital backed IPOs
Lee, P. M., & Wahal, S. (2004) · Journal of Financial Economics · doi:10.1016/j.jfineco.2003.09.003 · Cited by 638
Do People Vote with Their Feet? An Empirical Test of Tiebout's Mechanism
Banzhaf, H. S., & Walsh, R. P. (2008) · American Economic Review · doi:10.1257/aer.98.3.843 · Cited by 624
The impact of cooperatives on agricultural technology adoption: Empirical evidence from Ethiopia
Abebaw, D., & Haile, M. G. (2013) · Food Policy · doi:10.1016/j.foodpol.2012.10.003 · Cited by 623
Cook, T. D., Shadish, W. R., & Wong, V. C. (2008) · Journal of Policy Analysis and Management · doi:10.1002/pam.20375 · Cited by 604
“Even so, Heckman and his colleagues (Heckman & Smith, 1999; Heckman, LaLonde, & Smith, 1999; Heckman et al., 1997) have speculated that selection processes could be well measured in job training if there were information to make local case matches in the same labor market; if employment and wage data were available an…”
BackgroundPropensity Score Matching: A Statistical Method
Kane, L. T., Fang, T., Galetta, M. S., Goyal, D. K. C., Nicholson, K. J., Kepler, C. K., Vaccaro, A. R., & Schroeder, G. D. (2020) · Clinical Spine Surgery: A Spine Publication · doi:10.1097/bsd.0000000000000932 · Cited by 603
Ichino, A., Mealli, F., & Nannicini, T. (2008) · Journal of Applied Econometrics · doi:10.1002/jae.998 · Cited by 603
“this suggestion by comparing, as in Heckman, Ichimura and Todd (1997) , two groups of”
MethodClimate Risk and Capital Structure
Ginglinger, E., & Moreau, Q. (2023) · Management Science · doi:10.1287/mnsc.2023.4952 · Cited by 598
Does piped water reduce diarrhea for children in rural India?
Jalan, J., & Ravallion, M. (2003) · Journal of Econometrics · doi:10.1016/s0304-4076(02)00158-6 · Cited by 593
“…weights that one can use, ranging from “nearest neighbor” weights to non- parametric weights based on kernel functions of the differences in scores (Heckman et al., 1997).6 We use the nearest five neighbors estimator, which takes the average outcome measure of the closest five matched…”
MethodExecutive compensation and corporate governance in China
Conyon, M. J., & He, L. (2011) · Journal of Corporate Finance · doi:10.1016/j.jcorpfin.2011.04.006 · Cited by 592
Mobility and the Return to Education: Testing a Roy Model with Multiple Markets
Dahl, G. B. (2002) · Econometrica · doi:10.1111/1468-0262.00379 · Cited by 583
Does Exporting Increase Productivity? A Microeconometric Analysis of Matched Firms
Girma, S., Greenaway, A., & Kneller, R. (2004) · Review of International Economics · doi:10.1111/j.1467-9396.2004.00486.x · Cited by 582
A Systematic Review of Propensity Score Methods in the Social Sciences
Thoemmes, F. J., & Kim, E. S. (2011) · Multivariate Behavioral Research · doi:10.1080/00273171.2011.540475 · Cited by 577
Employee treatment and firm leverage: A test of the stakeholder theory of capital structure
Bae, K.-H., Kang, J.-K., & Wang, J. (2011) · Journal of Financial Economics · doi:10.1016/j.jfineco.2010.10.019 · Cited by 571
“Following Rosenbaum and Rubin (1983) and Heckman, Ichimura, and Todd (1997, 1998), we use a probit model to calculate propensity scores.”
Schools and Skills in Developing Countries: Education Policies and Socioeconomic Outcomes
Glewwe, P. (2002) · Journal of Economic Literature · doi:10.1257/jel.40.2.436 · Cited by 570
Some Causal Effects of an Industrial Policy
Criscuolo, C., Martin, R., Overman, H. G., & Van Reenen, J. (2019) · American Economic Review · doi:10.1257/aer.20160034 · Cited by 554
The Logic of the Survey Experiment Reexamined
Gaines, B. J., Kuklinski, J. H., & Quirk, P. J. (2007) · Political Analysis · doi:10.1093/pan/mpl008 · Cited by 553
Diagnosing and responding to violations in the positivity assumption
Petersen, M. L., Porter, K. E., Gruber, S., Wang, Y., & van der Laan, M. J. (2012) · Statistical Methods in Medical Research · doi:10.1177/0962280210386207 · Cited by 548
Mendola, M. (2007) · Food Policy · doi:10.1016/j.foodpol.2006.07.003 · Cited by 547
“Yet, non-parametric matching methods can only be meaningfully applied over regions of overlapping support (Heckman et al., 1997).”
BackgroundRishika, R., Kumar, A., Janakiraman, R., & Bezawada, R. (2013) · Information Systems Research · doi:10.1287/isre.1120.0460 · Cited by 547
“We follow recommendations of recent literature and use the same data sources for both groups (Heckman et al. 1997).”
MethodChapter 61 Using Randomization in Development Economics Research: A Toolkit
Duflo, E., Glennerster, R., & Kremer, M. (2007) · Handbook of Development Economics · doi:10.1016/s1573-4471(07)04061-2 · Cited by 545
Determinants of corporate cash policy: Insights from private firms
Gao, H., Harford, J., & Li, K. (2013) · Journal of Financial Economics · doi:10.1016/j.jfineco.2013.04.008 · Cited by 540
The Dangers of Extreme Counterfactuals
King, G., & Zeng, L. (2006) · Political Analysis · doi:10.1093/pan/mpj004 · Cited by 540
Surveillance and System Avoidance: Criminal Justice Contact and Institutional Attachment
Brayne, S. (2014) · American Sociological Review · doi:10.1177/0003122414530398 · Cited by 538
On the Benefits of Concurrent Lending and Underwriting
DRUCKER, S., & PURI, M. (2005) · The Journal of Finance · doi:10.1111/j.1540-6261.2005.00816.x · Cited by 538
“To reduce these problems, we rely on econometric matching techniques that were developed by Rosenbaum and Rubin (1983) and extended by Heckman and Robb (1986) and Heckman et al. (1997, 1998).15 In Appendix B, we provide a summary of these techniques and a detailed description of how we apply the methods to our data. E…”
InfluentialSensitivity to Exogeneity Assumptions in Program Evaluation
Imbens, G. W. (2003) · American Economic Review · doi:10.1257/000282803321946921 · Cited by 529
“I also carry out the sensitivity analysis using the change in earnings as the outcome variable, following the argument in Heckman et al. (1997) that this can improve robustness.”
Method
Metadata
- Authors
- Heckman, J. J., Ichimura, H., & Todd, P. E.
- Affiliations
- University of Chicago (US)
- University of Pittsburgh (US)
- University of Pennsylvania (US)
- Venue
- The Review of Economic Studies
- Publisher
- Oxford University Press (OUP)
- Published
- 1997-10-01
- Volume
- 64
- Issue
- 4
- Pages
- 605-654
- ISSN
- 0034-6527 (ISSN-L)
- 1467-937X
- OpenAlex
- W2066735350
- Semantic Scholar
- ec958b198d3b6712d1e0f3395a05ff2b0136a1bb
- Cited by
- 5,486
- References
- 32
- Citations by year
- 2026: 216 · 2025: 268 · 2024: 271 · 2023: 292 · 2022: 296 · 2021: 246 · 2020: 254 · 2019: 244 · 2018: 269 · 2017: 236 · 2016: 231 · 2015: 251 · 2014: 266 · 2013: 248 · 2012: 275
- FWCI
- 20.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Review of Economic Studies (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- selection on unobservables, sample selection model, identifying assumptions, omitted variables
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.