Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme
The DOI matches its Crossref record; 31 of the 32 references it cites were found in a registry or an index.
Abstract
This paper considers whether it is possible to devise a nonexperimental procedure for evaluating a prototypical job training programme. Using rich nonexperimental data, we examine the performance of a two-stage evaluation methodology that (a) estimates the probability that a person participates in a programme and (b) uses the estimated probability in extensions of the classical method of matching. We decompose the conventional measure of programme evaluation bias into several components and find that bias due to selection on unobservables, commonly called selection bias in econometrics, is empirically less important than other components, although it is still a sizeable fraction of the estimated programme impact. Matching methods applied to comparison groups located in the same labour markets as participants and administered the same questionnaire eliminate much of the bias as conventionally measured, but the remaining bias is a considerable fraction of experimentally-determined programme impact estimates. We test and reject the identifying assumptions that justify the classical method of matching. We present a nonparametric conditional difference-in-differences extension of the method of matching that is consistent with the classical index-sufficient sample selection model and is not rejected by our tests of identifying assumptions. This estimator is effective in eliminating bias, especially when it is due to temporally-invariant omitted variables.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For the OR approach, the consistency of the ATT estimator (2.2) relies on the estimators of md , t ( · ) , ̂ µ d , t ( · ) , being correctly specified, whereas the IPW estimator (2.4) relies on the propensity score estimator ̂ π ( · ) of p ( · ) being correctly specified.”
From Doubly robust difference-in-differences estimators (2020) · cites this paper as Heckman et al. (1997)
In the citing paper
“These fall into two main categories, which we denote trajectory modeling [28, 29, 86, 88, 95] and propensity score weighting [17, 30].”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“Doubly robust (DR) estimators combine trajectory modeling and propensity score estimation and produce consistent estimates if either the trajectory model or the propensity score model is correctly specified: [29]”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“The OR, IPW and DR estimands respectively generalize Heckman et al. (1997), Abadie (2005) and Sant'Anna and Zhao (2020) estimands for the two groups, two periods DiD setup to the staggered DiD setup with multiple periods and multiple groups.”
From Difference-in-Differences with multiple time periods (2021) · cites this paper as Heckman et al. (1997)
In the citing paper
“CS also derives estimators that are consistent for AT T (g, τ ) under more general conditions, such as when the parallel-trends assumption holds conditionally on covariates, including an outcome-regression-based estimator”
From How Much Should We Trust Staggered Difference-in-Differences Estimates? (2022) · cites this paper as Heckman et al., 1997
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,796
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774
SOME THOUGHTS ON THE DISTRIBUTION OF EARNINGS 1
ROY, A. D. (1951) · Oxford Economic Papers · doi:10.1093/oxfordjournals.oep.a041827 · Cited by 2,958
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503
Estimating the Effect of Training Programs on Earnings
Ashenfelter, O. (1978) · The Review of Economics and Statistics · doi:10.2307/1924332 · Cited by 1,515
Design-adaptive Nonparametric Regression
Fan, J. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10476255 · Cited by 1,268
The Estimation of Choice Probabilities from Choice Based Samples
Manski, C. F., & Lerman, S. R. (1977) · Econometrica · doi:10.2307/1914121 · Cited by 1,208
Cited by
Items 401–500 of 1,029
Turning Unemployment into Self‐Employment: Effectiveness of Two Start‐Up Programmes*
Baumgartner, H. J., & Caliendo, M. (2008) · Oxford Bulletin of Economics and Statistics · doi:10.1111/j.1468-0084.2008.00505.x · Cited by 185
Digital technologies and productivity: A firm-level investigation
Nucci, F., Puccioni, C., & Ricchi, O. (2023) · Economic Modelling · doi:10.1016/j.econmod.2023.106524 · Cited by 153
Behavioral Consequences of Overbooking Service Capacity
Wangenheim, F. V., & Bayón, T. (2007) · Journal of Marketing · doi:10.1509/jmkg.71.4.036 · Cited by 147
Abebe, G. K., Bijman, J., & Royer, A. (2015) · Journal of Rural Studies · doi:10.1016/j.jrurstud.2015.12.004 · Cited by 175
“As a robustness check, we also estimated the impact of smallholders' use of middlemen on farmers' income related to potato sales using propensity score matching (PSM), a method which helps to address the problem of self-selection bias (Heckman et al., 1997).”
MethodFeng, X., Zhao, Y., & Yan, R. (2023) · Journal of Environmental Management · doi:10.1016/j.jenvman.2023.119791 · Cited by 158
Effects of foreign acquisitions on R&D activity: Evidence from firm-level data for France
Bertrand, O. F. (2009) · Research Policy · doi:10.1016/j.respol.2009.03.001 · Cited by 192
Science Parks’ tenants versus out-of-Park firms: who innovates more? A duration model
Squicciarini, M. (2007) · The Journal of Technology Transfer · doi:10.1007/s10961-007-9037-z · Cited by 174
“3 Among others: Heckman et al. (1997, 1998, 1998) ; Heckman and Smith (1999); Ichimura and Taber”
BackgroundEffectiveness and efficiency of SME innovation policy
Foreman–Peck, J. (2012) · Small Business Economics · doi:10.1007/s11187-012-9426-z · Cited by 179
“It also provides a control function estimate of the parameter (Heckman and Navarro 2004).11 If the residuals’ coefficient is not significantly different from zero the hypothesis can be rejected that the disturbance term in the growth equation is correlated with the innovation measure.12 In these…”
BackgroundA practical guide to propensity score analysis for applied clinical research
Lee, J., & Little, T. D. (2017) · Behaviour Research and Therapy · doi:10.1016/j.brat.2017.01.005 · Cited by 155
Applied Bayesian Modeling And Causal Inference From Incomplete-Data Perspectives
Gelman, A., & Xiaoli, M. (2014) · Cited by 156
Impacts of free-floating bikesharing system on public transit ridership
Ma, X., Zhang, X., Li, X., Wang, X., & Zhao, X. (2019) · Transportation Research Part D Transport and Environment · doi:10.1016/j.trd.2019.09.014 · Cited by 151
The impact of FDI through mergers and acquisitions on innovation in target firms
Stiebale, J., & Reize, F. (2010) · International Journal of Industrial Organization · doi:10.1016/j.ijindorg.2010.06.003 · Cited by 150
Mutual Fund Transparency and Corporate Myopia
Agarwal, V., Vashishtha, R., & Venkatachalam, M. (2016) · Review of Financial Studies · doi:10.1093/rfs/hhx125 · Cited by 167
Welfare Reform and Lone Parents in the UK
Gregg, P., Harkness, S., & Smith, S. S. (2009) · The Economic Journal · doi:10.1111/j.1468-0297.2008.02226.x · Cited by 150
Propensity Score Matching: An Illustrative Analysis of Dose Response
Foster, E. M. (2003) · Medical Care · doi:10.1097/01.mlr.0000089629.62884.22 · Cited by 143
Sheepskin or Prozac: The Causal Effect of Education on Mental Health
Chevalier, A., & Feinstein, L. (2006) · SSRN Electronic Journal · doi:10.2139/ssrn.923530 · Cited by 145
“Here the treatment is defined as the level of education.”
BackgroundThe long-run labour market consequences of teenage motherhood in Britain
Chevalier, A., & Viitanen, T. K. (2003) · Journal of Population Economics · doi:10.1007/s001480200125 · Cited by 206
“The second method relies on creating a synthetic individua l for each teenage mother, which is based on the kernel-weight average of the characteristics of the nearest control persons (Heckman et al. (1997) .”
MethodDoes bankruptcy law improve the fate of distressed firms? The role of credit channels
Bose, U., Filomeni, S., & Mallick, S. (2020) · Journal of Corporate Finance · doi:10.1016/j.jcorpfin.2020.101836 · Cited by 174
“It is for this reason that we now consider a non-parametric method – propensity score matching (hereafter PSM) – to accommodate this potential endogeneity (see Heckman et al., 1997, 1998; Mallick and Yang, 2013). PSM technique enables ‘like-forlike’ comparison and it is an appropriate method to examine the relationshi…”
MethodKoch, N., & Basse Mama, H. (2019) · Energy Economics · doi:10.1016/j.eneco.2019.04.018 · Cited by 148
Family firms and firm performance: Evidence from Japan
Saito, T. (2008) · Journal of the Japanese and International Economies · doi:10.1016/j.jjie.2008.06.001 · Cited by 188
“We tackle this issue using a treatment effects model that estimates jointly the probability of being a family firm, and an outcome equation for market valuation (Maddala, 1983; Heckman et al., 1997; Green, 2000; Wooldridge, 2002).”
Agricultural Productivity and Forest Conservation: Evidence from the Brazilian Amazon
Koch, N., zu Ermgassen, E. K. H. J., Wehkamp, J., Oliveira Filho, F. J. B., & Schwerhoff, G. (2019) · American Journal of Agricultural Economics · doi:10.1093/ajae/aay110 · Cited by 130
“Following Cisneros et al. (2015), this can be tested by using the non-PL neighbors of priority municipalities as if treated.”
Heterogeneous responses of firms to trade protection
Konings, J., & Vandenbussche, H. (2008) · Journal of International Economics · doi:10.1016/j.jinteco.2008.08.002 · Cited by 180
“In addition to a fixed cost of exporting (Melitz, 2003; Helpman, 2006), the model assumes a fixed cost of productivity improving investment.”
BackgroundDetecting and Statistically Correcting Sample Selection Bias
Cuddeback, G. S., Wilson, E., Orme, J. G., & Combs-Orme, T. D. (2004) · Journal of Social Service Research · doi:10.1300/j079v30n03_02 · Cited by 147
COMMUTING TIME AND HOUSEHOLD RESPONSIBILITIES: EVIDENCE USING PROPENSITY SCORE MATCHING
Giménez-Nadal, J. I., & Molina, J. A. (2015) · Journal of Regional Science · doi:10.1111/jors.12243 · Cited by 186
Bondonio, D., & Greenbaum, R. T. (2012) · European Urban and Regional Studies · doi:10.1177/0969776411432986 · Cited by 146
“…interventions considered in the analysis, from a probit regression model yielding the firm-specific predicted probabilities of receiving that particular type of program assistance (for example, Rosenbaum and Rubin, 1983; Heckman et al., 1997, 1998; Bondonio, 2009; Bondonio and Engberg, 2000).”
MethodHow Does the Business Cycle Affect Eating Habits?
Dave, D., & Kelly, I. R. (2010) · Social Science & Medicine · doi:10.1016/j.socscimed.2011.10.005 · Cited by 146
Changes in Hospital Quality Associated with Hospital Value-Based Purchasing
Ryan, A. M., Krinsky, S., Maurer, K. A., & Dimick, J. B. (2017) · New England Journal of Medicine · doi:10.1056/nejmsa1613412 · Cited by 161
Measures, drivers and effects of green employment: evidence from US local labor markets, 2006–2014
Vona, F., Marin, G., & Consoli, D. (2018) · Journal of Economic Geography · doi:10.1093/jeg/lby038 · Cited by 181
Land Values in a Newly Zoned City
McMillen, D. P., & McDonald, J. F. (2002) · The Review of Economics and Statistics · doi:10.1162/003465302317331928 · Cited by 171
“The availability of land value data before and after zoning permits us to use recent extensions (Heckman, Smith, & Clements, 1997; Heckman, Ichimura, & Todd, 1997, 1998; Heckman et al., 1998) of Rosenbaum and Rubin’s (1983) propensity score Received for publication April 2, 1998. Revision accepted for publication Febr…”
MethodInfluentialThe effect of community college enrollment on bachelor's degree completion
Doyle, W. R. (2008) · Economics of Education Review · doi:10.1016/j.econedurev.2008.01.006 · Cited by 169
Self-Selection and Post-Entry Effects of Exports: Evidence from Italian Manufacturing Firms
Serti, F., & Tomasi, C. (2008) · Review of World Economics · doi:10.1007/s10290-008-0165-9 · Cited by 176
“Arnold and Hussinger (2005), who also employ a PSM-DID methodology, instead compare exporters with non exporters (not starters with never exporters) and includes lagged export status as a regressor in their “pooled” propensity score estimation.”
BackgroundMethodInfluentialKnowledge training and the change of fertilizer use intensity: Evidence from wheat farmers in China
Pan, D., Kong, F., Zhang, N., & Ying, R. (2017) · Journal of Environmental Management · doi:10.1016/j.jenvman.2017.03.069 · Cited by 150
Who should be treated? Empirical welfare maximization methods for treatment choice
Kitagawa, T., & Tetenov, A. (2017) · doi:10.1920/wp.cem.2017.2417 · Cited by 145
Impact of urban-rural health insurance integration on health care: Evidence from rural China
Huang, X. L., & Wu, B. (2020) · China Economic Review · doi:10.1016/j.chieco.2020.101543 · Cited by 143
MULTINATIONALS’ PRODUCTIVITY ADVANTAGE: SCALE OR TECHNOLOGY?
Girma, S., & Görg, H. (2007) · Economic Inquiry · doi:10.1111/j.1465-7295.2006.00008.x · Cited by 171
“Following the microeconometric evaluation literature such as that by Heckman et al. (1997), we defined the average effect of acquisition on the acquired plants as”
Tax Administration versus Tax Rates: Evidence from Corporate Taxation in Indonesia
Basri, M. C., Felix, M., Hanna, R., & Olken, B. (2021) · American Economic Review · doi:10.1257/aer.20201237 · Cited by 186
Can direct innovation subsidies relax SMEs’ financial constraints?
Chiappini, R., Montmartin, B., Pommet, S., & Demaria, S. (2022) · Research Policy · doi:10.1016/j.respol.2022.104493 · Cited by 152
Liu, L., Wang, Y., & Xu, Y. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3555463 · Cited by 142
Verde, S. F. (2020) · Journal of Economic Surveys · doi:10.1111/joes.12356 · Cited by 142
Global value chains participation and productivity gains for North African firms
Prete, D. D., Giovannetti, G., & Marvasi, E. (2017) · Review of World Economics · doi:10.1007/s10290-017-0292-2 · Cited by 158
“Finally, average out those double differences across matched subgroups (Card and Krueger 1994; Heckman et al. 1997; Caliendo and Kopeinig 2008).”
Eliason, M. (2011) · Journal of Population Economics · doi:10.1007/s00148-011-0394-4 · Cited by 181
“This method originates in statistics (Rosenbaum and Rubin, 1983, 1984) and has lately received increasing attention in economics (See Heckman et al., 1997; Dehejia and Wahba, 1999, 2002; Sianesi, 2001, 2002; Lechner, 2002a, b; Larsson, 2003 and Smith and Todd, 2004).”
MethodTHE IMPACT OF PROGRESA ON WORK, LEISURE, AND TIME ALLOCATION
Parker, S. W., & Skoufias, E. (2000) · IFPRI E-brary (International Food Policy Research Institute) · Cited by 153
Krause, R. M. (2012) · Review of Policy Research · doi:10.1111/j.1541-1338.2012.00582.x · Cited by 141
Tian, Z., Tian, Y., Chen, Y., & Shao, S. (2020) · Business Strategy and the Environment · doi:10.1002/bse.2464 · Cited by 141
Programme Evaluation with Multiple Treatments
Frölich, M. (2004) · Journal of Economic Surveys · doi:10.1111/j.0950-0804.2004.00001.x · Cited by 171
“…reason, propensity score matching has been used in many applied evaluation studies, e.g. Brodaty et al. (2001), Dehejia andWahba (1999), Frölich et al. (2000), Gerfin and Lechner (2002), Heckman et al. (1997, 1998), Jalan and Ravallion (2002), Larsson (2000), Lechner (1999), Puhani (1999) etc.”
BackgroundMethodInfluentialThe Impact Of Carbon Trading On Industry: Evidence From German Manufacturing Firms
Wagner, U. J., Rehdanz, K., & Petrick, S. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2389800 · Cited by 140
Dismissals for Cause: The Difference That Just Eight Paragraphs Can Make
Martins, P. S. (2009) · Journal of Labor Economics · doi:10.1086/599978 · Cited by 179
“In order to address this possible shortcoming, I also complement it with a matching framework (Rosenbaum and Rubin 1983), resulting in a difference-in-differences matching (DDM) estimator (Heckman, Ichimura, and Todd 1997, 1998).”
Sensitivity of matching-based program evaluations to the availability of control variables
Lechner, M., & Wunsch, C. (2013) · Labour Economics · doi:10.1016/j.labeco.2013.01.004 · Cited by 185
“…U.S.3 to obtain a benchmark estimate of the effect of interest (LaLonde, 1986, Fraker and Maynard, 1987, Friedlander and Robins, 1995, Heckman and Smith, 1999, Dehejia and Wahba, 1999, 2002; Heckman, Ichimura, and Todd, 1997, 1998, Heckman, Ichimura, Smith, and Todd, 1998, and Smith and Todd 2005).”
BackgroundResultApplying Propensity Score Methods in Medical Research: Pitfalls and Prospects
Luo, Z., Gardiner, J. C., & Bradley, C. J. (2010) · Medical Care Research and Review · doi:10.1177/1077558710361486 · Cited by 138
“This is similar to the evaluation test proposed by Heckman, Ichimura, and Todd (1997) in the context of evaluating training programs.”
MethodShould China further expand its high-speed rail network? Consider the low-cost carrier factor
Wang, K., Xia, W., & Zhang, A. (2017) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2017.04.010 · Cited by 160
Briggeman, B. C., Towe, C., & Morehart, M. J. (2009) · American Journal of Agricultural Economics · doi:10.1111/j.1467-8276.2008.01173.x · Cited by 179
“Applications of propensity score-matching are now quite prevalent in the literature, especially in labor economics where the evaluation of job training programs represents a significant challenge (such as Heckman, Ichimura, and Todd 1997; Dehejia and Wahba 2002; Lechner 2002; Smith and Todd 2005a).”
BackgroundEvaluating the employment impact of a mandatory job search assistance program
Meghir, C., Van Reenen, J., Blundell, R., & Costa Dias, M. (2001) · Working Paper Series · doi:10.1920/wp.ifs.2001.0120 · Cited by 132
Getting the unemployed back to work: the role of targeted wage subsidies
Bell, B., Blundell, R., & Van Reenen, J. (1999) · Working Paper Series · doi:10.1920/wp.ifs.1999.9912 · Cited by 139
Targeted Remedial Education for Underperforming Teenagers: Costs and Benefits
Lavy, V., & Schlosser, A. (2005) · Journal of Labor Economics · doi:10.1086/491609 · Cited by 137
From quality to innovation: Evidence from two French Employer Surveys
Peković, S., & Galia, F. (2009) · Technovation · doi:10.1016/j.technovation.2009.08.002 · Cited by 137
Aid for all: College coaching, financial aid, and post-secondary persistence in Tennessee
Carruthers, C. K., & Fox, W. F. (2015) · Economics of Education Review · doi:10.1016/j.econedurev.2015.06.001 · Cited by 158
“Matching methods have a rich tradition in applied labor economics research, beginning with Heckman, Ichimura, and Todd (1997), although more parametric methods based on ordinary least squares (OLS) identification remain the dominant nonexperimental tool to account for selection-on-observables in…”
MethodVenture Capital Conflicts of Interest: Evidence from Acquisitions of Venture-Backed Firms
Masulis, R. W., & Nahata, R. (2010) · Journal of Financial and Quantitative Analysis · doi:10.1017/s0022109010000827 · Cited by 154
Baiyegunhi, L. J. S., Majokweni, Z.-Z. P., & Ferrer, S. (2018) · Technology in Society · doi:10.1016/j.techsoc.2018.11.003 · Cited by 145
Friendly Boards and Innovation
Kang, J., Liu, W., Low, A., & Zhang, L. (2012) · Journal of Empirical Finance · doi:10.1016/j.jempfin.2017.09.007 · Cited by 136
The employment effects of job-creation schemes in Germany: A microeconometric evaluation
Caliendo, M., Hujer, R., & Thomsen, S. L. (2008) · Advances in econometrics · doi:10.1016/s0731-9053(07)00013-8 · Cited by 159
“If assumption 1 is fulfilled, the non-participant outcomes have, conditional on P (X), the same distribution that participants would have experienced if they had not participated in the programme (Heckman, Ichimura, and Todd, 1997).”
InfluentialHow green is the “Belt and Road Initiative”? – Evidence from Chinese OFDI in the energy sector
Liu, H., Wang, Y., Jiang, J., & Wu, P. (2020) · Energy Policy · doi:10.1016/j.enpol.2020.111709 · Cited by 135
Do firms' relationships with principal customers/suppliers affect shareholders' income?
Wang, J. (2012) · Journal of Corporate Finance · doi:10.1016/j.jcorpfin.2012.06.007 · Cited by 135
Damijan, J. P., & Kostevc, Č. (2006) · Review of World Economics · doi:10.1007/s10290-006-0083-7 · Cited by 164
“9 Finally, we also apply matching ( Heckman et al. 1997, 1998 ) and differencein-differences (Blundell and Costa Dias 2000) techniques in order to obtain more detailed evidence of the existence of learning-by-exporting.”
MethodExport market exit and performance dynamics: a causality analysis of matched firms
Girma, S., Greenaway, D., & Kneller, R. (2003) · Economics Letters · doi:10.1016/s0165-1765(03)00092-2 · Cited by 156
“Following the microeconometric evaluation literature (e.g. Heckman et al, 1997), we define the average effect of exit as { } { } { } 1 | 1 | 1 | 0 1 0 1 = − = = = − + + + + it s t it s t it s t s t EXIT y E EXIT y E EXIT y y E (3) Causal inference relies on the construction of the counterfactual,…”
An Evaluation of the Performance of Regression Discontinuity Design on PROGRESA
Buddelmeyer, H., & Skoufias, E. (2004) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-3386 · Cited by 130
Navaretti, G. B., Castellani, D., & Disdier, A. (2009) · Oxford Economic Papers · doi:10.1093/oep/gpp010 · Cited by 168
“To overcome the problem of self-selection we use the method of propensity score matching, which aims at re-establishing the conditions of a natural experiment with non-experimental data (Heckman et al., 1997; Blundell et al., 2004).”
Meng, X., Lin, S., & Zhu, X. (2018) · Transport Policy · doi:10.1016/j.tranpol.2018.05.006 · Cited by 134
Evaluating the impact of education on earnings in the UK: Models, methods and results from the NCDS
Sianesi, B., Dearden, L., & Blundell, R. (2003) · Working Paper Series · doi:10.1920/wp.ifs.2003.0320 · Cited by 134
“Heckman, Smith and Clements (1997) , Dearden (1999a and 1999b) and Blundell, Dearden,”
BackgroundChang, P.-L., & Lee, M.-J. (2011) · Journal of International Economics · doi:10.1016/j.jinteco.2011.05.011 · Cited by 128
“Studies by Helpman et al. (2008) and Felbermayr and Kohler”
BackgroundMethodInfluentialFu, R., Noguchi, H., Kawamura, A., Takahashi, H., & Tamiya, N. (2017) · Journal of Health Economics · doi:10.1016/j.jhealeco.2017.09.011 · Cited by 148
Hernandez‐Aguilera, J. N., Gomez, M. I., Rodewald, A. D., Rueda, X., Anunu, C., Bennett, R. E., & van Es, H. M. (2018) · Business Strategy and the Environment · doi:10.1002/bse.2009 · Cited by 142
Taxes on the Internet: Deterrence Effects of Public Disclosure
Bø, E. E., Slemrod, J., & Thoresen, T. O. (2015) · American Economic Journal: Economic Policy · doi:10.1257/pol.20130330 · Cited by 112
“The latter study shows empirical evidence of more tax evasion among doctors, engineers, private tutors, financial s ervices agents, 34 See also Heckman, Ichimura, and Todd (1997) and Abadie (2005) for approaches to matching.”
Chabé‐Ferret, S. (2014) · Journal of Econometrics · doi:10.1016/j.jeconom.2014.09.013 · Cited by 158
“It is thus an instance of the DID Matching estimator introduced by Heckman, Ichimura, and Todd (1997).”
MethodGhose, A., & Todri-Adamopoulos, V. (2016) · MIS Quarterly · doi:10.25300/misq/2016/40.4.05 · Cited by 132
“Heckman et al. (1997) developed the generalized differencein-differences matching estimator that allows for temporally time-invariant differences in outcomes between the treated and non-treated individuals.”
BackgroundThe effects at home of initiating production abroad: evidence from matched French firms
Hijzen, A., Jean, S., & Mayer, T. (2011) · Review of World Economics · doi:10.1007/s10290-011-0094-x · Cited by 162
The Effect of Mergers in Search Markets: Evidence from the Canadian Mortgage Industry
Allen, J., Clark, R., & Houde, J.-F. (2014) · American Economic Review · doi:10.1257/aer.104.10.3365 · Cited by 126
List, J. A., McHone, W. W., & Millimet, D. L. (2004) · Journal of Urban Economics · doi:10.1016/j.jue.2004.03.007 · Cited by 153
Chaudhury, N., & Parajuli, D. (2006) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-4102 · Cited by 131
Covariate balancing propensity score by tailored loss functions
Zhao, Q. (2019) · The Annals of Statistics · doi:10.1214/18-aos1698 · Cited by 119
The value of government ownership during the global financial crisis
Beuselinck, C., Cao, L., Deloof, M., & Xia, X. (2015) · Journal of Corporate Finance · doi:10.1016/j.jcorpfin.2015.05.002 · Cited by 143
“Following Heckman, Ichimura, and Todd (1997), and Smith and Todd (2005), we impose common support constraint by dropping treatment observations whose propensity score is higher than the maximum or less than the minimum propensity score of the controls.”
BackgroundEvaluating Social Programs with Endogenous Program Placement and Selection of the TreatedPreprint
Todd, P. (2008) · RePEc: Research Papers in Economics · Cited by 134
Self-citationMedina, C., & Cardona‐Sosa, L. (2010) · Lecturas de Economía · doi:10.17533/udea.le.n72a6498 · Cited by 147
Causal inference and data fusion in econometrics
Hünermund, P., & Bareinboim, E. (2023) · Econometrics Journal · doi:10.1093/ectj/utad008 · Cited by 161
“…present an interesting application of the frontdoor criterion (FDC) for evaluating the effect of the National Job Training Partnership Act program (Heckman et al., 1997) on earnings by complementing the FDC with a difference-in-differences-type identification approach that tackles potential bias…”
MethodKnowledge to money: Assessing the business performance effects of publicly-funded R&D grants
Vanino, E., Roper, S., & Becker, B. (2019) · Research Policy · doi:10.1016/j.respol.2019.04.001 · Cited by 145
“Finally, we have clustered the standard errors following the Abadie and Imbens (2011) methodology for the Nearest-Neighbour matching procedure to take into account the additional source of variability introduced by the estimation of the propensity score (Heckman et al., 1997).”
Danso-Abbeam, G., Dagunga, G., & Ehiakpor, D. S. (2020) · Heliyon · doi:10.1016/j.heliyon.2020.e05393 · Cited by 141
Xu, A., Song, M., Wu, Y., Luo, Y., Zhu, Y., & Qiu, K. (2024) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2023.123164 · Cited by 135
Measuring the impact of fair trade on development
Ruben, R., Fort, R., & Zúñiga-Arias, G. E. (2009) · Development in Practice · doi:10.1080/09614520903027049 · Cited by 127
Assisting the Transition from Workfare to Work: A Randomized Experiment
Galasso, E., Ravallion, M. D., & Salvia, A. (2004) · Industrial and Labor Relations Review · doi:10.2307/4126640 · Cited by 146
THE EFFECTS OF EXPANDING THE GENEROSITY OF THE STATUTORY SICKNESS INSURANCE SYSTEM
Ziebarth, N. R., & Karlsson, M. (2013) · Journal of Applied Econometrics · doi:10.1002/jae.2317 · Cited by 146
Sinyolo, S. (2019) · Technology in Society · doi:10.1016/j.techsoc.2019.101214 · Cited by 142
Assumptions of Value-Added Models for Estimating School Effects
Reardon, S. F., & Raudenbush, S. W. (2009) · Education Finance and Policy · doi:10.1162/edfp.2009.4.4.492 · Cited by 124
Lin, B., Wu, W., & Song, M. (2019) · Annals of Operations Research · doi:10.1007/s10479-019-03433-6 · Cited by 131
Close Enough? A Large-Scale Exploration of Non-Experimental Approaches to Advertising Measurement
Gordon, B. R., Moakler, R., & Zettelmeyer, F. (2022) · Marketing Science · doi:10.1287/mksc.2022.1413 · Cited by 153
A Review of Spatial Causal Inference Methods for Environmental and Epidemiological Applications
Reich, B. J., Yang, S., Guan, Y., Giffin, A., Miller, M. J., & Rappold, A. G. (2021) · International Statistical Review · doi:10.1111/insr.12452 · Cited by 170
“cedures such as (augmented) inverse probability weighting (e.g., Rosenbaum and Rubin, 1983a; Robins and Greenland, 1994; Bang and Robins, 2005; Cao et al., 2009), and matching (e.g., Rosenbaum, 1989; Heckman et al., 1997; Hirano et al., 2003; Hansen, 2004; Rubin, 2006; Abadie and Imbens, 2006; Stuart, 2010; Abadie and…”
BackgroundLi, Y., Zhang, J., Yang, X., Wang, W., Wu, H., Ran, Q., & Luo, R. (2021) · Sustainable Production and Consumption · doi:10.1016/j.spc.2021.09.012 · Cited by 128
Kandilov, I. T., & Renkow, M. (2010) · Growth and Change · doi:10.1111/j.1468-2257.2010.00524.x · Cited by 125
DOES ACCESS TO IMPROVED SANITATION REDUCE CHILDHOOD DIARRHEA IN RURAL INDIA?
Kumar, S., & Vollmer, S. (2012) · Health Economics · doi:10.1002/hec.2809 · Cited by 141
“…E Y1i Di ¼ 1; p Xið Þj g E Y0i Di ¼ 0; p Xið Þj g Di ¼ 1j ff½ (2) Equation (2) gives the average program impact under the conditional independence (CIA)14 and overlap assumption.15 13See Dehijia and Wahba (1999), Heckman et al. (1997), Smith and Todd (2005) for an evaluation of matching estimators.”
BackgroundCosts and benefits of Danish active labour market programmes
Jespersen, S. T., Munch, J. R., & Skipper, L. (2007) · Labour Economics · doi:10.1016/j.labeco.2007.07.005 · Cited by 176
“As noted by Heckman et al. (1999), the primary social benefit reported in most cost-benefit analyses is the discounted earnings gain, which is usually of far larger magnitude than other measured benefits. Therefore it is important to obtain credible and precise estimates of the earnings gain. We calculate treatment ef…”
BackgroundMethodInfluentialAutomatic Bill Payment and Salience Effects: Evidence from Electricity Consumption
Sexton, S. (2014) · The Review of Economics and Statistics · doi:10.1162/rest_a_00465 · Cited by 141
A comparison of CEO pay–performance sensitivity in privately-held and public firms
Gao, H., & Li, K. (2015) · Journal of Corporate Finance · doi:10.1016/j.jcorpfin.2015.10.005 · Cited by 139
“The matching procedure that we employ is a one-to-one nearest neighbor matching with replacement (Heckman et al. (1997)).”
Method
Metadata
- Authors
- Heckman, J. J., Ichimura, H., & Todd, P. E.
- Affiliations
- University of Chicago (US)
- University of Pittsburgh (US)
- University of Pennsylvania (US)
- Venue
- The Review of Economic Studies
- Publisher
- Oxford University Press (OUP)
- Published
- 1997-10-01
- Volume
- 64
- Issue
- 4
- Pages
- 605-654
- ISSN
- 0034-6527 (ISSN-L)
- 1467-937X
- OpenAlex
- W2066735350
- Semantic Scholar
- ec958b198d3b6712d1e0f3395a05ff2b0136a1bb
- Cited by
- 5,486
- References
- 32
- Citations by year
- 2026: 216 · 2025: 268 · 2024: 271 · 2023: 292 · 2022: 296 · 2021: 246 · 2020: 254 · 2019: 244 · 2018: 269 · 2017: 236 · 2016: 231 · 2015: 251 · 2014: 266 · 2013: 248 · 2012: 275
- FWCI
- 20.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Review of Economic Studies (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- selection on unobservables, sample selection model, identifying assumptions, omitted variables
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.