Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme
The DOI matches its Crossref record; 31 of the 32 references it cites were found in a registry or an index.
Abstract
This paper considers whether it is possible to devise a nonexperimental procedure for evaluating a prototypical job training programme. Using rich nonexperimental data, we examine the performance of a two-stage evaluation methodology that (a) estimates the probability that a person participates in a programme and (b) uses the estimated probability in extensions of the classical method of matching. We decompose the conventional measure of programme evaluation bias into several components and find that bias due to selection on unobservables, commonly called selection bias in econometrics, is empirically less important than other components, although it is still a sizeable fraction of the estimated programme impact. Matching methods applied to comparison groups located in the same labour markets as participants and administered the same questionnaire eliminate much of the bias as conventionally measured, but the remaining bias is a considerable fraction of experimentally-determined programme impact estimates. We test and reject the identifying assumptions that justify the classical method of matching. We present a nonparametric conditional difference-in-differences extension of the method of matching that is consistent with the classical index-sufficient sample selection model and is not rejected by our tests of identifying assumptions. This estimator is effective in eliminating bias, especially when it is due to temporally-invariant omitted variables.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For the OR approach, the consistency of the ATT estimator (2.2) relies on the estimators of md , t ( · ) , ̂ µ d , t ( · ) , being correctly specified, whereas the IPW estimator (2.4) relies on the propensity score estimator ̂ π ( · ) of p ( · ) being correctly specified.”
From Doubly robust difference-in-differences estimators (2020) · cites this paper as Heckman et al. (1997)
In the citing paper
“These fall into two main categories, which we denote trajectory modeling [28, 29, 86, 88, 95] and propensity score weighting [17, 30].”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“Doubly robust (DR) estimators combine trajectory modeling and propensity score estimation and produce consistent estimates if either the trajectory model or the propensity score model is correctly specified: [29]”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“The OR, IPW and DR estimands respectively generalize Heckman et al. (1997), Abadie (2005) and Sant'Anna and Zhao (2020) estimands for the two groups, two periods DiD setup to the staggered DiD setup with multiple periods and multiple groups.”
From Difference-in-Differences with multiple time periods (2021) · cites this paper as Heckman et al. (1997)
In the citing paper
“CS also derives estimators that are consistent for AT T (g, τ ) under more general conditions, such as when the parallel-trends assumption holds conditionally on covariates, including an outcome-regression-based estimator”
From How Much Should We Trust Staggered Difference-in-Differences Estimates? (2022) · cites this paper as Heckman et al., 1997
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,796
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774
SOME THOUGHTS ON THE DISTRIBUTION OF EARNINGS 1
ROY, A. D. (1951) · Oxford Economic Papers · doi:10.1093/oxfordjournals.oep.a041827 · Cited by 2,958
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503
Estimating the Effect of Training Programs on Earnings
Ashenfelter, O. (1978) · The Review of Economics and Statistics · doi:10.2307/1924332 · Cited by 1,515
Design-adaptive Nonparametric Regression
Fan, J. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10476255 · Cited by 1,268
The Estimation of Choice Probabilities from Choice Based Samples
Manski, C. F., & Lerman, S. R. (1977) · Econometrica · doi:10.2307/1914121 · Cited by 1,208
Cited by
Items 601–700 of 1,029
The Certification Role of Large Customers in the New Issues Market
Johnson, W. C., Kang, J., & Yi, S. (2010) · Financial Management · doi:10.1111/j.1755-053x.2010.01118.x · Cited by 105
The Impact of Academic Patenting on the Rate, Quality, and Direction of (Public) Research Output
Azoulay, P., Ding, W. W., & Stuart, T. E. (2006) · National Bureau of Economic Research · doi:10.3386/w11917 · Cited by 126
Reynolds, C. L., & DesJardins, S. L. (2009) · Higher Education: Handbook of Theory and Research · doi:10.1007/978-1-4020-9628-0_2 · Cited by 104
“Herein we discuss matching methods, which are cited as a potential tool to help social scientists make strong inferential statements using observational data (Rosenbaum and Rubin, 1983; Heckman et al., 1997; Dehejia and Wahba, 2002; Smith and Todd 2005a,b; Morgan and Harding, 2006; Caliendo and Kopeinig, 2008).”
MethodHong, S. (2011) · Journal of Applied Econometrics · doi:10.1002/jae.1269 · Cited by 125
International standards certification, institutional voids and exports from developing country firms
Goedhuys, M., & Sleuwaegen, L. E. (2016) · International Business Review · doi:10.1016/j.ibusrev.2016.04.006 · Cited by 123
Difference-in-Differences Hedonics
Banzhaf, H. S. (2021) · Journal of Political Economy · doi:10.1086/714442 · Cited by 132
“DUETða*Þ might be estimated using a regression-adjusted DD matching estimator (e.g., Heckman, Ichimura, and Todd 1997).”
MethodProductivity Performance of Export Market Entry and Exit: Evidence from I ndian Firms
Mallick, S., & Yang, Y. G. (2013) · Review of International Economics · doi:10.1111/roie.12072 · Cited by 122
Mobility of public researchers, scientific knowledge transfer, and the firm's innovation process
Herrera, L., Doyague, M. F. M., & Antolín, M. N. (2009) · Journal of Business Research · doi:10.1016/j.jbusres.2009.04.010 · Cited by 121
“Though all the methods arrive at the same result, in accordance with Heckman, Ichimura, and Todd (1997), the choice between one method and another is only important in the case of small samples.”
ResultBarriers to Competition and Productivity: Evidence from India
Sivadasan, J. (2009) · The B E Journal of Economic Analysis & Policy · doi:10.2202/1935-1682.2161 · Cited by 121
Clair, T. S., Cook, T. D., & Hallberg, K. (2014) · American Journal of Evaluation · doi:10.1177/1098214014527337 · Cited by 103
Selection and Moral Hazard in the Reverse Mortgage MarketPreprint
Davidoff, T., & Welke, G. (2004) · SSRN Electronic Journal · doi:10.2139/ssrn.608666 · Cited by 118
Character development among youth: Linking lives in time and place
Lerner, R. M. (2017) · International Journal of Behavioral Development · doi:10.1177/0165025417711057 · Cited by 121
A Multidimensional Approach to Measuring Fuel Poverty
Charlier, D., & Legendre, B. (2019) · The Energy Journal · doi:10.5547/01956574.40.2.bleg · Cited by 102
“Bootstrapping standard errors also enabled us to take into account the variance due to derivation of the propensity score matching and determination of the common support ( Efron and Tibshirani, 1993 ; Heckman et al., 1997 ; Horowitz, 2003).”
MethodLong-term costs of intimate partner violence in a sample of female HMO enrollees
Jones, A. S., Dienemann, J. A., Schollenberger, J., Kub, J. E., O'Campo, P. J., GIELEN, A. C., & Campbell, J. C. (2006) · Women s Health Issues · doi:10.1016/j.whi.2006.06.007 · Cited by 122
“Consequently, these differences could produce biased estimates of cost differences attributable to IPV ( Heckman, Ichimura, & Todd, 1997 ).”
BackgroundRoad injuries and long‐run effects on income and employment
Danø, A. M. (2005) · Health Economics · doi:10.1002/hec.1045 · Cited by 128
Microfinance and Household Poverty Reduction: Empirical Evidence from Rural Pakistan
Ghalib, A. K., Malki, I., & Imai, K. S. (2014) · Oxford Development Studies · doi:10.1080/13600818.2014.980228 · Cited by 128
Do the Poor Benefit from Devolution Policies? Evidence from Malawi's Forest Co-Management Program
Jumbe, C. B., & Angelsen, A. (2006) · Land Economics · doi:10.3368/le.82.4.562 · Cited by 131
Spillovers from universities: Evidence from the land-grant program
Liu, S. (2015) · Journal of Urban Economics · doi:10.1016/j.jue.2015.03.001 · Cited by 134
“7 Heckman et al. (1996) and Heckman et al. (1997) point out the failure of ‘‘common support condition’’ can result in a substantial bias of matching estimator.”
Qualitative & Multi-Method Research
Tanner, S. (2014) · Cited by 102
An evaluation of systemic reforms of public hospitals: the Sanming model in China
Fu, H., Li, L., Li, M., Yang, C., & Hsiao, W. C. L. (2017) · Health Policy and Planning · doi:10.1093/heapol/czx058 · Cited by 106
“Since we have outcomes both before and after the hospital was under the reform, our matching is a DID propensity score matching (Heckman et al. 1997).”
MethodAccounting for the role of habit in regular saving
Loibl, C., Kraybill, D. S., & DeMay, S. W. (2011) · Journal of Economic Psychology · doi:10.1016/j.joep.2011.04.004 · Cited by 109
Does Leaving Home Make You Poor? Evidence from 13 European Countries
Aassve, A., Davia, M. A., Iacovou, M., & Mazzuco, S. (2007) · European Journal of Population / Revue européenne de Démographie · doi:10.1007/s10680-007-9135-5 · Cited by 130
“That is, provided unobserved heterogeneity is fixed over time, its effect will be netted out by taking first differences in deprivation scores (Heckman et al., 1998).”
BackgroundAbebaw, D., Fentie, Y., & Kassa, B. (2010) · Food Policy · doi:10.1016/j.foodpol.2010.01.002 · Cited by 101
Does microfinance change informal lending in village economies? Evidence from Bangladesh
Islam, A., Nguyen, C., & Smyth, R. (2014) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2014.10.001 · Cited by 116
“We then apply the kernel matching method following Smith and Todd (2005), Heckman et al. (1997) and Heckman et al. (1998b).”
MethodThe effects of job displacement on job quality: Findings from the Wisconsin Longitudinal Study
Brand, J. E. (2006) · Research in Social Stratification and Mobility · doi:10.1016/j.rssm.2006.03.001 · Cited by 126
Does school ownership matter? An unbiased efficiency comparison for regions of Spain
Cebada, E. C., Chaparro, F. P., & González, D. S. (2013) · Journal of Productivity Analysis · doi:10.1007/s11123-013-0338-y · Cited by 120
Mao, C.-W. (2018) · Quality & Quantity · doi:10.1007/s11135-018-0722-9 · Cited by 112
Improving Child Nutrition? The Integrated Child Development Services in India
Lokshin, M. M., Gupta, M. D., Gragnolati, M., & Ivaschenko, O. (2005) · Development and Change · doi:10.1111/j.0012-155x.2005.00427.x · Cited by 100
“Matching estimators require that conditionals on a vector of observed characteristics, x (z1 and z0), are independent of s. Children for whom a match could not be found were dropped from the analysis in order to avoid the primary cause of a bias in a matching estimator (Heckman et al., 1997, 1998).”
BackgroundAmeha, A., Nielsen, Ø. J., & Larsen, H. O. (2013) · Ecological Economics · doi:10.1016/j.ecolecon.2013.11.011 · Cited by 113
On the International Effects of Inflation Targeting
Lin, S. (2010) · The Review of Economics and Statistics · doi:10.1162/rest.2009.11553 · Cited by 100
“In this section, we estimate the overall treatment effects of adopting inflation targeting using the pooled sample that contains both indus- 6 See Dehejia and Wahba (2002) and Heckman, Ichimura, and Todd (1997, 1998) for detailed discussions.”
MethodAre the benefits of export support durable? Evidence from Tunisia
Cadot, O., Fernandes, A. M., Gourdon, J., & Mattoo, A. (2015) · Journal of International Economics · doi:10.1016/j.jinteco.2015.07.005 · Cited by 115
“The standard approach is the difference-in-differences (DID) estimator combined with propensity-score matching (PSM-DID) proposed by Heckman, Ichimura, and Todd (1997), which has been widely used in the evaluation of export promotion (Görg, Henry and Strobl, 2008; Volpe and Carballo, 2008).”
Can Marketing Campaigns Induce Multichannel Buying and More Profitable Customers? A Field Experiment
Montaguti, E., Neslin, S. A., & Valentini, S. (2015) · Marketing Science · doi:10.1287/mksc.2015.0923 · Cited by 113
“We use PSM (Step 3 in Figure 4), in particular the kernel-Gaussian PSM procedure in STATA (Leuven and Sianesi 2003; Heckman et al. 1997).”
MethodUsing Matched Samples to Test for Differences in Trade Execution Costs
Davies, R. J., & Kim, S. S. (2007) · Journal of Financial Markets · doi:10.2139/ssrn.555182 · Cited by 110
“Heckman, Ichimura, and Todd (1997, 1998) describe the theory underlying matched sample estimation in the context of labor economics.3 They use matched sample estimation to compare the mean post-programme earnings of job-training programme participants with the mean earnings of comparable…”
Zhang, Y., Guo, S., Shi, X., Qian, X.-Y., & Nie, R. (2021) · Applied Energy · doi:10.1016/j.apenergy.2021.117338 · Cited by 99
Kärnä, A., & Stephan, A. (2022) · Regional Studies · doi:10.1080/00343404.2021.2016681 · Cited by 106
“We use matching and DiD regressions to reduce selection bias between treated and non-treated firms, a method used in other research to analyse SME financing effects (Heckman et al., 1997, 1998; Ho et al., 2007).”
MethodIntervention Research in Social Work: Recent Advances and Continuing Challenges
Fraser, M. W. (2004) · Research on Social Work Practice · doi:10.1177/1049731503262150 · Cited by 94
“, within local labor markets such as cities) (Heckman et al., 1997; Smith & Todd, 2000).”
BackgroundMethodKumar, N., & Quisumbing, A. R. (2011) · Journal of Development Effectiveness · doi:10.1080/19439342.2011.570452 · Cited by 106
Weitzen, S., Lapane, K. L., Toledano, A. Y., Hume, A. L., & Mor, V. (2005) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.986 · Cited by 93
Rural Roads And Poor Area Development In Vietnam
Mu, R., & van de Walle, D. (2007) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-4340 · Cited by 118
“We apply nonparametric kernel matching in which all the non-participants are used as comparison communes and weights are assigned according to a kernel function of the predicted propensity score following Heckman et al. (1997). This technique ensures valid bootstrapped standard errors (Abadie and Imbens, 2006).”
MethodEconomic And Social Impacts Of Self-Help Groups In India
Liu, Y., & Deininger, K. (2009) · The World Bank Open Knowledge Repository (World Bank) · doi:10.1596/1813-9450-4884 · Cited by 99
“We use a PS-matched kernel method and a PS-weighted regression method (Hirano et al. 2003).”
MethodThe Costs of Political Influence: Firm-Level Evidence From Developing Countries
Desai, R. M., & Olofsgård, A. (2011) · Quarterly Journal of Political Science · doi:10.1561/100.00010094 · Cited by 112
“…with unobservable firm-specific factors that are causing endogeneity bias.13 using smoothed local regression over multiple firms in the comparison group, and demonstrates greater robustness to different data densities than alternative pair-matching estimators (see Heckman et al., 1997).”
Ozoemena, E. L., Iweama, C. N., Agbaje, O. S., Umoke, P. C. I., Ene, O. C., Ofili, P. C., Agu, B. N., Orisa, C. U., Agu, M. A., & Anthony, E. (2019) · Archives of Public Health · doi:10.1186/s13690-019-0349-x · Cited by 112
Bachke, M. E. (2019) · Food Policy · doi:10.1016/j.foodpol.2019.101792 · Cited by 108
Abbas, F., Kumar, R., Mahmood, T., & Somrongthong, R. (2021) · Scientific Reports · doi:10.1038/s41598-021-98924-7 · Cited by 116
Impact evaluation of the Ethiopian Health Services Extension Programme
Admassie, A., Abebaw, D., & Woldemichael, A. D. (2009) · Journal of Development Effectiveness · doi:10.1080/19439340903375724 · Cited by 96
“As pointed out by Heckman et al. (1997), this procedure helps to ensure that ‘outcomes and characteristics are measured in the same way for both groups’.”
BackgroundMethodInfluentialMoving out of Poverty in Tanzania: Evidence from Kagera
Weerdt, J. D. (2009) · The Journal of Development Studies · doi:10.1080/00220380902974393 · Cited by 121
Gingerich, D. W. (2010) · Political Analysis · doi:10.1093/pan/mpq010 · Cited by 98
“…those generated by randomized experiments have found that propensity score methods may approximate the experimental benchmark fairly well when the set of control variables is appropriately chosen and sufficiently rich (Heckman, Ichimura, and Todd 1997; Dehejia and Wahba 1999; Diaz and Handa 2006).”
BackgroundTake a Stand or Keep Your Seat: Board Turnover after Social Movement Boycotts
McDonnell, M., & Cobb, J. A. (2019) · Academy of Management Journal · doi:10.5465/amj.2017.0890 · Cited by 110
Guo, Q., Su, Z., & Chiao, C. (2021) · Economic Change and Restructuring · doi:10.1007/s10644-021-09353-5 · Cited by 108
Implementing Propensity Score Matching Estimators with STATA
Sianesi, B. (2001) · Cited by 97
Driffield, N. L., Love, J. H., & Yang, Y. G. (2015) · Research Policy · doi:10.1016/j.respol.2015.11.004 · Cited by 110
“It has been long argued that the quality of matching exercise is largely influenced by the data structure (Heckman, Ichimura, and Todd, 1997; Zhao 2004).”
BackgroundEconometrics for Evaluations: An Introduction to Recent Developments
Cobb‐Clark, D. A., & Crossley, T. F. (2003) · Economic Record · doi:10.1111/j.1475-4932.2003.00148.x · Cited by 119
The market valuation of share repurchases in Europe
Andriosopoulos, D., & Lasfer, M. (2014) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2014.04.017 · Cited by 97
“We then consider the potential sample selection bias (Heckman, 1979) using the Heckman et al. (1997) two-stage estimation procedure.”
Hidden impact? Household saving in response to a poor-area development project
Ravallion, M. D., & Chen, S. (2005) · Journal of Public Economics · doi:10.1016/j.jpubeco.2004.12.003 · Cited by 97
R&D subsidies and productivity in SMEs
Karhunen, H., & Huovari, J. (2015) · Small Business Economics · doi:10.1007/s11187-015-9658-9 · Cited by 118
“If the CIA does not hold, we can examine the average treatment effect for the treated firms as long as we can assume that the possible bias is constant (Heckman et al. 1997, 1998).”
BackgroundDoes Self-Regulation Reduce Pollution? Responsible Care in the Chemical Industry
Gamper‐Rabindran, S., & Finger, S. R. (2011) · Journal of Regulatory Economics · doi:10.1007/s11149-012-9197-0 · Cited by 108
“30 The drawback of the PSM method is its assumption that program effects can be identified by matching on observables alone (Heckman et al., 1997).”
Matching and Propensity Scores
Steiner, P. M., & Cook, D. (2013) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199934874.013.0013 · Cited by 126
“Another regression estimator is kernel-based matching (Heckman, Ichimura, and Todd, 1997, 1998).”
MethodTo Apply or Not to Apply: FAFSA Completion and Financial Aid Gaps
Kofoed, M. (2016) · Research in Higher Education · doi:10.1007/s11162-016-9418-y · Cited by 110
“For example, the variance of the nearest neighbor estimator is smaller than the variance in the kernel estimator, but the kernel estimator uses all available data to form the counterfactual to reduce the probability of a ‘‘bad’’ match (Heckman et al. 1997, 1998; Abadie and Imbens 2006).”
InfluentialAcquisitions, markups, efficiency, and product quality: Evidence from India
Stiebale, J., & Vencappa, D. (2018) · Journal of International Economics · doi:10.1016/j.jinteco.2018.02.005 · Cited by 108
“This procedure allows selection into the group of acquired firms to be based on the expected impact on our outcome variables (Heckman et al., 1997).”
BackgroundDruetz, T., Corneau-Tremblay, N., Millogo, T., Kouanda, S., Ly, A., Bicaba, A., & Haddad, S. H. S. (2017) · American Journal of Tropical Medicine and Hygiene · doi:10.4269/ajtmh.17-0599 · Cited by 100
aus dem Moore, N., Großkurth, P., & Themann, M. (2019) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2018.11.003 · Cited by 87
Jabbour, L., Tao, Z., Vanino, E., & Zhang, Y. (2018) · Journal of International Economics · doi:10.1016/j.jinteco.2018.12.004 · Cited by 109
“We estimate standard errors using bootstrapping, with 500 repetitions, to alleviate heteroskedasticity concerns related to additional sources of variability introduced by the estimation of the propensity score and the kernel matching process (Heckman et al., 1997; Abadie and Imbens, 2011).”
BackgroundMethodIdentifying and Boosting 'Gazelles': Evidence from Business Accelerators
González-Uribe, J., & Reyes, S. (2019) · Journal of Financial Economics · doi:10.1016/j.jfineco.2020.07.012 · Cited by 106
Inherited or earned? Performance of foreign banks in Central and Eastern Europe
Havrylchyk, O., & Jurzyk, E. M. (2010) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2010.10.007 · Cited by 112
Läpple, D., Hennessy, T., & Newman, C. (2013) · Journal of Agricultural Economics · doi:10.1111/1477-9552.12000 · Cited by 94
Pink work: Same-sex marriage, employment and discrimination
Sansone, D. (2019) · Journal of Public Economics · doi:10.1016/j.jpubeco.2019.104086 · Cited by 94
Wilde, E. T., & Hollister, R. (2007) · Journal of Policy Analysis and Management · doi:10.1002/pam.20262 · Cited by 96
“…this approach to evaluate the performance of nonexperimental impact estimation methods include Friedlander and Robins (1995); Heckman and Hotz (1989); Heckman, Ichamura, and Todd (1997); Heckman, Ichamura, Smith, and Todd (1996); Heckman, Ichamura, Smith, and Todd (1998); and Diaz and Handa (2006).”
MethodTesting the Differential Effect of Business Incubators on Firm Growth
Stokan, E., Thompson, L., & Mahu, R. J. (2015) · Economic Development Quarterly · doi:10.1177/0891242415597065 · Cited by 94
“Heckman, Ichimura, and Todd (1997) advise that only variables that simultaneously influence the participation decision and the outcome variable should be included in the model.”
BackgroundThe impact of credit on the technical efficiency of maize-producing households in Northern Ghana
Martey, E., Wiredu, A. N., Etwire, P. M., & Kuwornu, J. K. M. (2019) · Agricultural Finance Review · doi:10.1108/afr-05-2018-0041 · Cited by 100
“Detailed discussion on the estimation of the ATT through matching procedures can be obtained from Becker and Ichino (2002), Dehejia and Wahba (2002), Heckman et al. (1997), Rosenbaum and Rubin (1983), Smith and Todd (2005), and Todd (2006).”
MethodHeshmati, A., & Lööf, H. (2005) · RePEc: Research Papers in Economics · doi:10.22004/ag.econ.11862 · Cited by 97
Livelihood Empowerment Against Poverty Program Impact Evaluation
Handa, S., Park, M., Osei, R., Osei‐Akoto, I., Davis, B., & Daidone, S. (2013) · Cited by 133
Environmental decentralization and political centralization
Fredriksson, P. G., & Wollscheid, J. R. (2014) · Ecological Economics · doi:10.1016/j.ecolecon.2014.09.019 · Cited by 99
“" Heckman et al. (1997) and Dehejia and Wahba (1999) show that omitted variables can significantly increase the bias of the results.”
BackgroundMethodKang, L., Peng, F., Zhu, Y., & An, P. (2018) · Sustainability · doi:10.3390/su10093264 · Cited by 102
“This allowed the OBOR initiative to be based on the expected pre-entry characteristics of a country and on an unobservable time-invariant [68].”
BackgroundResource efficiency investments and firm performance: Evidence from European SMEs
Özbuğday, F. C., Fındık, D., Metin-Özcan, K., & Başçı, S. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2019.119824 · Cited by 105
Jie, Y., Ying, L., & Gao, M. (2020) · Enterprise Information Systems · doi:10.1080/17517575.2020.1746407 · Cited by 101
“…in the field of ‘natural experiment’ has been a wide application, can accurately evaluate the efficacy of the policy, is mainly by observing a variable changes before and after the policy implementation to estimate the net effects of after policy implementation (Heckman, Ichimura, and Todd 1997).”
BackgroundMethodKoh, E., & Testa, M. F. (2008) · Social Work Research · doi:10.1093/swr/32.2.105 · Cited by 87
ACT for All: The Effect of Mandatory College Entrance Exams on Postsecondary Attainment and Choice
Hyman, J. (2017) · Education Finance and Policy · doi:10.1162/edfp_a_00206 · Cited by 92
Social and environmental impacts of agricultural cooperatives: evidence from Ethiopia
Mojo, D., Fischer, C., & Degefa, T. (2015) · International Journal of Sustainable Development & World Ecology · doi:10.1080/13504509.2015.1052860 · Cited by 92
“…of matching estimates The validity of PSM depends on three assumptions: overlap (common support) condition, balancing property, and the conditional independency assumption (CIA) or unconfoundedness (Rosenbaum & Rubin 1985; Heckman et al. 1997; Caliendo & Kopeinig 2008; Heinrich et al. 2010).”
BackgroundMethodInfluentialNatural disasters and electoral outcomes
Masiero, G., & Santarossa, M. (2020) · European Journal of Political Economy · doi:10.1016/j.ejpoleco.2020.101983 · Cited by 106
Law Firm Expertise and Merger and Acquisition Outcomes
Krishnan, C. N. V., & Masulis, R. W. (2013) · The Journal of Law and Economics · doi:10.1086/667361 · Cited by 92
Cash transfer programs and agricultural production: the case of Malawi
Boone, R., Covarrubias, K., Davis, B., & Winters, P. (2013) · Agricultural Economics · doi:10.1111/agec.12017 · Cited by 107
Combining Multiple Observational Data Sources to Estimate Causal Effects
Yang, S., & Ding, P. (2019) · Journal of the American Statistical Association · doi:10.1080/01621459.2019.1609973 · Cited by 137
“) inverse probability weighting (Horvitz and Thompson 1952, Rosenbaum and Rubin 1983b; Robins et al., 1994, Bang and Robins, 2005, Cao et al., 2009), and matching (e.g., Rubin, 1973, Rosenbaum, 1989, Heckman et al., 1997, Hi2 rano et al., 2003, Hansen, 2004, Rubin, 2006, Abadie and Imbens, 2006, Stuart, 2010, Abadie a…”
Is equity crowdfunding always good? Deal structure and the attraction of venture capital investors
Butticè, V., Pietro, F. D., & Tenca, F. (2020) · Journal of Corporate Finance · doi:10.1016/j.jcorpfin.2020.101773 · Cited by 100
Yang, Z., Shao, S., & Yang, L. (2020) · Energy Economics · doi:10.1016/j.eneco.2020.105072 · Cited by 93
Donald, S. G., & Hsu, Y.-C. (2013) · Journal of Econometrics · doi:10.1016/j.jeconom.2013.03.010 · Cited by 122
Koh, E. H. (2009) · Children and Youth Services Review · doi:10.1016/j.childyouth.2009.10.010 · Cited by 91
Performance Pay and Managerial Experience in Multitask Teams: Evidence from within a Firm
Griffith, R., & Neely, A. D. (2009) · Journal of Labor Economics · doi:10.1086/596324 · Cited by 111
Petrick, M., & Zier, P. (2010) · Agricultural Economics · doi:10.1111/j.1574-0862.2010.00509.x · Cited by 121
“7 An exception are matching approaches based on first differences (Heckman et al. 1997; Pufahl and Weiss 2009).”
BackgroundDo regulatory changes affect the underpricing of European IPOs?
Akyol, A. C., Cooper, T., Meoli, M., & Vismara, S. (2014) · Journal of Banking & Finance · doi:10.1016/j.jbankfin.2014.04.020 · Cited by 110
Neicu, D., Teirlinck, P., & Kelchtermans, S. (2015) · Economics of Innovation and New Technology · doi:10.1080/10438599.2015.1076192 · Cited by 102
“Hyytinen and Toivanen (2005), for Finland, show that government funding disproportionately helps firms from industries that depend more on external financing.”
InfluentialOgunniyi, A. I., Bolarin, O., Abioye, O. D., & Kehinde, O. (2018) · AIMS Agriculture and Food · doi:10.3934/agrfood.2018.2.154 · Cited by 103
Did the Integrated Urban and Rural Resident Basic Medical Insurance Improve Benefit Equity in China?
Ren, Y., Zhou, Z., Cao, D., Ma, B. H., Shen, C., Lai, S., & Chen, G. (2022) · Value in Health · doi:10.1016/j.jval.2022.03.007 · Cited by 93
Housing Affordability and Child Well-Being
Newman, S. J., & Holupka, C. S. (2014) · Housing Policy Debate · doi:10.1080/10511482.2014.899261 · Cited by 96
What Can Ex-Participants Reveal about a Program’s Impact?
Ravallion, M. D., Galasso, E., Lazo, T., & Philipp, E. (2005) · The Journal of Human Resources · doi:10.3368/jhr.xl.1.208 · Cited by 101
“Results in the literature suggest that single-difference PSM estimates can be unreliable when the data available do not include important determinants of participation (Heckman et al. 1997, 1998; Smith and Todd 2001).”
BackgroundHow do housing allowances affect rents? An empirical analysis of the French case
Laferrère, A., & Blanc, D. L. (2004) · Journal of Housing Economics · doi:10.1016/j.jhe.2004.02.001 · Cited by 89
“The first caveat when using matching estimators is to guarantee that the support of the characteristics is the same for the treatment group and the comparison group (see for example Heckman et al., 1997).”
BackgroundInfluentialAssessing the Effect of Batterer Program Completion on Reassault Using Propensity Scores
Jones, A. S., D’Agostino, R. B., Gondolf, E. W., & Heckert, A. (2004) · Journal of Interpersonal Violence · doi:10.1177/0886260504268005 · Cited by 89
“First, there is the superior performance of PSs in producing experimentally validated program effect estimates from quasi-experimental data when data quality is good (Dehejia & Wahba, 1999; Heckman et al., 1997; Smith & Todd, 2001).”
BackgroundDo exporters have anything to learn from foreign multinationals?
Girma, S., Kneller, R., & Pisu, M. (2006) · European Economic Review · doi:10.1016/j.euroecorev.2006.07.003 · Cited by 105
“Following the microeconometric evaluation literature (e.g. Heckman et al, 1997), we define the average effect of acquisition on the acquired firms as { } { } { }1|1|1| 0101 =−===− ++++ itstitstitstst ACQyEACQyEACQyyE (2) Casual inference relies on the construction of the counterfactual for the last…”
MethodFormer CEO Directors: Lingering CEOs or Valuable Resources?
Fahlenbrach, R., Minton, B. A., & Pan, C. H. (2011) · Review of Financial Studies · doi:10.1093/rfs/hhr056 · Cited by 103
“To examine the prediction of Hermalin and Weisbach (1998) that more powerful CEOs are reappointed to the board, we include proxies for the power and entrenchment of the CEO, as well as proxies for the strength of the board. We use three characteristics of the former CEO as proxies for the power and entrenchment of a f…”
Fishing for complementarities: Research grants and research productivity
Hottenrott, H., & Lawson, C. (2017) · International Journal of Industrial Organization · doi:10.1016/j.ijindorg.2016.12.004 · Cited by 103
“…estimators have been applied and discussed in a variety of contexts and by many scholars, amongst which Angrist (1998), Dehejia and Wahba (1999), Heckman et al. (1997, 1998a, 1998b), Lechner (1999, 2000) and Smith and Todd (2005). account for experience and the research sub-field to account…”
Background
Metadata
- Authors
- Heckman, J. J., Ichimura, H., & Todd, P. E.
- Affiliations
- University of Chicago (US)
- University of Pittsburgh (US)
- University of Pennsylvania (US)
- Venue
- The Review of Economic Studies
- Publisher
- Oxford University Press (OUP)
- Published
- 1997-10-01
- Volume
- 64
- Issue
- 4
- Pages
- 605-654
- ISSN
- 0034-6527 (ISSN-L)
- 1467-937X
- OpenAlex
- W2066735350
- Semantic Scholar
- ec958b198d3b6712d1e0f3395a05ff2b0136a1bb
- Cited by
- 5,486
- References
- 32
- Citations by year
- 2026: 216 · 2025: 268 · 2024: 271 · 2023: 292 · 2022: 296 · 2021: 246 · 2020: 254 · 2019: 244 · 2018: 269 · 2017: 236 · 2016: 231 · 2015: 251 · 2014: 266 · 2013: 248 · 2012: 275
- FWCI
- 20.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Review of Economic Studies (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- selection on unobservables, sample selection model, identifying assumptions, omitted variables
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.