Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme
The DOI matches its Crossref record; 31 of the 32 references it cites were found in a registry or an index.
Abstract
This paper considers whether it is possible to devise a nonexperimental procedure for evaluating a prototypical job training programme. Using rich nonexperimental data, we examine the performance of a two-stage evaluation methodology that (a) estimates the probability that a person participates in a programme and (b) uses the estimated probability in extensions of the classical method of matching. We decompose the conventional measure of programme evaluation bias into several components and find that bias due to selection on unobservables, commonly called selection bias in econometrics, is empirically less important than other components, although it is still a sizeable fraction of the estimated programme impact. Matching methods applied to comparison groups located in the same labour markets as participants and administered the same questionnaire eliminate much of the bias as conventionally measured, but the remaining bias is a considerable fraction of experimentally-determined programme impact estimates. We test and reject the identifying assumptions that justify the classical method of matching. We present a nonparametric conditional difference-in-differences extension of the method of matching that is consistent with the classical index-sufficient sample selection model and is not rejected by our tests of identifying assumptions. This estimator is effective in eliminating bias, especially when it is due to temporally-invariant omitted variables.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For the OR approach, the consistency of the ATT estimator (2.2) relies on the estimators of md , t ( · ) , ̂ µ d , t ( · ) , being correctly specified, whereas the IPW estimator (2.4) relies on the propensity score estimator ̂ π ( · ) of p ( · ) being correctly specified.”
From Doubly robust difference-in-differences estimators (2020) · cites this paper as Heckman et al. (1997)
In the citing paper
“These fall into two main categories, which we denote trajectory modeling [28, 29, 86, 88, 95] and propensity score weighting [17, 30].”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“Doubly robust (DR) estimators combine trajectory modeling and propensity score estimation and produce consistent estimates if either the trajectory model or the propensity score model is correctly specified: [29]”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“The OR, IPW and DR estimands respectively generalize Heckman et al. (1997), Abadie (2005) and Sant'Anna and Zhao (2020) estimands for the two groups, two periods DiD setup to the staggered DiD setup with multiple periods and multiple groups.”
From Difference-in-Differences with multiple time periods (2021) · cites this paper as Heckman et al. (1997)
In the citing paper
“CS also derives estimators that are consistent for AT T (g, τ ) under more general conditions, such as when the parallel-trends assumption holds conditionally on covariates, including an outcome-regression-based estimator”
From How Much Should We Trust Staggered Difference-in-Differences Estimates? (2022) · cites this paper as Heckman et al., 1997
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,796
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774
SOME THOUGHTS ON THE DISTRIBUTION OF EARNINGS 1
ROY, A. D. (1951) · Oxford Economic Papers · doi:10.1093/oxfordjournals.oep.a041827 · Cited by 2,958
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503
Estimating the Effect of Training Programs on Earnings
Ashenfelter, O. (1978) · The Review of Economics and Statistics · doi:10.2307/1924332 · Cited by 1,515
Design-adaptive Nonparametric Regression
Fan, J. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10476255 · Cited by 1,268
The Estimation of Choice Probabilities from Choice Based Samples
Manski, C. F., & Lerman, S. R. (1977) · Econometrica · doi:10.2307/1914121 · Cited by 1,208
Cited by
Items 501–600 of 1,029
Tian, S., Dian, J., & Chen, H. (2023) · Sustainable Cities and Society · doi:10.1016/j.scs.2023.104478 · Cited by 127
Gould, E. D., Lavy, V., & Paserman, M. D. (2004) · The Quarterly Journal of Economics · doi:10.1162/0033553041382193 · Cited by 127
A field experiment on the impact of weather shocks and insurance on risky investment
Hill, R. V., & Viceisza, A. (2012) · Experimental Economics · doi:10.1007/s10683-011-9303-7 · Cited by 143
“Matching has been shown to provide good estimates of the average treatment effect when, as in this case, data on the initial values of the outcome of interest can be used as part of the matching criteria (Heckman et al. 1997).”
Investments Abroad and Performance at Home: Evidence from Italian MultinationalsPreprint
Navaretti, G. B., Studi, C., d'Agliano, L., & Castellani, D. (2004) · RePEc: Research Papers in Economics · Cited by 136
The impact of private equity on firms׳ patenting activity
Amess, K., Stiebale, J., & Wright, M. (2015) · European Economic Review · doi:10.1016/j.euroecorev.2015.08.013 · Cited by 176
Relaxing rural constraints: a 'win-win' policy for poverty and environment in China?
Groom, B., Grosjean, P. A., Kontoleon, A., Swanson, T. M., & Zhang, S. (2009) · Oxford Economic Papers · doi:10.1093/oep/gpp021 · Cited by 134
“44Strictly speaking this is the average treatment on the treated (Heckman et al., 1997). level, the programme having a negative impact on labour which is supplied outside the village, despite o¤-farm activities being more lucrative outside the village than within45.”
BackgroundInfluentialThe new deal for young people: effect on the labour market status of young men
Dorsett, R. (2005) · Labour Economics · doi:10.1016/j.labeco.2004.10.006 · Cited by 156
Titus, M. A. (2006) · Research in Higher Education · doi:10.1007/s11162-006-9034-3 · Cited by 148
“Several researchers (e.g., Heckman and Robb, 1985; Heckman et al., 1997 ) contend that rather than an ATE for an entire sample, the effect of average treatment on individuals who select treatment, what is known as the average treatment on the treated (ATT) effect, may be more of an interest to researchers and program…”
BackgroundMethodInfluentialSensitivity of propensity score methods to the specifications
Zhao, Z. (2008) · Economics Letters · doi:10.1016/j.econlet.2007.05.010 · Cited by 129
Ibarrarán, P., & Rosas Shady, D. (2009) · Journal of Development Effectiveness · doi:10.1080/19439340902918094 · Cited by 122
“The European evidence is far more uncertain (Heckman et al., 1999) in part because of the lack of experimental studies and the wide variation in evaluation methods. Nevertheless, one key finding that emerges from the meta-analysis by Kluve et al. (2005) is that programs serving youth are substantially less likely to s…”
BackgroundMethodBiewen, M., Fitzenberger, B., Osikominu, A., & Paul, M. (2014) · Journal of Labor Economics · doi:10.1086/677233 · Cited by 165
“…he or she is looking for a part-time job, and the number of job proposals he or she received from the employment office.23 The literature ðe.g., Heckman, Ichimura, and Todd 1997; Heckman et al. 1998; Heckman et al. 1999; Heckman and Smith 1999Þ stresses the importance of conditioning flexibly…”
Trade and productivity: Self-selection or learning-by-exporting in India
Haidar, J. I. (2012) · Economic Modelling · doi:10.1016/j.econmod.2012.05.005 · Cited by 131
“Following Heckman et al. (1997), we define the average effect of exporting on export-starters as:”
Competitive Research Grants and Their Impact on Career Performance
Bloch, C. W., Graversen, E. K., & Pedersen, H. S. (2014) · Minerva · doi:10.1007/s11024-014-9247-0 · Cited by 138
“Heckman et al. (1997) and Dehejia and Wahba (1999) note that the treatment effect is highly sensitive to the matching parameters, thus omitted variable bias can be a serious concern.”
BackgroundThe Effect of Export Promotion on Firm-Level Performance
Munch, J. R., & Schaur, G. (2018) · American Economic Journal Economic Policy · doi:10.1257/pol.20150410 · Cited by 153
“29 For a detailed discussion, see Imbens and Wooldridge (2009); Heckman, Ichimura, and Todd (1997); Hirano, Imbens, and Ridder (2003); and http://www.stata.com/manuals13/te.pdf.”
BackgroundMethodMinimum-Wage Increases and Low-Wage Employment: Evidence from Seattle
Jardim, E., Long, M. C., Plotnick, R. D., van Inwegen, E., Vigdor, J. L., & Wething, H. (2022) · American Economic Journal Economic Policy · doi:10.1257/pol.20180578 · Cited by 174
Matching With Multiple Control Groups With Adjustment for Group Differences
Stuart, E. A., & Rubin, D. B. (2008) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998607306078 · Cited by 113
A Note on the Common Support Problem in Applied Evaluation Studies
LECHNER (2008) · Annales d Économie et de Statistique · doi:10.2307/27917246 · Cited by 142
Li, L., Liu, X., Yuan, D., & Yu, M. (2017) · International Business Review · doi:10.1016/j.ibusrev.2017.02.003 · Cited by 130
Homeowner Borrowing and Housing Collateral: New Evidence from Expiring Price Controls
DeFusco, A. (2017) · The Journal of Finance · doi:10.1111/jofi.12602 · Cited by 135
How mergers affect innovation: Theory and evidence
Haucap, J., Rasch, A., & Stiebale, J. (2018) · International Journal of Industrial Organization · doi:10.1016/j.ijindorg.2018.10.003 · Cited by 121
Democratic institutions versus autocratic regimes: The case of environmental policy
Fredriksson, P. G., & Wollscheid, J. R. (2006) · Public Choice · doi:10.1007/s11127-006-9093-1 · Cited by 121
Comparing Experimental and Matching Methods Using a Large-Scale Voter Mobilization Experiment
Arceneaux, K., Gerber, A. S., & Green, D. P. (2006) · Political Analysis · doi:10.1093/pan/mpj001 · Cited by 116
“16Studies evaluating the performance of matching estimators typically have treatment and control groups on the order of 3% the size of the treatment group in our data (e.g., Dehejia and Wahba 1999; Heckman, Ichimura, and Todd 1997, 1998; Heckman, Ichimura et al. 1998).”
BackgroundMethodResultDo city climate plans reduce emissions?
Millard‐Ball, A. (2011) · Journal of Urban Economics · doi:10.1016/j.jue.2011.12.004 · Cited by 120
Input and output additionality of R&D subsidies
Czarnitzki, D., & Hussinger, K. (2017) · Applied Economics · doi:10.1080/00036846.2017.1361010 · Cited by 139
“The literature on the econometrics of evaluation offers different estimation strategies to correct for a potential selection bias (see Heckman, Ichimura, and Todd 1997; Heckman, Lalonde, and Smith 1999; for surveys) including the difference-in-difference estimator, control function approaches…”
BackgroundDo health sector reforms have their intended impacts?
Wagstaff, A., & Yu, S. (2007) · Journal of Health Economics · doi:10.1016/j.jhealeco.2006.10.006 · Cited by 113
Angrist, J. D., & Kuersteiner, G. M. (2010) · The Review of Economics and Statistics · doi:10.1162/rest_a_00109 · Cited by 155
Can the land tax help curb urban sprawl? Evidence from growth patterns in Pennsylvania
Banzhaf, H. S., & Lavery, N. (2009) · Journal of Urban Economics · doi:10.1016/j.jue.2009.08.005 · Cited by 141
A Corporate Culture Channel: How Increased Shareholder Governance Reduces Firm ValuePreprint
Grennan, J. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2345384 · Cited by 132
“Additional motivation comes from the fact that the data are well suited to using such an algorithm (Heckman, Ichimura, and Todd (1997)); the pool of potential control firms is large, which increases the likelihood of overlap in the support of firm-specific covariates across the two groups.”
MethodFrom health research to social research: Privacy, methods, approaches
Roos, L. L., Brownell, M. D., Lix, L. M., Roos, N. P., Walld, R., & MacWilliam, L. (2007) · Social Science & Medicine · doi:10.1016/j.socscimed.2007.08.017 · Cited by 135
Is there an environmental benefit to being an exporter? Evidence from firm-level data
Batrakova, S., & Davies, R. B. (2012) · Review of World Economics · doi:10.1007/s10290-012-0125-2 · Cited by 137
“We therefore use a difference-in-differences estimator to remove such temporally-invariant components of bias (Heckman et al. 1997).”
MethodThe Balance‐Sample Size Frontier in Matching Methods for Causal Inference
King, G., Lucas, C., & Nielsen, R. A. (2017) · American Journal of Political Science · doi:10.1111/ajps.12272 · Cited by 119
Branded Apps and Their Impact on Firm Value: A Design Perspective
Boyd, D. E., Kannan, P. K., & Slotegraaf, R. J. (2019) · Journal of Marketing Research · doi:10.1177/0022243718820588 · Cited by 129
“To arrive at the matched sample, we employed propensity score matching using a logit model as recommended in prior research (Heckman, Ichimura, and Todd 1997; Rosenbaum and Rubin 1983).”
MethodA Cautionary Tale: Using Propensity Scores to Estimate the Effect of Food Stamps on Food Insecurity
Gibson‐Davis, C. M., & Foster, E. M. (2006) · Social Service Review · doi:10.1086/499416 · Cited by 117
Cook, T. D., & Steiner, P. M. (2010) · Psychological Methods · doi:10.1037/a0018536 · Cited by 114
Does Shortening the School Week Impact Student Performance? Evidence from the Four-Day School Week
Anderson, D. M., & Walker, M. B. (2015) · Education Finance and Policy · doi:10.1162/edfp_a_00165 · Cited by 131
Barnett, W. A., Hu, M., & Wang, X. (2019) · Technological Forecasting and Social Change · doi:10.1016/j.techfore.2019.01.007 · Cited by 125
“Matching incomparable observations can cause much larger estimation biases than selection on unobservables (Heckman, Ichimura and Todd, 1997).”
BackgroundEchoes of the Past: Organizational Foundings as Sources of an Institutional Legacy of Mutualism
Greve, H. R., & Rao, H. (2012) · American Journal of Sociology · doi:10.1086/667721 · Cited by 116
Weiss, F., Klein, M., & Grauenhorst, T. (2014) · Work Employment and Society · doi:10.1177/0950017013506772 · Cited by 118
“Here, we applied the Kernel Matching Method with an Epanechnikov-kernel (Heckman et al., 1997).”
MethodExport Destinations and Learning-by-Exporting: Evidence from BelgiumPreprint
Pisu, M. (2010) · SSRN Electronic Journal · doi:10.2139/ssrn.1685184 · Cited by 118
Do the short-term effects of a high-quality preschool program persist?
Hill, C. J., Gormley, W. T., & Adelstein, S. (2015) · Early Childhood Research Quarterly · doi:10.1016/j.ecresq.2014.12.005 · Cited by 138
“Based on examination of matching methods in the job training field, Heckman, Ichimura, and Todd (1997) concluded that geographic similarity and common data sources can eliminate much of the selection bias when constructing a comparison group.”
MethodDieckhoff, M. (2011) · Acta Sociologica · doi:10.1177/0001699311412798 · Cited by 142
“In contrast to regression techniques, matching avoids comparison of the incomparable (i.e. violating the common support condition) which is an important source of bias (Heckman et al., 1997; Brand, 2006).”
BackgroundMethodLong-term employment effects of surviving cancer
Moran, J. R., Short, P. F., & Hollenbeak, C. S. (2011) · Journal of Health Economics · doi:10.1016/j.jhealeco.2011.02.001 · Cited by 116
Incentives in the Public Sector: Evidence from a Government Agency
BURGESS, S. M., Propper, C., Ratto, M., & Tominey, E. (2017) · The Economic Journal · doi:10.1111/ecoj.12422 · Cited by 131
Impacts of nonstate, market-driven governance on Chilean forests
Heilmayr, R., & Lambin, E. F. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1600394113 · Cited by 108
“We calculated the difference-in-differences estimator of the ATT, adjusting SEs to reflect the estimated propensity scores (46).”
MethodUsing State Administrative Data to Measure Program Performance
Mueser, P. R., Troske, K. R., & Gorislavsky, A. (2007) · The Review of Economics and Statistics · doi:10.1162/rest.89.4.761 · Cited by 142
Cross-Border Acquisitions and Target Firms' Performance: Evidence From Japanese Firm-Level Data
Fukao, K., Ito, K., Kwon, H. U., & Takizawa, M. (2006) · National Bureau of Economic Research · doi:10.3386/w12422 · Cited by 130
Additionality and the Adoption of Farm Conservation Practices
Mezzatesta, M., Newburn, D. A., & Woodward, R. T. (2013) · Land Economics · doi:10.3368/le.89.4.722 · Cited by 113
“Propensity score matching estimators were developed by Rosenbaum and Rubin (1983) and are often used for program evaluation to estimate the average treatment effect on the treated (ATT).”
Different rays of sunlight: Understanding information disclosure and carbon transparency
Matisoff, D. C. (2013) · Energy Policy · doi:10.1016/j.enpol.2012.12.049 · Cited by 130
“The difference in differences approach controls for static heterogeneity between the treatment group and the control group, assuming that participants and controls have the same distributions of unobserved attributes; that they have the same distributions of the observed attributes; and that they are in a common econo…”
BackgroundMethodResultInfluentialBiofortification, Crop Adoption and Health Information: Impact Pathways in Mozambique and Uganda
de Brauw, A., Eozenou, P., Gilligan, D., Hotz, C. S., Kumar, N., & Meenakshi, J. V. (2018) · American Journal of Agricultural Economics · doi:10.1093/ajae/aay005 · Cited by 126
Barth, R. P., Greeson, J. K. P., Guo, S., Green, R. L., Hurley, S., & Sisson, J. (2007) · American Journal of Orthopsychiatry · doi:10.1037/0002-9432.77.4.497 · Cited by 106
The Link Between R&D Subsidies, R&D Spending and Technological Performance
Czarnitzki, D., & Hussinger, K. (2004) · MADOC (University of Mannheim) · Cited by 186
Elias, A., Nohmi, M., Yasunobu, K., & Ishida, A. (2013) · Journal of Agricultural Science · doi:10.5539/jas.v5n8p163 · Cited by 152
“…assumption in this study, different measures are taken such as inclusion of many covariates in our propensity score specification to minimize omitted variables bias following the suggestion in Smith & Todd (2005), then matching is implemented on the region of common support (Heckman et al., 1997).”
MethodHow does the one belt one road initiative affect the green economic growth?
Jiang, Q., Ma, X., & Wang, Y. (2021) · Energy Economics · doi:10.1016/j.eneco.2021.105429 · Cited by 120
The impact of digital government policy on entrepreneurial activity in China
Gan, T., Zhang, M., & Zhang, Z. (2023) · Economic Analysis and Policy · doi:10.1016/j.eap.2023.06.029 · Cited by 120
Subervie, J., & Vagneron, I. (2013) · World Development · doi:10.1016/j.worlddev.2013.05.002 · Cited by 137
Bifulco, R. (2012) · Journal of Policy Analysis and Management · doi:10.1002/pam.20637 · Cited by 112
An evaluation of public employment programmes in the East German State of Sachsen-Anhalt
Eichler, M., & Lechner, M. (2002) · Labour Economics · doi:10.1016/s0927-5371(02)00039-8 · Cited by 114
“Because our data are not sufficiently informative to make the assumption that selection is only driven by observable variables (the conditional independence assumption or CIA) plausible, we base our analysis on an identification strategy suggested by Heckman, Ichimura, and Todd (1997).”
InfluentialEnergy efficiency gains from importing intermediate inputs: Firm-level evidence from Indonesia
Imbruno, M., & Ketterer, T. D. (2018) · Journal of Development Economics · doi:10.1016/j.jdeveco.2018.06.014 · Cited by 118
Thúy, P. T. (2020) · Marine Policy · doi:10.1016/j.marpol.2020.103891 · Cited by 113
The Link between R&D Subsidies, R&D Spending and Technological PerformancePreprint
Czarnitzki, D., & Hussinger, K. (2004) · SSRN Electronic Journal · doi:10.2139/ssrn.575362 · Cited by 117
“…labor market policies.2 The literature on the econometrics of evaluation offers different estimation strategies to correct for selection bias (see Heckman et al., 1997, Heckman et al. 1999 for a survey) including the difference–in–difference estimator, control function approaches (selection…”
BackgroundThe impacts of speed cameras on road accidents: An application of propensity score matching methods
Li, H., Graham, D. J., & Majumdar, A. (2013) · Accident Analysis & Prevention · doi:10.1016/j.aap.2013.08.003 · Cited by 132
Impact evaluation of rural road projects
van de Walle, D. (2009) · Journal of Development Effectiveness · doi:10.1080/19439340902727701 · Cited by 112
Insurance Health Impacts on Health and Non-Medical Consumption in a Developing Country
Pradhan, M., & Wagstaff, A. R. (2005) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-3563 · Cited by 116
Lazzarini, S. G., Mesquita, L. F., Monteiro, F., & Musacchio, A. (2020) · Journal of International Business Studies · doi:10.1057/s41267-020-00327-9 · Cited by 121
Propensity score matching and abnormal performance after seasoned equity offerings
Li, X., & Zhao, X. S. (2006) · Journal of Empirical Finance · doi:10.1016/j.jempfin.2005.10.003 · Cited by 123
E-invoicing, tax audits and VAT compliance
Kotsogiannis, C., Salvadori, L., Karangwa, J., & Murasi, I. (2024) · Journal of Development Economics · doi:10.1016/j.jdeveco.2024.103403 · Cited by 122
Health shocks, employment and income in the Spanish labour market
García‐Gómez, P., & Nicolás, Á. L. (2006) · Health Economics · doi:10.1002/hec.1151 · Cited by 132
Quantile treatment effects in difference in differences models with panel data
Callaway, B., & Li, T. (2019) · Quantitative Economics · doi:10.3982/qe935 · Cited by 110
Are there lasting impacts of aid to poor areas?
Chen, S., Mu, R., & Ravallion, M. D. (2008) · Journal of Public Economics · doi:10.1016/j.jpubeco.2008.10.010 · Cited by 123
“In order to assure valid bootstrapped standard errors, we choose to apply nonparametric kernel matching in which all the non-participants are used as controls and weights are assigned according to a kernel function of the predicted propensity score (following Heckman et al., 1997, 1998).”
MethodFerraro, P. J., & Miranda, J. J. (2017) · Journal of the Association of Environmental and Resource Economists · doi:10.1086/689868 · Cited by 138
“Although nonexperimental designs can, in theory, perform as well as experimental designs in identifying causal relationships, debates about their performance in practice are common (e.g., Lalonde 1986; Heckman, Ichimura, and Todd 1997; Dehejia 2005; Smith and Todd 2005).”
BackgroundMethodInfluentialMigration, Remittances and Poverty in Ecuador
Bertoli, S., & Marchetta, F. (2014) · The Journal of Development Studies · doi:10.1080/00220388.2014.919382 · Cited by 132
“Frölich (2007) also argues that sampling weights have not to be used in the estimation of the propensity score when data for treated and untreated units are drawn from the same survey, and this represents a more general necessary condition for a sound application of matching estimators (Heckman et al., 1997).”
BackgroundMethodHow Many Credits Should an Undergraduate Take?
Attewell, P. A., & Monaghan, D. B. (2016) · Research in Higher Education · doi:10.1007/s11162-015-9401-z · Cited by 126
“…we ‘‘trim’’ from the sample the 5 % of treated cases with the least dense common support among the control group, a strategy suggested by Guo and Fraser (2010) and Heckman et al. (1997) to improve the efficiency of estimates by removing cases for whom potential matches likely to be few in number.”
BackgroundMethodLee, R., Zhai, F., Brooks-Gunn, J., Han, W., & Waldfogel, J. (2013) · Developmental Psychology · doi:10.1037/a0032280 · Cited by 118
The Impact of Lowering the Payroll Tax on Informality in Colombia
Fernández, C., & Villar, L. (2017) · Economía · doi:10.1353/eco.2017.a676998 · Cited by 131
The Impact of Municipal Mergers on Local Public Expenditures in Finland
Moisio, A., & Uusitalo, R. (2013) · Public Finance and Management · doi:10.1177/152397211301300302 · Cited by 109
The Impact of Violence Surges on Neighbourhood Business Activity
Greenbaum, R. T., & Tita, G. (2004) · Urban Studies · doi:10.1080/0042098042000294538 · Cited by 131
“It is important to limit the sample to only observations in which there are valid comparisons, or ‘support’ (Dehejia and Wahba, 1999; Heckman et al., 1997).”
BackgroundMethodThe Other Margin: Do Minimum Wages Cause Working Hours Adjustments for Low‐Wage Workers?
Stewart, M. B., & Swaffield, J. K. (2007) · Economica · doi:10.1111/j.1468-0335.2007.00593.x · Cited by 152
Political instability, access to private debt, and innovation investment in China
Cumming, D. J., Rui, O. M., & Wu, Y. (2016) · Emerging Markets Review · doi:10.1016/j.ememar.2016.08.013 · Cited by 118
Hegde, R., & Bull, G. Q. (2011) · Ecological Economics · doi:10.1016/j.ecolecon.2011.08.014 · Cited by 119
Zhu, Y., Hubbard, R. A., Chubak, J., Roy, J., & Mitra, N. (2021) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.5338 · Cited by 121
A Theory of Statistical Inference for Matching Methods in Causal Research
Iacus, S. M., King, G., & Porro, G. (2018) · Political Analysis · doi:10.1017/pan.2018.29 · Cited by 124
Dillon, A. (2011) · World Development · doi:10.1016/j.worlddev.2011.04.006 · Cited by 108
When to Control for Covariates? Panel Asymptotics for Estimates of Treatment Effects
Angrist, J., & Hahn, J. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023679 · Cited by 110
“1 See, for example, Cochran (1965), Rubin (1973, 1979), or Rosenbaum (1995, Chapter 9) for discussions of caliper and nearest-neighbor matching, or Heckman et al. (1997) for examples of nonparametric smoothing.”
BackgroundSchooling Impacts of Conditional Cash Transfers on Young Children: Evidence from Mexico
Behrman, J. R., Parker, S. W., & Todd, P. (2009) · Economic Development and Cultural Change · doi:10.1086/596614 · Cited by 108
“They have more recently been applied and extended in the economics literature (e.g., Heckman, Ichimura, and Todd 1997).”
BackgroundMethodSelf-citationDebaere, P., Lee, H., & Lee, J. (2009) · Journal of Development Economics · doi:10.1016/j.jdeveco.2009.07.002 · Cited by 134
“as used by Heckman et al. (1997) and extend the list of observables as much as we can.”
MethodA microeconometric evaluation of rehabilitation of long‐term sickness in Sweden
Frölich, M., Heshmati, A., & Lechner, M. (2004) · Journal of Applied Econometrics · doi:10.1002/jae.757 · Cited by 123
Adelman, S., & Gilligan, D. (2008) · doi:10.2499/0896295095fprev9 · Cited by 104
Politicking online: the transformation of election campaign communications
(2010) · Choice Reviews Online · doi:10.5860/choice.47-2864 · Cited by 108
Béné, C., Devereux, S., & Sabates‐Wheeler, R. (2012) · IDS Working Papers · doi:10.1111/j.2040-0209.2012.00395.x · Cited by 107
“This test is called the ‘balancing propensity’ test (Rosenbaum and Rubin 1983; Heckman et al. 1997, Heckman, Ichimura and Todd 1998; Dehejia and Wahba 2002).”
MethodDhanorkar, S. (2018) · Management Science · doi:10.1287/mnsc.2017.2963 · Cited by 116
Impact of maternal imprisonment on children's probability of grade retention
Cho, R. M. (2008) · Journal of Urban Economics · doi:10.1016/j.jue.2008.09.004 · Cited by 124
Méthodes économétriques pour l’évaluation de politiques publiques
Givord, P. (2014) · Économie & prévision · doi:10.3917/ecop.204.0002 · Cited by 126
Kluve, J., Puerto, S., Robalino, D., Romero, J. M., Rother, F., Stöterau, J., Weidenkaff, F., & Witte, M. (2017) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.4073/csr.2017.12 · Cited by 106
An Ex Post Facto Evaluation Framework for Place-Based Police Interventions
Braga, A. A., Hureau, D. M., & Papachristos, A. V. (2011) · Evaluation Review · doi:10.1177/0193841x11433827 · Cited by 106
“The broader propensity score matching literature identifies a wide variety of matching algorithms with different choices that need to be made when each approach is used (see, e.g. Apel and Sweeten 2010; Heckman, Ichimura, and Todd 1997; Imbens 2004; Smith and Todd 2005).”
MethodExport Premium, Self-selection and Learning-by-Exporting: Evidence from Chinese Matched Firms
Yang, Y. G., & Mallick, S. (2010) · World Economy · doi:10.1111/j.1467-9701.2010.01277.x · Cited by 117
From Association to Causation via a Potential Outcomes Approach
Mithas, S., & Krishnan, M. S. (2008) · Information Systems Research · doi:10.1287/isre.1080.0184 · Cited by 113
“This approach has received considerable attention in statistical (Dehejia and Wahba 1999, Holland 1986), philosophical (Glymour 1986), epidemiological (Little and Rubin 2000), sociological (Winship and Sobel 2004), and econometric (Dehejia and Wahba 2002; Heckman et al. 1997, 1998b ) literature.”
BackgroundMethodInfluentialChild Labor: The Role of Income Variability and Access to Credit Across Countries
Dehejia, R., & Gatti, R. V. (2002) · National Bureau of Economic Research · doi:10.3386/w9018 · Cited by 123
Gensler, S., Leeflang, P. S. H., & Skiera, B. (2012) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2011.09.004 · Cited by 126
Perceived and Objectively-Measured Neighborhood Violence and Adolescent Psychological Distress
Goldman-Mellor, S. J., Margerison-Zilko, C. E., Allen, K., & Cerdá, M. (2016) · Journal of Urban Health · doi:10.1007/s11524-016-0079-0 · Cited by 105
Sinyolo, S., Mudhara, M., & Wale, E. Z. (2014) · Water SA · doi:10.4314/wsa.v40i1.18 · Cited by 126
“Heckman et al. (1997) encouraged dropping treatment observations with weak common support as inferences can be made about causality only in the area of common support.”
Background
Metadata
- Authors
- Heckman, J. J., Ichimura, H., & Todd, P. E.
- Affiliations
- University of Chicago (US)
- University of Pittsburgh (US)
- University of Pennsylvania (US)
- Venue
- The Review of Economic Studies
- Publisher
- Oxford University Press (OUP)
- Published
- 1997-10-01
- Volume
- 64
- Issue
- 4
- Pages
- 605-654
- ISSN
- 0034-6527 (ISSN-L)
- 1467-937X
- OpenAlex
- W2066735350
- Semantic Scholar
- ec958b198d3b6712d1e0f3395a05ff2b0136a1bb
- Cited by
- 5,486
- References
- 32
- Citations by year
- 2026: 216 · 2025: 268 · 2024: 271 · 2023: 292 · 2022: 296 · 2021: 246 · 2020: 254 · 2019: 244 · 2018: 269 · 2017: 236 · 2016: 231 · 2015: 251 · 2014: 266 · 2013: 248 · 2012: 275
- FWCI
- 20.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Review of Economic Studies (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- selection on unobservables, sample selection model, identifying assumptions, omitted variables
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.