Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme
The DOI matches its Crossref record; 31 of the 32 references it cites were found in a registry or an index.
Abstract
This paper considers whether it is possible to devise a nonexperimental procedure for evaluating a prototypical job training programme. Using rich nonexperimental data, we examine the performance of a two-stage evaluation methodology that (a) estimates the probability that a person participates in a programme and (b) uses the estimated probability in extensions of the classical method of matching. We decompose the conventional measure of programme evaluation bias into several components and find that bias due to selection on unobservables, commonly called selection bias in econometrics, is empirically less important than other components, although it is still a sizeable fraction of the estimated programme impact. Matching methods applied to comparison groups located in the same labour markets as participants and administered the same questionnaire eliminate much of the bias as conventionally measured, but the remaining bias is a considerable fraction of experimentally-determined programme impact estimates. We test and reject the identifying assumptions that justify the classical method of matching. We present a nonparametric conditional difference-in-differences extension of the method of matching that is consistent with the classical index-sufficient sample selection model and is not rejected by our tests of identifying assumptions. This estimator is effective in eliminating bias, especially when it is due to temporally-invariant omitted variables.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For the OR approach, the consistency of the ATT estimator (2.2) relies on the estimators of md , t ( · ) , ̂ µ d , t ( · ) , being correctly specified, whereas the IPW estimator (2.4) relies on the propensity score estimator ̂ π ( · ) of p ( · ) being correctly specified.”
From Doubly robust difference-in-differences estimators (2020) · cites this paper as Heckman et al. (1997)
In the citing paper
“These fall into two main categories, which we denote trajectory modeling [28, 29, 86, 88, 95] and propensity score weighting [17, 30].”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“Doubly robust (DR) estimators combine trajectory modeling and propensity score estimation and produce consistent estimates if either the trajectory model or the propensity score model is correctly specified: [29]”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“The OR, IPW and DR estimands respectively generalize Heckman et al. (1997), Abadie (2005) and Sant'Anna and Zhao (2020) estimands for the two groups, two periods DiD setup to the staggered DiD setup with multiple periods and multiple groups.”
From Difference-in-Differences with multiple time periods (2021) · cites this paper as Heckman et al. (1997)
In the citing paper
“CS also derives estimators that are consistent for AT T (g, τ ) under more general conditions, such as when the parallel-trends assumption holds conditionally on covariates, including an outcome-regression-based estimator”
From How Much Should We Trust Staggered Difference-in-Differences Estimates? (2022) · cites this paper as Heckman et al., 1997
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,796
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774
SOME THOUGHTS ON THE DISTRIBUTION OF EARNINGS 1
ROY, A. D. (1951) · Oxford Economic Papers · doi:10.1093/oxfordjournals.oep.a041827 · Cited by 2,958
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503
Estimating the Effect of Training Programs on Earnings
Ashenfelter, O. (1978) · The Review of Economics and Statistics · doi:10.2307/1924332 · Cited by 1,515
Design-adaptive Nonparametric Regression
Fan, J. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10476255 · Cited by 1,268
The Estimation of Choice Probabilities from Choice Based Samples
Manski, C. F., & Lerman, S. R. (1977) · Econometrica · doi:10.2307/1914121 · Cited by 1,208
Cited by
Items 201–300 of 1,029
Substitution and Dropout Bias in Social Experiments: A Study of an Influential Social Experiment
Heckman, J., Hohmann, N., Smith, J., & Khoo, M. (2000) · The Quarterly Journal of Economics · doi:10.1162/003355300554764 · Cited by 266
Self-citationDoes knowledge diffusion between university and industry increase innovativeness?
Lööf, H., & Broström, A. (2008) · The Journal of Technology Transfer · doi:10.1007/s10961-006-9001-3 · Cited by 264
“relevant here. ( Heckman, Ichimura and Todd, 1997, Heckman, Ichimura, Smith and Todd, 1998,”
Towards Universal Health Coverage: An Evaluation of Rwanda Mutuelles in Its First Eight Years
Lu, C., Chin, B., Lewandowski, J. L., Basinga, P., Hirschhorn, L. R., Hill, K., Murray, M., & Binagwaho, A. (2012) · PLoS ONE · doi:10.1371/journal.pone.0039282 · Cited by 263
“To mitigate possible selection bias due to observable household characteristics, we constructed matched datasets with the propensity score matching (PSM) method to ensure that the observed characteristics of the control (uninsured population) and treatment (Mutuelles enrollees) groups were as similar as possible after…”
MethodFan, F., & Zhang, X. (2021) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2021.106648 · Cited by 262
de Brauw, A., & Hoddinott, J. F. (2009) · Journal of Development Economics · doi:10.2139/ssrn.1011901 · Cited by 309
“16 nonparticipants, (2) participants and nonparticipants have access to the same markets, and (3) the data include meaningful X variables capable of identifying program participation and outcomes (Heckman, Ichimura, and Todd 1997, 1998; Heckman et al. 1998). The evaluation surveys clearly meet criterion (1). Criterion…”
Simple approaches to nonlinear difference-in-differences with panel data
Wooldridge, J. M. (2023) · The Econometrics Journal · doi:10.1093/ectj/utad016 · Cited by 260
Too much of a good thing? On the growth effects of the EU's regional policy
Becker, S. O., Egger, P. H., & von Ehrlich, M. (2012) · European Economic Review · doi:10.1016/j.euroecorev.2012.03.001 · Cited by 260
“Following the seminal paper by Rosenbaum and Rubin (1983) propensity score matching became very popular in the case of binary treatment (see, e.g., Heckman et al., 1997; Dehejia and Wahba, 1999).”
ABATE, G. T., FRANCESCONI, G. N., & GETNET, K. (2014) · Annals of Public and Cooperative Economics · doi:10.1111/apce.12035 · Cited by 257
“The non-parametric kernel regression method is used to allow matching of members with the whole sample of non-members, since the technique uses the whole sample of the comparison with common support to construct a weighted average match for each treated (Heckman et al. 1997, 1998).”
BackgroundMethodLong-Term and Spillover Effects of Health Shocks on Employment and Income
García-Gómez, P., Kippersluis, H. V., O’Donnell, O., & Doorslaer, E. V. (2013) · Journal of Human Resources · doi:10.1353/jhr.2013.0031 · Cited by 257
“…account of observable differences between employed individuals with and without an acute admission by matching using propensity scores and combine this with difference- in- differences (DiD) regression to correct for any selection on time invariant unobservables (Heckman, Ichimura, and Todd 1997).”
MethodResultInfluentialWhen Can History Be Our Guide? The Pitfalls of Counterfactual Inference
KING, G., & ZENG, L. (2007) · International Studies Quarterly · doi:10.1111/j.1468-2478.2007.00445.x · Cited by 256
“Similarly, we can avoid the biases due to nonrandom selection if we control for the probability that each unit is selected into the sample, and we can eliminate endogeneity bias by including in the controls covariates that eliminate the conditional relationship between X and the error term.”
BackgroundResultCucculelli, M., & Bettinelli, C. (2015) · Small Business Economics · doi:10.1007/s11187-015-9631-7 · Cited by 254
Innovation Strategy of Private Firms
Gao, H., Hsu, P.-H., & Li, K. (2018) · Journal of Financial and Quantitative Analysis · doi:10.1017/s0022109017001119 · Cited by 253
Can training and employment subsidies combat European unemployment?
Kluve, J., & Schmidt, C. M. (2002) · Economic Policy · doi:10.1111/1468-0327.00093 · Cited by 253
What Do State-Owned Development Banks Do? Evidence from BNDES, 2002–09
Lazzarini, S. G., Musacchio, A., Bandeira-de-Mello, R., & Marcon, R. (2015) · World Development · doi:10.1016/j.worlddev.2014.08.016 · Cited by 250
Bernini, C., & Pellegrini, G. (2011) · Regional Science and Urban Economics · doi:10.1016/j.regsciurbeco.2011.01.005 · Cited by 250
Corporate Social Initiatives and Employee Retention
Bode, C., Singh, J., & Rogan, M. (2015) · Organization Science · doi:10.1287/orsc.2015.1006 · Cited by 250
“…analysis, combined with empirical tests based on the methodology of Altonji et al. (2005) and supplementary evidence drawn from survey and interview data, are consistent with a more conservative “treatment on the treated” interpretation (Angrist and Pischke 2009, Heckman et al. 1997, Imbens 2004).”
Executive Compensation and Corporate Fraud in China
Conyon, M. J., & He, L. (2016) · Journal of Business Ethics · doi:10.1007/s10551-014-2390-6 · Cited by 250
“…methods to partially resolve such selection effects (Angrist and Pischke 2009; Rosenbaum and Rubin 1983).10 The goal of propensity score matching (Heckman et al. 1997, 1998; Imbens 2000) is to find a set of non-fraud control firms that can be matched optimally to the set of firms that have…”
Are firms that receive R&D subsidies more innovative?
Bérubé, C., & Mohnen, P. (2009) · Canadian Journal of Economics/Revue canadienne d'économique · doi:10.1111/j.1540-5982.2008.01505.x · Cited by 250
BALL, R., LI, X., & SHIVAKUMAR, L. (2015) · Journal of Accounting Research · doi:10.1111/1475-679x.12095 · Cited by 249
Cluver, L., Boyes, M., Orkin, M., Pantelic, M., Molwena, T., & Sherr, L. (2013) · The Lancet Global Health · doi:10.1016/s2214-109x(13)70115-3 · Cited by 247
Does Microfinance Reduce Poverty in Bangladesh? New Evidence from Household Panel Data
Imai, K. S., & Azam, M. S. (2012) · Journal of Development Studies · doi:10.1080/00220388.2012.661853 · Cited by 246
“…issues for propensity score matching estimation are discussed in, for example, Becker and Ichino (2002), Dehejia (2005), Dehejia and Wahba (2002), Heckman et al. (1997), Ravallion (2008), Smith and Todd (2005), and Todd (2008).10 In the first stage logit model of PSM, we include the same set of…”
BackgroundMethodDoes the Current Account Matter?
Edwards, S. (2002) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226185057.003.0002 · Cited by 246
The Causal Effects of Rural-to-Urban Migration on Children’s Well-being in China
Xu, H., & Xie, Y. (2015) · European Sociological Review · doi:10.1093/esr/jcv009 · Cited by 245
Causal Inference About the Effects of Interventions From Observational Studies in Medical Journals
Dahabreh, I. J., & Bibbins-Domingo, K. (2024) · JAMA · doi:10.1001/jama.2024.7741 · Cited by 242
Mensah, J., Oppong, J. R., & Schmidt, C. M. (2010) · Health Economics · doi:10.1002/hec.1633 · Cited by 242
“Out of the complete set here we report four sets of the results, namely nearest neighbor matching with and without replacement, radius matching and Kernel matching (Heckman et al., 1997, 1998; Imbens 2000, Lechner, 2001).”
Regression–Discontinuity Analysis: A Survey of Recent Developments in Economics
Van Der Klaauw, W. (2008) · LABOUR · doi:10.1111/j.1467-9914.2008.00419.x · Cited by 242
Benefits, costs, and livelihood implications of a regional payment for ecosystem service program
Zheng, H., Robinson, B. E., Liang, Y.-C., Polasky, S., Ma, D.-C., Wang, F.-C., Ruckelshaus, M., Ouyang, Z.-Y., & Daily, G. C. (2013) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1312324110 · Cited by 241
Gao, Y., Zhao, D., Yu, L., & Yang, H. (2020) · Journal of Rural Studies · doi:10.1016/j.jrurstud.2020.04.016 · Cited by 239
Koufteros, X., Verghese, A. (., & Lucianetti, L. (2014) · Journal of Operations Management · doi:10.1016/j.jom.2014.06.003 · Cited by 234
Crosnoe, R. (2005) · American Educational Research Journal · doi:10.3102/00028312042002269 · Cited by 234
“Differences between individuals with the same or similar propensity score values are, therefore, a function of the treatment and not of the characteristics associated with receiving the treatment ( Heckman, Ichimura, & Todd, 1997; Morgan, 2001).”
BackgroundCurrency unions and trade: the effect is large
Rose, A. K. (2001) · Economic Policy · doi:10.1111/1468-0327.00082 · Cited by 234
Joppa, L., & Pfaff, A. (2010) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.2009.05162.x · Cited by 233
“address the issue of a lack of covariate overlap, noting that many common estimators become sensitive to the choice of specification (much as Cochran(62) had noted for regression and following also related prior work that includes the studies by Heckman, Ichimura, and Todd.(56,57)) Crump et al.”
ResultChen, Y., & Jin, G. Z. (2012) · Journal of Health Economics · doi:10.1016/j.jhealeco.2011.11.001 · Cited by 231
Place, space, and geographical exposure: Foreign subsidiary survival in conflict zones
Dai, L., Eden, L., & Beamish, P. W. (2013) · Journal of International Business Studies · doi:10.1057/jibs.2013.12 · Cited by 230
Remittances and natural disasters: ex-post response and contribution to ex-ante preparedness
Mohapatra, S., Joseph, G., & Ratha, D. (2012) · Environment, Development and Sustainability · doi:10.1007/s10668-011-9330-8 · Cited by 229
The Impact of Unconditional Cash Transfers on Nutrition: The South African Child Support Grant
Agüero, J. M., Carter, M. R., & Woolard, I. (2006) · LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) · Cited by 255
Causal inference and developmental psychology.
Foster, E. M. (2010) · Developmental Psychology · doi:10.1037/a0020204 · Cited by 227
“Heckman, Ichimura, and Todd (1997) considered the circumstances under which one might draw a comparison group from a secondary data source.”
BackgroundSpreeuwenberg, M. D., Bartak, A., Croon, M. A., Hagenaars, J. A., Busschbach, J. J. V., Andrea, H., Twisk, J., & Stijnen, T. (2010) · Medical Care · doi:10.1097/mlr.0b013e3181c1328f · Cited by 227
“This implies that control on the PS through regression adjustment, matching or stratification removes the bias associated with the differences in observed pretreatment differences.(8,9,11,14,16) –19 It has been proven that the PS is a balancing score since, after control on the PS, the distribution of the covariates i…”
BackgroundHow standards compete: comparative impact of coffee certification schemes in Northern Nicaragua
Ruben, R., & Zuñiga, G. (2011) · Supply Chain Management An International Journal · doi:10.1108/13598541111115356 · Cited by 227
Hutchison, M. M., & Noy, I. (2006) · Journal of Development Economics · doi:10.1016/j.jdeveco.2004.12.002 · Cited by 227
Finance and Growth at the Firm Level: Evidence from SBA Loans
BROWN, J. D., & EARLE, J. S. (2017) · The Journal of Finance · doi:10.1111/jofi.12492 · Cited by 226
The Labor Market Impacts of Youth Training in the Dominican Republic
Card, D., Ibarrarán, P., Regalia, F., Rosas-Shady, D., & Soares, Y. (2011) · Journal of Labor Economics · doi:10.1086/658090 · Cited by 225
Regional poverty targeting in China
Park, A., Wang, S., & Wu, G. (2002) · Journal of Public Economics · doi:10.1016/s0047-2727(01)00108-6 · Cited by 225
“…regression estimate of program impact during the period (an instrumented cross-sectional regression), and a 3SLS differenced estimate using data from all periods (specification 1 in Table 6), a parametric version of the difference-in-difference matching estimator proposed by Heckman et al. (1997).”
BackgroundMethodResultInfluentialPropensity score matching and variations on the balancing test
Lee, W.-S. (2013) · Empirical Economics · doi:10.1007/s00181-011-0481-0 · Cited by 224
“…true value of the propensity score, we use the estimated propensity score in our simulations because previous studies (for example, Rosenbaum 1987; Heckman et al. 1997; Hirano et al. 2003) have suggested that the estimated score helps to remove any potential sample imbalances and can lead to…”
Colmer, J., Martin, R., Muûls, M., & Wagner, U. J. (2025) · Review of Economic Studies · doi:10.1093/restud/rdae055 · Cited by 222
“We use a semi-parametric difference-in-differences approach, following Heckman et al. (1997, 1998): where I 1 denotes the set of ETS firms, I 0 the set of non-ETS firms, and N 1 the number of participating firms in the treatment group.”
Capital-flow management measures: What are they good for?
Forbes, K., Fratzscher, M., & Straub, R. (2015) · Journal of International Economics · doi:10.1016/j.jinteco.2014.11.004 · Cited by 222
“See Heckman, Ichimura, and Todd (1997, 1998) for a detailed description of the local-linear matching method.”
Bondonio, D., & Greenbaum, R. T. (2007) · Regional Science and Urban Economics · doi:10.1016/j.regsciurbeco.2006.08.002 · Cited by 222
“In a matching-estimator setting, Heckman et al. (1997) and Dehejia and Wahba (1999) show that better impact estimates can be retrieved by limiting the estimation sample to observations with propensity scores for which there are both treatment and comparison observations.”
BackgroundWhat Is Academic Momentum? And Does It Matter?
Attewell, P., Heil, S., & Reisel, L. (2012) · Educational Evaluation and Policy Analysis · doi:10.3102/0162373711421958 · Cited by 221
Farmer Bargaining Power and Market Information Services
Courtois, P., & Subervie, J. (2015) · American Journal of Agricultural Economics · doi:10.1093/ajae/aau051 · Cited by 219
“…factors X, there may be systematic di erences between informed and uninformed farmers' outcomes that could lead to a violation of the identi cation conditions required for matching, we choose to apply the di erence-in-di erence matching estimator, as de ned in Heckman, Ichimura, and Todd (1997).”
How far can reduced childcare prices push female labour supply?
Lundin, D., Mörk, E., & Öckert, B. (2008) · Labour Economics · doi:10.1016/j.labeco.2008.04.005 · Cited by 218
Machine learning in agricultural and applied economics
Storm, H., Baylis, K., & Heckelei, T. (2020) · European Review of Agricultural Economics · doi:10.1093/erae/jbz033 · Cited by 216
(International) R&D collaboration and SMEs: The effectiveness of targeted public R&D support schemes
Hottenrott, H., & Lopes-Bento, C. (2014) · Research Policy · doi:10.1016/j.respol.2014.01.004 · Cited by 216
Efficacy of Two Lion Conservation Programs in Maasailand, Kenya
HAZZAH, L., DOLRENRY, S., NAUGHTON, L., EDWARDS, C. T. T., MWEBI, O., KEARNEY, F., & FRANK, L. (2014) · Conservation Biology · doi:10.1111/cobi.12244 · Cited by 215
Verhofstadt, E., & Maertens, M. (2014) · Agricultural Economics · doi:10.1111/agec.12128 · Cited by 214
Adukia, A. (2017) · American Economic Journal: Applied Economics · doi:10.1257/app.20150083 · Cited by 214
“…estimates using nearest-neighbor matching without replacement (Abadie and Imbens 2006), column 4 reports estimates from kernel-based matching (Heckman et al. 1997), column 5 reports estimates using Mahalanobis matching (Rosenbaum and Rubin 1985), and column 6 reports estimates from radius…”
MethodBound, J., Lovenheim, M. F., & Turner, S. (2010) · American Economic Journal: Applied Economics · doi:10.1257/app.2.3.129 · Cited by 213
Job displacement and stress‐related health outcomes
Browning, M., Moller Dano, A., & Heinesen, E. (2006) · Health Economics · doi:10.1002/hec.1101 · Cited by 213
(2009) · Solutions for the World's Biggest Problems · doi:10.1017/cbo9780511493560.022 · Cited by 213
Zhang, Y.-J., & Wang, W. (2021) · Energy Economics · doi:10.1016/j.eneco.2021.105224 · Cited by 212
Simulation-Based Sensitivity Analysis for Matching Estimators
Nannicini, T. (2007) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0700700303 · Cited by 212
“Moreover, the between-imputation standard error is shown, to use only the variability of the simulated ATT across iterations.”
InfluentialGertler, P., Levine, D. I., & Ames, M. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023769 · Cited by 211
Wang, X., Huang, J., & Liu, H. (2022) · Journal of Environmental Management · doi:10.1016/j.jenvman.2021.114357 · Cited by 210
Estimating causal effects: considering three alternatives to difference-in-differences estimation
O’Neill, S., Kreif, N., Grieve, R., Sutton, M., & Sekhon, J. S. (2016) · Health Services and Outcomes Research Methodology · doi:10.1007/s10742-016-0146-8 · Cited by 210
“Matching also aims to control for pre-treatment outcomes and covariates, by creating a matched control pool which is similar to the treated group (Heckman et al. 1997; Smith and Todd 2005; Imbens 2004; Stuart et al. 2014).”
MethodInfluentialA Propensity Score Matching Analysis of the Effects of Special Education Services
Morgan, P. L., Frisco, M. L., Farkas, G., & Hibel, J. (2010) · The Journal of Special Education · doi:10.1177/0022466908323007 · Cited by 209
Rural Roads and Local Market Development in Vietnam
Mu, R., & van de Walle, D. (2011) · The Journal of Development Studies · doi:10.1080/00220381003599436 · Cited by 209
“We apply nonparametric kernel matching in which all the nonparticipants are used as comparison communes and weights are assigned according to a kernel function of the predicted propensity score following Heckman et al. (1997).”
MethodEvaluating the effects of farm programmes: results from propensity score matching
Pufahl, A., & Weiss, C. R. (2009) · European Review of Agricultural Economics · doi:10.1093/erae/jbp001 · Cited by 209
“[14] stress that, for a variety of reasons, there may be systematic differe nces between participant and non-participant outcomes, even after conditioning on observables.”
BackgroundWen, S., Jia, Z., & Chen, X. (2022) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2022.131131 · Cited by 209
Jia, S., Zhou, C., & Qin, C. (2017) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2017.08.011 · Cited by 209
The effect of school quality on educational attainment and wages
Dearden, L., Ferri, J., & Meghir, C. (2000) · Working Paper Series · doi:10.1920/wp.ifs.2000.0022 · Cited by 205
Value for money? New microeconometric evidence on public R&D grants in Flanders
Czarnitzki, D., & Lopes-Bento, C. (2013) · Research Policy · doi:10.1016/j.respol.2012.04.008 · Cited by 202
Hill, J. L., Brooks-Gunn, J., & Waldfogel, J. (2003) · Developmental Psychology · doi:10.1037/0012-1649.39.4.730 · Cited by 202
Enterprise zones and local employment: evidence from the states’ programs
Bondonio, D., & Engberg, J. (2000) · Regional Science and Urban Economics · doi:10.1016/s0166-0462(00)00042-9 · Cited by 202
Welfare impacts of maize–pigeonpea intensification in Tanzania
Amare, M., Asfaw, S., & Shiferaw, B. (2012) · Agricultural Economics · doi:10.1111/j.1574-0862.2011.00563.x · Cited by 200
The Impact of Gurus: Parker Grades and en Primeur Wine Prices
Ali, H. H., Lecocq, S., & Visser, M. (2008) · The Economic Journal · doi:10.1111/j.1468-0297.2008.02147.x · Cited by 200
Abate, G. T., Rashid, S., Borzaga, C., & Getnet, K. (2016) · World Development · doi:10.1016/j.worlddev.2016.03.003 · Cited by 199
Do Fresh Produce Exporters in Sub-Saharan Africa Benefit from GlobalGAP Certification?
Henson, S., Masakure, O., & Cranfield, J. (2011) · World Development · doi:10.1016/j.worlddev.2010.06.012 · Cited by 199
Michalopoulos, C., Bloom, H. S., & Hill, C. J. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023732 · Cited by 199
“As noted earlier, prior research by Friedlander and Robins (1995) and Heckman et al. (1997) suggests that out-of-state comparison groups should perform less well than in-state ones.”
Result“Lending by example”: Direct and indirect effects of foreign banks in emerging markets
Giannetti, M., & Ongena, S. (2012) · Journal of International Economics · doi:10.1016/j.jinteco.2011.08.005 · Cited by 198
“To mitigate concerns that firms with certain unobservable characteristics systematically establish relationships with foreign banks, we thus estimate a treatment effects model (see, for instance, Heckman and Robb (1985)).”
Diff: Simplifying the Estimation of Difference-in-differences Treatment Effects
Villa, J. M. (2016) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x1601600108 · Cited by 198
“This option generates the variable weights, which contains the weights(2) derived from the kernel propensityscore matching, as well as generates ps when the propensity score is not supplied in pscore(varname), following Leuven and Sianesi (2003). This option requires specification of the id(varname) option except when…”
Chen, L., & Wang, K. (2022) · Energy Economics · doi:10.1016/j.eneco.2022.106018 · Cited by 198
Solar photovoltaic interventions have reduced rural poverty in China
Zhang, H., Wu, K., Qiu, Y. L., Chan, G., Wang, S., Zhou, D., & Ren, X. (2020) · Nature Communications · doi:10.1038/s41467-020-15826-4 · Cited by 215
Estimating the Cost of Type 1 Diabetes in the U.S.: A Propensity Score Matching Method
Tao, B., Pietropaolo, M., Atkinson, M., Schatz, D., & Taylor, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0011501 · Cited by 197
Heckman, J. J., & Smith, J. A. (2004) · Journal of Labor Economics · doi:10.1086/381250 · Cited by 197
“For example, the propensity score matching methods developed and applied in Heckman, Ichimura, and Todd (1997, 1998) and Heckman, Ichimura, Smith, and Todd (1998) build directly on estimates of the probability of participation conditional on observable characteristics.”
Self-citationDiaz, J. J., & Handa, S. (2006) · Journal of Human Resources · doi:10.3368/jhr.xli.2.319 · Cited by 196
Currency Crises, Capital-Account Liberalization, and Selection Bias
Glick, R., Guo, X., & Hutchison, M. (2006) · Review of Economics and Statistics · doi:10.1162/rest.88.4.698 · Cited by 194
What Makes a Good Image? Airbnb Demand Analytics Leveraging Interpretable Image Features
Zhang, S., Lee, D., Singh, P. V., & Srinivasan, K. (2022) · Management Science · doi:10.1287/mnsc.2021.4175 · Cited by 193
“Methods and Results We implement a DiD analysis (Heckman et al. 1997) with PSW to mitigate the endogeneity concern.”
Chabé-Ferret, S., & Subervie, J. (2013) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2012.09.003 · Cited by 193
“We use difference-in-difference (DID) matching [2,15] to eliminate selection bias and to estimate the ATT.”
BackgroundMethodInfluentialUnemployment and social exclusion
Pohlan, L. (2019) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2019.06.006 · Cited by 192
Gitonga, Z. M., De Groote, H., Kassie, M., & Tefera, T. (2013) · Food Policy · doi:10.1016/j.foodpol.2013.08.005 · Cited by 192
“Another econometric method of dealing with the problem of selection bias with cross-sectional data in a non-experimental framework without the assumptions of functional and distributional form or exogeneity of covariates, is the propensity score matching (PSM) method, that has recently gained popularity (Diagne and De…”
BackgroundMethodInfluentialSocial Protection in a Crisis: Argentina's Plan Jefes y Jefas
Galasso, E. (2004) · The World Bank Economic Review · doi:10.1093/wber/lhh044 · Cited by 190
Gilligan, D. O., & Hoddinott, J. (2007) · American Journal of Agricultural Economics · doi:10.1111/j.1467-8276.2007.00992.x · Cited by 190
“The version of this estimator based on matching was formalized in Heckman, Ichimura, and Todd (1997) and Heckman et al. (1998). Through comparisons with experimental estimators, Heckman, Ichimura, and Todd (1997, 1998) and Heckman et al.”
Colombo, M. G., & Piva, E. (2012) · Research Policy · doi:10.1016/j.respol.2011.08.010 · Cited by 190
“Thus, xact matching on this variable limits the risk that our results are riven by a selection bias (Heckman et al., 1997, 1998).”
BackgroundEstimating Dynamic Treatment Effects in Event Studies with Heterogeneous Treatment Effects
(2018) · doi:10.48550/arxiv.1804.05785 · Cited by 189
“This case corresponds to essential heterogeneity as discussed in Heckman et al. (2006). In addition to these two sources of heterogeneity, treatment effects may vary across cohorts due to calendar time-varying effects (e.”
BackgroundInstitutional Investors and Mutual Fund Governance: Evidence from Retail–Institutional Fund Twins
Evans, R. B., & Fahlenbrach, R. (2012) · Review of Financial Studies · doi:10.1093/rfs/hhs105 · Cited by 189
All the president's friends: Political access and firm value
Brown, J. R., & Huang, J. (2020) · Journal of Financial Economics · doi:10.1016/j.jfineco.2020.05.004 · Cited by 188
“We use a one-to-one nearest neighbor matching with replacement (Heckman, Ichimura, and Todd, 1997).”
MethodZhang, H., Duan, M., & Deng, Z. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2019.06.247 · Cited by 187
Lin, B., & Zhang, A. (2023) · Environmental Impact Assessment Review · doi:10.1016/j.eiar.2022.106991 · Cited by 185
van Rijsbergen, B., Elbers, W., Ruben, R., & Njuguna, S. N. (2016) · World Development · doi:10.1016/j.worlddev.2015.08.021 · Cited by 184
Political Institutions and Policy Outcomes: What are the Stylized Facts?
Persson, T., & Tabellini, G. (2001) · SSRN Electronic Journal · doi:10.2139/ssrn.270935 · Cited by 184
Ibanez, M., & Blackman, A. (2016) · World Development · doi:10.1016/j.worlddev.2016.01.004 · Cited by 183
Metadata
- Authors
- Heckman, J. J., Ichimura, H., & Todd, P. E.
- Affiliations
- University of Chicago (US)
- University of Pittsburgh (US)
- University of Pennsylvania (US)
- Venue
- The Review of Economic Studies
- Publisher
- Oxford University Press (OUP)
- Published
- 1997-10-01
- Volume
- 64
- Issue
- 4
- Pages
- 605-654
- ISSN
- 0034-6527 (ISSN-L)
- 1467-937X
- OpenAlex
- W2066735350
- Semantic Scholar
- ec958b198d3b6712d1e0f3395a05ff2b0136a1bb
- Cited by
- 5,486
- References
- 32
- Citations by year
- 2026: 216 · 2025: 268 · 2024: 271 · 2023: 292 · 2022: 296 · 2021: 246 · 2020: 254 · 2019: 244 · 2018: 269 · 2017: 236 · 2016: 231 · 2015: 251 · 2014: 266 · 2013: 248 · 2012: 275
- FWCI
- 20.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Review of Economic Studies (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- selection on unobservables, sample selection model, identifying assumptions, omitted variables
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.