Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme
The DOI matches its Crossref record; 31 of the 32 references it cites were found in a registry or an index.
Abstract
This paper considers whether it is possible to devise a nonexperimental procedure for evaluating a prototypical job training programme. Using rich nonexperimental data, we examine the performance of a two-stage evaluation methodology that (a) estimates the probability that a person participates in a programme and (b) uses the estimated probability in extensions of the classical method of matching. We decompose the conventional measure of programme evaluation bias into several components and find that bias due to selection on unobservables, commonly called selection bias in econometrics, is empirically less important than other components, although it is still a sizeable fraction of the estimated programme impact. Matching methods applied to comparison groups located in the same labour markets as participants and administered the same questionnaire eliminate much of the bias as conventionally measured, but the remaining bias is a considerable fraction of experimentally-determined programme impact estimates. We test and reject the identifying assumptions that justify the classical method of matching. We present a nonparametric conditional difference-in-differences extension of the method of matching that is consistent with the classical index-sufficient sample selection model and is not rejected by our tests of identifying assumptions. This estimator is effective in eliminating bias, especially when it is due to temporally-invariant omitted variables.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For the OR approach, the consistency of the ATT estimator (2.2) relies on the estimators of md , t ( · ) , ̂ µ d , t ( · ) , being correctly specified, whereas the IPW estimator (2.4) relies on the propensity score estimator ̂ π ( · ) of p ( · ) being correctly specified.”
From Doubly robust difference-in-differences estimators (2020) · cites this paper as Heckman et al. (1997)
In the citing paper
“These fall into two main categories, which we denote trajectory modeling [28, 29, 86, 88, 95] and propensity score weighting [17, 30].”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“Doubly robust (DR) estimators combine trajectory modeling and propensity score estimation and produce consistent estimates if either the trajectory model or the propensity score model is correctly specified: [29]”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“The OR, IPW and DR estimands respectively generalize Heckman et al. (1997), Abadie (2005) and Sant'Anna and Zhao (2020) estimands for the two groups, two periods DiD setup to the staggered DiD setup with multiple periods and multiple groups.”
From Difference-in-Differences with multiple time periods (2021) · cites this paper as Heckman et al. (1997)
In the citing paper
“CS also derives estimators that are consistent for AT T (g, τ ) under more general conditions, such as when the parallel-trends assumption holds conditionally on covariates, including an outcome-regression-based estimator”
From How Much Should We Trust Staggered Difference-in-Differences Estimates? (2022) · cites this paper as Heckman et al., 1997
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,796
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774
SOME THOUGHTS ON THE DISTRIBUTION OF EARNINGS 1
ROY, A. D. (1951) · Oxford Economic Papers · doi:10.1093/oxfordjournals.oep.a041827 · Cited by 2,958
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503
Estimating the Effect of Training Programs on Earnings
Ashenfelter, O. (1978) · The Review of Economics and Statistics · doi:10.2307/1924332 · Cited by 1,515
Design-adaptive Nonparametric Regression
Fan, J. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10476255 · Cited by 1,268
The Estimation of Choice Probabilities from Choice Based Samples
Manski, C. F., & Lerman, S. R. (1977) · Econometrica · doi:10.2307/1914121 · Cited by 1,208
Cited by
Items 301–400 of 1,029
State ownership reinvented? Explaining performance differences between state‐owned and private firms
Lazzarini, S. G., & Musacchio, A. (2018) · Corporate Governance: An International Review · doi:10.1111/corg.12239 · Cited by 183
“In some specifications, we also run differences-in-differences estimations to remove the effect of unobservables (Heckman, Ichimura, & Todd, 1997), as well as dynamic panel regressions to control for adjustment processes (Arellano & Bover, 1995; Blundell & Bond, 1998).”
What Goes Up May Not Come Down: Asymmetric Incidence of Value-Added Taxes
Benzarti, Y., Carloni, D., Harju, J., & Kosonen, T. (2020) · Journal of Political Economy · doi:10.1086/710558 · Cited by 182
Melguizo, T., Kienzl, G., & Alfonso, M. (2011) · The Journal of Higher Education · doi:10.1353/jhe.2011.0013 · Cited by 209
Propensity Score Matching Methods for Non-experimental Causal Studies
Dehejia, R., & Wahba, S. (1998) · National Bureau of Economic Research · doi:10.3386/w6829 · Cited by 181
Workfare as an Effective Way to Fight Poverty: The Case of India’s NREGS
Ravi, S., & Engler, M. (2015) · World Development · doi:10.1016/j.worlddev.2014.09.029 · Cited by 181
The impact of audit quality on real and accrual earnings management around IPOs
Alhadab, M., & Clacher, I. (2017) · The British Accounting Review · doi:10.1016/j.bar.2017.12.003 · Cited by 202
Are RTA agreements with environmental provisions reducing emissions?
Baghdadi, L., Martinez-Zarzoso, I., & Zitouna, H. (2013) · Journal of International Economics · doi:10.1016/j.jinteco.2013.04.001 · Cited by 180
“The difference-in-differences (hereafter DID) approach is well suited to dealing with this issue (Meyer, 1994; Heckman et al., 1997).”
The Sovereign Wealth Fund Discount: Evidence from Public Equity Investments
Bortolotti, B., Fotak, V., & Megginson, W. L. (2015) · Review of Financial Studies · doi:10.1093/rfs/hhv036 · Cited by 180
The Effect of School Quality on Educational Attainment and Wages
Dearden, L., Ferri, J., & Meghir, C. (2002) · Review of Economics and Statistics · doi:10.1162/003465302317331883 · Cited by 180
“This ensures that the comparison takes place over a common support for the treated and the nontreated group.29 (See Heckman et al., 1997.)”
BackgroundEmployee Ownership and Firm Disclosure
Bova, F., Dou, Y., & Hope, O. (2015) · Contemporary Accounting Research · doi:10.1111/1911-3846.12084 · Cited by 179
Behrman, J. R., Parker, S. W., & Todd, P. E. (2011) · Journal of Human Resources · doi:10.3368/jhr.46.1.93 · Cited by 178
Self-citationDecomposing changes in wage distributions: a unified approach
Lemieux, T. (2002) · Canadian Journal of Economics/Revue canadienne d'économique · doi:10.1111/1540-5982.00149 · Cited by 178
Bank ownership, lending, and local economic performance during the 2008–2009 financial crisis
Coleman, N., & Feler, L. (2014) · Journal of Monetary Economics · doi:10.1016/j.jmoneco.2014.11.001 · Cited by 209
“See Dehejia and Wahba (1999) and Heckman et al. (1997) for a discussion of propensity-score matching.”
Asymmetric Information and Imperfect Competition in Lending Markets
Crawford, G. S., Pavanini, N., & Schivardi, F. (2018) · American Economic Review · doi:10.1257/aer.20150487 · Cited by 177
Why do loans contain covenants? Evidence from lending relationships
Prilmeier, R. (2017) · Journal of Financial Economics · doi:10.1016/j.jfineco.2016.12.007 · Cited by 177
Schools, Teachers, and Education Outcomes in Developing Countries
Glewwe, P. W., & Kremer, M. R. (2005) · Digital Access to Scholarship at Harvard (DASH) (Harvard University) · Cited by 558
The Returns to Academic and Vocational Qualifications in Britain
Dearden, L., McIntosh, S., Myck, M., & Vignoles, A. (2002) · Bulletin of Economic Research · doi:10.1111/1467-8586.00152 · Cited by 176
“This estimator is a simplified version of the fully non-parametric propensity score-matching estimators described in Heckman et al. (1997; 1998) .”
Andersson, C., Mekonnen, A., & Stage, J. (2011) · Journal of Development Economics · doi:10.1016/j.jdeveco.2009.12.002 · Cited by 176
“To check the robustness of the effect of the PSNP on asset holdings, we also used propensity score matching (Rosenbaum and Rubin 1983; Heckman et al. 1997, 1998).”
MethodRennings, K., & Rammer, C. (2009) · SSRN Electronic Journal · doi:10.2139/ssrn.1495761 · Cited by 176
“Matching approaches have been developed for evaluation purposes (see Heckman et al., 1997) but are increasingly used in other fields today, including innovation analysis (see Almus and Czarnitzki 2003, Aschhoff 2009, Deguet 2004, Czarnitzki and Licht 2006, Czarnitzki et al. 2007).”
MethodDoes job loss cause ill health?
Salm, M. (2009) · Health Economics · doi:10.1002/hec.1537 · Cited by 175
“A formal definition of this effect, similar to Heckman et al. (1997) is: a ¼ EðYði; 1Þ Yði; 0ÞjDði; 1Þ ¼ 1Þ EðYði; 1Þ Yði; 0ÞjDði; 1Þ ¼ 0Þ ð1Þ where Y(i, t) is the health of individual i at time t.”
Leth-Petersen, S. (2010) · American Economic Review · doi:10.1257/aer.100.3.1080 · Cited by 175
OECD Framework for the Evaluation of SME and Entrepreneurship Policies and Programmes
OECD (2008) · OECD eBooks · doi:10.1787/9789264040090-en · Cited by 174
Difference-in-Differences Designs: A Practitioner’s Guide
Baker, A., Callaway, B., Cunningham, S., Goodman-Bacon, A., & Sant’Anna, P. H. C. (2026) · Journal of Economic Literature · doi:10.1257/jel.20251650 · Cited by 266
Getting Girls into School: Evidence from a Scholarship Program in Cambodia
Filmer, D., & Schady, N. (2008) · Economic Development and Cultural Change · doi:10.1086/533548 · Cited by 173
De Haas, R., & Popov, A. (2023) · The Economic Journal · doi:10.1093/ej/ueac081 · Cited by 173
Switching to self-employment can be good for your health
Nikolova, M. (2019) · Journal of Business Venturing · doi:10.1016/j.jbusvent.2018.09.001 · Cited by 172
Capital structure decisions in family firms: empirical evidence from a bank-based economy
Ampenberger, M., Schmid, T., Achleitner, A.-K., & Kaserer, C. (2013) · Review of Managerial Science · doi:10.1007/s11846-011-0077-2 · Cited by 172
Propensity Score Analysis: Recent Debate and Discussion
Guo, S., Fräser, M. W., & Chen, Q. (2020) · Journal of the Society for Social Work and Research · doi:10.1086/711393 · Cited by 185
“Themodelmay be called a difference-in-differences approach (Heckman et al., 1997) when it is applied to data for two timepoints (i.”
BackgroundMethodOn the Failure of the Bootstrap for Matching Estimators
Abadie, A., & Imbens, G. (2006) · National Bureau of Economic Research · doi:10.3386/t0325 · Cited by 152
Structural Equations, Treatment Effects and Econometric Policy Evaluation
Heckman, J., & Vytlacil, E. (2005) · National Bureau of Economic Research · doi:10.3386/t0306 · Cited by 170
Self-citationDo Joint Audits Improve Audit Quality? Evidence from Voluntary Joint Audits
Zerni, M., Haapamäki, E., Järvinen, T., & Niemi, L. (2012) · European Accounting Review · doi:10.1080/09638180.2012.678599 · Cited by 170
The Identification Zoo: Meanings of Identification in Econometrics
Lewbel, A. (2019) · Journal of Economic Literature · doi:10.1257/jel.20181361 · Cited by 225
Changes in hospital efficiency after privatization
Tiemann, O., & Schreyögg, J. (2012) · Health Care Management Science · doi:10.1007/s10729-012-9193-z · Cited by 169
“The second approach has involved much larger samples of privatized entities and, defining the privatization event as an intervention, has applied methods proposed in the literature on program evaluation [24, 25].”
MethodDifferential effects of active labour market programs for the unemployed
Sianesi, B. (2008) · Labour Economics · doi:10.1016/j.labeco.2007.04.004 · Cited by 169
Marital Disruption and Economic Well-Being: a Comparative Analysis
Aassve, A., Betti, G., Mazzuco, S., & Mencarini, L. (2007) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2007.00483.x · Cited by 169
“X/=E.Ut0i|Xi, Di =1/−E.Ut0i|Xi, Di =0/, where U0i is the value of unobserved variables (Heckman et al., 1998).”
InfluentialImpact evaluation of India's ‘Yeshasvini’ community‐based health insurance programme
Aggarwal, A. (2010) · Health Economics · doi:10.1002/hec.1605 · Cited by 168
When Does Regulation Distort Costs? Lessons from Fuel Procurement in US Electricity Generation
Cicala, S. (2015) · American Economic Review · doi:10.1257/aer.20131377 · Cited by 168
Relationship between private schooling and achievement: Results from rural and urban India
Chudgar, A., & Quin, E. (2011) · Economics of Education Review · doi:10.1016/j.econedurev.2011.12.003 · Cited by 168
Lobbying on Regulatory Enforcement Actions: Evidence from U.S. Commercial and Savings Banks
Lambert, T. (2019) · Management Science · doi:10.1287/mnsc.2017.2895 · Cited by 167
Fletcher, J. (2010) · Journal of Policy Analysis and Management · doi:10.1002/pam.20479 · Cited by 149
Criscuolo, P., Nicolaou, N., & Salter, A. J. (2012) · Research Policy · doi:10.1016/j.respol.2011.12.001 · Cited by 206
“…estimators are usually applied to evaluate the effect of a policy intervention (treatment) on the sub-population of individuals or firms exposed to the treatment (treated) and/or on the sub-population not exposed to it (non-treated) (see for example Heckman et al. 1997; Heckman et al. 1999).”
BackgroundMethodDo more reputable financial institutions reduce earnings management by IPO issuers?
Lee, G., & Masulis, R. W. (2011) · Journal of Corporate Finance · doi:10.1016/j.jcorpfin.2011.04.012 · Cited by 186
“Therefore, a further refinement was developed called “kernel matching” proposed and implemented by Heckman et al. (1997, 1998).”
MethodRevisiting field experimentation: Field notes for the future.
Shadish, W. R. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.3 · Cited by 153
Water for Life: The Impact of the Privatization of Water Services on Child MortalityPreprint
Galiani, S., Schargrodsky, E., & Gertler, P. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1751702 · Cited by 167
Levine, D. I., & Painter, G. (2003) · Review of Economics and Statistics · doi:10.1162/003465303772815790 · Cited by 167
“Heckman, Ichimura, and Todd (1997) stress the importance of the probability distributions of, in our case, being a teen mom coming from the same support.”
BackgroundEcopayments and Deforestation in Costa Rica: A Nationwide Analysis of PSA’s Initial Years
Robalino, J., & Pfaff, A. (2013) · Land Economics · doi:10.3368/le.89.3.432 · Cited by 152
A Critical Survey of Empirical Methods for Evaluating Active Labor Market Policies
Smith, J. A. (2000) · Zeitschrift für schweizerische Statistik und Volkswirtschaft/Schweizerische Zeitschrift für Volkswirtschaft und Statistik/Swiss journal of economics and statistics · Cited by 233
Wang, W., Temsah, G., & Mallick, L. (2016) · Health Policy and Planning · doi:10.1093/heapol/czw135 · Cited by 165
“We imposed the common support to improve the quality of matching (Heckman et al. 1997).”
MethodCan unconditional cash transfers raise long-term living standards? Evidence from Zambia
Handa, S., Natali, L., Seidenfeld, D., Tembo, G., & Davis, B. (2018) · Journal of Development Economics · doi:10.1016/j.jdeveco.2018.01.008 · Cited by 165
“This weighting approach to account for general attrition is discussed in Shadish et al. (2002), and is akin to selection on observables (Imbens, 2004; Rosenbaum and Rubin, 1983; Heckman et al., 1997).”
Institutions, health shocks and labour market outcomes across Europe
García-Gómez, P. (2011) · Journal of Health Economics · doi:10.1016/j.jhealeco.2010.11.003 · Cited by 165
Remittances and Labor Force Participation in Mexico: An Analysis Using Propensity Score Matching
Edwards, A. C., & Rodríguez-Oreggia, E. (2009) · World Development · doi:10.1016/j.worlddev.2008.09.010 · Cited by 201
Evanschitzky, H., Iyer, G. R., Pillai, K. G., Kenning, P., & Schütte, R. (2015) · Journal of Product Innovation Management · doi:10.1111/jpim.12241 · Cited by 151
Measuring the effect of M&A on patenting quantity and quality
Valentini, G. (2012) · Strategic Management Journal · doi:10.1002/smj.946 · Cited by 164
Foreign direct investment and firm performance: an empirical analysis of Italian firms
Borin, A., & Mancini, M. (2016) · Review of World Economics · doi:10.1007/s10290-016-0255-z · Cited by 196
“This can be obtained by combining a difference-in-differences estimations by Heckman et al. (1997), which eliminate the fixed unobserved variables, with propensity score matching (PSM-DiD), meaning we compare the growth rates calculated between t 1 and t þ s (with s 1⁄4 1; 3; 5) between new MNEs and the matched domest…”
InfluentialEstimating Conditional Average Treatment Effects
Abrevaya, J., Hsu, Y.-C., & Lieli, R. P. (2015) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2014.975555 · Cited by 153
“Though not referred to by this name, the CATE function introduced in the second example already appears in Hahn (1998) and Heckman, Ichimura, and Todd (1997, 1998) as a “first stage” estimand in the (imputation-based) nonparametric estimation of ATE.”
MethodTang, C., Xue, Y., Wu, H., Irfan, M., & Hao, Y. (2022) · Technology in Society · doi:10.1016/j.techsoc.2022.101963 · Cited by 163
Braga, A. A., Hureau, D. M., & Papachristos, A. V. (2013) · Journal of Quantitative Criminology · doi:10.1007/s10940-013-9198-x · Cited by 185
“The broader propensity score matching literature identifies a wide variety of matching algorithms with different choices that need to be made when each approach is used (see, e.g. Apel and Sweeten 2010; Heckman et al. 1997; Imbens 2004; Smith and Todd 2005).”
Domestic versus cross-border acquisitions: which impact on the target firms’ performance?
Bertrand, O. F., & Zitouna, H. (2008) · Applied Economics · doi:10.1080/00036840600949397 · Cited by 163
“It results in one question: what would have been the target firm's performance if it had not been taken over? The difference-in-difference (hereafter DID) approach is well adapted to deal with this question (Meyer, 1994 ; Heckman et al , 1997 ).”
Matching for Causal Inference Without Balance CheckingPreprint
Iacus, S. M., King, G., & Porro, G. (2008) · SSRN Electronic Journal · doi:10.2139/ssrn.1152391 · Cited by 185
The Benefits and Costs of Microfinance: Evidence from Bangladesh
Chemin, M. (2008) · The Journal of Development Studies · doi:10.1080/00220380701846735 · Cited by 162
“…explanation of participation but not too good, since in cases where a certain X allowed us to discriminate perfectly between participant and non-participant, then a regression discontinuity design with such a variable would be more appropriate than a matching technique (Heckman et al., 1997a: 637).”
BackgroundMethodResultInfluentialAuntie Knows Best? Public Broadcasters and Current Affairs Knowledge
Soroka, S., Andrew, B., Aalberg, T., Iyengar, S., Curran, J., Coen, S., Hayashi, K., Jones, P., Mazzoleni, G., Woong Rhee, J., et al. (2013) · British Journal of Political Science · doi:10.1017/s0007123412000555 · Cited by 162
Assessing the impact of improved agricultural technologies on household income in rural Mozambique
Cunguara, B., & Darnhofer, I. (2011) · Food Policy · doi:10.1016/j.foodpol.2011.03.002 · Cited by 197
The specification of the propensity score in multilevel observational studies
Arpino, B., & Mealli, F. (2011) · Computational Statistics & Data Analysis · doi:10.1016/j.csda.2010.11.008 · Cited by 161
“It is instructive to remember the decomposition of the selection bias proposed by Heckman et al (1998).”
MethodLeone, M. I., & Reichstein, T. (2012) · Strategic Management Journal · doi:10.1002/smj.1950 · Cited by 161
Has Rural Infrastructure Rehabilitation in Georgia Helped the Poor?
Lokshin, M. M. (2005) · The World Bank Economic Review · doi:10.1093/wber/lhi007 · Cited by 198
Air pollution prevention and control action plan substantially reduced PM2.5 concentration in China
Yu, Y., Dai, C., Wei, Y., Ren, H., & Zhou, J. (2022) · Energy Economics · doi:10.1016/j.eneco.2022.106206 · Cited by 161
Trujillo, A. J., Portillo, J. E., & Vernon, J. A. (2005) · International Journal of Health Care Finance and Economics · doi:10.1007/s10754-005-1792-5 · Cited by 188
An evaluation of the active labour market programmes in SwedenPreprint
Sianesi, B. (2001) · RePEc: Research Papers in Economics · Cited by 188
Cross-country variations in capital structures: The role of bankruptcy codes
Acharya, V. V., Sundaram, R. K., & John, K. (2011) · Journal of Financial Intermediation · doi:10.1016/j.jfi.2010.02.001 · Cited by 161
“To this end, we use the procedures suggested by Heckman, Ichimura, and Todd (1997, 1998) to match each US firm in a given year to firms in the UK in that year.”
Economic and Social Impacts of an Innovative Self-Help Group Model in India
Deininger, K., & Liu, Y. (2013) · World Development · doi:10.1016/j.worlddev.2012.09.019 · Cited by 160
Poverty Reduction Effects of Agricultural Technology Adoption: A Micro-evidence from Rural Tanzania
Asfaw, S., Kassie, M., Simtowe, F., & Lipper, L. (2012) · Journal of Development Studies · doi:10.1080/00220388.2012.671475 · Cited by 160
“This assumption ensures that persons with the same X values have a positive probability of being both adopters and non-adopters (Heckman et al., 1997).”
BackgroundVolpe Martincus, C., & Carballo, J. (2010) · Journal of Development Economics · doi:10.1016/j.jdeveco.2009.02.007 · Cited by 160
Frölich, M. (2007) · The Econometrics Journal · doi:10.1111/j.1368-423x.2007.00212.x · Cited by 155
“…(i) that matching on the propensity score required different assumptions than matching on covariates, 2 and (ii) that PSM needed to be modified in the presence of choice-based sampling, i.e. over-or undersampling of treatment participants as in Heckman et al. (1997) and Heckman et al. (1998).”
State‐owned enterprises going public The case of China
Wang, X., Xu, L. C., & Zhu, T. (2004) · Economics of Transition · doi:10.1111/j.0967-0750.2004.00189.x · Cited by 160
Exporting and Plant-Level Efficiency Gains: It's in the Measure
García-Marín, Á., & Voigtländer, N. (2013) · Journal of Political Economy · doi:10.1086/701607 · Cited by 192
“This empirical approachuses propensity scorematching (PSM) in the spirit of Rosenbaum and Rubin (1983) and further developed by Heckman, Ichimura, and Todd (1997).”
Hijzen, A., Martins, P. S., Schank, T., & Upward, R. (2013) · European Economic Review · doi:10.1016/j.euroecorev.2013.02.001 · Cited by 159
Do high technology acquirers become more innovative?
Desyllas, P., & Hughes, A. (2010) · Research Policy · doi:10.1016/j.respol.2010.05.005 · Cited by 196
“…medians between acquirers and non-acquirers are consistent with the relationships that emerge from mean comparisons in all the different time periods. some acquirers there are no comparable non-acquiring firms (Heckman et al., 1997).11 To account for this, we impose the “common support” condition.”
BackgroundLiu, Q. B., Liu, X., & Guo, X. (2020) · MIS Quarterly · doi:10.25300/misq/2020/15102 · Cited by 175
Crump, R., Hotz, V. J., Imbens, G., & Mitnik, O. (2006) · National Bureau of Economic Research · doi:10.3386/t0330 · Cited by 159
“Heckman, Ichimura and Todd (1997) and Dehejia and Wahba (1999) point out the empirical relevance of this overlap issue.1”
InfluentialThe Anticipated Capitalisation Effect of a New Metro Line on Housing Prices*
Agostini, C. A., & Palmucci, G. A. (2008) · Fiscal Studies · doi:10.1111/j.1475-5890.2008.00074.x · Cited by 158
Hotz, V. J., Imbens, G. W., & Klerman, J. A. (2006) · Journal of Labor Economics · doi:10.1086/505050 · Cited by 158
Evaluation of credit guarantee policy using propensity score matching
Oh, I., Lee, J.-D., Heshmati, A., & Choi, G.-G. (2009) · Small Business Economics · doi:10.1007/s11187-008-9102-5 · Cited by 158
“However, in practice, the results seem to be sensitive to the matching estimators selected (Heckman et al., 1997).”
BackgroundMethodInfluentialGnawali, D., Pokhrel, S., Sié, A., Sanon, M., Allegri, M. D., Souares, A., Dong, H., & Sauerborn, R. (2008) · Health Policy · doi:10.1016/j.healthpol.2008.09.015 · Cited by 185
Did the EU ETS Make a Difference? An Empirical Assessment Using Lithuanian Firm-Level Data
Jaraitė, J., & Maria, C. D. (2016) · The Energy Journal · doi:10.5547/01956574.37.2.jjar · Cited by 40
“Heckman, Ichimura, and Todd (1997) and Heckman et al. (1998) who introduced the following DID matching estimator:”
Saving taxes through foreign plant ownership
Egger, P. H., Eggert, W., & Winner, H. (2010) · Journal of International Economics · doi:10.1016/j.jinteco.2009.12.004 · Cited by 198
Institutional trading and alternative trading systems
CONRAD, J. S., Johnson, K. M., & Wahal, S. (2003) · Journal of Financial Economics · doi:10.1016/s0304-405x(03)00143-0 · Cited by 157
“Heckman et al. (1997) analyze the sources of selection bias in a problem in which some sample elements receive a ‘‘treatment’’ while others do not.”
BackgroundGebel, M., & Voßemer, J. (2014) · Social Science & Medicine · doi:10.1016/j.socscimed.2014.02.039 · Cited by 157
Tax incentives and R&D activity: Firm-level evidence from Taiwan
Yang, C., Huang, C.-H., & Hou, T. C. (2012) · Research Policy · doi:10.1016/j.respol.2012.04.006 · Cited by 173
“12 For the criteria on the effectiveness of matching process, please refer to Heckman et al. (1997, 1998) 19 Fortunately, one advantage of our dataset is that it contains the amount of R&D tax credits, enabling us to examine the marginal rather than the treatment effect of R&D tax credits on firms’…”
BackgroundMethodInfluentialThe Impact of Cash Transfers on Child Labor and School Attendance in BrazilPreprint
Cardoso, E., & Souza, A. P. (2004) · RePEc: Research Papers in Economics · Cited by 157
Guo, S., Barth, R. P., & Gibbons, C. (2005) · Children and Youth Services Review · doi:10.1016/j.childyouth.2005.04.012 · Cited by 176
The Washington consensus works: Causal effects of reform, 1970-2015
GRIER, K. B., & Grier, R. M. (2020) · Journal of Comparative Economics · doi:10.1016/j.jce.2020.09.001 · Cited by 193
The Effect of Foreign Acquisition on Employment and Wages: Evidence from Finnish Establishments
Huttunen, K. (2007) · The Review of Economics and Statistics · doi:10.1162/rest.89.3.497 · Cited by 156
“Moreover, we combine the matching methods with a difference-in-differences method, as suggested by Heckman, Ichimura, and Todd (1997) to control for the possible bias that is due to selection on unobservables.”
MethodThe Income Losses of Displaced Workers
Hijzen, A., Upward, R., & Wright, P. W. G. (2010) · The Journal of Human Resources · doi:10.1353/jhr.2010.0000 · Cited by 155
Farmer training in off-season vegetables: Effects on income and pesticide use in Bangladesh
Schreinemachers, P., Wu, M.-H., Uddin, M. N., Ahmad, S., & Hanson, P. M. (2016) · Food Policy · doi:10.1016/j.foodpol.2016.03.002 · Cited by 170
Liu, S., Xu, R., & Chen, X. (2021) · Environmental Science and Pollution Research · doi:10.1007/s11356-021-15217-2 · Cited by 162
Chapter 59 Evaluating Anti-Poverty Programs
Ravallion, M. D. (2007) · Handbook of development economics · doi:10.1016/s1573-4471(07)04059-4 · Cited by 245
Do unemployed workers benefit from enterprise zones? The French experience
Gobillon, L., Magnac, T., & Selod, H. (2012) · Journal of Public Economics · doi:10.1016/j.jpubeco.2012.06.003 · Cited by 151
William, W., Anselmi, L., Kristensen, S. R., Lau, Y., Bailey, S. F., Bower, P., Checkland, K., Elvey, R., Rothwell, K., Stokes, J., et al. (2016) · PLoS Medicine · doi:10.1371/journal.pmed.1002113 · Cited by 169
“We constructed our matched comparator and intervention groups under a variety of matching strategies: a) nearest neighbour with replacement (whereby each intervention practice is matched to n comparator practices based on propensity score closest proximity) [18]; b) radius matching (whereby each intervention practice…”
MethodLöschel, A., Lutz, B. J., & Managi, S. (2019) · Resource and Energy Economics · doi:10.1016/j.reseneeco.2018.03.001 · Cited by 140
Do Financial Analysts Restrain Insiders' Informational Advantage?
Ellul, A., & Panayides, M. A. (2009) · Journal of Financial and Quantitative Analysis · doi:10.1017/s0022109017000990 · Cited by 164
“We run the propensity score matching methodology (Rosenbaum and Rubin (1985), and Heckman, Ichimura, and Todd (1997)) using variables that broadly capture firm’s informational environment, liquidity and past firm performance to generate the control group.”
Metadata
- Authors
- Heckman, J. J., Ichimura, H., & Todd, P. E.
- Affiliations
- University of Chicago (US)
- University of Pittsburgh (US)
- University of Pennsylvania (US)
- Venue
- The Review of Economic Studies
- Publisher
- Oxford University Press (OUP)
- Published
- 1997-10-01
- Volume
- 64
- Issue
- 4
- Pages
- 605-654
- ISSN
- 0034-6527 (ISSN-L)
- 1467-937X
- OpenAlex
- W2066735350
- Semantic Scholar
- ec958b198d3b6712d1e0f3395a05ff2b0136a1bb
- Cited by
- 5,486
- References
- 32
- Citations by year
- 2026: 216 · 2025: 268 · 2024: 271 · 2023: 292 · 2022: 296 · 2021: 246 · 2020: 254 · 2019: 244 · 2018: 269 · 2017: 236 · 2016: 231 · 2015: 251 · 2014: 266 · 2013: 248 · 2012: 275
- FWCI
- 20.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Review of Economic Studies (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- selection on unobservables, sample selection model, identifying assumptions, omitted variables
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.