Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme
The DOI matches its Crossref record; 31 of the 32 references it cites were found in a registry or an index.
Abstract
This paper considers whether it is possible to devise a nonexperimental procedure for evaluating a prototypical job training programme. Using rich nonexperimental data, we examine the performance of a two-stage evaluation methodology that (a) estimates the probability that a person participates in a programme and (b) uses the estimated probability in extensions of the classical method of matching. We decompose the conventional measure of programme evaluation bias into several components and find that bias due to selection on unobservables, commonly called selection bias in econometrics, is empirically less important than other components, although it is still a sizeable fraction of the estimated programme impact. Matching methods applied to comparison groups located in the same labour markets as participants and administered the same questionnaire eliminate much of the bias as conventionally measured, but the remaining bias is a considerable fraction of experimentally-determined programme impact estimates. We test and reject the identifying assumptions that justify the classical method of matching. We present a nonparametric conditional difference-in-differences extension of the method of matching that is consistent with the classical index-sufficient sample selection model and is not rejected by our tests of identifying assumptions. This estimator is effective in eliminating bias, especially when it is due to temporally-invariant omitted variables.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For the OR approach, the consistency of the ATT estimator (2.2) relies on the estimators of md , t ( · ) , ̂ µ d , t ( · ) , being correctly specified, whereas the IPW estimator (2.4) relies on the propensity score estimator ̂ π ( · ) of p ( · ) being correctly specified.”
From Doubly robust difference-in-differences estimators (2020) · cites this paper as Heckman et al. (1997)
In the citing paper
“These fall into two main categories, which we denote trajectory modeling [28, 29, 86, 88, 95] and propensity score weighting [17, 30].”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“Doubly robust (DR) estimators combine trajectory modeling and propensity score estimation and produce consistent estimates if either the trajectory model or the propensity score model is correctly specified: [29]”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“The OR, IPW and DR estimands respectively generalize Heckman et al. (1997), Abadie (2005) and Sant'Anna and Zhao (2020) estimands for the two groups, two periods DiD setup to the staggered DiD setup with multiple periods and multiple groups.”
From Difference-in-Differences with multiple time periods (2021) · cites this paper as Heckman et al. (1997)
In the citing paper
“CS also derives estimators that are consistent for AT T (g, τ ) under more general conditions, such as when the parallel-trends assumption holds conditionally on covariates, including an outcome-regression-based estimator”
From How Much Should We Trust Staggered Difference-in-Differences Estimates? (2022) · cites this paper as Heckman et al., 1997
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,796
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774
SOME THOUGHTS ON THE DISTRIBUTION OF EARNINGS 1
ROY, A. D. (1951) · Oxford Economic Papers · doi:10.1093/oxfordjournals.oep.a041827 · Cited by 2,958
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503
Estimating the Effect of Training Programs on Earnings
Ashenfelter, O. (1978) · The Review of Economics and Statistics · doi:10.2307/1924332 · Cited by 1,515
Design-adaptive Nonparametric Regression
Fan, J. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10476255 · Cited by 1,268
The Estimation of Choice Probabilities from Choice Based Samples
Manski, C. F., & Lerman, S. R. (1977) · Econometrica · doi:10.2307/1914121 · Cited by 1,208
Cited by
Items 101–200 of 1,029
Todd, P. E., & Wolpin, K. I. (2006) · American Economic Review · doi:10.1257/aer.96.5.1384 · Cited by 528
Self-citationCheng, J., Yi, J., Dai, S., & Xiong, Y. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2019.05.327 · Cited by 534
Evaluating the impact of R&D tax credits on innovation: A microeconometric study on Canadian firms
Czarnitzki, D., Hanel, P., & Rosa, J. M. (2011) · Research Policy · doi:10.1016/j.respol.2010.09.017 · Cited by 522
Evaluating Anti-Poverty Programs
Ravallion, M. (2005) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-3625 · Cited by 507
Evaluating the Employment Impact of a Mandatory Job Search Program
Blundell, R., Dias, M. C., Meghir, C., & van Reenen, J. (2004) · Journal of the European Economic Association · doi:10.1162/1542476041423368 · Cited by 500
Handbook on Impact Evaluation: Quantitative Methods and Practices
Khandker, S., B. Koolwal, G., & Samad, H. (2009) · RePEc: Research Papers in Economics · doi:10.1596/978-0-8213-8028-4 · Cited by 485
Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score
Hirano, K., Imbens, G. W., & Ridder, G. (2002) · SSRN Electronic Journal · doi:10.2139/ssrn.324940 · Cited by 480
Shadish, W. R., Clark, M. H., & Steiner, P. M. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000733 · Cited by 479
“This was not done by Dehejia and Wahba (1999), Heckman et al. (1997), or Hill et al. (2004), or in any other such studies.”
BackgroundResultInfluentialCovariance Adjustment in Randomized Experiments and Observational Studies
Rosenbaum, P. R. (2002) · Statistical Science · doi:10.1214/ss/1042727942 · Cited by 477
Journal of Development and Agricultural Economics
(2026) · Journal of Development and Agricultural Economics · doi:10.5897/jdae · Cited by 465
Scar Effects of Unemployment: An Assessment of Institutional Complementarities
Gangl, M. (2006) · American Sociological Review · doi:10.1177/000312240607100606 · Cited by 452
Evaluating the Effect of Teachers’ Group Performance Incentives on Pupil Achievement
Lavy, V. (2002) · Journal of Political Economy · doi:10.1086/342810 · Cited by 448
“However, instead of relying solely on this model, we can use a matching strategy to nonparametrically control for any remaining average pretreatment achievement differences (see, e.g., Heckman, Ichimura, and Todd 1997).”
Nonparametric Estimation of Average Treatment Effects under Exogeneity: A Review
Imbens, G. (2003) · National Bureau of Economic Research · doi:10.3386/t0294 · Cited by 446
Corporate Dividend Policies: Lessons from Private Firms
Michaely, R., & Roberts, M. R. (2012) · Review of Financial Studies · doi:10.1093/rfs/hhr108 · Cited by 441
Innovation on demand—Can public procurement drive market success of innovations?
Aschhoff, B., & Sofka, W. (2009) · Research Policy · doi:10.1016/j.respol.2009.06.011 · Cited by 435
Financial Inclusion, Gender Dimension, and Economic Impact on Poor Households
Swamy, V. (2014) · World Development · doi:10.1016/j.worlddev.2013.10.019 · Cited by 432
Endogenous product versus process innovation and a firm’s propensity to export
Becker, S. O., & Egger, P. H. (2013) · Empirical Economics · doi:10.1007/s00181-009-0322-6 · Cited by 431
“One strategy of exploiting this assumption for the purpose of treatment effect identification is propensity score matching (see Angrist, 1998; Dehejia and Wahba, 1999, 2002; Heckman, Ichimura, and Todd, 1997, 1998; Lechner, 2001; Heckman, LaLonde, and Smith, 1999, provide a survey).”
Building Relationships Early: Banks in Venture Capital
Hellmann, T., Lindsey, L., & Puri, M. (2008) · Review of Financial Studies · doi:10.1093/rfs/hhm080 · Cited by 427
Regional policy evaluation: interactive fixed effects and synthetic controls.
Gobillon, L., & Magnac, T. (2016) · Review of Economics and Statistics · doi:10.1162/rest_a_00537 · Cited by 424
“Furthermore, we know that difference in differences can dramatically fail when heterogeneity is richer than what is modelled (Heckman, Ichimura and Todd, 1997). In this paper, we restrict our attention to linear models because the number of units is rather small although extensions to non-linear settings could follow…”
BackgroundMethodInfluentialThe Impact of Ethiopia's Productive Safety Net Programme and its Linkages
Gilligan, D. O., Hoddinott, J., & Taffesse, A. S. (2009) · Journal of Development Studies · doi:10.1080/00220380902935907 · Cited by 416
“…of programme impact provided that: (1) a comparable group of non-beneficiary households is available; and (2) there is access to carefully collected household survey data with many variables that are correlated with programme participation and the outcome variables (Heckman et al., 1997, 1998).”
Analysis of Adoption and Impacts of Improved Maize Varieties in Eastern Zambia
Khonje, M., Manda, J., Alene, A. D., & Kassie, M. (2015) · World Development · doi:10.1016/j.worlddev.2014.09.008 · Cited by 414
“Following Heckman, Ichimura, and Todd (1997), let Y 1 be the value of welfare when the household i is subject to treatment ( P = 1) and Y 0 the same variable when the household does not adopt an improved maize variety ( P = 0).”
Currency unions and trade: how large is the treatment effect?
Persson, T. (2001) · Economic Policy · doi:10.1111/1468-0327.00081 · Cited by 414
Constitutional Rules and Fiscal Policy Outcomes
Persson, T., & Tabellini, G. (2004) · American Economic Review · doi:10.1257/000282804322970689 · Cited by 413
“…located in Latin America tend to have a smaller 5 These methods were introduced into economics as tools for evaluating labor market and education programs (see for instance James J. Heckman et al., 1997; Rajeev H. Dehejia and Sadek Wahba, 1999; and Heckman et al., 1999). size of government.”
MethodMcKenzie, D., Stillman, S., & Gibson, J. (2010) · Journal of the European Economic Association · doi:10.1111/j.1542-4774.2010.tb00544.x · Cited by 409
THE IMPACT OF ACADEMIC PATENTING ON THE RATE, QUALITY AND DIRECTION OF (PUBLIC) RESEARCH OUTPUT*
AZOULAY, P., DING, W., & STUART, T. (2009) · The Journal of Industrial Economics · doi:10.1111/j.1467-6451.2009.00395.x · Cited by 407
“Of 25 course, these univariate comparisons are subject to “static” omitted variable bias in addition to the dynamic selection bias mentioned in section 3.”
BackgroundThe Direct and Indirect Costs of Untreated Insomnia in Adults in the United States
Ozminkowski, R. J., Wang, S., & Walsh, J. K. (2007) · Sleep · doi:10.1093/sleep/30.3.263 · Cited by 403
List, J. A., Millimet, D. L., Fredriksson, P. G., & McHone, W. W. (2003) · Review of Economics and Statistics · doi:10.1162/003465303772815844 · Cited by 403
“…are applicable primarily to problems of selection on observables, we employ a difference-in-difference matching estimator, similar to the efforts in Heckman, Ichimura, and Todd (1997) and Smith and Todd (2000), to control for the presence of unobservables that under normal circumstances may lead…”
1. The Scientific Model of Causality
Heckman, J. J. (2005) · Sociological Methodology · doi:10.1111/j.0081-1750.2006.00164.x · Cited by 401
“This is also the support condition used in the generalization of matching by Heckman, Ichimura, and Todd (1997).”
BackgroundMethodInfluentialSelf-citationCausal Inference in Sociological Research
Gangl, M. (2010) · Annual Review of Sociology · doi:10.1146/annurev.soc.012809.102702 · Cited by 401
Finite-Sample Properties of Propensity-Score Matching and Weighting Estimators
Frölich, M. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023697 · Cited by 399
“Moreover, the effect of trimming, as suggested by Heckman et al. (1997, 1998), is examined.”
BackgroundMethodInfluentialEstimating the Benefit Incidence of an Antipoverty Program by Propensity-Score Matching
Jalan, J., & Ravallion, M. (2003) · Journal of Business & Economic Statistics · doi:10.1198/073500102288618720 · Cited by 394
“Following Heckman et al. (1998), we also report a kernel-weighted estimator where the weights are given by”
BackgroundMethodInfluentialMatching Estimators of Causal Effects: Prospects and Pitfalls in Theory and Practice
Morgan, S. L., & Harding, D. J. (2006) · Sociological Methods & Research · doi:10.1177/0049124106289164 · Cited by 392
“Smith and Todd (2005) offer an excellent intuitive discussion of kernel matching along with generalizations to local linear matching (Heckman, Ichimura, and Todd 1997, 1998; Heckman, Ichimura, Smith, and Todd 1998) and local quadratic matching (Ham, Li, and Reagan 2003).”
BackgroundMethodInfluentialLiu, L., Wang, Y., & Xu, Y. (2024) · American Journal of Political Science · doi:10.1111/ajps.12723 · Cited by 390
Practical propensity score matching: a reply to Smith and Todd
Dehejia, R. (2005) · Journal of Econometrics · doi:10.1016/j.jeconom.2004.04.012 · Cited by 390
“Re-visiting the Propensity Score Estimates In this section, we reexamine Smith and Todd’s contention that propensity score matching methods are unable to replicate the treatment effect in Lalonde’s original sample or in the further subsample that Smith and Todd extract from the NSW. This conclusion is based on applyin…”
BackgroundMethodInfluentialZhao, Z. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023705 · Cited by 389
“2 Recent papers in this field by economists include Heckman, Ichimura, and Todd (1997, 1998), Heckman, Ichimura, Smith, and Todd (1998), Angrist (1998), Dehejia and Wahba (1999, 2002), Hahn (1998), Lechner (2002), Imbens (2000, 2003), Smith and Todd (2001, forthcoming), and Abadie and Imbens (2002).”
BackgroundHeckman, J. J., & Smith, J. A. (1999) · The Economic Journal · doi:10.1111/1468-0297.00451 · Cited by 386
Self-citationMojo, D., Fischer, C., & Degefa, T. (2017) · Journal of Rural Studies · doi:10.1016/j.jrurstud.2016.12.010 · Cited by 382
Life satisfaction and self-employment: a matching approach
Binder, M., & Coad, A. (2013) · Small Business Economics · doi:10.1007/s11187-011-9413-9 · Cited by 375
“On the one hand, it has been argued that omitting important variables can seriously increase bias in the resulting estimates (Heckman et al., 1997; Dehejia and Wahba, 1999).”
BackgroundAccounting for the Black–White Wealth Gap: A Nonparametric Approach
Barsky, R., Bound, J., Charles, K. K., & Lupton, J. P. (2002) · Journal of the American Statistical Association · doi:10.1198/016214502388618401 · Cited by 374
“In this case, one could use either parametric (e.g., DiNardo et al. 1996) or nonparametric (e.g., Heckman et al. 1997) methods to estimate the probability that a sample member was black conditional on the characteristics of the sample member, and then use this propensity score to construct the…”
BackgroundMethodResultEvaluating the foreign ownership wage premium using a difference-in-differences matching approach
Girma, S., & Görg, H. (2007) · Journal of International Economics · doi:10.1016/j.jinteco.2006.07.006 · Cited by 374
“7 microeconometric evaluation literature (e.g. Heckman et al, 1997, Dehejia and Wahba, 2002), we define the average effect of acquisition on the acquired firms as { } { } { }1|1|1| 0101 =−===− ++++ itstitstitstst ACQyEACQyEACQyyE (2) where causal inference relies on the construction of the…”
BackgroundToo Much Ado about Propensity Score Models? Comparing Methods of Propensity Score Matching
Baser, O. (2006) · Value in Health · doi:10.1111/j.1524-4733.2006.00130.x · Cited by 372
Heckman, J. J., & Vytlacil, E. J. (2007) · Handbook of Econometrics · doi:10.1016/s1573-4412(07)06071-0 · Cited by 369
“3) are equivalent to the assumptions used to generate the LATE model of Imbens and Angrist (1994) which are developed below in Section 4.”
MethodSelf-citationLechner, M. (2002) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/1467-985x.0asp2 · Cited by 369
“Matching for binary comparisons has recently been discussed in the literature and applied to various evaluation problems by Angrist (1998), Dehejia and Wahba (1999), Heckman et al. (1997, 1998), Lechner (1999, 2000) and Smith and Todd (2000), among others.”
MethodEarnings and Employment Effects of Continuous Gff-the-Job Training in East Germany After Unification
Lechner, M. (1999) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1999.10524798 · Cited by 368
Performance Pay and Teachers' Effort, Productivity, and Grading Ethics
Lavy, V. (2009) · American Economic Review · doi:10.1257/aer.99.5.1979 · Cited by 368
Using the Propensity Score Method to Estimate Causal Effects: A Review and Practical Guide
Li, M. (2013) · Organizational Research Methods · doi:10.1177/1094428112447816 · Cited by 366
“Readers who are interested in estimating the ATT using longitudinal data can also refer to the nonparametric conditional difference-in-difference model (Heckman et al., 1997) and the semiparametric conditional difference-in-difference model (Heckman et al.”
BackgroundMethodBehrman, J. R., Cheng, Y., & Todd, P. E. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023714 · Cited by 361
“14 See Rosenbaum and Rubin (1983).”
InfluentialSelf-citationDeterminants of Corporate Cash Policy: Insights from Private Firms
Gao, H., Harford, J., & Li, K. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.2023999 · Cited by 360
“Cash reserve policy should balance the precautionary demand identified in Keynes (1936), Baumol (1952), and Miller and Orr (1966) against agency problems highlighted in Jensen (1986) and Stulz (1990).”
Office Size of Big 4 Auditors and Client Restatements
Francis, J. R., Michas, P. N., & Yu, M. D. (2013) · Contemporary Accounting Research · doi:10.1111/1911-3846.12011 · Cited by 357
Matching as a Tool to Decompose Wage Gaps
Ñopo, H. (2008) · Review of Economics and Statistics · doi:10.1162/rest.90.2.290 · Cited by 355
Propensity Score Matching Methods for Non-experimental Causal Studies
Rajeev, D., & Wahba, S. (1999) · SSRN Electronic Journal · doi:10.2139/ssrn.138259 · Cited by 355
The Costs of Being Private: Evidence from the Loan Market
Saunders, A., & Steffen, S. (2011) · Review of Financial Studies · doi:10.1093/rfs/hhr083 · Cited by 347
Leviathan as a Minority Shareholder: Firm-Level Implications of State Equity Purchases
Inoue, C. F. K. V., Lazzarini, S. G., & Musacchio, A. (2013) · Academy of Management Journal · doi:10.5465/amj.2012.0406 · Cited by 346
“Second, following the approach proposed by Heckman, Ichimura, and Todd (1997), we ran ad- ditional regressions combining fixed-effects estimation with propensity score matching.”
MethodAcosta, P. A. (2006) · The World Bank Open Knowledge Repository (World Bank) · doi:10.1596/1813-9450-3903 · Cited by 461
Alix-Garcia, J. M., Shapiro, E. N., & Sims, K. R. E. (2012) · Land Economics · doi:10.3368/le.88.4.613 · Cited by 345
Blundell, R., Dearden, L., & Sianesi, B. (2005) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2004.00360.x · Cited by 343
“A more refined procedure was suggested by Heckman, Ichimura and Todd (1997) , who ‘trimmed’ the common support region of those treated individuals falling where the comparison group density, albeit strictly positive, is still considered to be too thin to produce reliable estimates.”
BackgroundMethodInfluentialSimple and Bias-Corrected Matching Estimators for Average Treatment Effects
Abadie, A., & Imbens, G. (2002) · National Bureau of Economic Research · doi:10.3386/t0283 · Cited by 342
Causal inference with observational data
Nichols, A. (2007) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0800700403 · Cited by 339
Micro-Econometrics for Policy, Program and Treatment Effects
Lee, M.-J. (2005) · doi:10.1093/0199267693.001.0001 · Cited by 339
Propensity Scores: An Introduction and Experimental Test
Luellen, J. K., Shadish, W. R., & Clark, M. H. (2005) · Evaluation Review · doi:10.1177/0193841x05275596 · Cited by 336
Earnings Functions, Rates of Return and Treatment Effects: The Mincer Equation and Beyond
Heckman, J., Lochner, L., & Todd, P. (2005) · National Bureau of Economic Research · doi:10.3386/w11544 · Cited by 335
Self-citationBest Practices in Quasi–Experimental Designs: Matching Methods for Causal Inference
Stuart, E. A., & Rubin, D. B. (2008) · Best Practices in Quantitative Methods · doi:10.4135/9781412995627.d14 · Cited by 335
Estimating Heterogeneous Treatment Effects with Observational Data
Xie, Y., Brand, J. E., & Jann, B. (2012) · Sociological Methodology · doi:10.1177/0081175012452652 · Cited by 333
Reconciling Conflicting Evidence on the Performance of Propensity-Score Matching Methods
Smith, J. A., & Todd, P. E. (2001) · American Economic Review · doi:10.1257/aer.91.2.112 · Cited by 331
“In Heckman et al. (1997, 1998a), matching methods applied to the data from the JTPA experiment yield biases of roughly the same order of magnitude as the experimental impact estimates. However, the CPS and PSID comparison groups in LaLonde's (1986) and Dehejia and Wahba's (1998, 1999) studies using the NSW data suffer…”
BackgroundMethodResultInfluentialSelf-citationThe effect of unemployment on the mental health of spouses – Evidence from plant closures in Germany
Marcus, J. (2013) · Journal of Health Economics · doi:10.1016/j.jhealeco.2013.02.004 · Cited by 329
“1 in the appendix not only reports the means for other conditioning variables, but it also compares the matched control groups resulting a) from entropy balancing and b) the propensity score based kernel matching (Heckman et al. 1997).”
InfluentialChapter 7 Earnings Functions, Rates of Return and Treatment Effects: The Mincer Equation and Beyond
Heckman, J. J., Lochner, L. J., & Todd, P. E. (2006) · Handbook of the Economics of Education · doi:10.1016/s1574-0692(06)01007-5 · Cited by 328
Self-citationStructural Equations, Treatment Effects and Econometric Policy Evaluation
Heckman, J., & Vytlacil, E. (2005) · National Bureau of Economic Research · doi:10.3386/w11259 · Cited by 326
Self-citationThe effect of charter schools on charter students and public schools
Bettinger, E. P. (2005) · Economics of Education Review · doi:10.1016/j.econedurev.2004.04.009 · Cited by 325
Chapter 16 Schools, Teachers, and Education Outcomes in Developing Countries
Glewwe, P., & Kremer, M. (2006) · Handbook of the Economics of Education · doi:10.1016/s1574-0692(06)02016-2 · Cited by 323
Robust inference on average treatment effects with possibly more covariates than observations
Farrell, M. H. (2015) · Journal of Econometrics · doi:10.1016/j.jeconom.2015.06.017 · Cited by 320
“However, as observed by Heckman, Ichimura, and Todd (1997), the weaker mean independence is sufficient.”
The use of propensity score matching in the evaluation of active labour market policies
Bryson, A., Dorsett, R., & Purdon, S. (2002) · London School of Economics and Political Science Research Online (London School of Economics and Political Science) · Cited by 410
Auditor Choice in Politically Connected Firms
GUEDHAMI, O., PITTMAN, J. A., & SAFFAR, W. (2014) · Journal of Accounting Research · doi:10.1111/1475-679x.12032 · Cited by 318
“29 (CHANGE_EARNINGS), as well as country-level measures for earnings management (EARNINGS_MGN), the quality of financial reporting (CIFAR), domestic listed firms (LISTED FIRMS), investor protection (ANTISELF), Hofstede’s (2001) cultural dimensions uncertainty avoidance (UAI) and individualism (IDV), along with industr…”
Stuart, E. A., & Green, K. M. (2008) · Developmental Psychology · doi:10.1037/0012-1649.44.2.395 · Cited by 312
Alon, S., & Tienda, M. (2005) · Sociology of Education · doi:10.1177/003804070507800402 · Cited by 308
Key Factors in the Market for Remanufactured Products
Subramanian, R., & Subramanyam, R. (2012) · Manufacturing & Service Operations Management · doi:10.1287/msom.1110.0368 · Cited by 308
“We employ potential outcomes analysis (e.g., Dehejia and Wahba 1999, Heckman et al. 1997, Rubin 1974)—specifically, propensity score matching (Rosenbaum and Rubin 1983, Rubin and Thomas 1996)—to examine the causal effect of negative reputation on price differential (details of this analysis are…”
MethodMcDonnell, M.-H., King, B. G., & Soule, S. A. (2015) · American Sociological Review · doi:10.1177/0003122415581335 · Cited by 307
The Impact of Fair Trade Certification for Coffee Farmers in Peru
Ruben, R., & Fort, R. (2012) · World Development · doi:10.1016/j.worlddev.2011.07.030 · Cited by 305
“The propensity score matching procedure for obtaining un-biased groups of FT and non FT farm-households thus needs to rely on intrinsic characteristics that are themselves not influenced by FT participation (Heckman et al., 1997).”
MethodMinimum Wages and Firm Profitability
Draca, M., Machin, S., & Van Reenen, J. (2011) · American Economic Journal: Applied Economics · doi:10.1257/app.3.1.129 · Cited by 305
LASSEN, D. D., & SERRITZLEW, S. (2011) · American Political Science Review · doi:10.1017/s000305541100013x · Cited by 305
Nakano, Y., Tsusaka, T. W., Aida, T., & Pede, V. O. (2018) · World Development · doi:10.1016/j.worlddev.2017.12.013 · Cited by 305
“Since panel data are available in our study, we follow the PSMDID procedure proposed by Heckman et al. (1997) and applied by Todo and Takahashi (2013), to examine the treatment effect on the over-time change in the outcome variables.”
MethodSchool decentralization: Helping the good get better, but leaving the poor behind
Galiani, S., Gertler, P., & Schargrodsky, E. (2008) · Journal of Public Economics · doi:10.1016/j.jpubeco.2008.05.004 · Cited by 304
Volpe Martincus, C., & Carballo, J. (2008) · Journal of International Economics · doi:10.1016/j.jinteco.2008.05.002 · Cited by 296
“also Heckman et al. (1997), Heckman et al. (1998), Abadie (2005), and Smith and Todd (2005a).”
BackgroundEnvironmental Regulation and Green Skills: An Empirical Exploration
Vona, F., Marin, G., Consoli, D., & Popp, D. (2018) · Journal of the Association of Environmental and Resource Economists · doi:10.1086/698859 · Cited by 293
“…setting, the coef fi cient ^ β measures the treatment effect on the treated under two conditions: (1) the two groups are similar in terms of observable and unobservable characteristics (including pretreatment dynamics) and (2) selection into treatment is random (Heckman et al. 1997).”
BackgroundLevine, D. I., & Toffel, M. W. (2010) · Management Science · doi:10.1287/mnsc.1100.1159 · Cited by 293
“…propensity scores (that is, some of the controls differ substantially from any of the treatments); (5) the distributions of participants’ and non-participants’ propensity scores differ; or (6) unobservable factors influence both participation and outcomes (Heckman, Ichimura, and Todd 1997).”
Retaining winners: Can policy boost high-growth entrepreneurship?
Autio, E., & Rannikko, H. (2016) · Research Policy · doi:10.1016/j.respol.2015.06.002 · Cited by 293
Madajewicz, M., Pfaff, A., van Geen, A., Graziano, J., Hussein, I., Momotaj, H., Sylvi, R., & Ahsan, H. (2007) · Journal of Development Economics · doi:10.1016/j.jdeveco.2006.12.002 · Cited by 291
“30 Dehejia and Wahba (2002), Heckman et al. (1997, 1998), Smith and Todd (2001). 748 M. Madajewicz et al. / Journal of Development Economics 84 (2007) 731–754”
BackgroundThe impact of entrepreneurship education in high school on long-term entrepreneurial performance
Elert, N., Andersson, F. W., & Wennberg, K. (2015) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2014.12.020 · Cited by 290
“Second, we assess the effect of JACP participation on entrepreneurial income provided that the individual started a new firm.”
BackgroundMethodResultInfluentialEnvironmental non-governmental organizations and urban environmental governance: Evidence from China
Li, G., He, Q., Shao, S., & Cao, J. (2018) · Journal of Environmental Management · doi:10.1016/j.jenvman.2017.09.076 · Cited by 290
(2011) · The University of Bath Online Publications Store (The University of Bath) · Cited by 284
Zhou, B., Zhang, C., Song, H., & Wang, Q. (2019) · Science of The Total Environment · doi:10.1016/j.scitotenv.2019.04.303 · Cited by 284
Recent developments in the econometrics of program evaluation
Wooldridge, J. M., & Imbens, G. (2008) · doi:10.1920/wp.cem.2008.2408 · Cited by 283
Who Should Be Treated? Empirical Welfare Maximization Methods for Treatment Choice
Kitagawa, T., & Tetenov, A. (2018) · Econometrica · doi:10.3982/ecta13288 · Cited by 277
Advances in Measuring the Environmental and Social Impacts of Environmental Programs
Ferraro, P. J., & Hanauer, M. M. (2014) · Annual Review of Environment and Resources · doi:10.1146/annurev-environ-101813-013230 · Cited by 276
Exporting, productivity and agglomeration
Greenaway, D., & Kneller, R. (2008) · European Economic Review · doi:10.1016/j.euroecorev.2007.07.001 · Cited by 275
Economic Consequences of Noncommunicable Diseases and Injuries in the Russian Federation
Suhrcke, M., Rocco, L., McKee, M., Mazzuco, S., Urban, D., & Steinherr, A. (2007) · UEA Digital Repository (University of East Anglia) · Cited by 283
Aakvik, A., Heckman, J. J., & Vytlacil, E. J. (2005) · Journal of Econometrics · doi:10.1016/j.jeconom.2004.04.002 · Cited by 274
“¼ 1 ¼ 1 PrðD ¼ 1jZ ¼ zÞ Z 1ð N;zbD ðuDÞ1Aðm1ðx; u1Þ m0ðx; u0ÞÞ dFD;0;1ðuD; u0; u1Þ ¼ 1 PrðD ¼ 1jZ ¼ zÞ Z zbD N Z AðxÞ dF0;1jDðu0; u1juDÞ dFUDðuDÞ; ARTICLE IN PRESS 9Heckman (1992), Heckman et al. (1997b), and Heckman and Smith (1998) and Heckman and Vytlacil (2005) emphasize that many criteria for…”
BackgroundInfluentialSelf-citationFowlie, M., Holland, S. P., & Mansur, E. T. (2012) · American Economic Review · doi:10.1257/aer.102.2.965 · Cited by 272
Verhofstadt, E., & Maertens, M. (2015) · Applied Economic Perspectives and Policy · doi:10.1093/aepp/ppu021 · Cited by 271
“As proposed by Heckman et al. (1997) and Becker and Ichino (2002), we only use observations in the common support region, where the PS of the control units is not smaller than the minimum PS of the treated units and the PS of the treated units not larger than the maximum PS of the control units…”
MethodCounterfactuals, Causal Effect Heterogeneity, and the Catholic School Effect on Learning
Morgan, S. L. (2001) · Sociology of Education · doi:10.2307/2673139 · Cited by 269
Field, E. (2009) · American Economic Journal: Applied Economics · doi:10.1257/app.1.1.1 · Cited by 268
Metadata
- Authors
- Heckman, J. J., Ichimura, H., & Todd, P. E.
- Affiliations
- University of Chicago (US)
- University of Pittsburgh (US)
- University of Pennsylvania (US)
- Venue
- The Review of Economic Studies
- Publisher
- Oxford University Press (OUP)
- Published
- 1997-10-01
- Volume
- 64
- Issue
- 4
- Pages
- 605-654
- ISSN
- 0034-6527 (ISSN-L)
- 1467-937X
- OpenAlex
- W2066735350
- Semantic Scholar
- ec958b198d3b6712d1e0f3395a05ff2b0136a1bb
- Cited by
- 5,486
- References
- 32
- Citations by year
- 2026: 216 · 2025: 268 · 2024: 271 · 2023: 292 · 2022: 296 · 2021: 246 · 2020: 254 · 2019: 244 · 2018: 269 · 2017: 236 · 2016: 231 · 2015: 251 · 2014: 266 · 2013: 248 · 2012: 275
- FWCI
- 20.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Review of Economic Studies (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- selection on unobservables, sample selection model, identifying assumptions, omitted variables
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.