Matching As An Econometric Evaluation Estimator: Evidence from Evaluating a Job Training Programme
The DOI matches its Crossref record; 31 of the 32 references it cites were found in a registry or an index.
Abstract
This paper considers whether it is possible to devise a nonexperimental procedure for evaluating a prototypical job training programme. Using rich nonexperimental data, we examine the performance of a two-stage evaluation methodology that (a) estimates the probability that a person participates in a programme and (b) uses the estimated probability in extensions of the classical method of matching. We decompose the conventional measure of programme evaluation bias into several components and find that bias due to selection on unobservables, commonly called selection bias in econometrics, is empirically less important than other components, although it is still a sizeable fraction of the estimated programme impact. Matching methods applied to comparison groups located in the same labour markets as participants and administered the same questionnaire eliminate much of the bias as conventionally measured, but the remaining bias is a considerable fraction of experimentally-determined programme impact estimates. We test and reject the identifying assumptions that justify the classical method of matching. We present a nonparametric conditional difference-in-differences extension of the method of matching that is consistent with the classical index-sufficient sample selection model and is not rejected by our tests of identifying assumptions. This estimator is effective in eliminating bias, especially when it is due to temporally-invariant omitted variables.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“For the OR approach, the consistency of the ATT estimator (2.2) relies on the estimators of md , t ( · ) , ̂ µ d , t ( · ) , being correctly specified, whereas the IPW estimator (2.4) relies on the propensity score estimator ̂ π ( · ) of p ( · ) being correctly specified.”
From Doubly robust difference-in-differences estimators (2020) · cites this paper as Heckman et al. (1997)
In the citing paper
“These fall into two main categories, which we denote trajectory modeling [28, 29, 86, 88, 95] and propensity score weighting [17, 30].”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“Doubly robust (DR) estimators combine trajectory modeling and propensity score estimation and produce consistent estimates if either the trajectory model or the propensity score model is correctly specified: [29]”
From Difference-in-Differences for Health Policy and Practice: A Review of Modern Methods (2025) · cites this paper as [29]
In the citing paper
“The OR, IPW and DR estimands respectively generalize Heckman et al. (1997), Abadie (2005) and Sant'Anna and Zhao (2020) estimands for the two groups, two periods DiD setup to the staggered DiD setup with multiple periods and multiple groups.”
From Difference-in-Differences with multiple time periods (2021) · cites this paper as Heckman et al. (1997)
In the citing paper
“CS also derives estimators that are consistent for AT T (g, τ ) under more general conditions, such as when the parallel-trends assumption holds conditionally on covariates, including an outcome-regression-based estimator”
From How Much Should We Trust Staggered Difference-in-Differences Estimates? (2022) · cites this paper as Heckman et al., 1997
1 more claim about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
The central role of the propensity score in observational studies for causal effects
ROSENBAUM, P. R., & RUBIN, D. B. (1983) · Biometrika · doi:10.1093/biomet/70.1.41 · Cited by 31,241
Classification and Regression Trees.
Gordon, A. D., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1984) · Biometrics · doi:10.2307/2530946 · Cited by 23,522
Classification and Regression Trees.
Ryzin, J. V., Breiman, L., Friedman, J. H., Olshen, R. A., & Stone, C. J. (1986) · Journal of the American Statistical Association · doi:10.2307/2288003 · Cited by 20,825
Density Estimation for Statistics and Data Analysis
Silverman, B. W. (2018) · Routledge eBooks · doi:10.1201/9781315140919 · Cited by 15,796
Rosenbaum, P. R., & Rubin, D. B. (1985) · The American Statistician · doi:10.2307/2683903 · Cited by 4,774
SOME THOUGHTS ON THE DISTRIBUTION OF EARNINGS 1
ROY, A. D. (1951) · Oxford Economic Papers · doi:10.1093/oxfordjournals.oep.a041827 · Cited by 2,958
Bayesian inference for causal effects: The role of randomization
Rubin, D. B. (1978) · The Annals of Statistics · doi:10.1214/aos/1176344064 · Cited by 2,503
Estimating the Effect of Training Programs on Earnings
Ashenfelter, O. (1978) · The Review of Economics and Statistics · doi:10.2307/1924332 · Cited by 1,515
Design-adaptive Nonparametric Regression
Fan, J. (1992) · Journal of the American Statistical Association · doi:10.1080/01621459.1992.10476255 · Cited by 1,268
The Estimation of Choice Probabilities from Choice Based Samples
Manski, C. F., & Lerman, S. R. (1977) · Econometrica · doi:10.2307/1914121 · Cited by 1,208
Cited by
Items 801–900 of 1,029
Rui, G. U., & Nie, F. (2021) · Journal of Integrative Agriculture · doi:10.1016/s2095-3119(20)63436-0 · Cited by 77
Are corruption and corporate tax avoidance in the United States related?
Al‐Hadi, A., Taylor, G., & Richardson, G. (2021) · Review of Accounting Studies · doi:10.1007/s11142-021-09587-8 · Cited by 86
Völz, S., Redfors, B., Angerås, O., Ioanes, D., Odenstedt, J., Koul, S. M., Valeljung, I., Dworeck, C., Hofmann, R., Hansson, E. C., et al. (2021) · European Heart Journal · doi:10.1093/eurheartj/ehab273 · Cited by 79
Zheng, X., Menezes, F. M., Zheng, X., & Wu, C. (2022) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2022.05.020 · Cited by 100
Martínez-Espiñeira, R., García-Valiñas, M. Á., & González‐Gómez, F. (2009) · Urban Studies · doi:10.1177/0042098009102135 · Cited by 90
L'approche expérimentale en économie du développement
Banerjee, A., & Duflo, E. (2009) · Revue d économie politique · doi:10.3917/redp.195.0691 · Cited by 88
Chang, K., Lee, J. T., Vamos, E. P., Soljak, M., Johnston, D. G., Khunti, K., Majeed, A., & Millett, C. J. (2016) · Canadian Medical Association Journal · doi:10.1503/cmaj.151201 · Cited by 80
Ogunniyi, A. I., Olagunju, K. O., Ogundipe, A. A., Kabir, S. K., & Philips, F. (2017) · African Development Review · doi:10.1111/1467-8268.12267 · Cited by 88
The earnings returns to graduating with honors — Evidence from law graduates
Freier, R., Schumann, M., & Siedler, T. (2015) · Labour Economics · doi:10.1016/j.labeco.2015.03.001 · Cited by 102
“Hoekstra (2009) and Saavedra (2009), for example, use a fuzzy regression discontinuity design based on university admission rules and report sizable positive effects of graduating from particular colleges on labor market outcomes such as employment and earnings. Kane and Rouse (1995), Jacobson et al. (2005) and Jepsen…”
BackgroundInfluentialAre There Lasting Impacts Of Aid To Poor Areas ? Evidence From Rural China
Mu, R., Chen, S., & Ravallion, M. D. (2008) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-4084 · Cited by 85
Do Foreign Firms Really Pay Higher Wages? Evidence from Different EstimatorsPreprint
Martins, P. S. (2004) · SSRN Electronic Journal · doi:10.2139/ssrn.617407 · Cited by 77
“As mentioned before, this is motivated, inter alia, by the findings of Heckman et al (1997) that a difference-indifferences extension of the method of matching is particularly effective in eliminating bias, especially that due to time-invariant unobserved variables.”
BackgroundResultInfluentialE-Commerce Participation and Household Income Growth in Taobao Villages
Luo, X., & Niu, C. (2019) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-8811 · Cited by 93
“Since then, PSM has been widely employed in empirical economic studies (Heckman et al. 1997, Dehejia and Wahba 1999, and Davies and Kim 2003), and many other fields where there is a treatment, a group of treated individuals, and a group of untreated individuals.”
MethodDevelopmental Science in 2025: A Predictive Review
Lerner, R. M., Agans, J. P., DeSouza, L. M., & Hershberg, R. M. (2014) · Research in Human Development · doi:10.1080/15427609.2014.967046 · Cited by 83
“Propensity scores are used to reduce selection bias by equating groups based on these covariates (e.g., Heckman et al., 1997, 1998; Rosenbaum & Rubin, 1983).”
MethodHo, T. T., & Shimada, K. (2019) · Agriculture · doi:10.3390/agriculture9050099 · Cited by 83
Does land registration and certification boost farm productivity? Evidence from Ethiopia
Melesse, M. B., & Bulte, E. (2015) · Agricultural Economics · doi:10.1111/agec.12191 · Cited by 94
BURGESS, S. M., Wilson, D., & Worth, J. (2013) · Journal of Public Economics · doi:10.1016/j.jpubeco.2013.06.005 · Cited by 94
The Long-Term Effects of Cancer on Employment and Earnings
Jeon, S. (2016) · Health Economics · doi:10.1002/hec.3342 · Cited by 85
Bonetti, P., MAGNAN, M. L., & Parbonetti, A. (2013) · Journal of Business Finance & Accounting · doi:10.1111/jbfa.12220 · Cited by 77
Kluve, J., Lehmann, H., & Schmidt, C. M. (1999) · Journal of Comparative Economics · doi:10.1006/jcec.1998.1573 · Cited by 74
“As Heckman et al. (1997) point out, the strong assumptions traditionally invoked in the matching literature, conditional independence of the labor market status 0 qi Y and of the treatment”
InfluentialThe Effects of Multinational Production on Domestic Performance: Evidence from Japanese FirmsPreprint
Hijzen, A., Inui, T., & Todo, Y. (2007) · RePEc: Research Papers in Economics · Cited by 104
The Dragon Is Flying West: Micro-level Evidence of Chinese Outward Direct Investment
Chen, W., & Tang, H. (2014) · Asian Development Review · doi:10.1162/adev_a_00032 · Cited by 84
“Without a feasible instrument in the dataset, we will rely on matching techniques (i.e., Heckman et al. 1997 and subsequent studies) to identify the effects of ODI on firm performance, relative to the control group that shares similar ex ante characteristics.”
At a Cost: The Real Effects of Transfer Pricing Regulations
Mooij, R. A. D., & Liu, L. (2020) · IMF Economic Review · doi:10.1057/s41308-019-00105-0 · Cited by 107
Ryu, D., & Kang, C. (2013) · Asian Economic Journal · doi:10.1111/asej.12002 · Cited by 92
Hedge Fund Intervention and Accounting Conservatism
Cheng, A., Huang, H. H., & Li, Y. (2014) · Contemporary Accounting Research · doi:10.1111/1911-3846.12076 · Cited by 88
Bonsall, S. B. (2014) · Journal of Accounting and Economics · doi:10.1016/j.jacceco.2014.01.001 · Cited by 91
Olitsky, N. H. (2013) · Research in Higher Education · doi:10.1007/s11162-013-9310-y · Cited by 79
“11 This method has been identified as being a good way to estimate treatment effects across subgroups (Heckman et al. 1997; Caliendo and Kopeinig 2008).”
MethodDo Wage Subsidies Increase Employment in Subsidized Firms?
Kangasharju, A. (2006) · Economica · doi:10.1111/j.1468-0335.2006.00525.x · Cited by 75
Fougère, D., Crépon, B., & Brodaty, T. (2007) · Économie & prévision · doi:10.3406/ecop.2007.7982 · Cited by 75
Liu, X., & Lynch, L. (2011) · Land Economics · doi:10.3368/le.87.2.183 · Cited by 101
“Heckman et al. (1998) relax the strong CIA condition by proposing a Conditional Mean Independence (CMI) assumption.”
MethodEnvironmental pollution policy of small businesses in Nigeria and Ghana: extent and impact
Efobi, U., Tanankem, B., Orkoh, E., Atata, S. N., Akınyemi, O., & Beecroft, I. (2018) · Environmental Science and Pollution Research · doi:10.1007/s11356-018-3817-x · Cited by 75
Edwards, S. (2001) · Journal of Policy Modeling · doi:10.1016/s0161-8938(01)00045-x · Cited by 75
Lu, H., Nie, P., & Sousa-Poza, A. (2021) · Child Indicators Research · doi:10.1007/s12187-020-09750-8 · Cited by 74
“does not assume a linear relation between variables, can effectively address problems of endogeneity and self-selection bias (Heckman et al., 1997).”
The Causal Effect of Access to Finance on Productivity of Small and Medium Enterprises in Vietnam
Giang, M. H., Trung, B. H., Yoshida, Y., Xuan, T. D., & Que, M. T. (2019) · Sustainability · doi:10.3390/su11195451 · Cited by 90
Subsidies, loans, and companies' performance: evidence from China's photovoltaic industry
Xu, L., Zhang, Q., Wang, K., & Shi, X. (2019) · Applied Energy · doi:10.1016/j.apenergy.2019.114280 · Cited by 77
Standards and export performance in developing countries: Evidence from Pakistan
Masakure, O., Henson, S., & Cranfield, J. (2009) · Journal of International Trade & Economic Development · doi:10.1080/09638190902986538 · Cited by 89
“This counterfactual item cannot be observed, but can be estimated using Propensity Score Matching methods (Heckman et al. 1997; Blundell and Costa-Dias 2000; Ravallion 2006; Todd 2006).”
BackgroundMethodInfluentialStar CEOs or Political Connections? Evidence from China's Publicly Traded Firms
Conyon, M. J., He, L., & Zhou, X. (2015) · Journal of Business Finance & Accounting · doi:10.1111/jbfa.12110 · Cited by 84
“The goal of propensity score matching is to find a set of non-star control samples that can be matched optimally to the set of firms that have hired star CEOs (Heckman et al., 1997, 1998 ; Imbens, 2000).”
Getting the Unemployed Back to Work: The Role of Targeted Wage Subsidies
Bell, B., Blundell, R. W., & Reenen, J. M. V. (1999) · International Tax and Public Finance · doi:10.1023/a:1008787013977 · Cited by 141
Additionality in U.S. Agricultural Conservation Programs
Claassen, R., Duquette, E. N., & Smith, D. J. (2018) · Land Economics · doi:10.3368/le.94.1.19 · Cited by 73
“22 February 2018Land Economics estimates of the ATT under the CIA are also achievable with PSM (Heckman, Ichimura, and Todd 1997, 1998).”
InfluentialThe Effects of Structural Reforms: Evidence from Italy
Ciapanna, E., Mocetti, S., & Notarpietro, A. (2020) · Economic Policy · doi:10.1093/epolic/eiac053 · Cited by 92
“To account for this concern, we adopt a combination of matching with DID, as proposed in Heckman et al. (1997), thus pairing each treated firm with “similar” control firms.”
MethodEvaluating State Programmes: "Natural Experiments" and Propensity Scores*
Conniffe, D., Gash, V., & O’Connell, P. J. (2000) · Economic and social review · Cited by 95
Crown, W. H. (2014) · Applied Health Economics and Health Policy · doi:10.1007/s40258-013-0075-4 · Cited by 82
Evaluating active labor market programs in Romania
Rodríguez‐Planas, N., & Benus, J. M. (2009) · Empirical Economics · doi:10.1007/s00181-009-0256-z · Cited by 94
Evaluation of training in African enterprises
Rosholm, M., Nielsen, H. S., & Dabalen, A. (2006) · Journal of Development Economics · doi:10.1016/j.jdeveco.2005.11.008 · Cited by 89
“The local linear matching estimator has a slight advantage over the kernel matching estimator because of some desirable statistical properties (Heckman et al., 1997).”
BackgroundWage changes through job mobility in Europe: A multinomial endogenous switching approach
Pérez, J. I. G., & Rebollo‐Sanz, Y. F. (2005) · Labour Economics · doi:10.1016/j.labeco.2005.05.005 · Cited by 73
Diallo, M. F., Diop-Sall, F., Djelassi, S., & Godefroit‐Winkel, D. (2018) · Journal of International Marketing · doi:10.1177/1069031x18807473 · Cited by 92
“As a check for self-selection bias, we follow Chang, Chung, and Moon (2013) and apply propensity score matching in STATA 15 (Heckman, Ichimura, and Todd, 1997).”
MethodTripney, J., Hombrados, J., Newman, M., Hovish, K., Brown, C., Steinka-Fry, K., & Wilkey, E. (2013) · Campbell Systematic Reviews: Better Evidence for a Better World · doi:10.4073/csr.2013.9 · Cited by 72
The Market: Catalyst for Rationality and Filter of Irrationality
List, J. A., & Millimet, D. L. (2008) · The B E Journal of Economic Analysis & Policy · doi:10.2202/1935-1682.2115 · Cited by 82
Bonnet, C., Garbinti, B., & Solaz, A. (2020) · Journal of Population Economics · doi:10.1007/s00148-020-00786-2 · Cited by 79
Lin, B., & Jia, H. (2022) · Transportation Research Part D Transport and Environment · doi:10.1016/j.trd.2022.103230 · Cited by 76
Chen, Y., & Lee, S. (2021) · Journal of Marketing · doi:10.1177/00222429221146511 · Cited by 77
The Distribution of Lifetime Earnings Returns to College
Nybom, M. (2017) · Journal of Labor Economics · doi:10.1086/692475 · Cited by 69
Hamersma, S. (2008) · Journal of Policy Analysis and Management · doi:10.1002/pam.20354 · Cited by 84
Rawat, R., Kadiyala, S., & McNamara, P. E. (2010) · BMC Public Health · doi:10.1186/1471-2458-10-316 · Cited by 72
Bloom, H. S., Michalopoulos, C., Hill, C. J., & Lei, Y. (2002) · Cited by 85
Hutchison, M. M., & Noy, I. (2003) · Journal of International Money and Finance · doi:10.1016/j.jimonfin.2003.09.007 · Cited by 72
“Heckman et al. (1997) note that “…simple balancing of observables in the participant and comparison group samples goes a long way toward producing a more effective evaluation strategy” (p. 607).”
InfluentialWelfare Reform and Lone Parents Employment in the UKPreprint
Gregg, P., & Harkness, S. (2003) · RePEc: Research Papers in Economics · Cited by 72
Regulation and Market Liquidity
Trebbi, F., & Xiao, K. (2015) · National Bureau of Economic Research · doi:10.3386/w21739 · Cited by 78
A Bracketing Relationship between Difference-in-Differences and Lagged-Dependent-Variable Adjustment
Ding, P., & Li, F. (2019) · Political Analysis · doi:10.1017/pan.2019.25 · Cited by 73
“The key assumption underlying difference-indifferences is parallel trends, that is, the counterfactual trend behavior of treatment and control groups, in the absence of treatment, is the same, possibly conditioning on some observed covariates (Heckman et al., 1997; Abadie, 2005).”
BackgroundMethodInfluentialMoric, I., Jovanovic, J. S., Đoković, R., Peković, S., & Perović, Đ. (2020) · Sustainability · doi:10.3390/su12062557 · Cited by 77
“In this paper, the matching principle is based on kernel techniques in order to deliver a non-parametric assessment of the treatment effect given the value of the propensity score [56,57].”
MethodJimenez‐Soto, E., & Brown, R. P. (2012) · Economic Record · doi:10.1111/j.1475-4932.2012.00824.x · Cited by 82
“…the dataset includes a relatively large number of observable variables that would capture the ‘non-ignorable’ determinants of treatment (LaLonde, 1986; Heckman et al., 1996, 1997; Smith & Todd, 2005).13 In our case, both the migrant and the non-migrant groups are obviously located in the same…”
BackgroundCrosnoe, R. L. (2009) · Developmental Psychology · doi:10.1037/a0016131 · Cited by 88
Fan, M., & Jin, Y. (2015) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph121114640 · Cited by 74
Kantarevic, J., & Kralj, B. (2012) · Health Economics · doi:10.1002/hec.2890 · Cited by 80
Takahashi, R., & Todo, Y. (2013) · Journal of Environmental Management · doi:10.1016/j.jenvman.2013.08.025 · Cited by 81
“If panel data are available, a difference-indifferences (DID) PSM estimation of the ATT can be employed, as proposed by Heckman et al. (1997, 1998).”
MethodEmpirical generalizations on the impact of stars on the economic success of movies
Hofmann, J., Clément, M., Völckner, F., & Hennig‐Thurau, T. (2016) · International Journal of Research in Marketing · doi:10.1016/j.ijresmar.2016.08.006 · Cited by 77
Discretionary loan loss provision behavior in the US banking industry
Tran, D. V., Hassan, M. K., & Houston, R. (2019) · Review of Quantitative Finance and Accounting · doi:10.1007/s11156-019-00854-z · Cited by 71
Effect of China's western development strategy on carbon intensity
Zhang, C., Zhou, B., & Wang, Q. (2019) · Journal of Cleaner Production · doi:10.1016/j.jclepro.2019.01.136 · Cited by 71
The impact of agri-environment schemes on farm productivity: a DID-matching approach
Mennig, P., & Sauer, J. (2019) · European Review of Agricultural Economics · doi:10.1093/erae/jbz006 · Cited by 83
Social Protection in a Crisis: Argentina’s Plan Jefes y Jefas
Galasso, E., & Ravallion, M. D. (2003) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-3165 · Cited by 114
Policy-Induced Environmental Technology and Inventive Efforts: Is There a Crowding Out?Preprint
Hottenrott, H., & Rexhäuser, S. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2379461 · Cited by 74
Ying, H., Peng, X., Zhao, X., & Chen, Z. (2023) · Production and Operations Management · doi:10.1111/poms.13968 · Cited by 70
“Searchable attributes matching helped us to locate potential control SKUs for each treated SKU, and this potential control matching strategy is consistent with the literature (Heckman et al., 1997; Hendricks and Singhal, 2005; Levine and Toffel, 2010).”
The effect of disability on labour market outcomes in Germany
Lechner, M., & Vazquez‐Alvarez, R. (2009) · Applied Economics · doi:10.1080/00036840802599974 · Cited by 81
Estimating Treatment Effects from Spatial Policy Experiments: An Application to Ugandan Microfinance
McIntosh, C. (2008) · The Review of Economics and Statistics · doi:10.1162/rest.90.1.15 · Cited by 90
“The closest analogy to this is the “regression-adjusted conditional difference-in-differences matching estimator” discussed in Heckman, Ichimura, and Todd (1997).”
BackgroundMethodFamily planning and fertility decline in rural Iran: the impact of rural health clinics
Salehi‐Isfahani, D., Abbasi‐Shavazi, M. J., & Hosseini‐Chavoshi, M. (2010) · Health Economics · doi:10.1002/hec.1613 · Cited by 70
Teenage Pregnancy in Mexico: Evolution and Consequences
Económicas, C. D. I. Y. D., Arceo-Gómez, E. O., & Campos-Vázquez, R. M. (2014) · Latin american journal of economics · doi:10.7764/laje.51.1.109 · Cited by 92
“Panel C matches on the log of odds ratio of the main estimated propensity score as suggested by Heckman, Ichimura, and Todd (1997).”
Does auditor gender affect issuing going-concern decisions for financially distressed clients?
Hossain, S., Chapple, L., & Monroe, G. (2016) · Accounting and Finance · doi:10.1111/acfi.12242 · Cited by 52
Kwon, J., & Johnson, M. E. (2018) · MIS Quarterly · doi:10.25300/misq/2018/13580 · Cited by 83
Relationship Bank Behavior during Borrower Distress
Li, Y., Lu, R., & Srinivasan, A. (2018) · Journal of Financial and Quantitative Analysis · doi:10.1017/s0022109018001084 · Cited by 77
Chaudhury, N., & Parajuli, D. (2008) · Applied Economics · doi:10.1080/00036840802167376 · Cited by 70
“This is a case of sharp RD design,(14) where there is no region of common support in the propensity-score matching language of evaluation literature (Rosenbaum and Rubin, 1983; Heckman et al., 1997) In other words, probability of being exposed to treatment changes from 0 to 1 discontinuously as one crosses the cut-off…”
Assessing the effectiveness of global protected areas based on the difference in differences model
Feng, Y., Wang, Y., Su, H., Pan, J., Sun, Y., Zhu, J., Fang, J., & Tang, Z. (2021) · Ecological Indicators · doi:10.1016/j.ecolind.2021.108078 · Cited by 74
How do industrial robots applications affect the quality upgrade of Chinese export trade?
Lin, C., Xiao, S., & Yin, Z. H. (2022) · Telecommunications Policy · doi:10.1016/j.telpol.2022.102425 · Cited by 75
Sidhoum, A. A., Canessa, C., & Sauer, J. (2022) · Journal of Agricultural Economics · doi:10.1111/1477-9552.12520 · Cited by 69
How Do Restrictions on High-Skilled Immigration Affect Offshoring? Evidence from the H-1B Program
Glennon, B. M. (2023) · Management Science · doi:10.1287/mnsc.2023.4715 · Cited by 89
Youth employment policies in France
Fougère, D., Kramarz, F., & Magnac, T. (2000) · European Economic Review · doi:10.1016/s0014-2921(99)00051-3 · Cited by 84
“In view of the work of James Heckman and his coauthors ( Heckman et al., 1997a, b, 1998), evidence from these sources are informative provided that care be taken in estimating econometric models (Heckman and Hotz, 1989).”
BackgroundLinden, A. (2014) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12254 · Cited by 84
The economic impact of taking short parental leave: Evaluation of a French reform
Joseph, O., Pailhé, A., Recotillet, I., & Solaz, A. (2013) · Labour Economics · doi:10.1016/j.labeco.2013.04.012 · Cited by 78
“…each individual I who received the CLCA with an untreated individual with the same characteristics X as the individual 15 It is also possible to take unobservable characteristics into account by combining a difference-in-differences estimator with the matching procedure (Heckman et al., 1997). i.”
MethodLes méthodes économétriques d'évaluation
Fougère, D. (2010) · Revue française des affaires sociales · doi:10.3917/rfas.101.0105 · Cited by 93
Brännström, L. (2004) · Urban Studies · doi:10.1080/0042098042000294547 · Cited by 91
Agricultural water management and poverty in Ethiopia
Hagos, F., Jayasinghe, G., Awulachew, S. B., Loulseged, M., & Yilma, A. D. (2012) · Agricultural Economics · doi:10.1111/j.1574-0862.2012.00623.x · Cited by 76
Abadi, N., Gebrehiwot, K., Techane, A., & Nerea, H. (2016) · Energy Policy · doi:10.1016/j.enpol.2016.11.015 · Cited by 73
Osikominu, A. (2012) · The Review of Economic Studies · doi:10.1093/restud/rds022 · Cited by 69
“Ashenfelter (1978); Heckman, Ichimura, and Todd (1997); and Heckman and Smith (1999), among others, stress the importance to carefully align treated and comparison persons with respect to their pretreatment outcomes.”
Building Relationships Early: Banks in Venture Capital
Hellmann, T. F., Lindsey, L. A., & Puri, M. (2004) · National Bureau of Economic Research · doi:10.3386/w10535 · Cited by 82
Li, X., Wang, Y., Hongchun, Z., & Shi, L. (2020) · Journal of Environmental Management · doi:10.1016/j.jenvman.2019.109851 · Cited by 68
Income effects of poverty alleviation relocation program on rural farmers in China
Leng, G., Feng, X., & Qiu, H. (2021) · Journal of Integrative Agriculture · doi:10.1016/s2095-3119(20)63583-3 · Cited by 70
Cao, G., Liu, C., & Zhou, L. (2021) · Journal of Public Economics · doi:10.1016/j.jpubeco.2023.104895 · Cited by 71
Tusiime, H. A., Renard, R., & Smets, L. (2013) · Food Policy · doi:10.1016/j.foodpol.2013.07.005 · Cited by 68
Cluster development policy, SME’s performance, and spillovers: evidence from Brazil
Garone, L. F., Maffioli, A., Negri, J. A. D., Rodríguez, C. M., & Vázquez-Baré, G. (2015) · Small Business Economics · doi:10.1007/s11187-014-9620-2 · Cited by 80
“23 Heckman et al. (1997, 1998) point out this source of bias.”
BackgroundMcNulty, J. E., Dowling, C. M., & Ariotti, M. H. (2009) · Political Analysis · doi:10.1093/pan/mpp014 · Cited by 75
“In addition, Heckman, Ichimura, and Todd (1997, 1998), Heckman et al. (1998), and J. Smith and Todd (2001) suggest that data of the type that is typically generated by the voter rolls is especially amenable to this matching approach.”
BackgroundSugarcane Outgrowers in Ethiopia: “Forced” to Remain Poor?
Wendimu, M. A., Henningsen, A., & Gibbon, P. (2016) · World Development · doi:10.1016/j.worlddev.2016.03.002 · Cited by 79
Soil water management practices (terraces) helped to mitigate the 2015 drought in Ethiopia
Kosmowski, F. (2018) · Agricultural Water Management · doi:10.1016/j.agwat.2018.02.025 · Cited by 93
“covariates likely to influence yields were included (Heckman et al., 1997).”
Background
Metadata
- Authors
- Heckman, J. J., Ichimura, H., & Todd, P. E.
- Affiliations
- University of Chicago (US)
- University of Pittsburgh (US)
- University of Pennsylvania (US)
- Venue
- The Review of Economic Studies
- Publisher
- Oxford University Press (OUP)
- Published
- 1997-10-01
- Volume
- 64
- Issue
- 4
- Pages
- 605-654
- ISSN
- 0034-6527 (ISSN-L)
- 1467-937X
- OpenAlex
- W2066735350
- Semantic Scholar
- ec958b198d3b6712d1e0f3395a05ff2b0136a1bb
- Cited by
- 5,486
- References
- 32
- Citations by year
- 2026: 216 · 2025: 268 · 2024: 271 · 2023: 292 · 2022: 296 · 2021: 246 · 2020: 254 · 2019: 244 · 2018: 269 · 2017: 236 · 2016: 231 · 2015: 251 · 2014: 266 · 2013: 248 · 2012: 275
- FWCI
- 20.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- The Review of Economic Studies (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Sociology and Political Science › Names, Identity, and Discrimination Research
- Keywords
- selection on unobservables, sample selection model, identifying assumptions, omitted variables
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.