Characterizing Selection Bias Using Experimental Data
The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Abstract
This paper develops and applies semiparametric econometric methods to estimate the form of selection bias that arises from using nonexperimental comparison groups to evaluate social programs and to test the identifying assumptions that justify three widely-used classes of estimators and our extensions of them: (a) the method of matching; (b) the classical econometric selection model which represents the bias solely as a function of the probability of participation; and (c) the method of difference-in-differences. Using data from an experiment on a prototypical social program combined with unusually rich data from a nonexperimental comparison group, we reject the assumptions justifying matching and our extensions of that method but find evidence in support of the index-sufficient selection bias model and the assumptions that justify application of a conditional semiparametric version of the method of difference-in-difference. Fa comparable people and to appropriately weight participants and nonparticipants a sources of selection bias as conveniently measured. We present a rigorous defin bias and find that in our data it is a small component of conventially meausred it is still substantial when compared with experimentally-estimated program impa matching participants to comparison group members in the same labor market, givi same questionnaire, and making sure they have comparable characteristics substan the performance of any econometric program evaluation estimator. We show how t analysis to estimate the impact of treatment on the treated using ordinary obser
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Model selection is conducted through an iterative process, with the primary goal of achieving covariate balance afterwards (Heckman, Ichimura, Smith, & Todd, 1998; Rosenbaum & Rubin, 1984), as opposed to explicit modeling of the selection process.”
From Differential Effects of Adult Court Transfer on Juvenile Offender Recidivism (2010) · cites this paper as Heckman, Ichimura, Smith, & Todd, 1998
In the citing paper
“Inference can be done using the delta-method for parametric models, and there are also several methods available for semi-/non-parametric models (under some additional regularity conditions), including the bootstrap, as described in Heckman et al. (1998).”
From What's trending in difference-in-differences? A synthesis of the recent econometrics literature (2023) · cites this paper as Heckman et al. (1998)
In the citing paper
“The identification strategy for the effect of the ETS on innovation has been matching-adjusted DID that proceeded in two steps44,45, used for estimation of both the main policy effects and spillovers.”
From Low-carbon innovation induced by emissions trading in China (2019) · cites this paper as [44]
In the citing paper
“The Achilles heel of the survey methodology is its inability to escape from the glaring problems of selection that plague research in this field (see Winship and Morgan 1999; Rubin 1990; Heckman et al. 1998).”
From The Mark of a Criminal Record (2003) · cites this paper as Heckman et al. 1998
Citations
Cites
The publisher hasn’t deposited this paper’s reference list.
Cited by
Difference-in-Differences with multiple time periods
Callaway, B., & Sant’Anna, P. H. C. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.12.001 · Cited by 9,126
SOME PRACTICAL GUIDANCE FOR THE IMPLEMENTATION OF PROPENSITY SCORE MATCHING
Caliendo, M., & Kopeinig, S. (2008) · Journal of Economic Surveys · doi:10.1111/j.1467-6419.2007.00527.x · Cited by 6,238
Estimating dynamic treatment effects in event studies with heterogeneous treatment effects
Sun, L., & Abraham, S. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.09.006 · Cited by 5,518
Matching Methods for Causal Inference: A Review and a Look Forward
Stuart, E. A. (2010) · Statistical Science · doi:10.1214/09-sts313 · Cited by 5,478
Recent Developments in the Econometrics of Program Evaluation
Imbens, G. W., & Wooldridge, J. M. (2009) · Journal of Economic Literature · doi:10.1257/jel.47.1.5 · Cited by 4,926
Propensity Score-Matching Methods for Nonexperimental Causal Studies
Dehejia, R. H., & Wahba, S. (2002) · Review of Economics and Statistics · doi:10.1162/003465302317331982 · Cited by 4,846
Matching as Nonparametric Preprocessing for Reducing Model Dependence in Parametric Causal Inference
Ho, D. E., Imai, K., King, G., & Stuart, E. A. (2007) · Political Analysis · doi:10.1093/pan/mpl013 · Cited by 4,205
Matching As An Econometric Evaluation Estimator
Heckman, J. J., Ichimura, H., & Todd, P. (1998) · Review of Economic Studies · doi:10.1111/1467-937x.00044 · Cited by 3,807
Self-citationDoes matching overcome lalonde’s critique of nonexperimental estimators?
A. Smith, J., & E. Todd, P. (2005) · Journal of Econometrics · doi:10.1016/j.jeconom.2004.04.011 · Cited by 3,176
Nonparametric Estimation of Average Treatment Effects Under Exogeneity: A Review
Imbens, G. W. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023651 · Cited by 2,994
The Economics and Econometrics of Active Labor Market Programs
Heckman, J. J., Lalonde, R. J., & Smith, J. A. (1999) · Handbook of Labor Economics · doi:10.1016/s1573-4463(99)03012-6 · Cited by 3,059
Self-citationLarge sample properties of matching estimators for average treatment effects
Abadie, A., & Imbens, G. W. (2006) · Econometrica · doi:10.1111/j.1468-0262.2006.00655.x · Cited by 2,908
Pager, D. (2003) · American Journal of Sociology · doi:10.1086/374403 · Cited by 2,840
Estimation of Average Treatment Effects Based on Propensity Scores
Becker, S. O., & Ichino, A. (2002) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0200200403 · Cited by 2,754
Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score
Hirano, K., Imbens, G. W., & Ridder, G. (2003) · Econometrica · doi:10.1111/1468-0262.00442 · Cited by 2,355
Endogeneity in Empirical Corporate Finance1
Roberts, M. R., & Whited, T. M. (2013) · Handbook of the Economics of Finance · doi:10.1016/b978-0-44-453594-8.00007-0 · Cited by 2,459
Causal effects in nonexperimental studies: Reevaluating the evaluation of training programs
Dehejia, R. H., & Wahba, S. (1999) · Journal of the American Statistical Association · doi:10.1080/01621459.1999.10473858 · Cited by 2,395
Semiparametric Difference-in-Differences Estimators
Abadie, A. (2005) · The Review of Economic Studies · doi:10.1111/0034-6527.00321 · Cited by 2,286
What's trending in difference-in-differences? A synthesis of the recent econometrics literature
Roth, J., Sant’Anna, P. H. C., Bilinski, A., & Poe, J. (2023) · Journal of Econometrics · doi:10.1016/j.jeconom.2023.03.008 · Cited by 2,027
“…ATT when the outcome model used to estimate Inference can be done using the delta-method for parametric models, and there are also several methods available for semi-/non-parametric models (under some additional regularity conditions), including the bootstrap, as described in Heckman et al. (1998).”
The Globalization of Liberalization: Policy Diffusion in the International Political Economy
SIMMONS, B. A., & ELKINS, Z. (2004) · American Political Science Review · doi:10.1017/s0003055404001078 · Cited by 1,611
A More Credible Approach to Parallel Trends
Rambachan, A., & Roth, J. (2023) · Review of Economic Studies · doi:10.1093/restud/rdad018 · Cited by 1,559
Sekhon, J. S. (2011) · Journal of Statistical Software · doi:10.18637/jss.v042.i07 · Cited by 1,543
Bias-Corrected Matching Estimators for Average Treatment Effects
Abadie, A., & Imbens, G. W. (2011) · Journal of Business & Economic Statistics · doi:10.1198/jbes.2009.07333 · Cited by 1,416
Active Labour Market Policy Evaluations: A Meta‐Analysis
Card, D., Kluve, J., & Weber, A. (2010) · The Economic Journal · doi:10.1111/j.1468-0297.2010.02387.x · Cited by 1,298
Structural Equations, Treatment Effects, and Econometric Policy Evaluation1
Heckman, J. J., & Vytlacil, E. (2005) · Econometrica · doi:10.1111/j.1468-0262.2005.00594.x · Cited by 1,220
Self-citationUsing Randomization in Development Economics Research: A Toolkit
Duflo, E., Glennerster, R., & Kremer, M. (2006) · National Bureau of Economic Research · doi:10.3386/t0333 · Cited by 1,191
Decomposition Methods in Economics
Fortin, N., Lemieux, T., & Firpo, S. (2011) · Handbook of Labor Economics · doi:10.1016/s0169-7218(11)00407-2 · Cited by 1,029
Panel data analysis—advantages and challenges
Hsiao, C. (2007) · TEST · doi:10.1007/s11749-007-0046-x · Cited by 1,059
Environmental Policy and Directed Technological Change: Evidence from the European Carbon Market
Calel, R., & Dechezleprêtre, A. (2016) · Review of Economics and Statistics · doi:10.1162/rest_a_00470 · Cited by 1,147
Diamond, A., & Sekhon, J. S. (2013) · Review of Economics and Statistics · doi:10.1162/rest_a_00318 · Cited by 1,102
Doubly robust difference-in-differences estimators
Sant’Anna, P. H. C., & Zhao, J. (2020) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.06.003 · Cited by 1,047
“Heckman et al. (1997). In this case, one would need to model two additional conditional expectations when compared to (6).”
InfluentialWhat Works? A Meta Analysis of Recent Active Labor Market Program Evaluations
Card, D., Kluve, J., & Weber, A. (2018) · Journal of the European Economic Association · doi:10.1093/jeea/jvx028 · Cited by 990
An Evaluation of the Swedish System of Active Labor Market Programs in the 1990s
Sianesi, B. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023723 · Cited by 1,053
Dealing with limited overlap in estimation of average treatment effects
Crump, R. K., Hotz, V. J., Imbens, G. W., & Mitnik, O. A. (2009) · Biometrika · doi:10.1093/biomet/asn055 · Cited by 1,007
Alternative approaches to evaluation in empirical microeconomics
Blundell, R., & Costa Dias, M. (2008) · doi:10.1920/wp.cem.2008.2608 · Cited by 881
The Estimation of Causal Effects by Difference-in-Difference Methods
Lechner, M. (2011) · Foundations and Trends® in Econometrics · doi:10.1561/0800000014 · Cited by 935
“, Card and Krueger, 1994), the effects of training and other active labor market programmes for unemployed on labor market outcomes (e.g., Ashenfelter, 1978; Ashenfelter and Card, 1985; Heckman and Robb, 1986; Heckman and Hotz, 1989; Heckman et al., 1998; Blundell et al., 2004), the effect of immigration on the local…”
BackgroundMethodInfluentialUnderstanding Instrumental Variables in Models with Essential Heterogeneity
Heckman, J. J., Urzua, S., & Vytlacil, E. (2006) · Review of Economics and Statistics · doi:10.1162/rest.88.3.389 · Cited by 874
Self-citationMisunderstandings Between Experimentalists and Observationalists about Causal Inference
Imai, K., King, G., & Stuart, E. A. (2008) · Journal of the Royal Statistical Society Series A: Statistics in Society · doi:10.1111/j.1467-985x.2007.00527.x · Cited by 906
THE ESTIMATION OF CAUSAL EFFECTS FROM OBSERVATIONAL DATA
Winship, C., & Morgan, S. L. (1999) · Annual Review of Sociology · doi:10.1146/annurev.soc.25.1.659 · Cited by 890
Water For Life: The impact of the privatization of water services on child mortality
Galiani, S., Gertler, P., & Schargrodsky, E. (2005) · Journal of Political Economy · doi:10.1086/426041 · Cited by 877
Can environmental innovation facilitate carbon emissions reduction? Evidence from China
Zhang, Y.-J., Peng, Y.-L., Ma, C.-Q., & Shen, B. (2017) · Energy Policy · doi:10.1016/j.enpol.2016.10.005 · Cited by 862
Causal Effects in Non-Experimental Studies: Re-Evaluating the Evaluation of Training Programs
Dehejia, R., & Wahba, S. (1998) · National Bureau of Economic Research · doi:10.3386/w6586 · Cited by 805
Heckman, J. (1997) · The Journal of Human Resources · doi:10.2307/146178 · Cited by 825
Self-citationUsing matching, instrumental variables and control functions to estimate economic choice models
Heckman, J., & Navarro-Lozano, S. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023660 · Cited by 768
Self-citationElectoral Rules and Corruption
Persson, T., Tabellini, G., & Trebbi, F. (2003) · Journal of the European Economic Association · doi:10.1162/154247603322493203 · Cited by 782
Decomposition Methods in Economics
Fortin, N., Lemieux, T., & Firpo, S. (2010) · National Bureau of Economic Research · doi:10.3386/w16045 · Cited by 736
Propensity Score Matching Methods for Non-Experimental Causal Studies
Dehejia, R. H., & Wahba, S. (2002) · SSRN Electronic Journal · doi:10.2139/ssrn.1084955 · Cited by 735
New Evidence on College Remediation
Attewell, P., Lavin, D., Domina, T., & Levey, T. (2006) · The Journal of Higher Education · doi:10.1080/00221546.2006.11778948 · Cited by 730
Abadie, A., Angrist, J., & Imbens, G. (2002) · Econometrica · doi:10.1111/1468-0262.00270 · Cited by 701
The Effects of Public R&D Subsidies on Firms' Innovation Activities: The Case of Eastern Germany
Almus, M., & Czarnitzki, D. (2003) · Journal of Business & Economic Statistics · doi:10.1198/073500103288618918 · Cited by 740
Does Diversification Cause the 'Diversification Discount'?
Villalonga, B. (2000) · SSRN Electronic Journal · doi:10.2139/ssrn.227828 · Cited by 737
Corporate Debt Maturity and the Real Effects of the 2007 Credit Crisis
Almeida, H. (2012) · Critical Finance Review · doi:10.1561/104.00000001 · Cited by 569
Earnings Losses of Displaced Workers Revisited
Couch, K. A., & Placzek, D. W. (2010) · American Economic Review · doi:10.1257/aer.100.1.572 · Cited by 676
Micro Data, Heterogeneity, and the Evaluation of Public Policy: Nobel Lecture
Heckman, J. J. (2001) · Journal of Political Economy · doi:10.1086/322086 · Cited by 675
Self-citationDo subsidies to commercial R&D reduce market failures? Microeconometric evaluation studies
Klette, T. J., Møen, J., & Griliches, Z. (2000) · Research Policy · doi:10.1016/s0048-7333(99)00086-4 · Cited by 678
Decomposing Wage Distributions Using Recentered Influence Function Regressions
Firpo, S. P., Fortin, N. M., & Lemieux, T. (2018) · Econometrics · doi:10.3390/econometrics6020028 · Cited by 647
The Experimental Approach to Development Economics
Banerjee, A. V., & Duflo, E. (2009) · Annual Review of Economics · doi:10.1146/annurev.economics.050708.143235 · Cited by 654
Statistical estimation in varying coefficient models
Fan, J., & Zhang, W. (1999) · The Annals of Statistics · doi:10.1214/aos/1017939139 · Cited by 656
Harding, D. J. (2003) · American Journal of Sociology · doi:10.1086/379217 · Cited by 644
Efficient Semiparametric Estimation of Quantile Treatment Effects
Firpo, S. (2007) · Econometrica · doi:10.1111/j.1468-0262.2007.00738.x · Cited by 631
Sensitivity analysis for average treatment effects
Becker, S. O., & Caliendo, M. (2007) · The Stata Journal: Promoting communications on statistics and Stata · doi:10.1177/1536867x0700700104 · Cited by 620
Estimating Marginal Returns to Education
Carneiro, P., Heckman, J. J., & Vytlacil, E. J. (2011) · American Economic Review · doi:10.1257/aer.101.6.2754 · Cited by 612
Self-citationPropensity Score Matching: A Statistical Method
Kane, L. T., Fang, T., Galetta, M. S., Goyal, D. K. C., Nicholson, K. J., Kepler, C. K., Vaccaro, A. R., & Schroeder, G. D. (2020) · Clinical Spine Surgery: A Spine Publication · doi:10.1097/bsd.0000000000000932 · Cited by 603
Schools and Skills in Developing Countries: Education Policies and Socioeconomic Outcomes
Glewwe, P. (2002) · Journal of Economic Literature · doi:10.1257/jel.40.2.436 · Cited by 570
Cook, T. D., Shadish, W. R., & Wong, V. C. (2008) · Journal of Policy Analysis and Management · doi:10.1002/pam.20375 · Cited by 604
Inference on Counterfactual Distributions
(2013) · Econometrica · doi:10.3982/ecta10582 · Cited by 601
Does piped water reduce diarrhea for children in rural India?
Jalan, J., & Ravallion, M. (2003) · Journal of Econometrics · doi:10.1016/s0304-4076(02)00158-6 · Cited by 593
Worms: Education and health externalities in kenyaPreprint
Kremer, M. R., & Miguel, E. A. (n.d.) · RePEc: Research Papers in Economics · Cited by 581
Brock, W., & Durlauf, S. (2000) · National Bureau of Economic Research · doi:10.3386/t0258 · Cited by 528
Impact of farmer field schools on agricultural productivity and poverty in East Africa
Davis, K., Nkonya, E., Kato, E., Mekonnen, D. A., Odendo, M., Miiro, R., & Nkuba, J. (2012) · World Development · doi:10.1016/j.worlddev.2011.05.019 · Cited by 561
“Using this control group accounts for other factors that could have also affected yield or any other outcome (Heckman et al. 1998).”
BackgroundRecent Developments in the Econometrics of Program Evaluation
Imbens, G., & Wooldridge, J. (2008) · National Bureau of Economic Research · doi:10.3386/w14251 · Cited by 533
Some Causal Effects of an Industrial Policy
Criscuolo, C., Martin, R., Overman, H. G., & Van Reenen, J. (2019) · American Economic Review · doi:10.1257/aer.20160034 · Cited by 554
Mendola, M. (2007) · Food Policy · doi:10.1016/j.foodpol.2006.07.003 · Cited by 547
The Logic of the Survey Experiment Reexamined
Gaines, B. J., Kuklinski, J. H., & Quirk, P. J. (2007) · Political Analysis · doi:10.1093/pan/mpl008 · Cited by 553
Chapter 61 Using Randomization in Development Economics Research: A Toolkit
Duflo, E., Glennerster, R., & Kremer, M. (2007) · Handbook of Development Economics · doi:10.1016/s1573-4471(07)04061-2 · Cited by 545
Agricultural Technology, Crop Income, and Poverty Alleviation in Uganda
Kassie, M., Shiferaw, B., & Muricho, G. (2011) · World Development · doi:10.1016/j.worlddev.2011.04.023 · Cited by 529
Adding Bricks to Clicks: Predicting the Patterns of Cross-Channel Elasticities over Time
Avery, J., Steenburgh, T. J., Deighton, J., & Caravella, M. (2012) · Journal of Marketing · doi:10.1509/jm.09.0081 · Cited by 533
“…p < .05), indicating that the catalog chan6Examples include Winship and Morgan (1999) in sociology; Lee and Wahal (2004) in finance; Ho et al. (2007) in political science; Jaffe, Trajtenberg, and Henderson (1993), Meyer (1995), and Heckman et al. (1998) in economics; and Hansen (2004) in education.”
BackgroundThe Dangers of Extreme Counterfactuals
King, G., & Zeng, L. (2006) · Political Analysis · doi:10.1093/pan/mpj004 · Cited by 540
Chapter 76 Large Sample Sieve Estimation of Semi-Nonparametric Models
Chen, X. (2007) · Handbook of Econometrics · doi:10.1016/s1573-4412(07)06076-x · Cited by 535
Evaluating the impact of R&D tax credits on innovation: A microeconometric study on Canadian firms
Czarnitzki, D., Hanel, P., & Rosa, J. M. (2011) · Research Policy · doi:10.1016/j.respol.2010.09.017 · Cited by 522
Evaluating Anti-Poverty Programs
Ravallion, M. (2005) · World Bank, Washington, DC eBooks · doi:10.1596/1813-9450-3625 · Cited by 507
The Labor Market Consequences of Incarceration
Western, B., Kling, J. R., & Weiman, D. F. (2001) · Crime & Delinquency · doi:10.1177/0011128701047003007 · Cited by 499
Identification and Estimation of Triangular Simultaneous Equations Models Without Additivity
(2009) · Econometrica · doi:10.3982/ecta7108 · Cited by 488
Czarnitzki, D., Ebersberger, B., & Fier, A. (2007) · Journal of Applied Econometrics · doi:10.1002/jae.992 · Cited by 478
Efficient Estimation of Average Treatment Effects Using the Estimated Propensity Score
Hirano, K., Imbens, G. W., & Ridder, G. (2002) · SSRN Electronic Journal · doi:10.2139/ssrn.324940 · Cited by 480
Low-carbon innovation induced by emissions trading in China
Zhu, J., Fan, Y., Deng, X., & Xue, L. (2019) · Nature Communications · doi:10.1038/s41467-019-12213-6 · Cited by 467
1. The Scientific Model of Causality
Heckman, J. J. (2005) · Sociological Methodology · doi:10.1111/j.0081-1750.2006.00164.x · Cited by 401
Self-citationNonparametric Estimation of Average Treatment Effects under Exogeneity: A Review
Imbens, G. (2003) · National Bureau of Economic Research · doi:10.3386/t0294 · Cited by 446
Money for nothing? Universal child care and maternal employment
Havnes, T., & Mogstad, M. (2011) · Journal of Public Economics · doi:10.1016/j.jpubeco.2011.05.016 · Cited by 442
Patents and Cumulative Innovation: Causal Evidence from the Courts *
Galasso, A., & Schankerman, M. (2015) · The Quarterly Journal of Economics · doi:10.1093/qje/qju029 · Cited by 448
Earnings and Employment Effects of Continuous Gff-the-Job Training in East Germany After Unification
Lechner, M. (1999) · Journal of Business & Economic Statistics · doi:10.1080/07350015.1999.10524798 · Cited by 368
Site Selection Bias in Program Evaluation *
Allcott, H. (2015) · The Quarterly Journal of Economics · doi:10.1093/qje/qjv015 · Cited by 426
How robust is the evidence on the effects of college quality? Evidence from matching
Black, D. A., & Smith, J. A. (2004) · Journal of Econometrics · doi:10.1016/j.jeconom.2003.10.006 · Cited by 673
Self-citationDechezleprêtre, A., Nachtigall, D., & Venmans, F. (2023) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2022.102758 · Cited by 416
Statistical methods with varying coefficient models
Fan, J., & Zhang, W. (2008) · Statistics and Its Interface · doi:10.4310/sii.2008.v1.n1.a15 · Cited by 417
A Microeconometric Evaluation of the Active Labour Market Policy in Switzerland
Gerfin, M., & Lechner, M. (2002) · The Economic Journal · doi:10.1111/1468-0297.00072 · Cited by 416
Fifty Years of Mincer Earnings Regressions
Heckman, J., Lochner, L., & Todd, P. (2003) · National Bureau of Economic Research · doi:10.3386/w9732 · Cited by 345
Self-citationZhao, Z. (2004) · Review of Economics and Statistics · doi:10.1162/003465304323023705 · Cited by 389
Estimating the Benefit Incidence of an Antipoverty Program by Propensity-Score Matching
Jalan, J., & Ravallion, M. (2003) · Journal of Business & Economic Statistics · doi:10.1198/073500102288618720 · Cited by 394
Matching Estimators of Causal Effects: Prospects and Pitfalls in Theory and Practice
Morgan, S. L., & Harding, D. J. (2006) · Sociological Methods & Research · doi:10.1177/0049124106289164 · Cited by 392
Metadata
- Authors
- Heckman, J., Ichimura, H., Smith, J., & Todd, P.
- Venue
- Econometrica
- Publisher
- JSTOR
- Published
- 1998-09
- Volume
- 66
- Issue
- 5
- Pages
- 1017
- ISSN
- 0012-9682 (ISSN-L)
- OpenAlex
- W3021176487
- Cited by
- 2,286
- References
- 0
- Citations by year
- 2026: 27 · 2025: 49 · 2024: 51 · 2023: 68 · 2022: 95 · 2021: 70 · 2020: 89 · 2019: 72 · 2018: 84 · 2017: 98 · 2016: 90 · 2015: 120 · 2014: 116 · 2013: 120 · 2012: 133
- FWCI
- 30.50
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Econometrica (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Social Sciences › Public Administration › Evaluation and Performance Assessment
- Social Sciences › Education › School Choice and Performance
- Keywords
- selection bias, program evaluation, matching estimators, difference-in-differences, selection model, social programs, treatment effect estimation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.