Broken or Fixed Effects?
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
We replicate eight influential papers to provide empirical evidence that, in the presence of heterogeneous treatment effects, OLS with fixed effects (FE) is generally not a consistent estimator of the average treatment effect (ATE). We propose two alternative estimators that recover the ATE in the presence of group-specific heterogeneity. We document that heterogeneous treatment effects are common and the ATE is often statistically and economically different from the FE estimate. In all but one of our replications, there is statistically significant treatment effect heterogeneity and, in six, the ATEs are either economically or statistically different from the FE estimates.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“This theme is addressed for ordinary least squares inAngrist (1998) andSloczynski (2022); for one way fixed effects models in Gibbons, Suárez Serrato, and Urbancic (2019) andMiller, Shenhav, and Grosz (2021); and for difference-in-difference in Goodman-Bacon (2021a), Callaway and Sant'Anna (2021), de Chaisemartin and D'Haultfœuille (2020), andBorusyak, Jaravel, and Spiess (2022).”
From An Introductory Guide to Event Study Models (2023) · cites this paper as Gibbons, Suárez Serrato, and Urbancic (2019)
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Mostly Harmless Econometrics: An Empiricist's Companion
Angrist, J. D., & Pischke, J.-S. (2009) · doi:10.1515/9781400829828 · Cited by 9,467
Microeconometrics: Methods and Applications
Cameron, A. C., & Trivedi, P. K. (2005) · doi:10.1017/cbo9780511811241 · Cited by 8,092
The Effect of Education on Crime: Evidence from Prison Inmates, Arrests, and Self-Reports
Lochner, L., & Moretti, E. (2004) · American Economic Review · doi:10.1257/000282804322970751 · Cited by 2,032
Empirical Strategies in Labor Economics
Angrist, J. D., & Krueger, A. B. (1999) · Handbook of Labor Economics · doi:10.1016/s1573-4463(99)03004-7 · Cited by 1,628
Solon, G., Haider, S. J., & Wooldridge, J. M. (2015) · Journal of Human Resources · doi:10.3368/jhr.50.2.301 · Cited by 1,367
History, Institutions, and Economic Performance: The Legacy of Colonial Land Tenure Systems in India
Banerjee, A., & Iyer, L. (2005) · American Economic Review · doi:10.1257/0002828054825574 · Cited by 1,268
Did Unilateral Divorce Raise Divorce Rates? Evidence from Panel Data
Friedberg, L. (1997) · doi:10.2139/ssrn.2207 · Cited by 522
Did Unilateral Divorce Raise Divorce Rates? Evidence from Panel Data
Friedberg, L. (1998) · doi:10.3386/w6398 · Cited by 514
Efficiency Bounds for Semiparametric Regression
Chamberlain, G. (1992) · Econometrica · doi:10.2307/2951584 · Cited by 318
(2012) · Econometrica · doi:10.3982/ecta8220 · Cited by 131
Research works printed but not linked: 25
- Abadie, Alberto. 2002. “Bootstrap Tests for Distributional Treatment Effects in Instrumental Variable Models.” Journal of the American Statistical Association 97 (457): 284–292. · DOI · Paper page
- Arellano, Manuel and Stéphane Bonhomme. 2012. “Identifying Distributional Characteristics in Random Coefficients Panel Data Models.” The Review of Economic Studies 79 (3): 987–1020. · DOI · Paper page
- Bedard, Kelly and Olivier Deschênes. 2006. “The Long-Term Impact of Military Service on Health: Evidence from World War II and Korean War Veterans.” American Economic Review 96 (1): 176–194. · DOI · Paper page
- Bitler, Marianne P., Jonah B. Gelbach and Hilary W. Hoynes. 2014. Can Variation in Subgroups’ Average Treatment Effects Explain Treatment Effect Heterogeneity? Evidence from a Social Experiment. Working Paper 20142 National Bureau of Economic Research. · DOI
- Blundell, R. W. and James L. Powell. 2003. Endogeneity in Nonparametric and Semiparametric Regression Models. In Advances in Economics and Econometrics: Theory and Applications, ed. M. Dewatripont, L. P. Hansen and S. J. Turnovsky. Vol. II. Cambrige: Cambridge University Press.
- Card, David, Carlos Dobkin and Nicole Maestas. 2008. “The Impact of Nearly Universal Insurance Coverage on Health Care Utilization: Evidence from Medicare.” American Economic Review 98 (5): 2242–2258. · DOI · Paper page
- Chamberlain, Gary. 1980. “Analysis of Covariance with Qualitative Data.” Review of Economic Studies 47: 225–238. · DOI · Paper page
- Chamberlain, Gary. 1982. “Multivariate Regression Models for Panel Data.” Journal of Econometrics 18: 5–46. · DOI · Paper page
- Chamberlain, Gary. 1984. Chapter 22 Panel data. In Handbook of Econometrics, 1247–1318. Vol. 2. Amsterdam: Elsevier. · DOI · Paper page
- Chernozhukov, Victor, Iván Fernández-Val, Jinyong Hahn and Whitney Newey. 2013. “Average and Quantile Effects in Nonseparable Panel Models.” Econometrica 81 (2): 535–580. · DOI · Paper page
- Ghanem, Dalia. 2017. “Testing Identifying Assumptions in Nonseparable Panel Data Models.” Journal of Econometrics 197 (2): 202–217. · DOI
- Griffith, Rachel, Rupert Harrison and John Van Reenen. 2006. “How Special Is the Special Relationship? Using the Impact of U.S. R&D Spillovers on U.K. Firms as a Test of Technology Sourcing.” American Economic Review 96 (5): 1859–1875. · DOI · Paper page
- Heckman, James J., and V. Joseph Hotz. 1989. “Choosing Among Alternative Nonexperimental Methods for Estimating the Impact of Social Programs: The Case of Manpower Training.” Journal of the American Statistical Association 84 (408): 862–874. · DOI · Paper page
- Karlan, Dean S. and Jonathan Zinman. 2008. “Credit Elasticities in Less-Developed Economies: Implications for Microfinance.” American Economic Review 98 (3): 1040–1068. · DOI · Paper page
- Kline, Patrick and Andres Santos. 2012. “A Score Based Approach to Wild Bootstrap Inference.” Journal of Econometric Methods 1 (1): 23–41. · DOI · Paper page
- Kling, Jeffrey R. 2001. “Interpreting Instrumental Variables Estimates of the Returns to Schooling.” Journal of Business & Economic Statistics 19 (3): 358–364. · DOI · Paper page
- Meghir, Costas and Marten Palme. 2005. “Educational Reform, Ability, and Family Background.” American Economic Review 95 (1): 414–424. · DOI · Paper page
- Murphy, Kevin M. and Robert H. Topel. 1985. “Estimation and Inference in Two-Step Econometric Models.” Journal of Business & Economic Statistics 3 (4): 370–379. · DOI · Paper page
- Oreopoulos, Philip. 2006. “Estimating Average and Local Average Treatment Effects of Education When Compulsory Schooling Laws Really Matter.” American Economic Review 96 (1): 152–175. · DOI · Paper page
- Oster, Emily. 2014. Unobservable Selection and Coefficient Stability: Theory and Validation. Working Paper, University of Chicago. · DOI · Paper page
- Papke, Leslie E. 1994. “Tax Policy and Urban Development: Evidence from the Indiana Enterprise Zone Program.” Journal of Public Economics 54: 37–49. · DOI
- Pérez-González, Francisco. 2006. “Inherited Control and Firm Performance.” American Economic Review 96 (5): 1559–1588. · DOI · Paper page
- Wooldridge, Jeffrey M. 1997. “On Two Stage Least Squares Estimation of the Average Treatment Effect in a Random Coefficient Model.” Economic Letters 56: 129–133. · DOI · Paper page
- Wooldridge, Jeffrey M. 2001. Econometric Analysis of Cross-Section and Panel Data. Cambridge, MA: MIT Press.
- Wooldridge, Jeffrey M. 2005. “Fixed-Effects and Related Estimators for Correlated Random-Coefficient and Treatment-Effect Panel Data Models.” Review of Economics and Statistics 87 (2): 385–390. · DOI · Paper page
Cited by
Difference-in-Differences with multiple time periods
Callaway, B., & Sant’Anna, P. H. C. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.12.001 · Cited by 9,126
Difference-in-differences with variation in treatment timing
Goodman-Bacon, A. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2021.03.014 · Cited by 8,046
Estimating dynamic treatment effects in event studies with heterogeneous treatment effects
Sun, L., & Abraham, S. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2020.09.006 · Cited by 5,518
‘Effortless Perfection:’ Do Chinese cities manipulate air pollution data?
Ghanem, D., & Zhang, J. (2014) · Journal of Environmental Economics and Management · doi:10.1016/j.jeem.2014.05.003 · Cited by 564
An Introductory Guide to Event Study Models
Miller, D. L. (2023) · Journal of Economic Perspectives · doi:10.1257/jep.37.2.203 · Cited by 360
Metadata
- Authors
- Gibbons, C. E., Suárez Serrato, J. C., & Urbancic, M. B.
- Venue
- Journal of Econometric Methods
- Publisher
- Walter de Gruyter GmbH
- Published
- 2018-02-03
- Volume
- 8
- Issue
- 1
- ISSN
- 2156-6674 (ISSN-L)
- OpenAlex
- W1498518571
- Cited by
- 79
- References
- 10
- FWCI
- 7.66
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Broken or Fixed Effects? https://app.cochat.ai/papers/10.1515/jem-2017-0002
- The paper
- Gibbons, C. E., Suárez Serrato, J. C., & Urbancic, M. B. (2019). Broken or Fixed Effects? Journal of Econometric Methods. https://doi.org/10.1515/jem-2017-0002
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.