Poorly Measured Confounders are More Useful on the Left Than on the Right
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Researchers frequently test identifying assumptions in regression based research designs (which include instrumental variables or difference-in-differences models) by adding additional control variables on the right hand side of the regression.If such additions do not affect the coefficient of interest (much) a study is presumed to be reliable.We caution that such invariance may result from the fact that the observed variables used in such robustness checks are often poor measures of the potential underlying confounders.In this case, a more powerful test of the identifying assumption is to put the variable on the left hand side of the candidate regression.We provide derivations for the estimators and test statistics involved, as well as power calculations, which can help applied researchers interpret their findings.We illustrate these results in the context of various strategies which have been suggested to identify the returns to schooling.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482
Unobservable Selection and Coefficient Stability: Theory and Evidence
Oster, E. (2019) · Journal of Business & Economic Statistics · doi:10.1080/07350015.2016.1227711 · Cited by 5,367
Experimental Analysis of Neighborhood Effects
Kling, J. R., Liebman, J. B., & Katz, L. F. (2007) · Econometrica · doi:10.1111/j.1468-0262.2007.00733.x · Cited by 2,719
Anderson, M. L. (2008) · Journal of the American Statistical Association · doi:10.1198/016214508000000841 · Cited by 2,410
MacKinnon, J. G., & White, H. (1985) · Journal of Econometrics · doi:10.1016/0304-4076(85)90158-7 · Cited by 1,879
In Pursuit of Balance: Randomization in Practice in Development Field Experiments
Bruhn, M., & McKenzie, D. (2009) · American Economic Journal: Applied Economics · doi:10.1257/app.1.4.200 · Cited by 788
High-Dimensional Methods and Inference on Structural and Treatment Effects
Belloni, A., Chernozhukov, V., & Hansen, C. (2014) · Journal of Economic Perspectives · doi:10.1257/jep.28.2.29 · Cited by 722
Misclassification of the dependent variable in a discrete-response setting
Hausman, J. A., Abrevaya, J., & Scott-Morton, F. M. (1998) · Journal of Econometrics · doi:10.1016/s0304-4076(98)00015-3 · Cited by 563
Cited by
Difference-in-differences with variation in treatment timing
Goodman-Bacon, A. (2021) · Journal of Econometrics · doi:10.1016/j.jeconom.2021.03.014 · Cited by 8,046
Difference-in-Differences with Variation in Treatment Timing
Goodman-Bacon, A. (2018) · doi:10.3386/w25018 · Cited by 757
Bias in Cable News: Persuasion and Polarization
Martin, G. J., & Yurukoglu, A. (2017) · American Economic Review · doi:10.1257/aer.20160812 · Cited by 666
The causal effects of education on health outcomes in the UK Biobank
Davies, N. M., Dickson, M., Davey Smith, G., van den Berg, G. J., & Windmeijer, F. (2018) · Nature Human Behaviour · doi:10.1038/s41562-017-0279-y · Cited by 302
Long-Term Contextual Effects in Education: Schools and Neighborhoods
Laliberté, J.-W. (2021) · American Economic Journal: Economic Policy · doi:10.1257/pol.20190257 · Cited by 69
Metadata
- Authors
- Pei, Z., Pischke, J.-S., & Schwandt, H.
- Venue
- National Bureau of Economic Research
- Publisher
- National Bureau of Economic Research
- Published
- 2017-03
- OpenAlex
- W3124663894
- Cited by
- 28
- References
- 8
- Type
- report
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Poorly Measured Confounders are More Useful on the Left Than on the Right. https://app.cochat.ai/papers/10.3386/w23232
- The paper
- Pei, Z., Pischke, J.-S., & Schwandt, H. (2017). Poorly Measured Confounders are More Useful on the Left Than on the Right. National Bureau of Economic Research. https://doi.org/10.3386/w23232
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.