War and Wages: The Strength of Instrumental Variables and Their Sensitivity to Unobserved Biases
The DOI matches its Crossref record; 4 of the 4 references it cites were found in a registry or an index.
Abstract
An instrument manipulates a treatment that it does not entirely control, but the instrument affects the outcome only indirectly through its manipulation of the treatment. The idealized prototype is the randomized encouragement design, in which subjects are randomly assigned to receive either encouragement to accept the treatment or no such encouragement, but not all subjects comply by doing what they are encouraged to do, and the situation is such that only the treatment itself, not disregarded encouragement alone, can affect the outcome. An instrument is weak if it has only a slight impact on acceptance of the treatment, that is, if most people disregard encouragement to accept the treatment. Typical applications of instrumental variables are not ideal; encouragement is not randomized, although it may be assigned in a far less biased manner than the treatment itself. Using the concept of design sensitivity, we study the sensitivity of instrumental variable analyses to departures from the ideal of random assignment of encouragement, with particular reference to the strength of the instrument. With these issues in mind, we reanalyze a clever study by Angrist and Krueger concerning the effects of military service during World War II on subsequent earnings, in which birth cohorts of very similar but not identical age were differently “encouraged” to serve in the war. A striking feature of this example is that those who served earned more, but the effect of service on earnings appears to be negative; that is, the instrumental variables analysis reverses the sign of the naive comparison. For expository purposes, this example has the convenient feature of enabling, by selecting different birth cohorts, the creation of instruments of varied strength, from extremely weak to fairly strong, although separated by the same time interval and thus perhaps similarly biased. No matter how large the sample size becomes, even if the effect under study is quite large, studies with weak instruments are extremely sensitive to tiny biases, whereas studies with stronger instruments can be insensitive to moderate biases.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Estimating causal effects of treatments in randomized and nonrandomized studies
Rubin, D. B. (1974) · Journal of Educational Psychology · doi:10.1037/h0037350 · Cited by 9,436 · cited 1×
“Each subject ij has two potential responses: rT ij if encouraged, Zij = 1, or rCij if not encouraged, Zij = 0, so the effect of encouragement, rT ij − rCij , is not observed (see Neyman 1923; Rubin 1974).”
BackgroundFisher, R. A. (1936) · BMJ · doi:10.1136/bmj.1.3923.554-a · Cited by 4,980
The Consquences of Adjustment for a Concomitant Variable That Has Been Affected by the Treatment
Rosenbaum, P. R. (1984) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2981697 · Cited by 849
Self-citationAssessing the sensitivity of regression results to unmeasured confounders in observational studies
Lin, D. Y., Psaty, B. M., & Kronmal, R. A. (1998) · Biometrics · doi:10.2307/2533848 · Cited by 742 · cited 1×
“For alternative models and methods of sensitivity analysis, see, e.g., Copas and Eguchi 2001; Cornfield et al. 1959; Gastwirth 1992; Imbens 2003; Lin, Psaty, and Kronmal 1998; Robins, Rotnitzky, and Scharfstein 1999; Wang and Krieger 2006.)”
Method
Cited by
A review of instrumental variable estimators for Mendelian randomization
Burgess, S., Small, D. S., & Thompson, S. G. (2017) · Statistical Methods in Medical Research · doi:10.1177/0962280215597579 · Cited by 1,764
Self-citationInstrumental variable methods for causal inference
Baiocchi, M., Cheng, J., & Small, D. S. (2014) · Statistics in Medicine · doi:10.1002/sim.6128 · Cited by 683
Self-citationInstrumental variable methods in comparative safety and effectiveness research
Brookhart, M. A., Rassen, J. A., & Schneeweiss, S. (2010) · Pharmacoepidemiology and Drug Safety · doi:10.1002/pds.1908 · Cited by 332
Identification With Imperfect Instruments
Nevo, A., & Rosen, A. M. (2012) · Review of Economics and Statistics · doi:10.1162/rest_a_00171 · Cited by 321
Anesthesia Technique, Mortality, and Length of Stay After Hip Fracture Surgery
Neuman, M. D., Rosenbaum, P. R., Ludwig, J. M., Zubizarreta, J. R., & Silber, J. H. (2014) · JAMA · doi:10.1001/jama.2014.6499 · Cited by 303
Self-citation
Metadata
- Authors
- Small, D. S., & Rosenbaum, P. R.
- Venue
- Journal of the American Statistical Association
- Publisher
- Informa UK Limited
- Published
- 2008-09
- Volume
- 103
- Issue
- 483
- Pages
- 924-933
- ISSN
- 0162-1459 (ISSN-L)
- 1537-274X
- OpenAlex
- W1905274468
- Cited by
- 139
- References
- 4
- FWCI
- 5.90
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: War and Wages: The Strength of Instrumental Variables and Their Sensitivity to Unobserved Biases. https://app.cochat.ai/papers/10.1198/016214507000001247
- The paper
- Small, D. S., & Rosenbaum, P. R. (2008). War and Wages: The Strength of Instrumental Variables and Their Sensitivity to Unobserved Biases. Journal of the American Statistical Association. https://doi.org/10.1198/016214507000001247
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.