Issues in the Reporting and Conduct of Instrumental Variable Studies: A Systematic Review
The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
Abstract
Instrumental variables can be used to estimate the causal effects of exposures on outcomes in the presence of residual or uncontrolled confounding. To assess the validity of analyses using instrumental variables, specific information about whether underlying assumptions are met must be presented, in particular to demonstrate that the instrument is associated with the exposure but not with measured confounding factors. We systematically reviewed the epidemiological literature in Embase and Medline for articles containing the term "instrumental variable$" to investigate whether reporting of test statistics in studies using instrumental variables was sufficient to assess the validity of the results. We extracted the information each study reported about their instrumental variables, including specification tests used to check assumptions. The search found 756 studies of which 90 were relevant and were included. Only 25 (28%) studies reported appropriate tests of the strength of the associations between instruments and exposure. Forty-four (49%) studies reported associations between the instrumental variables and observed covariates. Studies using instrumental variables had wide confidence intervals and so effect estimates were imprecise. We propose a checklist of information and specification tests that studies using instrumental variables should report.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Instrumental Variables Regression with Weak Instruments
Staiger, D., & Stock, J. H. (1997) · Econometrica · doi:10.2307/2171753 · Cited by 7,081
Instrumental Variables Regression with Weak Instruments
Staiger, D., & Stock, J. (1994) · doi:10.3386/t0151 · Cited by 5,302
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Randomized, Controlled Trials, Observational Studies, and the Hierarchy of Research Designs
Concato, J., Shah, N., & Horwitz, R. I. (2000) · New England Journal of Medicine · doi:10.1056/nejm200006223422507 · Cited by 3,563 · cited 3×
“We excluded articles that (1) did not use instrumental variables; (2) had a nonclinical outcome or exposure, such as economic exposures or outcomes; (3) were analyses of randomized controlled trials; (4) were reviews or theoretical articles; or (5) were related publications from a single study.”
BackgroundMethodThe Estimation of Economic Relationships using Instrumental Variables
Sargan, J. D. (1958) · Econometrica · doi:10.2307/1907619 · Cited by 3,377
Vandenbroucke, J. P., von Elm, E., Altman, D. G., Gøtzsche, P. C., Mulrow, C. D., Pocock, S. J., Poole, C., Schlesselman, J. J., & Egger, M. (2007) · Epidemiology · doi:10.1097/ede.0b013e3181577511 · Cited by 2,779
An introduction to instrumental variables for epidemiologists
Greenland, S. (2000) · International Journal of Epidemiology · doi:10.1093/ije/29.4.722 · Cited by 1,156
Cardiac Rehabilitation and Survival in Older Coronary Patients
Suaya, J. A., Stason, W. B., Ades, P. A., Normand, S.-L. T., & Shepard, D. S. (2009) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2009.01.078 · Cited by 557
Schneeweiss, S., Setoguchi, S., Brookhart, A., Dormuth, C., & Wang, P. S. (2007) · Canadian Medical Association Journal · doi:10.1503/cmaj.061250 · Cited by 366
Lalani, T., Cabell, C. H., Benjamin, D. K., Lasca, O., Naber, C., Fowler, V. G., Corey, G. R., Chu, V. H., Fenely, M., Pachirat, O., et al. (2010) · Circulation · doi:10.1161/circulationaha.109.864488 · Cited by 308
Cited by
Reading Mendelian randomisation studies: a guide, glossary, and checklist for clinicians
Davies, N. M., Holmes, M. V., & Davey Smith, G. (2018) · BMJ · doi:10.1136/bmj.k601 · Cited by 4,404
Self-citationSkrivankova, V. W., Richmond, R. C., Woolf, B. A. R., Yarmolinsky, J., Davies, N. M., Swanson, S. A., VanderWeele, T. J., Higgins, J. P. T., Timpson, N. J., Dimou, N., et al. (2021) · JAMA · doi:10.1001/jama.2021.18236 · Cited by 3,994
Self-citationMendelian Randomization as an Approach to Assess Causality Using Observational Data
Sekula, P., Del Greco M, F., Pattaro, C., & Köttgen, A. (2016) · Journal of the American Society of Nephrology · doi:10.1681/asn.2016010098 · Cited by 2,351
A review of instrumental variable estimators for Mendelian randomization
Burgess, S., Small, D. S., & Thompson, S. G. (2017) · Statistical Methods in Medical Research · doi:10.1177/0962280215597579 · Cited by 1,764
Instrumental variable methods for causal inference
Baiocchi, M., Cheng, J., & Small, D. S. (2014) · Statistics in Medicine · doi:10.1002/sim.6128 · Cited by 683
Metadata
- Authors
- Davies, N. M., Smith, G. D., Windmeijer, F., & Martin, R. M.
- Venue
- Epidemiology
- Published
- 2013-05
- Volume
- 24
- Issue
- 3
- Pages
- 363-369
- ISSN
- 1044-3983 (ISSN-L)
- OpenAlex
- W2090606108
- Cited by
- 147
- References
- 10
- FWCI
- 10.04
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Issues in the Reporting and Conduct of Instrumental Variable Studies: A Systematic Review. https://app.cochat.ai/papers/10.1097/ede.0b013e31828abafb
- The paper
- Davies, N. M., Smith, G. D., Windmeijer, F., & Martin, R. M. (2013). Issues in the Reporting and Conduct of Instrumental Variable Studies: A Systematic Review. Epidemiology. https://doi.org/10.1097/ede.0b013e31828abafb
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.