The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.
Use of directed acyclic graphs (DAGs) to identify confounders in applied health research: review and recommendations
Open accessAbstract
Background: Directed acyclic graphs (DAGs) are an increasingly popular approach for identifying confounding variables that require conditioning when estimating causal effects. This review examined the use of DAGs in applied health research to inform recommendations for improving their transparency and utility in future research. Methods: Original health research articles published during 1999–2017 mentioning ‘directed acyclic graphs’ (or similar) or citing DAGitty were identified from Scopus, Web of Science, Medline and Embase. Data were extracted on the reporting of: estimands, DAGs and adjustment sets, alongside the characteristics of each article’s largest DAG. Results: A total of 234 articles were identified that reported using DAGs. A fifth (n = 48, 21%) reported their target estimand(s) and half (n = 115, 48%) reported the adjustment set(s) implied by their DAG(s). Two-thirds of the articles (n = 144, 62%) made at least one DAG available. DAGs varied in size but averaged 12 nodes [interquartile range (IQR): 9–16, range: 3–28] and 29 arcs (IQR: 19–42, range: 3–99). The median saturation (i.e. percentage of total possible arcs) was 46% (IQR: 31–67, range: 12–100). 37% (n = 53) of the DAGs included unobserved variables, 17% (n = 25) included ‘super-nodes’ (i.e. nodes containing more than one variable) and 34% (n = 49) were visually arranged so that the constituent arcs flowed in the same direction (e.g. top-to-bottom). Conclusion: There is substantial variation in the use and reporting of DAGs in applied health research. Although this partly reflects their flexibility, it also highlights some potential areas for improvement. This review hence offers several recommendations to improve the reporting and use of DAGs in future research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Causal Diagrams for Epidemiologic Research
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00008 · Cited by 3,728 · cited 4×
“This is arguably unnecessary since omitting an arc invokes the greater assumption, because no arc between two variables declares there is no causal relationship between the two variables, regardless of direction, sign, strength or parametric form.(12) Increasing the number of arcs does however bring important practica…”
BackgroundInfluentialAir Pollution and Hospital Admissions for Heart Disease in Eight U.S. Counties
Schwartz, J. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00005 · Cited by 3,038
Robust causal inference using directed acyclic graphs: the R package ‘dagitty’
Textor, J., van der Zander, B., Gilthorpe, M. S., Liśkiewicz, M., & Ellison, G. T. H. (2017) · International Journal of Epidemiology · doi:10.1093/ije/dyw341 · Cited by 2,295 · cited 6×
“Data were extracted on the reporting of: estimands, DAGs and adjustment sets, alongside the characteristics of each article’s largest DAG.”
BackgroundMethodInfluentialSelf-citationCausal Inference Using Potential Outcomes: Design, Modeling, Decisions
Rubin, D. B. (2005) · Journal of the American Statistical Association · doi:10.1198/016214504000001880 · Cited by 2,173 · cited 1×
“their causal ‘estimand’) before they begin their analysis.(9) Estimating this effect is then informed by external knowledge of the data-generating process (i.”
BackgroundUnderstanding and misunderstanding randomized controlled trials
Deaton, A., & Cartwright, N. (2018) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.12.005 · Cited by 1,841
Maternal Pesticide Exposure from Multiple Sources and Selected Congenital Anomalies
Shaw, G. M., Wasserman, C. R., OʼMalley, C. D., Nelson, V., & Jackson, R. J. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00011 · Cited by 1,784
Variable selection – A review and recommendations for the practicing statistician
Heinze, G., Wallisch, C., & Dunkler, D. (2018) · Biometrical Journal · doi:10.1002/bimj.201700067 · Cited by 1,639
Principles of confounder selection
VanderWeele, T. J. (2019) · European Journal of Epidemiology · doi:10.1007/s10654-019-00494-6 · Cited by 1,535
Reducing bias through directed acyclic graphs
Shrier, I., & Platt, R. W. (2008) · BMC Medical Research Methodology · doi:10.1186/1471-2288-8-70 · Cited by 1,386
The Table 2 Fallacy: Presenting and Interpreting Confounder and Modifier Coefficients
Westreich, D., & Greenland, S. (2013) · American Journal of Epidemiology · doi:10.1093/aje/kws412 · Cited by 1,276 · cited 1×
“This is exemplified by the ‘Table 2 fallacy’, which occurs when the coefficients for two or more ‘risk factors’ in a multivariable regression model are (mistakenly) interpreted as estimates for meaningful causal effects.(8) Causal inference approaches, such as the potential outcomes framework, promote greater transpar…”
BackgroundDAGitty: A Graphical Tool for Analyzing Causal Diagrams
Textor, J., Hardt, J., & Knüppel, S. (2011) · Epidemiology · doi:10.1097/ede.0b013e318225c2be · Cited by 1,221
Self-citationCounterfactuals and Causal Inference: Methods and Principles for Social Research
Morgan, S. L., & Winship, C. (2014) · Cambridge University Press · doi:10.1017/cbo9781107587991 · Cited by 1,037
The C-Word: Scientific Euphemisms Do Not Improve Causal Inference From Observational Data
Hernán, M. A. (2018) · American Journal of Public Health · doi:10.2105/ajph.2018.304337 · Cited by 571
A Second Chance to Get Causal Inference Right: A Classification of Data Science Tasks
Hernán, M. A., Hsu, J., & Healy, B. (2019) · CHANCE · doi:10.1080/09332480.2019.1579578 · Cited by 495 · cited 1×
“Estimating causal effects is a key aim of applied health research.(1) One approach is to conduct a randomized controlled experiment, but practical and ethical constraints mean this is only possible for a limited range of exposures.”
BackgroundDeveloping a Protocol for Observational Comparative Effectiveness Research: A User's Guide
Velentgas, P., Dreyer, N. A., Nourjah, P. A., Smith, S. R., & Torchia, M. (2013) · Cited by 380
(2014) · Springer eBooks · doi:10.1007/978-0-387-09834-0 · Cited by 360
Applying Quantitative Bias Analysis to Epidemiologic Data
Fink, A. K., Fox, M. P., & Lash, T. L. (2009) · Statistics for Biology and Health · doi:10.1007/b97920 · Cited by 343
Self-citationCausality and causal inference in epidemiology: the need for a pluralistic approach
Vandenbroucke, J. P., Broadbent, A., & Pearce, N. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyv341 · Cited by 327
On the definition of a confounder
VanderWeele, T. J., & Shpitser, I. (2013) · The Annals of Statistics · doi:10.1214/12-aos1058 · Cited by 268 · cited 1×
“Competing exposures are not always included in sufficient adjustment sets, unless they are caused by one or more unobserved confounders for which they can serve as a surrogate confounder.(22)”
BackgroundKrieger, N., & Davey Smith, G. (2016) · International Journal of Epidemiology · doi:10.1093/ije/dyw114 · Cited by 250
Ferguson, K. D., McCann, M., Katikireddi, S. V., Thomson, H., Green, M. J., Smith, D. J., & Lewsey, J. D. (2020) · International Journal of Epidemiology · doi:10.1093/ije/dyz150 · Cited by 188
Phthalates and risk of endometriosis
Upson, K., Sathyanarayana, S., De Roos, A. J., Thompson, M. L., Scholes, D., Dills, R., & Holt, V. L. (2013) · Environmental Research · doi:10.1016/j.envres.2013.07.003 · Cited by 157
Gestational diabetes and the risk of late stillbirth: a case–control study from England, UK
Stacey, T., Tennant, P. W. G., McCowan, L., Mitchell, E. A., Budd, J., Li, M., Thompson, J., Martin, B. L., Roberts, D., & Heazell, A. E. P. (2019) · BJOG An International Journal of Obstetrics & Gynaecology · doi:10.1111/1471-0528.15659 · Cited by 115
Self-citationReflection on modern methods: when worlds collide—prediction, machine learning and causal inference
Blakely, T., Lynch, J., Simons, K., Bentley, R., & Rose, S. (2021) · International Journal of Epidemiology · doi:10.1093/ije/dyz132 · Cited by 98
Wei, C., Cheung, D. H., Yan, H., Li, J., Shi, L., & Raymond, H. F. (2015) · JAIDS Journal of Acquired Immune Deficiency Syndromes · doi:10.1097/qai.0000000000000815 · Cited by 83
Arnold, K. F., Davies, V., de Kamps, M., Tennant, P. W. G., Mbotwa, J., & Gilthorpe, M. S. (2020) · International Journal of Epidemiology · doi:10.1093/ije/dyaa049 · Cited by 81
Self-citationKnüppel, S., & Stang, A. (2009) · Epidemiology · doi:10.1097/ede.0b013e3181c307ce · Cited by 76
Road traffic noise and children’s inattention
Weyde, K. V. F., Krog, N. H., Oftedal, B., Magnus, P. M., Øverland, S. N., Stansfeld, S. A., Nieuwenhuijsen, M. J., Vrijheid, M., de Castro, M., & Aasvang, G. M. (2017) · Environmental Health · doi:10.1186/s12940-017-0337-y · Cited by 72
Applying Quantitative Bias Analysis to Epidemiologic Data
Bedogni, G. (2011) · Journal of the Royal Statistical Society Series A (Statistics in Society) · doi:10.1111/j.1467-985x.2010.00681_10.x · Cited by 67
Buchner, H., & Rehfuess, E. A. (2015) · PLoS ONE · doi:10.1371/journal.pone.0128933 · Cited by 58
Bliddal, M., Pottegård, A., Kirkegaard, H., Olsen, J., Jørgensen, J. S., Sørensen, T. I. A., Dreyer, L., & Nohr, E. A. (2015) · Arthritis & Rheumatology · doi:10.1002/art.39565 · Cited by 40
Rutegård, M., Boström, P., Haapamäki, M. M., Matthiessen, P., & Rutegård, M. (2015) · International Journal of Colorectal Disease · doi:10.1007/s00384-015-2465-6 · Cited by 23
Breitling, L. P. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181e09112 · Cited by 20
Road traffic noise and registry based use of sleep medication
Evandt, J., Oftedal, B., Krog, N. H., Skurtveit, S. O., Nafstad, P. H. J., Schwarze, P. E., Skovlund, E., Houthuijs, D., & Aasvang, G. M. (2017) · Environmental Health · doi:10.1186/s12940-017-0330-5 · Cited by 17
Ferguson, K., McCann, M., Katikireddi, S. V., Thomson, H., Green, M. J., Smıth, D. J., & Lewsey, J. (2019) · International Journal of Epidemiology · doi:10.1093/ije/dyz220 · Cited by 11
Ng, W. L., Peeters, A., Näslund, I., Ottosson, J., Johansson, K., Marcus, C., Shaw, J. E., Bruze, G., Sundström, J., & Neovius, M. (2017) · Obesity · doi:10.1002/oby.21908 · Cited by 8
Arnold, K. F., Davies, V., de Kamps, M., Tennant, P. W. G., Mbotwa, J., & Gilthorpe, M. S. (2019) · White Rose Research Online (University of Leeds, The University of Sheffield, University of York) · doi:10.48550/arxiv.1906.01461 · Cited by 2
Self-citation
Cited by
Lee, H., Cashin, A. G., Lamb, S. E., Hopewell, S., Vansteelandt, S., VanderWeele, T. J., MacKinnon, D. P., Mansell, G., Collins, G. S., Golub, R. M., et al. (2021) · JAMA · doi:10.1001/jama.2021.14075 · Cited by 548
Principles and methods for transferring polygenic risk scores across global populations
Kachuri, L., Chatterjee, N., Hirbo, J., Schaid, D. J., Martin, I., Kullo, I. J., Kenny, E. E., Pasaniuc, B., Polygenic Risk Methods in Diverse Populations (PRIMED) Consortium Methods Working Group, Auer, P. L., et al. (2024) · Nature Reviews Genetics · doi:10.1038/s41576-023-00637-2 · Cited by 328
Yang, T., Wang, J., Huang, J., Kelly, F. J., & Li, G. (2023) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2022.4812 · Cited by 289
Conformal Inference of Counterfactuals and Individual Treatment Effects
Lei, L., & Candès, E. J. (2021) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/rssb.12445 · Cited by 166
Triangulating Evidence through the Inclusion of Genetically Informed Designs
Munafò, M. R., Higgins, J. P. T., & Smith, G. D. (2021) · Cold Spring Harbor Perspectives in Medicine · doi:10.1101/cshperspect.a040659 · Cited by 125
Metadata
- Authors
- Tennant, P. W. G., Murray, E. J., Arnold, K. F., Berrie, L., Fox, M. P., Gadd, S. C., Harrison, W. J., Keeble, C., Ranker, L. R., Textor, J., Tomova, G. D., Gilthorpe, M. S., & Ellison, G. T. H.
- Venue
- International Journal of Epidemiology
- Publisher
- Oxford University Press (OUP)
- Published
- 2020-12-17
- Volume
- 50
- Issue
- 2
- Pages
- 620-632
- ISSN
- 0300-5771 (ISSN-L)
- 1464-3685
- OpenAlex
- W3114319529
- Cited by
- 1,052
- References
- 37
- FWCI
- 61.50
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.