Methodological Challenges in Causal Research on Racial and Ethnic Patterns of Cognitive Trajectories: Measurement, Selection, and Bias
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Research focused on understanding how and why cognitive trajectories differ across racial and ethnic groups can be compromised by several possible methodological challenges. These difficulties are especially relevant in research on racial and ethnic disparities and neuropsychological outcomes because of the particular influence of selection and measurement in these contexts. In this article, we review the counterfactual framework for thinking about causal effects versus statistical associations. We emphasize that causal inferences are key to predicting the likely consequences of possible interventions, for example in clinical settings. We summarize a number of common biases that can obscure causal relationships, including confounding, measurement ceilings/floors, baseline adjustment bias, practice or retest effects, differential measurement error, conditioning on common effects in direct and indirect effects decompositions, and differential survival. For each, we describe how to recognize when such biases may be relevant and some possible analytic or design approaches to remediating these biases.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
Statistical Analysis with Missing Data
Little, R. J. A., & Rubin, D. B. (2002) · Wiley Series in Probability and Statistics · doi:10.1002/9781119013563 · Cited by 8,473
Robust Regression and Outlier Detection
Rousseeuw, P. J., & Leroy, A. M. (1987) · Wiley Series in Probability and Statistics · doi:10.1002/0471725382 · Cited by 5,609
Statistics and Causal Inference
Holland, P. W. (1986) · Journal of the American Statistical Association · doi:10.1080/01621459.1986.10478354 · Cited by 5,293 · cited 1×
“Because of the impossibility of randomizing such factors, some have even argued that race or sex should not be considered causes (Holland 1986; Kaufman and Cooper 2001).”
Mendelian randomization: Using genes as instruments for making causal inferences in epidemiology
Lawlor, D. A., Harbord, R. M., Sterne, J. A. C., Timpson, N., & Davey Smith, G. (2008) · Statistics in Medicine · doi:10.1002/sim.3034 · Cited by 4,618
Causation, Prediction, and Search
Spirtes, P., Glymour, C., & Scheines, R. (2001) · doi:10.7551/mitpress/1754.001.0001 · Cited by 4,521
Identification of Causal Effects Using Instrumental Variables
Angrist, J. D., Imbens, G. W., & Rubin, D. B. (1996) · Journal of the American Statistical Association · doi:10.1080/01621459.1996.10476902 · Cited by 4,230
Causal Diagrams for Epidemiologic Research
Greenland, S., Pearl, J., & Robins, J. M. (1999) · Epidemiology · doi:10.1097/00001648-199901000-00008 · Cited by 3,728
Trail Making Test A and B: normative data stratified by age and education
Tombaugh, T. (2004) · Archives of Clinical Neuropsychology · doi:10.1016/s0887-6177(03)00039-8 · Cited by 3,239 · cited 4×
“In contrast, there is no reason to think that a 65-year old with no schooling who requires 86 s to complete the TMT is suffering from AD.”
InfluentialThe fetal and infant origins of adult disease.
Barker, D. J. (1990) · BMJ · doi:10.1136/bmj.301.6761.1111 · Cited by 2,768
Process Analysis: Estimating Mediation in Treatment Evaluations
Judd, C. M., & Kenny, D. A. (1981) · Evaluation Review · doi:10.1177/0193841x8100500502 · Cited by 2,442
Angrist, J. D., & Krueger, A. B. (2001) · Journal of Economic Perspectives · doi:10.1257/jep.15.4.69 · Cited by 2,355
Identifiability and exchangeability for direct and indirect effects
Robins, J. M., & Greenland, S. (1992) · Epidemiology · doi:10.1097/00001648-199203000-00013 · Cited by 1,793
Mendelian randomization: prospects, potentials, and limitations
Smith, G. D. (2004) · International Journal of Epidemiology · doi:10.1093/ije/dyh132 · Cited by 1,222
An introduction to instrumental variables for epidemiologists
Greenland, S. (2000) · International Journal of Epidemiology · doi:10.1093/ije/29.4.722 · Cited by 1,156
Mendelian randomization as an instrumental variable approach to causal inference
Didelez, V., & Sheehan, N. (2007) · Statistical Methods in Medical Research · doi:10.1177/0962280206077743 · Cited by 923 · cited 2×
“…exploiting an allelic variant that influences the phenotype but is thought to have no source of association with the health outcome other than pathways mediated by the phenotype (Little and Khoury 2003; Katan 2004; Smith 2004; Smith and Ebrahim 2004; Didelez and Sheehan 2007; Lawlor et al. 2008).”
THE ESTIMATION OF CAUSAL EFFECTS FROM OBSERVATIONAL DATA
Winship, C., & Morgan, S. L. (1999) · Annual Review of Sociology · doi:10.1146/annurev.soc.25.1.659 · Cited by 890 · cited 2×
“In the last few decades there has been an outpouring of research on causal inference, from a range of disciplines, and this has produced solutions, or at least partial solutions to many vexing methodological problems (Winship and Morgan 1999; Pearl 2000).”
Quantifying Biases in Causal Models: Classical Confounding vs Collider-Stratification Bias
Greenland, S. (2003) · Epidemiology · doi:10.1097/01.ede.0000042804.12056.6c · Cited by 810 · cited 2×
“be dwarfed by other sources of bias (Greenland 2003).”
Fallibility in estimating direct effects
Cole, S. R., & Hernán, M. A. (2002) · International Journal of Epidemiology · doi:10.1093/ije/31.1.163 · Cited by 548 · cited 1×
“Cole and Hernán (2002) provide an accessible discussion of this problem illustrating with a numerical example.”
Commentary: Considerations for Use of Racial/Ethnic Classification in Etiologic Research
Kaufman, J. S. (2001) · American Journal of Epidemiology · doi:10.1093/aje/154.4.291 · Cited by 405
Effect of literacy on neuropsychological test performance in nondemented, education-matched elders
MANLY, J. J., JACOBS, D. M., SANO, M., BELL, K., MERCHANT, C. A., SMALL, S. A., & STERN, Y. (1999) · Journal of the International Neuropsychological Society · doi:10.1017/s135561779953302x · Cited by 250 · cited 1×
“Even if racial differences were entirely mediated by schooling differences, we would anticipate race would predict test score adjusted for years of schooling (Manly et al. 1999, 2002).”
Expanding test–retest designs to include developmental time-lag components.
McArdle, J. J., & Woodcock, R. W. (1997) · Psychological Methods · doi:10.1037/1082-989x.2.4.403 · Cited by 157
Cited by
Principles of confounder selection
VanderWeele, T. J. (2019) · European Journal of Epidemiology · doi:10.1007/s10654-019-00494-6 · Cited by 1,535
Accounting for Bias Due to Selective Attrition: The Example of Smoking and Cognitive Decline
Weuve, J., Tchetgen Tchetgen, E. J., Glymour, M. M., Beck, T. L., Aggarwal, N. T., Wilson, R. S., Evans, D. A., & Mendes de Leon, C. F. (2012) · Epidemiology · doi:10.1097/ede.0b013e318230e861 · Cited by 514
Self-citationA New Criterion for Confounder Selection
VanderWeele, T. J., & Shpitser, I. (2011) · Biometrics · doi:10.1111/j.1541-0420.2011.01619.x · Cited by 434
“” Likewise, Glymour et al. (2008) note that, “The conventional approach to control for confounding is to identify the possible common causes of the exposure of interest and the outcome”
BackgroundWeuve, J., Barnes, L. L., Mendes de Leon, C. F., Rajan, K. B., Beck, T., Aggarwal, N. T., Hebert, L. E., Bennett, D. A., Wilson, R. S., & Evans, D. A. (2018) · Epidemiology · doi:10.1097/ede.0000000000000747 · Cited by 340
Self-citationOutcome-Wide Longitudinal Designs for Causal Inference: A New Template for Empirical Studies
VanderWeele, T. J., Mathur, M. B., & Chen, Y. (2020) · Statistical Science · doi:10.1214/19-sts728 · Cited by 310
Metadata
- Authors
- Glymour, M. M., Weuve, J., & Chen, J. T.
- Venue
- Neuropsychology Review
- Published
- 2008-09
- Volume
- 18
- Issue
- 3
- Pages
- 194-213
- ISSN
- 1040-7308 (ISSN-L)
- 1573-6660
- OpenAlex
- W2054090239
- Cited by
- 88
- References
- 22
- FWCI
- 3.10
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.