The DOI matches its Crossref record; 74 of the 74 references it cites were found in a registry or an index.
Gene × Environment Interaction Studies Have Not Properly Controlled for Potential Confounders: The Problem and the (Simple) Solution
Open accessAbstract
Candidate gene-by-environment (G×E) interaction research tests the hypothesis that the effects of some environmental variable (e.g., childhood maltreatment) on some outcome measure (e.g., depression) depend on a particular genetic polymorphism. Because this research is inherently non-experimental, investigators have been rightly concerned that detected interactions could be driven by confounders (e.g., ethnicity, gender, age, socioeconomic status, etc.) rather than by the specified genetic or environmental variables per se. In an attempt to eliminate such alternative explanations for detected G×E interactions, investigators routinely enter the potential confounders as covariates in general linear models. However, this practice does not control for the effects these variables might have on the G×E interaction. Rather, to properly control for confounders, researchers need to enter the covariate-by-environment and the covariate-by-gene interaction terms in the same model that tests the G×E term. In this manuscript, I demonstrate this point analytically and show that the practice of improperly controlling for covariates is the norm in the G×E interaction literature to date. Thus, many alternative explanations for G×E findings that investigators had thought were eliminated have not been.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Cohen, P., Cohen, P., West, S. G., & Aiken, L. S. (2014) · Psychology Press eBooks · doi:10.4324/9781410606266 · Cited by 20,737
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Applied Multiple Regression/Correlation Analysis for the Behavioral Sciences
Kemp, F. (2003) · Journal of the Royal Statistical Society: Series D (The Statistician) · doi:10.1046/j.1467-9884.2003.t01-2-00383_4.x · Cited by 9,293
Influence of life stress on depression: moderation by a polymorphism in the 5-HTT gene
Caspi, A., Sugden, K., Moffitt, T. E., Taylor, A., Craig, I. W., Harrington, H., McClay, J., Mill, J., Martin, J., Braithwaite, A., et al. (2003) · Science · doi:10.1126/science.1083968 · Cited by 8,120
Role of genotype in the cycle of violence in maltreated children
Caspi, A., McClay, J., Moffitt, T. E., Mill, J., Martin, J., Craig, I. W., Taylor, A., & Poulton, R. (2002) · Science · doi:10.1126/science.1072290 · Cited by 4,842
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
When moderation is mediated and mediation is moderated.
Muller, D., Judd, C. M., & Yzerbyt, V. Y. (2005) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.89.6.852 · Cited by 3,340
Statistical difficulties of detecting interactions and moderator effects.
McClelland, G. H., & Judd, C. M. (1993) · Psychological Bulletin · doi:10.1037/0033-2909.114.2.376 · Cited by 3,270
Christakis, D., Richards, J. A., Zimmerman, F. J., Garrison, M. M., Xu, D., & Yapanel, U. H. (2009) · Cited by 2,289
Risch, N., Herrell, R., Lehner, T., Liang, K.-Y., Eaves, L., Hoh, J., Griem, A., Kovacs, M., Ott, J., & Merikangas, K. R. (2009) · JAMA · doi:10.1001/jama.2009.878 · Cited by 1,655
Caspi, A., Moffitt, T. E., Cannon, M., McClay, J., Murray, R., Harrington, H., Taylor, A., Arseneault, L., Williams, B., Braithwaite, A., et al. (2005) · Biological Psychiatry · doi:10.1016/j.biopsych.2005.01.026 · Cited by 1,409
Binder, E. B. (2008) · JAMA · doi:10.1001/jama.299.11.1291 · Cited by 1,362
A functional polymorphism in the monoamine oxidase A gene promoter
Sabol, S. Z., Hu, S., & Hamer, D. (1998) · Human Genetics · doi:10.1007/s004390050816 · Cited by 1,079
Duncan, L. E., & Keller, M. C. (2011) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2011.11020191 · Cited by 1,032
Self-citationSocial supports and serotonin transporter gene moderate depression in maltreated children
Kaufman, J., Yang, B.-Z., Douglas-Palumberi, H., Houshyar, S., Lipschitz, D., Krystal, J. H., & Gelernter, J. (2004) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0404376101 · Cited by 803
Escalation of Drug Use in Early-Onset Cannabis Users vs Co-twin Controls
Lynskey, M. T., Heath, A. C., Bucholz, K. K., Slutske, W. S., Madden, P. A. F., Nelson, E. C., Statham, D. J., & Martin, N. G. (2003) · JAMA · doi:10.1001/jama.289.4.427 · Cited by 649
Bradley, R. G., Binder, E. B., Epstein, M. P., Tang, Y., Nair, H. P., Liu, W., Gillespie, C. F., Berg, T., Evces, M., Newport, D. J., et al. (2008) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2007.26 · Cited by 643
Gene×environment interactions at the serotonin transporter locus
Munafò, M. R., Durrant, C., Lewis, G., & Flint, J. (2009) · Biological Psychiatry · doi:10.1016/j.biopsych.2008.06.009 · Cited by 576
Bakermans-Kranenburg, M. J., & van IJzendoorn, M. H. (2006) · Developmental Psychobiology · doi:10.1002/dev.20152 · Cited by 526
A Genome-Wide Investigation of SNPs and CNVs in Schizophrenia
Need, A. C., Ge, D., Weale, M. E., Maia, J., Feng, S., Heinzen, E. L., Shianna, K. V., Yoon, W., Kasperavičiūtė, D., Gennarelli, M., et al. (2009) · PLoS Genetics · doi:10.1371/journal.pgen.1000373 · Cited by 447
Genomewide association for schizophrenia in the CATIE study: results of stage 1
Sullivan, P. F., Lin, D., Tzeng, J.-Y., van den Oord, E., Perkins, D., Stroup, T. S., Wagner, M., Lee, S., Wright, F. A., Zou, F., et al. (2008) · Molecular Psychiatry · doi:10.1038/mp.2008.25 · Cited by 355
Sanders, A. R., Duan, J., Levinson, D. F., Shi, J., He, D., Hou, C., Burrell, G. J., Rice, J. P., Nertney, D. A., Olincy, A., et al. (2008) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2007.07101573 · Cited by 349
Adjusting researchers’ approach to adjustment: On the use of covariates when testing interactions
Yzerbyt, V. Y., Muller, D., & Judd, C. M. (2004) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2003.10.001 · Cited by 330
Poor replication of candidate genes for major depressive disorder using genome-wide association data
Bosker, F. J., Hartman, C. A., Nolte, I. M., Prins, B. P., Terpstra, P., Posthuma, D., van Veen, T., Willemsen, G., DeRijk, R. H., de Geus, E. J., et al. (2011) · Molecular Psychiatry · doi:10.1038/mp.2010.38 · Cited by 309
Gene-Environment Interaction in Genome-Wide Association Studies
Murcray, C. E., Lewinger, J. P., & Gauderman, W. J. (2008) · American Journal of Epidemiology · doi:10.1093/aje/kwn353 · Cited by 305
Kahn, R. S., Khoury, J., Nichols, W. C., & Lanphear, B. P. (2003) · The Journal of Pediatrics · doi:10.1016/s0022-3476(03)00208-7 · Cited by 284
Grabe, H. J., Lange, M., Wolff, B., Völzke, H., Lucht, M., Freyberger, H. J., John, U., & Cascorbi, I. (2005) · Molecular Psychiatry · doi:10.1038/sj.mp.4001555 · Cited by 279
Evidence for a Gene-Environment Interaction in Predicting Behavioral Inhibition in Middle Childhood
Fox, N. A., Nichols, K. E., Henderson, H. A., Rubin, K., Schmidt, L., Hamer, D., Ernst, M., & Pine, D. S. (2005) · Psychological Science · doi:10.1111/j.1467-9280.2005.01637.x · Cited by 262
Stein, M. B., Schork, N. J., & Gelernter, J. (2008) · Neuropsychopharmacology · doi:10.1038/sj.npp.1301422 · Cited by 247
Interaction between CRHR1 gene and stressful life events predicts adolescent heavy alcohol use
Blomeyer, D., Treutlein, J., Esser, G., Schmidt, M. H., Schumann, G., & Laucht, M. (2008) · Biological Psychiatry · doi:10.1016/j.biopsych.2007.04.026 · Cited by 211
Laucht, M., Skowronek, M. H., Becker, K., Schmidt, M. H., Esser, G., Schulze, T. G., & Rietschel, M. (2007) · Archives of General Psychiatry · doi:10.1001/archpsyc.64.5.585 · Cited by 205
Cicchetti, D., Rogosch, F. A., & Sturge-Apple, M. L. (2007) · Development and Psychopathology · doi:10.1017/s0954579407000600 · Cited by 204
Hewitt, J. K. (2012) · Behavior Genetics · doi:10.1007/s10519-011-9504-z · Cited by 190
Genotype × Environment Interaction in Psychopathology: Fact or Artifact?
Eaves, L. J. (2006) · Twin Research and Human Genetics · doi:10.1375/twin.9.1.1 · Cited by 183
Covault, J., Tennen, H., Armeli, S., Conner, T. S., Herman, A. I., Cillessen, A. H. N., & Kranzler, H. R. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.05.018 · Cited by 179
Koenen, K. C., Aiello, A. E., Bakshis, E., Amstadter, A. B., Ruggiero, K. J., Acierno, R. E., Kilpatrick, D. G., Gelernter, J. E., & Galea, S. (2009) · American Journal of Epidemiology · doi:10.1093/aje/kwn397 · Cited by 167
Grabe, H. J., Spitzer, C., Schwahn, C., Marcinek, A., Frahnow, A., Barnow, S., Lucht, M., Freyberger, H. J., John, U., Wallaschofski, H., et al. (2009) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2009.08101542 · Cited by 167
Retz, W., Freitag, C. M., Retz-Junginger, P., Wenzler, D., Schneider, M., Kissling, C., Thome, J., & Rösler, M. (2008) · Psychiatry Research · doi:10.1016/j.psychres.2007.05.004 · Cited by 142
Interaction between BDNF Val66Met and childhood trauma on adult’s violent suicide attempt
Perroud, N. A., Courtet, P., Vincze, I., Jaussent, I., Jollant, F., Bellivier, F., Leboyer, M., Baud, P., Burési, C., & Malafosse, A. (2007) · Genes Brain & Behavior · doi:10.1111/j.1601-183x.2007.00354.x · Cited by 138
Bet, P. M., Penninx, B. W. J. H., Bochdanovits, Z., Uitterlinden, A. G., Beekman, A. T. F., van Schoor, N. M., Deeg, D. J. H., & Hoogendijk, W. J. G. (2009) · American Journal of Medical Genetics Part B: Neuropsychiatric Genetics · doi:10.1002/ajmg.b.30886 · Cited by 138
van Winkel, R., Henquet, C., Rosa, A., Papiol, S., Fañanás, L., Binder, M. D., Peuskens, J., van Os, J., & Myin‐Germeys, I. (2007) · American Journal of Medical Genetics Part B Neuropsychiatric Genetics · doi:10.1002/ajmg.b.30559 · Cited by 131
Amstadter, A. B., Koenen, K. C., Ruggiero, K. J., Acierno, R. E., Galea, S., Kilpatrick, D. G., & Gelernter, J. E. (2008) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2008.12.005 · Cited by 126
Gervai, J., Novák, A., Lakatos, K., Tóth, I., Danis, I., Rónai, Z., Nemoda, Z., Sasvári‐Székely, M., Bureau, J.-F., Bronfman, E. T., et al. (2007) · Social Neuroscience · doi:10.1080/17470910701391893 · Cited by 125
Dick, D. M., Agrawal, A., Schuckit, M. A., Bierut, L. J., Hinrichs, A. L., Fox, L. W., Mullaney, J., Cloninger, C. R., HESSELBROCK, V. M., Nürnberger, J. I., et al. (2006) · Journal of Studies on Alcohol · doi:10.15288/jsa.2006.67.185 · Cited by 122
Henquet, C., Rosa, A., Delespaul, P., Papiol, S., Fañanás, L., van Os, J., & Myin‐Germeys, I. (2008) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2008.01265.x · Cited by 117
Hypothesis-driven candidate genes for schizophrenia compared to genome-wide association results
Collins, A. L., Kim, Y., Sklar, P. B., O’Donovan, M. C., & Sullivan, P. F. (2011) · Psychological Medicine · doi:10.1017/s0033291711001607 · Cited by 110
Bau, C. H. D., Almeida, S., & Hutz, M. H. (2000) · American Journal of Medical Genetics · doi:10.1002/1096-8628(20000612)96:3<302::aid-ajmg13>3.0.co;2-i · Cited by 108
Jokela, M. M., Keltikangas‐Järvinen, L., Kivimäki, M., Puttonen, S., Elovainio, M. J., Rontu, R., & Lehtimäki, T. J. (2007) · Archives of General Psychiatry · doi:10.1001/archpsyc.64.3.356 · Cited by 106
Todd, R. D., & Neuman, R. J. (2007) · American Journal of Medical Genetics Part B: Neuropsychiatric Genetics · doi:10.1002/ajmg.b.30640 · Cited by 99
Haeffel, G. J., Getchell, M., Koposov, R. A., Yrigollen, C. M., De Young, C. G., Klinteberg, B. A., Oreland, L., Ruchkin, V. V., & Grigorenko, E. L. (2008) · Psychological Science · doi:10.1111/j.1467-9280.2008.02047.x · Cited by 96
Stevens, S. E., Kumsta, R., Kreppner, J. M., Brookes, K. J., Rutter, M., & Sonuga‐Barke, E. J. S. (2009) · American Journal of Medical Genetics Part B: Neuropsychiatric Genetics · doi:10.1002/ajmg.b.31010 · Cited by 89
Moderator Variables in Personality Research: The Problem of Controlling for Plausible Alternatives
Hull, J. G., Tedlie, J. C., & Lehn, D. A. (1992) · Personality and Social Psychology Bulletin · doi:10.1177/0146167292182001 · Cited by 87
Åslund, C., Leppert, J., Comasco, E., Nordquist, N., Oreland, L., & Nilsson, K. W. (2009) · Behavior Genetics · doi:10.1007/s10519-009-9285-9 · Cited by 84
Seeger, G., Schloss, P. D., Schmidt, M. H., Rüter-Jungfleisch, A., & Henn, F. A. (2004) · Neuroscience Letters · doi:10.1016/j.neulet.2004.05.049 · Cited by 84
Racine, S. E., Culbert, K. M., Larson, C. L., & Klump, K. L. (2009) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2009.05.002 · Cited by 81
Nature and nurture in novelty seeking
Keltikangas‐Järvinen, L., Räikkönen, K., Ekelund, J., & Peltonen, L. (2003) · Molecular Psychiatry · doi:10.1038/sj.mp.4001433 · Cited by 80
Chotai, J., Serretti, A., Lattuada, E., Lorenzi, C., & Lilli, R. (2003) · Psychiatry Research · doi:10.1016/s0165-1781(03)00112-4 · Cited by 79
Replication and heterogeneity in gene×environment interaction studies
Munafo, M. R., & Flint, J. (2009) · The International Journal of Neuropsychopharmacology · doi:10.1017/s1461145709000479 · Cited by 76
Nobile, M., Giorda, R., Marino, C., Carlet, O., Pastore, V., Vanzin, L., Bellina, M., Molteni, M., & Battaglia, M. (2007) · Development and Psychopathology · doi:10.1017/s0954579407000594 · Cited by 72
Waldman, I. D. (2007) · Development and Psychopathology · doi:10.1017/s0954579407000570 · Cited by 65
Lasky-Su, J. A., Faraone, S. V., Lange, C., Tsuang, M. T., Doyle, A. E., Smoller, J. W., Laird, N. M., & Biederman, J. (2007) · Behavior Genetics · doi:10.1007/s10519-006-9136-x · Cited by 63
Vanyukov, M. M., Maher, B. S., Devlin, B., Kirillova, G. P., Kirisci, L., Yu, L.-M., & Ferrell, R. E. (2007) · Psychiatric Genetics · doi:10.1097/ypg.0b013e32811f6691 · Cited by 61
Jokela, M. M., Lehtimäki, T. J., & Keltikangas‐Järvinen, L. (2007) · American Journal of Medical Genetics Part B Neuropsychiatric Genetics · doi:10.1002/ajmg.b.30555 · Cited by 60
Nobile, M., Rusconi, M., Bellina, M., Marino, C., Giorda, R., Carlet, O., Vanzin, L., Molteni, M., & Battaglia, M. (2009) · Journal of Child Psychology and Psychiatry · doi:10.1111/j.1469-7610.2008.01958.x · Cited by 48
Jokela, M. M., Räikkönen, K., Lehtimäki, T. J., Rontu, R., & Keltikangas‐Järvinen, L. (2006) · Journal of Affective Disorders · doi:10.1016/j.jad.2006.10.016 · Cited by 46
Ozkaragoz, T. Z., & Noble, E. P. (2000) · Alcohol · doi:10.1016/s0741-8329(00)00112-9 · Cited by 45
Sun, N., Xu, Y. J., Wang, Y., Duan, H., Wang, S., Ren, Y., Peng, J., Du, Q., Shen, Y., Xu, Q., et al. (2008) · Journal of Neural Transmission · doi:10.1007/s00702-008-0109-5 · Cited by 45
Jokela, M. M., Lehtimäki, T. J., & Keltikangas‐Järvinen, L. (2007) · Behavior Genetics · doi:10.1007/s10519-007-9157-0 · Cited by 45
Forum: interactions between gene and environment
Flint, J., & Munafo, M. R. (2008) · Current Opinion in Psychiatry · doi:10.1097/yco.0b013e328306a791 · Cited by 38
Socio-demographic characteristics moderate the association between DRD4 and Novelty seeking
Lahti, J. M. T., Räikkönen, K., Ekelund, J., Peltonen, L., Raitakari, O. T., & Keltikangas‐Järvinen, L. (2005) · Personality and Individual Differences · doi:10.1016/j.paid.2005.07.011 · Cited by 36
Editorial Policy for Candidate Gene Studies
Johnston, C., Lahey, B. B., & Matthys, W. (2013) · Research on Child and Adolescent Psychopathology · doi:10.1007/s10802-013-9741-0 · Cited by 35
GENETIC STUDY: Tryptophan hydroxylase 2 gene and alcohol use among college students
Gacek, P., Conner, T. S., Tennen, H. A., Kranzler, H. R., & Covault, J. (2008) · Addiction Biology · doi:10.1111/j.1369-1600.2008.00118.x · Cited by 33
Yen, Y.-C., Rebok, G. W., Yang, M.-J., & Lung, F.-W. (2008) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/j.pnpbp.2007.09.023 · Cited by 25
Xu, Y. J., Li, F. Y., Huang, X., Sun, N., Zhang, F., Liu, P., Yang, H., Luo, J., Sun, Y., & Zhang, K. (2009) · Psychiatry Research · doi:10.1016/j.psychres.2009.03.015 · Cited by 23
Cited by
Border, R., Johnson, E. C., Evans, L. M., Smolen, A., Berley, N., Sullivan, P. F., & Keller, M. C. (2019) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.18070881 · Cited by 629
Self-citationGene–Stress–Epigenetic regulation of FKBP5: clinical and translational implications
Zannas, A. S., Wiechmann, T., Gassen, N. C., & Binder, E. B. (2016) · Neuropsychopharmacology · doi:10.1038/npp.2015.235 · Cited by 622
Resilience in Development: Progress and Transformation
Masten, A. S., & Cicchetti, D. (2016) · Developmental Psychopathology · doi:10.1002/9781119125556.devpsy406 · Cited by 416
Candidate Gene–Environment Interaction Research: Reflections and Recommendations
Dick, D. M., Agrawal, A., Keller, M. C., Adkins, A., Aliev, F., Monroe, S., Hewitt, J. K., Kendler, K. S., & Sher, K. J. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691614556682 · Cited by 361
Self-citationEpigenetics of Stress-Related Psychiatric Disorders and Gene × Environment Interactions
Klengel, T., & Binder, E. B. (2015) · Neuron · doi:10.1016/j.neuron.2015.05.036 · Cited by 353
“…rely only on statistical interactions are fraught with possible methodological problems that need to be carefully considered when interpreting these studies (Almli et al., 2014; Dudbridge and Fletcher, 2014; Duncan and Keller, 2011; Keller, 2014; Manuck and McCaffery, 2014; Munafò et al., 2014).”
Background
Metadata
- Authors
- Keller, M. C.
- Venue
- Biological Psychiatry
- Publisher
- Elsevier BV
- Published
- 2014-01
- Volume
- 75
- Issue
- 1
- Pages
- 18-24
- ISSN
- 0006-3223 (ISSN-L)
- OpenAlex
- W1992204010
- Cited by
- 625
- References
- 74
- FWCI
- 24.68
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.