Characterizing implicit mental health associations across clinical domains
Open accessThe DOI matches its Crossref record; 22 of the 22 references it cites were found in a registry or an index.
Abstract
Background and objectives Implicit associations are relatively uncontrollable associations between concepts in memory. The current investigation focuses on implicit associations in four mental health domains (alcohol use, anxiety, depression, and eating disorders) and how these implicit associations: a) relate to explicit associations and b) self-reported clinical symptoms within the same domains, and c) vary based on demographic characteristics (age, gender, race, ethnicity, and education). Methods Participants (volunteers over age 18 to a research website) completed implicit association (Implicit Association Tests), explicit association (self+psychopathology or attitudes toward food, using semantic differential items), and symptom measures at the Project Implicit Mental Health website tied to: alcohol use (N=12,387), anxiety (N=21,304), depression (N=24,126), or eating disorders (N=10,115). Results Within each domain, implicit associations showed small to moderate associations with explicit associations and symptoms, and predicted self-reported symptoms beyond explicit associations. In general, implicit association strength varied little by race and ethnicity, but showed small ties to age, gender, and education. Limitations This research was conducted on a public research and education website, where participants could take more than one of the studies. Conclusions Among a large and diverse sample, implicit associations in the four domains are congruent with explicit associations and self-reported symptoms, and also add to our prediction of self-reported symptoms over and above explicit associations, pointing to the potential future clinical utility and validity of using implicit association measures with diverse populations.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
SAUNDERS, J. B., AASLAND, O. G., BABOR, T. F., DE LA FUENTE, J. R., & GRANT, M. (1993) · Addiction · doi:10.1111/j.1360-0443.1993.tb02093.x · Cited by 13,597
Leys, C., Ley, C., Klein, O., Bernard, P., & Licata, L. (2013) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2013.03.013 · Cited by 4,147 · cited 2×
“Following Leys et al. (2013), cases with a MAD of 3 or more were removed from the samples.”
MethodPsychometric properties of the Depression Anxiety Stress Scales (DASS) in clinical samples
Brown, T. A., Chorpita, B. F., Korotitsch, W., & Barlow, D. H. (1997) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(96)00068-x · Cited by 1,860 · cited 2×
“The full list of demographic items is available from the first author. they were asked to report their age, gender, ethnicity, race, and educational background.”
BackgroundCrawford, J. R., & Henry, J. D. (2003) · British Journal of Clinical Psychology · doi:10.1348/014466503321903544 · Cited by 1,756 · cited 1×
“It also correlates with other established measures of anxiety (Antony et al., 1998; Brown, Chorpita, Korotitsch, & Barlow, 1997; Crawford & Henry, 2003).”
BackgroundHofmann, W., Gawronski, B., Gschwendner, T., Le, H., & Schmitt, M. (2005) · Personality and Social Psychology Bulletin · doi:10.1177/0146167205275613 · Cited by 1,642
Harvesting implicit group attitudes and beliefs from a demonstration web site.
Nosek, B. A., Banaji, M. R., & Greenwald, A. G. (2002) · Group Dynamics: Theory, Research, and Practice · doi:10.1037/1089-2699.6.1.101 · Cited by 1,321
An information processing model of anxiety: Automatic and strategic processes
Beck, A. T., & Clark, D. A. (1997) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(96)00069-1 · Cited by 1,317
The Alcohol Use Disorders Identification Test (AUDIT): A review of recent research
Reinert, D. F., & Allen, J. P. (2002) · Alcoholism: Clinical and Experimental Research · doi:10.1111/j.1530-0277.2002.tb02534.x · Cited by 1,143
Using Mechanical Turk to Study Clinical Populations
Shapiro, D. N., Chandler, J., & Mueller, P. A. (2013) · Clinical Psychological Science · doi:10.1177/2167702612469015 · Cited by 1,139 · cited 3×
“…DASS-21 depression subscale is higher than the mean of a previous community sample (e.g., community mean: 5.66; Henry & Crawford, 2005) and another online examination of mental health (e.g., approximately 5% of individuals endorsed clinically significant depressive symptoms; Shapiro et al., 2013).”
MethodResultInfluentialModerators of the Relationship Between Implicit and Explicit Evaluation.
Nosek, B. A. (2005) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.134.4.565 · Cited by 701
Martin, L. A., Neighbors, H. W., & Griffith, D. M. (2013) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2013.1985 · Cited by 674
Measuring the Suicidal Mind: Implicit Cognition Predicts Suicidal Behavior
Nock, M. K., Park, J. M., Finn, C. T., Deliberto, T. L., Dour, H. J., & Banaji, M. R. (2010) · Psychological Science · doi:10.1177/0956797610364762 · Cited by 624 · cited 1×
“For example, previous research in this area suggests that stronger implicit associations linking the self to death (as opposed to life) are able to uniquely predict suicide attempts, even when known risk factors are accounted for (Nock et al., 2010).”
Self-citationTeachman, B. A., Gapinski, K. D., Brownell, K. D., Rawlins, M., & Jeyaram, S. (2003) · Health Psychology · doi:10.1037/0278-6133.22.1.68 · Cited by 536
Self-citationWiers, R. W., Gladwin, T. E., Hofmann, W., Salemink, E., & Ridderinkhof, K. R. (2013) · Clinical Psychological Science · doi:10.1177/2167702612466547 · Cited by 486
The Eating Attitudes Test: Validation With DSM-IV Eating Disorder Criteria
Mintz, L. B., & O'Halloran, M. S. (2000) · Journal of Personality Assessment · doi:10.1207/s15327752jpa7403_11 · Cited by 396
Cognitive vulnerability to depression: a dual process model
Beevers, C. G. (2005) · Clinical Psychology Review · doi:10.1016/j.cpr.2005.03.003 · Cited by 357
Automatic processing in spider phobia: Implicit fear associations over the course of treatment.
Teachman, B. A., & Woody, S. R. (2003) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.112.1.100 · Cited by 258 · cited 1×
“…validity (e.g., drinking identity and drinking avoidance associations predict differently; Lindgren, Foster, Westgate, & Neighbors, 2013; see also Teachman & Woody, 2003, in the anxiety domain), so it will be important to assess a broader range of implicit mental health associations to determine…”
BackgroundSelf-citationUnderstanding and Using the Brief Implicit Association Test: Recommended Scoring Procedures
Nosek, B. A., Bar-Anan, Y., Sriram, N., Axt, J., & Greenwald, A. G. (2014) · PLoS ONE · doi:10.1371/journal.pone.0110938 · Cited by 179
Automaticity in anxiety disorders and major depressive disorder
Teachman, B. A., Joormann, J., Steinman, S. A., & Gotlib, I. H. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.06.004 · Cited by 130
Self-citationAutomatic associations and panic disorder: Trajectories of change over the course of treatment.
Teachman, B. A., Marker, C. D., & Smith-Janik, S. B. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0013113 · Cited by 113
Self-citationGlashouwer, K. A., & de Jong, P. J. (2010) · Psychological Medicine · doi:10.1017/s0033291709991371 · Cited by 111 · cited 1×
“…associations and self-reported symptoms across multiple disorder domains in large and relatively diverse samples (though see important work by Glashouwer & de Jong, 2010, examining implicit anxious and depressed associations in a large Dutch sample recruited from different health settings).”
BackgroundGlashouwer, K. A., de Jong, P. J., & Penninx, B. W. J. H. (2012) · Behaviour Research and Therapy · doi:10.1016/j.brat.2012.05.002 · Cited by 25 · cited 1×
“For the alcohol, anxiety, and depression domains, we opted to test implicit associations that had clear theoretical ties to core aspects of the psychopathology and had been measured in previous research (alcohol: Lindgren, Neighbors, et al., 2013; anxiety and depression: Glashouwer et al., 2012).”
Method
Research works printed but not linked: 31
- Allen, 1997, A review of research on the alcohol use disorders identification test (audit), Alcoholism: Clinical and Experimental Research, 21, 613, 10.1111/j.1530-0277.1997.tb03811.x · doi:10.1111/j.1530-0277.1997.tb03811.x · Paper page
- Antony, 1998, Psychometric properties of the 42-item and 21-item versions of the depression anxiety stress scales in clinical groups and a community sample, Psychological Assessment, 10, 176, 10.1037/1040-3590.10.2.176 · DOI · Paper page
- Brown, 1995, Conjoint screening questionnaires for alcohol and other drug abuse: criterion validity in a primary care practice, Wisconsin Medical Journal, 94, 135
- Darcy, 2007, A clinical profile of participants in an online support group, European Eating Disorders Review, 15, 185, 10.1002/erv.775 · DOI
- Egloff, 2002, Predictive validity of an implicit association test for assessing anxiety, Journal of Personality and Social Psychology, 83, 1441, 10.1037/0022-3514.83.6.1441 · doi:10.1037/0022-3514.83.6.1441 · Paper page
- Garner, 1982, The eating attitudes test: psychometric features and clinical correlates, Psychological Medicine, 12, 871, 10.1017/S0033291700049163 · DOI · Paper page
- Glashouwer, 2010, Do automatic self-associations relate to suicidal ideation?, Journal of Psychopathology and Behavioral Assessment, 32, 428, 10.1007/s10862-009-9156-y · DOI · Paper page
- Greenwald, 1995, Implicit social cognition: attitudes, self-esteem, and stereotypes, Psychological Review, 102, 4, 10.1037/0033-295X.102.1.4 · DOI · Paper page
- Greenwald, 1998, Measuring individual differences in implicit cognition: the implicit association test, Journal of Personality and Social Psychology, 74, 1464, 10.1037/0022-3514.74.6.1464 · DOI · Paper page
- Greenwald, 2003, Understanding and using the implicit association test: I. An improved scoring algorithm, Journal of Personality and Social Psychology, 85, 197, 10.1037/0022-3514.85.2.197 · DOI · Paper page
- Grover, 2003, Gender differences in implicit weight identity, International Journal of Eating Disorders, 34, 125, 10.1002/eat.10167 · DOI · Paper page
- Henry, 2005, The short-form version of the depression anxiety stress scales (dass-21): construct validity and normative data in a large non-clinical sample, The British Journal of Clinical Psychology, 44, 227, 10.1348/014466505X29657 · DOI · Paper page
- Hollon, 1986, Specificity of depressotypic cognitions in clinical depression, Journal of Abnormal Psychology, 95, 52, 10.1037/0021-843X.95.1.52 · DOI · Paper page
- Houben, 2008, Measuring implicit alcohol associations via the internet: validation of web-based implicit association tests, Behavior Research Methods, 40, 1134, 10.3758/BRM.40.4.1134 · DOI
- Insel, 2010, Research domain criteria (rdoc): toward a new classification framework for research on mental disorders, American Journal of Psychiatry, 167, 748, 10.1176/appi.ajp.2010.09091379 · DOI · Paper page
- de Jong, 2002, Implicit self-esteem and social anxiety: differential self-favouring effects in high and low anxious individuals, Behaviour Research and Therapy, 40, 501, 10.1016/S0005-7967(01)00022-5 · DOI · Paper page
- Kessler, 2003, The epidemiology of major depressive disorder: results from the national comorbidity survey replication (ncs-r), JAMA: Journal of the American Medical Association, 289, 3095, 10.1001/jama.289.23.3095 · DOI · Paper page
- Lindgren, 2013, Implicit drinking identity: drinker+me associations predict college student drinking consistently, Addictive Behaviors, 38, 2163, 10.1016/j.addbeh.2013.01.026 · DOI
- Lindgren, 2013, I drink therefore i am: validating alcohol-related implicit association tests, Psychology of Addictive Behaviors, 27, 1, 10.1037/a0027640 · DOI · Paper page
- Nock, 2007, Prediction of suicide ideation and attempts among adolescents using a brief performance-based test, Journal of Consulting and Clinical Psychology, 75, 707, 10.1037/0022-006X.75.5.707 · DOI · Paper page
- Nosek, 2005, Understanding and using the implicit association test: Ii. Method variables and construct validity, Personality and Social Psychology Bulletin, 31, 166, 10.1177/0146167204271418 · DOI · Paper page
- Nosek, 2007, A multitrait-multimethod validation of the implicit association test: implicit and explicit attitudes are related but distinct constructs, Experimental Psychology, 54, 14, 10.1027/1618-3169.54.1.14 · DOI · Paper page
- Osman, 2012, The depression anxiety stress scales—21 (dass-21): further examination of dimensions, scale reliability, and correlates, Journal of Clinical Psychology, 68, 1322, 10.1002/jclp.21908 · DOI · Paper page
- Peris, 2008, Implicit and explicit stigma of mental illness: links to clinical care, Journal of Nervous and Mental Disease, 196, 752, 10.1097/NMD.0b013e3181879dfd · DOI · Paper page
- Ranganath, 2008, Implicit attitude generalization occurs immediately; explicit attitude generalization takes time, Psychological Science, 19, 249, 10.1111/j.1467-9280.2008.02076.x · DOI · Paper page
- Roefs, 2011, Implicit measures of association in psychopathology research, Psychological Bulletin, 137, 149, 10.1037/a0021729 · DOI · Paper page
- Sriram, 2009, The brief implicit association test, Experimental Psychology, 56, 283, 10.1027/1618-3169.56.4.283 · DOI · Paper page
- Stoner, 1996, Food preferences and desire to eat in anorexia and bulimia nervosa, International Journal of Eating Disorders, 19, 13, 10.1002/(SICI)1098-108X(199601)19:1<13::AID-EAT3>3.0.CO;2-Z · DOI
- Teachman, 2001, Implicit associations for fear-relevant stimuli among individuals with snake and spider fears, Journal of Abnormal Psychology, 110, 226, 10.1037/0021-843X.110.2.226 · doi:10.1037/0021-843x.110.2.226 · Paper page
- Vitousek, 1990, The investigation of schematic content and processing in eating disorders, Cognitive Therapy and Research, 14, 191, 10.1007/BF01176209 · DOI · Paper page
- Yamaguchi, 2007, Apparent universality of positive implicit self-esteem, Psychological Science, 18, 498, 10.1111/j.1467-9280.2007.01928.x · DOI · Paper page
Cited by
Lindgren, K. P., Neighbors, C., Gasser, M. L., Ramirez, J. J., & Cvencek, D. (2017) · The American Journal of Drug and Alcohol Abuse · doi:10.1080/00952990.2016.1229324 · Cited by 120
Glenn, C. R., Kleiman, E. M., Coppersmith, D. D. L., Santee, A. C., Esposito, E. C., Cha, C. B., Nock, M. K., & Auerbach, R. P. (2017) · Journal of Child Psychology and Psychiatry · doi:10.1111/jcpp.12769 · Cited by 54
“…for Child and Adolescent Mental Health. difference in the constructs being assessed (i.e., explicit suicide ideation and implicit self-identification with death), as well as the low to moderate correspondence generally found between explicit and implicit measures (Nosek, 2005; Werntz et al., 2016).”
Self-citationLamontagne, S. J., Zabala, P. K., Zarate, C. A., & Ballard, E. D. (2023) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2023.105361 · Cited by 12
Metadata
- Authors
- Werntz, A. J., Steinman, S. A., Glenn, J. J., Nock, M. K., & Teachman, B. A.
- Venue
- Journal of Behavior Therapy and Experimental Psychiatry
- Publisher
- Elsevier BV
- Published
- 2016-09
- Volume
- 52
- Pages
- 17-28
- ISSN
- 0005-7916 (ISSN-L)
- OpenAlex
- W2290488671
- Cited by
- 38
- References
- 22
- FWCI
- 4.48
- Type
- journal article
- Language
- en
- Open access
- green
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- www.elsevier.com/legal/tdmrep-license (tdm)
- Funders
- NIH (R01AG033033, R34MH106770)
- University of Virginia
- Norlien Foundation
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.