Implicit measures of association in psychopathology research.
Open accessThe DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
Studies obtaining implicit measures of associations in Diagnostic and Statistical Manual of Mental Disorders (4th ed., Text Revision; American Psychiatric Association, 2000) Axis I psychopathology are organized into three categories: (a) studies comparing groups having a disorder with controls, (b) experimental validity studies, and (c) incremental and predictive validity studies. In the first category, implicit measures of disorder-relevant associations were consistent with explicit beliefs for some disorders (e.g., specific phobia), but for other disorders evidence was either mixed (e.g., panic disorder) or inconsistent with explicit beliefs (e.g., pain disorder). For substance use disorders and overeating, expected positive and unexpected negative associations with craved substances were found consistently. Contrary to expectation, implicit measures of self-esteem were consistently positive for patients with depressive disorder, social phobia, and body dysmorphic disorder. In the second category, short-term manipulations of disorder-relevant states generally affected implicit measures as expected. Therapeutic interventions affected implicit measures for one type of specific phobia, social phobia, and panic disorder, but not for alcohol use disorders or obesity. In the third category, implicit measures had predictive value for certain psychopathological behaviors, sometimes moderated by the availability of cognitive resources (e.g., for alcohol and food, only when cognitive resources were limited). The strengths of implicit measures include (a) converging evidence for dysfunctional beliefs regarding certain disorders and consistent new insights for other disorders and (b) prediction of some psychopathological behaviors that explicit measures cannot explain. Weaknesses include (a) that findings were inconsistent for some disorders, raising doubts about the validity of the measures, and (b) that understanding of the concept "implicit" is incomplete.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Telling more than we can know: Verbal reports on mental processes.
Nisbett, R. E., & Wilson, T. D. (1977) · Psychological Review · doi:10.1037/0033-295x.84.3.231 · Cited by 11,317 · cited 1×
“…Bulletin © 2011 American Psychological Association 2011, Vol. 137, No. 1, 149–193 0033-2909/11/$12.00 DOI: 10.1037/a0021729 149 know that people do not have introspective access to all of the mechanisms that underlie their behavior (Nisbett & Wilson, 1977).”
BackgroundInfluentialDiagnostic and Statistical Manual of Mental Disorders, Fourth Edition, Text Revision (DSM-IV-TR)
American Psychiatric Association (2000) · doi:10.1176/appi.books.9780890423349 · Cited by 11,069
Measuring individual differences in implicit cognition: the implicit association test
Greenwald, A. G., McGhee, D. E., & Schwartz, J. L. K. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.6.1464 · Cited by 9,210
Understanding and using the Implicit Association Test: I. An improved scoring algorithm.
Greenwald, A. G., Nosek, B. A., & Banaji, M. R. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.2.197 · Cited by 5,815
Emotional processing of fear: Exposure to corrective information.
Foa, E. B., & Kozak, M. J. (1986) · Psychological Bulletin · doi:10.1037/0033-2909.99.1.20 · Cited by 5,396 · cited 2×
“Words may provide an insufficiently strong threat cue to differentiate between high- and lowfearful individuals (cf. Foa & Kozak, 1986; Huijding & de Jong, 2005b).”
BackgroundCognitive Therapy of Depression
HOLLON, S. D., & BECK, A. T. (1979) · Cognitive-Behavioral Interventions · doi:10.1016/b978-0-12-404480-7.50012-5 · Cited by 4,685
Reflective and Impulsive Determinants of Social Behavior
Strack, F., & Deutsch, R. (2004) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0803_1 · Cited by 3,984 · cited 1×
“As reflected in dual-process models (e.g., Fazio & Towles-Schwen, 1999; Smith & DeCoster, 2000; Strack & Deutsch, 2004), both types of measures are true in the sense that both have predictive validity.”
MethodThe biopsychosocial approach to chronic pain: Scientific advances and future directions.
Gatchel, R. J., Peng, Y. B., Peters, M. L., Fuchs, P. N., & Turk, D. C. (2007) · Psychological Bulletin · doi:10.1037/0033-2909.133.4.581 · Cited by 3,392
Understanding and using the Implicit Association Test: III. Meta-analysis of predictive validity.
Greenwald, A. G., Poehlman, T. A., Uhlmann, E. L., & Banaji, M. R. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0015575 · Cited by 3,257
A cognitive-behavioral model of anxiety in social phobia
Rapee, R. M., & Heimberg, R. G. (1997) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(97)00022-3 · Cited by 2,987 · cited 1×
“From a cognitive perspective, symptoms are a result of dysfunctional beliefs regarding danger of rejection and failure in social situations and a negative sense of self-esteem (e.g., D. M. Clark & Wells, 1995; Rapee & Heimberg, 1997).”
BackgroundSelf-reports: How the questions shape the answers.
Schwarz, N. (1999) · American Psychologist · doi:10.1037/0003-066x.54.2.93 · Cited by 2,846 · cited 1×
“Explicit measures are also subject to other criticisms, including their sensitivity to socially desirable answering tendencies and the fact that people sometimes may dismiss as irrelevant cognitions that actually are relevant (Schwarz, 1999; Schwarz & Oyserman, 2001).”
BackgroundOn the automatic activation of attitudes.
Fazio, R. H., Sanbonmatsu, D. M., Powell, M. C., & Kardes, F. R. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.50.2.229 · Cited by 2,584
Fear of movement/(re)injury in chronic low back pain and its relation to behavioral performance
Vlaeyen, J. W. S., Kole-Snijders, A. M. J., Boeren, R. G. B., & van Eek, H. (1995) · Pain · doi:10.1016/0304-3959(94)00279-n · Cited by 2,446
Clark, D. M. (1986) · Behaviour Research and Therapy · doi:10.1016/0005-7967(86)90011-2 · Cited by 2,422 · cited 2×
“Implicit measures are expected to reflect associations between the self and panic, indicating a panic self-schema (Teachman, 2005), and between bodily sensations and catastrophic outcomes (D. M. Clark, 1986).”
BackgroundThe emotional Stroop task and psychopathology
Williams, J. M. G., Mathews, A., & MacLeod, C. (1996) · Psychological Bulletin · doi:10.1037/0033-2909.120.1.3 · Cited by 2,420
Self-citationDrinking to regulate positive and negative emotions: A motivational model of alcohol use
Cooper, M. L., Frone, M. R., Russell, M., & Mudar, P. (1995) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.69.5.990 · Cited by 1,975
Obsessional-compulsive problems: A cognitive-behavioural analysis
Salkovskis, P. M. (1985) · Behaviour Research and Therapy · doi:10.1016/0005-7967(85)90105-6 · Cited by 1,842
Fazio, R. H., Jackson, J. R., Dunton, B. C., & Williams, C. J. (1995) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.69.6.1013 · Cited by 1,793 · cited 1×
“…20 08 ) ex -p at ie nt sc (1 9) 1 – 2 IA T 1 m e– no t m e 1 – 2 sa d– ha pp y 1 # .4 1b to # .2 6 1 in co ng ru en t d % c he al th yc (2 3) 2 fu tu re –p as t 2 # .1 8 to .2 5 2 in co ng ru en t d ! c /m oo d in du ct io n 1 re du ce d by m oo d in du ct io n in he al th y 2 no ef fe ct m oo…”
A review of psychological risk factors in back and neck pain
Linton, S. J. (2000) · Spine · doi:10.1097/00007632-200005010-00017 · Cited by 1,776
Hofmann, W., Gawronski, B., Gschwendner, T., Le, H., & Schmitt, M. (2005) · Personality and Social Psychology Bulletin · doi:10.1177/0146167205275613 · Cited by 1,642
Chen, M., & Bargh, J. A. (1999) · Personality and Social Psychology Bulletin · doi:10.1177/0146167299025002007 · Cited by 1,473
Using the implicit association test to measure self-esteem and self-concept
Greenwald, A. G., & Farnham, S. D. (2000) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.79.6.1022 · Cited by 1,393 · cited 1×
“As Greenwald and Farnham (2000) acknowledged, the original IAT can yield only relative strength measures.”
BackgroundAn information processing model of anxiety: Automatic and strategic processes
Beck, A. T., & Clark, D. A. (1997) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(96)00069-1 · Cited by 1,317
A cognitive theory of obsessions
Rachman, S. (1997) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(97)00040-5 · Cited by 1,179 · cited 13×
“OCD is characterized by the occurrence and recurrence of persistent thoughts, impulses, or images that are experienced as intrusive and inappropriate (obsessions) and/or repetitive behaviors aimed at preventing or neutralizing feared events (compulsions) (American Psychiatric Association, 2000).”
InfluentialAbnormal and normal obsessions
Rachman, S., & de Silva, P. (1978) · Behaviour Research and Therapy · doi:10.1016/0005-7967(78)90022-0 · Cited by 1,160
Dietary fat intake does affect obesity!
Bray, G. A., & Popkin, B. M. (1998) · The American Journal of Clinical Nutrition · doi:10.1093/ajcn/68.6.1157 · Cited by 1,123 · cited 1×
“…be related to a perception of high-caloric foods—often forbidden in diets—as being extra desirable (Gendall & Joyce, 2001; Stice, 2002), consistent with a large literature suggesting that the consumption of a high-fat diet plays a major role in obesity (e.g., Bray & Popkin, 1998; Jéquier, 2002).”
BackgroundThe Single Category Implicit Association Test as a measure of implicit social cognition.
Karpinski, A., & Steinman, R. B. (2006) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.91.1.16 · Cited by 1,108 · cited 4×
“The SC-IAT uses only one target category (e.g., alcohol; Karpinski & Steinman, 2006).”
BackgroundMethodResultInfluentialImplicit attitude measures: Consistency, stability, and convergent validity
Cunningham, W. A., Preacher, K. J., & Banaji, M. R. (2001) · Psychological Science · doi:10.1111/1467-9280.00328 · Cited by 968
Psychological aspects of persistent pain: Current state of the science
Keefe, F. J., Rumble, M. E., Scipio, C. D., Giordano, L. A., & Perri, L. M. (2004) · The Journal of Pain · doi:10.1016/j.jpain.2004.02.576 · Cited by 954
Causes of sexual dysfunction: The role of anxiety and cognitive interference.
Barlow, D. H. (1986) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.54.2.140 · Cited by 896 · cited 1×
“According to a cognitive perspective, fear of pain results in sexual problems (Barlow, 1986).”
BackgroundModerators of the Relationship Between Implicit and Explicit Evaluation.
Nosek, B. A. (2005) · Journal of Experimental Psychology: General · doi:10.1037/0096-3445.134.4.565 · Cited by 701
Arbitrary metrics in psychology
Blanton, H., & Jaccard, J. (2006) · American Psychologist · doi:10.1037/0003-066x.61.1.27 · Cited by 681
(2001) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(00)00085-1 · Cited by 590
Hofmann, W., Gschwendner, T., Friese, M., Wiers, R. W., & Schmitt, M. (2008) · Journal of Personality and Social Psychology · doi:10.1037/a0012705 · Cited by 524
Self-citation(2003) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(02)00099-2 · Cited by 500
Handbook of Implicit Cognition and Addiction
Wiers, R., & Stacy, A. (2006) · doi:10.4135/9781412976237 · Cited by 474
Self-citationMogg, K., Bradley, B. P., Field, M., & De Houwer, J. (2003) · Addiction · doi:10.1046/j.1360-0443.2003.00392.x · Cited by 455 · cited 1×
“…evidence was obtained with an SRC task: Although participants were faster overall to approach smoking pictures and avoid neutral pictures than vice versa, this approach bias was significantly stronger in smokers than in nonsmokers (Bradley, Field, Mogg, & De Houwer, 2004; Mogg et al., 2003).”
MethodWhy do implicit and explicit attitude tests diverge? The role of structural fit.
Payne, B. K., Burkley, M. A., & Stokes, M. B. (2008) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.94.1.16 · Cited by 401
Avoidance of emotional facial expressions in social anxiety: the approach-avoidance task
Heuer, K., Rinck, M., & Becker, E. S. (2007) · Behaviour Research and Therapy · doi:10.1016/j.brat.2007.08.010 · Cited by 380
Relatively strong automatic appetitive action‐tendencies in male carriers of the OPRM1 G‐allele
Wiers, R. W., Rinck, M., Dictus, M., & Van Den Wildenberg, E. (2009) · Genes, Brain and Behavior · doi:10.1111/j.1601-183x.2008.00454.x · Cited by 377 · cited 1×
“Summaries are included where there is a sufficiently large literature.”
BackgroundSelf-citationSocial phobia and social appraisal in successful and unsuccessful social interactions
Alden, L. E., & Wallace, S. T. (1995) · Behaviour Research and Therapy · doi:10.1016/0005-7967(94)00088-2 · Cited by 336 · cited 1×
“…evaluation than do healthy and clinical control groups (e.g., Heimberg, Hope, Rapee, & Bruch, 1988), (b) underestimate the quality of their social performance (Alden & Wallace, 1995), and (c) tend to evaluate even positive social situations as threatening (Alden, Taylor, Mellings, & Laposa, 2008).”
BackgroundThush, C., Wiers, R. W., Ames, S. L., Grenard, J. L., Sussman, S., & Stacy, A. W. (2008) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2007.10.019 · Cited by 282 · cited 4×
“Finally, another interesting and promising approach has been the study of moderating variables of the relation between implicit measures and behavior in the context of eating behavior (e.g., Hofmann et al., 2009) and problem drinking (e.g., Thush et al., 2008).”
BackgroundResultInfluentialSelf-citationAutomatic processing in spider phobia: Implicit fear associations over the course of treatment.
Teachman, B. A., & Woody, S. R. (2003) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.112.1.100 · Cited by 258
Challenging implicit and explicit alcohol-related cognitions in young heavy drinkers
Wiers, R. W., Van De Luitgaarden, J., Van Den Wildenberg, E., & Smulders, F. T. Y. (2005) · Addiction · doi:10.1111/j.1360-0443.2005.01064.x · Cited by 238 · cited 4×
“In an IAT contrasting alcohol with soft drinks and arousal with sedation, heavy-drinking students (Wiers et al., 2002, 2005) and alcohol-abuse patients (De Houwer et al., 2004) had stronger arousal associations than sedation associations with alcohol than they did with soft drinks.”
BackgroundInfluentialSelf-citationMood-induced changes on the implicit association test in recovered depressed patients
Gemar, M. C., Segal, Z. V., Sagrati, S., & Kennedy, S. J. (2001) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.110.2.282 · Cited by 227 · cited 2×
“Gemar et al. (2001) used an IAT to measure self-esteem before and after a negative mood induction in healthy controls and formerly depressed individuals.”
BackgroundMethodArntz, A., Lavy, E., van den Berg, G., & van Rijsoort, S. (1993) · Advances in Behaviour Research and Therapy · doi:10.1016/0146-6402(93)90012-q · Cited by 192
Social anxiety and the interpretation of positive social events
Alden, L. E., Taylor, C. T., Mellings, T. M. J. B., & Laposa, J. M. (2008) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2007.05.007 · Cited by 177
Selective processing of cannabis cues in regular cannabis users
Field, M., Eastwood, B., Bradley, B. P., & Mogg, K. (2006) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2006.03.018 · Cited by 170
de Jong, P. J., & Muris, P. (2002) · Journal of Anxiety Disorders · doi:10.1016/s0887-6185(01)00089-5 · Cited by 136 · cited 1×
“Implicit measures are therefore expected to reflect negative associations with these objects of fear (de Jong & Muris, 2002).”
BackgroundConner, M. T., Perugini, M., O'Gorman, R., Ayres, K., & Prestwich, A. (2007) · Personality and Social Psychology Bulletin · doi:10.1177/0146167207309194 · Cited by 129
Automatic associations and panic disorder: Trajectories of change over the course of treatment.
Teachman, B. A., Marker, C. D., & Smith-Janik, S. B. (2008) · Journal of Consulting and Clinical Psychology · doi:10.1037/a0013113 · Cited by 113 · cited 2×
“Interestingly, for panic disorder, cognitive changes preceded symptom reduction (Teachman et al., 2008).”
BackgroundImplicit and explicit measures of alcohol and smoking cognitions.
McCarthy, D. M., & Thompsen, D. M. (2006) · Psychology of Addictive Behaviors · doi:10.1037/0893-164x.20.4.436 · Cited by 91
Conceptualizing Personal and Extrapersonal Associations
Olson, M. A., Fazio, R. H., & Han, H. A. (2009) · Social and Personality Psychology Compass · doi:10.1111/j.1751-9004.2008.00164.x · Cited by 29
Cited by
Fonagy, P., Luyten, P., Moulton-Perkins, A., Lee, Y.-W., Warren, F., Howard, S., Ghinai, R., Fearon, P., & Lowyck, B. (2016) · PLOS ONE · doi:10.1371/journal.pone.0158678 · Cited by 754
“Limitations in self-knowledge and consequent biases associated with assessment of personality features through self-report questionnaires are well demonstrated [28].”
BackgroundWiers, R. W., Gladwin, T. E., Hofmann, W., Salemink, E., & Ridderinkhof, K. R. (2013) · Clinical Psychological Science · doi:10.1177/2167702612466547 · Cited by 486
“Despite these issues, the overall picture is that many studies have demonstrated that implicit and explicit measures predict unique variance in addictive behaviors, as two metaanalyses have shown (Reich, Below, & Goldman, 2010), with similar findings in other forms of psychopathology (Roefs et al., 2011).”
BackgroundResultInfluentialSelf-citationLoijen, A., Vrijsen, J. N., Egger, J. I. M., Becker, E. S., & Rinck, M. (2020) · Clinical Psychology Review · doi:10.1016/j.cpr.2020.101825 · Cited by 135
Automaticity in anxiety disorders and major depressive disorder
Teachman, B. A., Joormann, J., Steinman, S. A., & Gotlib, I. H. (2012) · Clinical Psychology Review · doi:10.1016/j.cpr.2012.06.004 · Cited by 130
“By changing the category labels and associated stimuli, this paradigm can be adapted to reflect a range of psychopathology-relevant associations (see De Houwer, 2002; Roefs et al., 2011; Teachman & Woody, 2004).”
BackgroundMethodFietta, V., Zecchinato, F., Stasi, B. D., Polato, M., & Monaro, M. (2022) · IEEE Transactions on Human-Machine Systems · doi:10.1109/thms.2021.3125280 · Cited by 81
Metadata
- Authors
- Roefs, A., Huijding, J., Smulders, F. T. Y., MacLeod, C. M., de Jong, P. J., Wiers, R. W., & Jansen, A. T. M.
- Venue
- Psychological Bulletin
- Published
- 2011-01
- Volume
- 137
- Issue
- 1
- Pages
- 149-193
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2160435594
- Cited by
- 228
- References
- 53
- FWCI
- 30.05
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.