Two Replicable Suppressor Situations in Personality Research
The DOI matches its Crossref record; 79 of the 81 references it cites were found in a registry or an index.
Abstract
Suppressor situations occur when the simultaneous inclusion of two predictors improves one or both validities. A common allegation is that suppressor effects rarely replicate and have little substantive import. We present substantive examples from two established research domains to counter this skepticism. In the first domain, we show how measures of guilt and shame act consistently as mutual suppressors: Adding shame into a regression equation increases the negative association between guilt and aggression, whereas adding guilt increases the positive association between shame and aggression. In the second domain, we show how the effects of self-esteem and narcissism operate consistently as mutual suppressors: That is, adding narcissism into a regression equation increases the negative association between self-esteem and antisocial behavior, whereas adding self-esteem increases the positive association between narcissism and antisocial behavior. Discussion addresses the different implications for suppressors in theoretical and variable selection applications.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“We replicated the prior findings (i.e., suppressor situation; Paulhus et al., 2004), demonstrating directionally opposite causal effects of loneliness on nostalgia and perceived social support.”
From To Nostalgize (2015) · cites this paper as Paulhus et al., 2004
In the citing paper
“Paulhus et al. (2004) demonstrated that these situations are replicable”
From The mnemonic mover: Nostalgia regulates avoidance and approach motivation (2014) · cites this paper as Paulhus et al., 2004
In the citing paper
“In summary, when BIS and nostalgia jointly predicted Fun Seeking and Drive, the negative association of BIS with these BAS-related dimensions was strengthened and became significant (i.e., a suppressor situation; Paulhus et al., 2004).”
From The mnemonic mover: Nostalgia regulates avoidance and approach motivation (2014) · cites this paper as Paulhus et al., 2004
In the citing paper
“The regulatory model therefore predicts that, when the opposing indirect effect via nostalgia is controlled, the partial negative direct effect of avoidance motivation on approach motivation (path c') is strengthened”
From The mnemonic mover: Nostalgia regulates avoidance and approach motivation (2014) · cites this paper as Paulhus et al., 2004
In the citing paper
“When BIS and nostalgia jointly predicted Reward Responsiveness, the positive association of BIS with this BASrelated dimension was weakened but remained significant (i.e., a redundancy situation; Paulhus et al., 2004).”
From The mnemonic mover: Nostalgia regulates avoidance and approach motivation (2014) · cites this paper as Paulhus et al., 2004
2 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Baron, R. M., & Kenny, D. A. (1986) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.51.6.1173 · Cited by 91,532
Society and the Adolescent Self-Image
Rosenberg, M. (1965) · doi:10.1515/9781400876136 · Cited by 30,126
Intraclass correlations: Uses in assessing rater reliability.
Shrout, P. E., & Fleiss, J. L. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.2.420 · Cited by 24,532
Mediation in experimental and nonexperimental studies: New procedures and recommendations.
Shrout, P. E., & Bolger, N. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.4.422 · Cited by 11,335
A comparison of methods to test mediation and other intervening variable effects
MacKinnon, D. P., Lockwood, C. M., Hoffman, J. M., West, S. G., & Sheets, V. (2002) · Psychological Methods · doi:10.1037/1082-989x.7.1.83 · Cited by 9,406
The dark triad of personality: Narcissism, Machiavellianism, and psychopathy
Paulhus, D. L., & Williams, K. M. (2002) · Journal of Research in Personality · doi:10.1016/s0092-6566(02)00505-6 · Cited by 5,265
Self-citationEquivalence of the Mediation, Confounding and Suppression Effect
MacKinnon, D. P., Krull, J. L., & Lockwood, C. M. (2000) · Prevention Science · doi:10.1023/a:1026595011371 · Cited by 4,188
Baumeister, R. F., Campbell, J. D., Krueger, J. I., & Vohs, K. D. (2003) · Psychological Science in the Public Interest · doi:10.1111/1529-1006.01431 · Cited by 3,893
(1982) · Cited by 3,737
Measurement and Control of Response Bias
Paulhus, D. L. (1991) · Measures of Personality and Social Psychological Attitudes · doi:10.1016/b978-0-12-590241-0.50006-x · Cited by 3,598
Self-citationMeasures of Personality and Social Psychological Attitudes
(1991) · Elsevier eBooks · doi:10.1016/c2013-0-07551-2 · Cited by 3,216
An inventory for assessing different kinds of hostility.
Buss, A. H., & Durkee, A. (1957) · Journal of Consulting Psychology · doi:10.1037/h0046900 · Cited by 2,575
(2014) · Fundamentals of Psychology · doi:10.4324/9781315736945-36 · Cited by 2,224
Leon, R. L. (1974) · Journal of the American Academy of Child Psychiatry · doi:10.1016/s0002-7138(09)61341-8 · Cited by 2,081
Tangney, J. P., & Dearing, R. L. (2002) · Medical Entomology and Zoology · Cited by 2,063
TARGET ARTICLE: "Putting the Self Into Self-Conscious Emotions: A Theoretical Model"
Tracy, J. L., & Robins, R. W. (2004) · Psychological Inquiry · doi:10.1207/s15327965pli1502_01 · Cited by 1,445
Self-citationPersonality and Prediction: Principles of Personality Assessment
Wiggins, J. S. (1973) · Medical Entomology and Zoology · Cited by 1,244
Multiple regression in psychological research and practice.
Darlington, R. B. (1968) · Psychological Bulletin · doi:10.1037/h0025471 · Cited by 1,132
Interpersonal and intrapsychic adaptiveness of trait self enhancement: a mixed blessing?
Paulhus, D. L. (1998) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.74.5.1197 · Cited by 1,114
Self-citationMeasurement Theory for the Behavioral Sciences.
Elliott, G. C., Ghiselli, E. E., Campbell, J. P., & Zedeck, S. (1982) · Contemporary Sociology · doi:10.2307/2067145 · Cited by 1,011
John, O. P., & Robins, R. W. (1994) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.66.1.206 · Cited by 1,010
Self-citationSome New Results on Indirect Effects and Their Standard Errors in Covariance Structure Models
Sobel, M. E. (1986) · Sociological Methodology · doi:10.2307/270922 · Cited by 1,006
Role of social desirability in personality testing for personnel selection: The red herring.
Ones, D. S., Viswesvaran, C., & Reiss, A. D. (1996) · Journal of Applied Psychology · doi:10.1037//0021-9010.81.6.660 · Cited by 924
(2002) · Encyclopedia of Crime and Punishment · doi:10.4135/9781412950664.n388 · Cited by 889
Paulhus, D. L., & John, O. P. (1998) · Journal of Personality · doi:10.1111/1467-6494.00041 · Cited by 853
Self-citationProneness to shame, proneness to guilt, and psychopathology.
Tangney, J. P., Wagner, P., & Gramzow, R. H. (1992) · Journal of Abnormal Psychology · doi:10.1037//0021-843x.101.3.469 · Cited by 790
Twenge, J. M., & Campbell, W. K. (2003) · Personality and Social Psychology Bulletin · doi:10.1177/0146167202239051 · Cited by 776
A Revised Definition for Suppressor Variables: a Guide To Their Identification and Interpretation
Conger, A. J. (1974) · Educational and Psychological Measurement · doi:10.1177/001316447403400105 · Cited by 702
Raskin, R., & Hall, C. S. (1981) · Journal of Personality Assessment · doi:10.1207/s15327752jpa4502_10 · Cited by 622
Shamed into anger? The relation of shame and guilt to anger and self-reported aggression.
Tangney, J. P., Wagner, P., Fletcher, C., & Gramzow, R. (1992) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.62.4.669 · Cited by 620
Tangney, J. P., Wagner, P. E., Hill-Barlow, D., Marschall, D. E., & Gramzow, R. (1996) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.70.4.797 · Cited by 618
The over-claiming technique: Measuring self-enhancement independent of ability.
Paulhus, D. L., Harms, P. D., Bruce, M. N., & Lysy, D. C. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.84.4.890 · Cited by 521
Self-citationThe Next Generation of Moderator Research in Personality Psychology
Chaplin, W. F. (1991) · Journal of Personality · doi:10.1111/j.1467-6494.1991.tb00772.x · Cited by 513
External validity of "trivial" experiments: The case of laboratory aggression.
Anderson, C. A., & Bushman, B. J. (1997) · Review of General Psychology · doi:10.1037//1089-2680.1.1.19 · Cited by 508
Comparative analysis of the reliability of job performance ratings.
Viswesvaran, C., Ones, D. S., & Schmidt, F. L. (1996) · Journal of Applied Psychology · doi:10.1037/0021-9010.81.5.557 · Cited by 505
The impact of response distortion on preemployment personality testing and hiring decisions.
Rosse, J. G., Stecher, M. D., Miller, J. L., & Levin, R. A. (1998) · Journal of Applied Psychology · doi:10.1037//0021-9010.83.4.634 · Cited by 486
Herriott, R. E., & Rosenberg, M. (1969) · American Educational Research Journal · doi:10.2307/1162260 · Cited by 458
The Association between Anxiety and Psychopathy Dimensions in Children
Frick, P. J., Lilienfeld, S. O., Ellis, M., Loney, B., & Silverthorn, P. (1999) · Journal of Abnormal Child Psychology · doi:10.1023/a:1021928018403 · Cited by 455
Suppression situations in psychological research: Definitions, implications, and applications
Tzelgov, J., & Henik, A. (1991) · Psychological Bulletin · doi:10.1037/0033-2909.109.3.524 · Cited by 424
The Six Pillars of Self-Esteem
Branden, N. (1994) · Medical Entomology and Zoology · Cited by 419
Suppressor Variables in Path Models: Definitions and Interpretations
MAASSEN, G. H., & BAKKER, A. B. (2001) · Sociological Methods & Research · doi:10.1177/0049124101030002004 · Cited by 407
Stuart, M., & Davis, J. A. (1987) · The Statistician · doi:10.2307/2348867 · Cited by 348
Salmivalli, C., Kaukiainen, A., Kaistaniemi, L., & Lagerspetz, K. M. J. (1999) · Personality and Social Psychology Bulletin · doi:10.1177/0146167299258008 · Cited by 329
Davis, J. (1985) · Sage eBooks · doi:10.4135/9781412986212 · Cited by 323
Rater bias in performance ratings: Superior, self-, and peer ratings.
Holzbach, R. L. (1978) · Journal of Applied Psychology · doi:10.1037/0021-9010.63.5.579 · Cited by 249
McNemar, Q. (1949) · Bibliothèque et Archives nationales du Québec (Québec government) · Cited by 227
Robins, R. W., & John, O. P. (1997) · Handbook of Personality Psychology · doi:10.1016/b978-012134645-4/50026-3 · Cited by 206
Self-citationSuppressor Variables in Multiple Regression/Correlation
Smith, R. L., Ager, J. W., & Williams, D. L. (1992) · Educational and Psychological Measurement · doi:10.1177/001316449205200102 · Cited by 142
Is satisfaction with self a measure of adjustment?
Block, J., & Thomas, H. F. (1955) · Journal of Abnormal & Social Psychology · doi:10.1037/h0048246 · Cited by 137
Methodological problems and issues in MMPI, MMPI-2, and MMPI-A research.
Butcher, J. N., Graham, J. R., & Ben‐Porath, Y. S. (1995) · Psychological Assessment · doi:10.1037/1040-3590.7.3.320 · Cited by 133
A model of personality test item response dissimulation.
Holden, R. R., Kroner, D. G., Fekken, G. C., & Popham, S. M. (1992) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.63.2.272 · Cited by 128
McFatter, R. M. (1979) · Applied Psychological Measurement · doi:10.1177/014662167900300113 · Cited by 115
Validation of the TOSCA to measure shame and guilt
Woien, S., Ernst, H. A. H., Patock‐Peckham, J. A., & Nagoshi, C. T. (2002) · Personality and Individual Differences · doi:10.1016/s0191-8869(02)00191-5 · Cited by 113
Social desirability scales as moderator and suppressor variables
Borkenau, P., & Ostendorf, F. (1992) · European Journal of Personality · doi:10.1002/per.2410060303 · Cited by 105
Good Impression, Social Desirability, and Acquiescence as Suppressor Variables
Dicken, C. F. (1963) · Educational and Psychological Measurement · doi:10.1177/001316446302300406 · Cited by 96
Evaluating Sources of Ego-Threatening Feedback: Self-Esteem and Narcissism Effects
Smalley, R. L., & Stake, J. E. (1996) · Journal of Research in Personality · doi:10.1006/jrpe.1996.0035 · Cited by 94
Suppressor Variables, Prediction, and the interpretation of Psychological Relationships
Conger, A. J., & Jackson, D. N. (1972) · Educational and Psychological Measurement · doi:10.1177/001316447203200303 · Cited by 90
Suppressor Variables and the Semipartial Correlation Coefficient
Velicer, W. F. (1978) · Educational and Psychological Measurement · doi:10.1177/001316447803800415 · Cited by 86
Demonstration of properties of a suppressor variable
Krus, D. J., & Wilkinson, S. M. (1986) · Behavior Research Methods, Instruments, & Computers · doi:10.3758/bf03200988 · Cited by 73
"Death of a (Narcissistic) Salesman:" An Integrative Model of Fragile Self-Esteem: Comment.
Tracy, J. L., & Robins, R. W. (2003) · Cited by 67
Self-citationThe character of self-enhancers: Implications for organizations.
Robins, R. W., & Paulhus, D. L. (2001) · American Psychological Association eBooks · doi:10.1037/10434-008 · Cited by 63
Self-citationPersonality assessment, 3rd ed.
Lanyon, R. I., & Goodstein, L. D. (1997) · Cited by 61
Response set as a suppressor variable in the OAIS and MMPI.
Fricke, B. G. (1956) · Journal of Consulting Psychology · doi:10.1037/h0040063 · Cited by 51
Some Formulae for Use With Suppressor Variables
Lubin, A. (1957) · Educational and Psychological Measurement · doi:10.1177/001316445701700209 · Cited by 43
Social Science Research Council
(1995) · Anthropology News · doi:10.1111/an.1995.36.7.34.8 · Cited by 37
A Simple Algebraic Development of Horst's Suppressor Variables
Meehl, P. E. (1945) · The American Journal of Psychology · doi:10.2307/1417770 · Cited by 31
Self-esteem, need for approval, and reactions to personal evaluations
Hewitt, J., & Goldman, M. (1974) · Journal of Experimental Social Psychology · doi:10.1016/0022-1031(74)90067-5 · Cited by 30
Aggregation, acquiescence, and the assessment of trait affectivity
Watson, D., & Tellegen, A. (2002) · Journal of Research in Personality · doi:10.1016/s0092-6566(02)00509-3 · Cited by 29
Effects of Two MMPI-2 Validity Scales on Basic Scale Relations to External Criteria
Archer, R. P., Fontaine, J. D. L., & McCrae, R. R. (1998) · Journal of Personality Assessment · doi:10.1207/s15327752jpa7001_6 · Cited by 28
Can Suppressor Variables Enhance Criterion-Related Validity in the Personality Domain?
Collins, J. M., & Schmidt, F. L. (1997) · Educational and Psychological Measurement · doi:10.1177/0013164497057006003 · Cited by 27
Suppressor Structures in the General Linear Model
Holling, H. (1983) · Educational and Psychological Measurement · doi:10.1177/001316448304300101 · Cited by 23
Crime, Violence, and Self-Esteem: Review and Proposals
Scheff, T. J., Retzinger, S. M., & Ryan, M. T. (1990) · University of California Press eBooks · doi:10.1525/9780520355033-007 · Cited by 22
Control of halo error: A multiple regression approach.
Henik, A., & Tzelgov, J. (1985) · Journal of Applied Psychology · doi:10.1037/0021-9010.70.3.577 · Cited by 19
A Definition of Suppression Situations for the General Linear Model: A Regression Weights Approach
Tzelgov, J., & Henik, A. (1985) · Educational and Psychological Measurement · doi:10.1177/001316448504500211 · Cited by 16
Comment on the use of moderator variables.
Ghiselli, E. Ε. (1972) · Journal of Applied Psychology · doi:10.1037/h0033091 · Cited by 15
Goldberg, L. R., Rorer, L. G., & Greene, M. M. (1970) · PsycEXTRA Dataset · doi:10.1037/e301622005-001 · Cited by 9
Two Additional Formulae for Use With Suppressor Variables
Chandler, R. E. (1961) · Educational and Psychological Measurement · doi:10.1177/001316446102100421 · Cited by 4
The antisocial individual: The negative consequences of low self-esteem and narcissism
Trzesniewski, K. H., Donnellan, M. B., Robins, R. W., & Paulhus, D. L. (2003) · PsycEXTRA Dataset · doi:10.1037/e633872013-870 · Cited by 2
Self-citation(1971) · PubMed
Research works printed but not linked: 14
- Baer, R. A., Rinaldo, J. C. & Berry, D. T. R. (2003). Response distortions in self-report assessment. In S. Ballesteros (Ed.), Encyclopedia of Psychological Assessment (pp. 132-133). London: Sage Publications.
- 10.1037//0022-3514.51.6.1173 · doi:10.1037//0022-3514.51.6.1173 · Paper page
- Cohen, J. & Cohen, P. (1975). Applied multiple correlation/regression analysis for the social sciences. New York: Wiley.
- 10.1037//0021-9010.70.3.577 · doi:10.1037//0021-9010.70.3.577
- 10.1037//0022-3514.63.2.272 · doi:10.1037//0022-3514.63.2.272
- 10.1037//0021-9010.63.5.579 · doi:10.1037//0021-9010.63.5.579 · Paper page
- 10.1037//1082-989X.7.1.83 · DOI · Paper page
- Mecca, A. M., Smelser, N. J. & Vasconellos, J. (Eds.). (1989). The social importance of selfesteem. Berkeley, CA: University of California Press.
- 10.1037//0021-9010.81.5.557 · doi:10.1037//0021-9010.81.5.557
- 10.1037//0022-3514.74.5.1197 · DOI · Paper page
- Paulhus D. L., 2001, Psychological Inquiry, 11, 222
- 10.1037//1082-989X.7.4.422 · DOI · Paper page
- 10.1037//0033-2909.86.2.420 · DOI · Paper page
- 10.1037//0033-2909.109.3.524 · DOI
Cited by
MacKinnon, D. P., Fairchild, A. J., & Fritz, M. S. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.58.110405.085542 · Cited by 5,688
Moral Emotions and Moral Behavior
Tangney, J. P., Stuewig, J., & Mashek, D. J. (2007) · Annual Review of Psychology · doi:10.1146/annurev.psych.56.091103.070145 · Cited by 3,222
Does low self-esteem predict depression and anxiety? A meta-analysis of longitudinal studies.
Sowislo, J. F., & Orth, U. (2013) · Psychological Bulletin · doi:10.1037/a0028931 · Cited by 2,123
Between facets and domains: 10 aspects of the Big Five.
DeYoung, C. G., Quilty, L. C., & Peterson, J. B. (2007) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.93.5.880 · Cited by 1,920
Akinwande, M. O., Dikko, H. G., & Samson, A. (2015) · Open Journal of Statistics · doi:10.4236/ojs.2015.57075 · Cited by 1,534
Metadata
- Authors
- Paulhus, D. L., Robins, R. W., Trzesniewski, K. H., & Tracy, J. L.
- Affiliations
- University of British Columbia (CA)
- University of California, Davis (US)
- Venue
- Multivariate Behavioral Research
- Publisher
- Informa UK Limited
- Published
- 2004-04
- Volume
- 39
- Issue
- 2
- Pages
- 303-328
- ISSN
- 0027-3171 (ISSN-L)
- 1532-7906
- OpenAlex
- W2056868472
- Cited by
- 631
- References
- 81
- Citations by year
- 2026: 38 · 2025: 28 · 2024: 25 · 2023: 23 · 2022: 32 · 2021: 31 · 2020: 35 · 2019: 48 · 2018: 45 · 2017: 38 · 2016: 35 · 2015: 32 · 2014: 36 · 2013: 37 · 2012: 28
- FWCI
- 12.88
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Multivariate Behavioral Research (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Psychology › Clinical Psychology › Personality Traits and Psychology
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Social Psychology › Emotions and Moral Behavior
- Keywords
- suppressor variables, replication, guilt, shame, aggression, self-esteem, narcissism, antisocial behavior, feature selection, personality predictors, suppressor effect
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.