The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
More reasons to be straightforward: Findings and norms for two scales relevant to social anxiety
Open accessAbstract
The validity of both the Social Interaction Anxiety Scale and Brief Fear of Negative Evaluation scale has been well-supported, yet the scales have a small number of reverse-scored items that may detract from the validity of their total scores. The current study investigates two characteristics of participants that may be associated with compromised validity of these items: higher age and lower levels of education. In community and clinical samples, the validity of each scale's reverse-scored items was moderated by age, years of education, or both. The straightforward items did not show this pattern. To encourage the use of the straightforward items of these scales, we provide normative data from the same samples as well as two large student samples. We contend that although response bias can be a substantial problem, the reverse-scored questions of these scales do not solve that problem and instead decrease overall validity.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Participants exhibited elevated symptoms of social anxiety (LSAS, M = 80.48, SD = 15.71; SIAS-SF, M = 45.86, SD = 6.90) comparable to treatment-seeking samples reported in prior research (e.g., Clark et al., 2006; Rodebaugh et al., 2011).”
From The affective tie that binds: Examining the contribution of positive emotions and anxiety to relationship formation in social anxiety disorder (2017) · cites this paper as Rodebaugh et al., 2011
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. B. (2013) · Oxford University Press eBooks · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,845
Multiple regression: testing and interpreting interactions
(1992) · Choice Reviews Online · doi:10.5860/choice.29-3352 · Cited by 36,647
The processing-speed theory of adult age differences in cognition
Salthouse, T. A. (1996) · Psychological Review · doi:10.1037/0033-295x.103.3.403 · Cited by 5,902 · cited 1×
“Increasing age is correlated with decreases in cognitive abilities such as explicit memory, reasoning, and processing speed (Salthouse, 1996, 2000; Schaie & Willis, 1993).”
BackgroundMeasurement of social-evaluative anxiety.
Watson, D., & Friend, R. (1969) · Journal of Consulting and Clinical Psychology · doi:10.1037/h0027806 · Cited by 3,467 · cited 1×
“The BFNE (Leary, 1983) is a 12-item measure based on the original Fear of Negative Evaluation scale (FNE; Watson & Friend, 1969) and employing a 1 (not at all) to 5 (extremely) Likert-type scale.”
MethodMattick, R. P., & Clarke, J. C. (1998) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(97)10031-6 · Cited by 3,367 · cited 2×
“The Brief Fear of Negative Evaluation scale (BFNE; Leary, 1983) and the Social Interaction Anxiety Scale (SIAS; Mattick & Clarke, 1998) both have a small number of reverse-scored items that have demonstrated problematic reliability and validity across multiple studies (Carleton et al., 2009; Duke,…”
BackgroundMethodBeckman, R. J., & Weisberg, S. (1987) · Technometrics · doi:10.2307/1269895 · Cited by 2,835
Diagnostic and Statistical Manual of Mental Disorders
Raber, G., & Spokas, M. (2024) · doi:10.4135/9781071886229.n145 · Cited by 2,806
Amelia II: A Program for Missing Data
Honaker, J., King, G., & Blackwell, M. (2011) · Journal of Statistical Software · doi:10.18637/jss.v045.i07 · Cited by 2,552
A brief version of the Fear of Negative Evaluation Scale
Leary, M. R. (1983) · Personality and Social Psychology Bulletin · doi:10.1177/0146167283093007 · Cited by 2,178 · cited 3×
“The measure related highly to the FNE and demonstrated very good test-retest reliability, internal consistency, and convergent validity (Leary, 1983).”
BackgroundMethodAging and measures of processing speed
Salthouse, T. A. (2000) · Biological Psychology · doi:10.1016/s0301-0511(00)00052-1 · Cited by 1,114 · cited 3×
“Increasing age is correlated with decreases in cognitive abilities such as explicit memory, reasoning, and processing speed (Salthouse, 1996, 2000; Schaie & Willis, 1993).”
BackgroundResultHigh Occurrence of Mood and Anxiety Disorders Among Older Adults
Byers, A. L., Yaffe, K. S., Covinsky, K. E., Friedman, M. B., & BRUCE, M. L. (2010) · Archives of General Psychiatry · doi:10.1001/archgenpsychiatry.2010.35 · Cited by 759 · cited 2×
“With the number of older adults increasing in the USA and the high occurrence of anxiety disorders in adults over the age of 55 (Byers et al., 2010), it is imperative to increase the field's understanding of the assessment of anxiety within older populations, particularly with regard to social anxiety disorder.”
BackgroundHeimberg, R. G., Mueller, G. P., Holt, C. S., Hope, D. A., & Liebowitz, M. R. (1992) · Behavior Therapy · doi:10.1016/s0005-7894(05)80308-9 · Cited by 740
Self-citationWeeks, J. W., Heimberg, R. G., Fresco, D. M., Hart, T. A., Turk, C. L., Schneier, F. R., & Liebowitz, M. R. (2005) · Psychological Assessment · doi:10.1037/1040-3590.17.2.179 · Cited by 557 · cited 9×
“The demonstration by Weeks et al. (2005) represents a single test of the hypothesis that reverse-scored questions (but not the J Anxiety Disord.”
BackgroundResultInfluentialBrown, E. J., Turovsky, J., Heimberg, R. G., Juster, H. R., Brown, T. A., & Barlow, D. H. (1997) · Psychological Assessment · doi:10.1037/1040-3590.9.1.21 · Cited by 506
Self-citationRodebaugh, T. L., Woods, C. M., Thissen, D. M., Heimberg, R. G., Chambless, D. L., & Rapee, R. M. (2004) · Psychological Assessment · doi:10.1037/1040-3590.16.2.169 · Cited by 477 · cited 3×
“Item response theory analyses suggest that it provides more information than the original FNE (Rodebaugh et al., 2004).”
BackgroundRodebaugh, T. L., Woods, C. M., & Heimberg, R. G. (2007) · Behavior Therapy · doi:10.1016/j.beth.2006.08.001 · Cited by 370 · cited 4×
“…questions function comparatively well for younger, better-educated participants; therefore, typical undergraduate student samples may underestimate the problems with these items (however, problems remain detectable even in such samples: e.g., Rodebaugh et al., 2007; Rodebaugh et al., 2006).”
BackgroundResultInfluentialSelf-citationThe MMPI-2/MMPI: An Interpretive Manual
Greene, R. L. (1980) · Medical Entomology and Zoology · Cited by 345
Brief Fear of Negative Evaluation scale—revised
Carleton, R. N., McCreary, D. R., Norton, P. J., & Asmundson, G. J. G. (2006) · Depression and Anxiety · doi:10.1002/da.20142 · Cited by 295
Brown, T. A. (2003) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(03)00059-7 · Cited by 289
The validity of the brief version of the Fear of Negative Evaluation Scale
Collins, K., Westra, H. A., Dozois, D. J. A., & Stewart, S. H. (2004) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2004.02.003 · Cited by 240
Social anxiety and fear of negative evaluation: Construct validity of the BFNE-II
Carleton, R. N., Collimore, K. C., & Asmundson, G. J. G. (2006) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2006.03.010 · Cited by 219 · cited 3×
“Presentation of other norms is rare; Carleton et al. (2007) provide some information on the straightforward items of the original BFNE for an undergraduate sample, and Rodebaugh et al.”
BackgroundReviving the Problem of Acquiescent Response Bias
Ray, J. J. (1983) · The Journal of Social Psychology · doi:10.1080/00224545.1983.9924470 · Cited by 187 · cited 1×
“More formal arguments have been made (e.g., Ray, 1983) that only completely balanced scales (i.e., with an equal number of straightforwardly worded and reverse-scored questions) can avoid certain response biases, because only such scales effectively counterbalance to avoid these biases.”
BackgroundThe factor structure and screening utility of the Social Interaction Anxiety Scale.
Rodebaugh, T. L., Woods, C. M., Heimberg, R. G., Liebowitz, M. R., & Schneier, F. R. (2006) · Psychological Assessment · doi:10.1037/1040-3590.18.2.231 · Cited by 185 · cited 4×
“Notably, research supports the unidimensionality of the straightforward and reverse-scored totals used here (e.g., Rodebaugh et al. 2006; Weeks et al. 2005); thus, we did not replicate the extensive past analyses (e.g., confirmatory factor analyses) here for the sake of conciseness.”
BackgroundInfluentialSelf-citationMMPI-2 random responding indices: Validation using a self-report methodology.
Berry, D. T. R., Wetter, M. W., Baer, R. A., Larsen, L. H., Clark, C. D., & Monroe, K. (1992) · Psychological Assessment · doi:10.1037/1040-3590.4.3.340 · Cited by 177 · cited 1×
“Such items have indeed been used with some success to detect such problems in MMPI and MMPI-2 responses (Baer, Wetter, & Berry, 1992; Berry et al., 1992; Blanchard, McGrath, Pogge, & Khadivi, 2003).”
BackgroundRefining and validating the Social Interaction Anxiety Scale and the Social Phobia Scale
Carleton, R. N., Collimore, K. C., Asmundson, G. J. G., McCabe, R. E., Rowa, K., & Antony, M. M. (2009) · Depression and Anxiety · doi:10.1002/da.20480 · Cited by 177 · cited 2×
“…Clarke, 1998) both have a small number of reverse-scored items that have demonstrated problematic reliability and validity across multiple studies (Carleton et al., 2009; Duke, Krishnan, Faith, & Storch, 2006; Rodebaugh, Woods, & Heimberg, 2007; Rodebaugh, Woods, Heimberg, Liebowitz, & Schneier,…”
BackgroundThe psychometric properties of the Brief Fear of Negative Evaluation Scale
Duke, D. C., Krishnan, M., Faith, M. A., & Storch, E. A. (2005) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2005.11.002 · Cited by 145
Schaie, K. W., & Willis, S. L. (1993) · Psychology and Aging · doi:10.1037/0882-7974.8.1.44 · Cited by 135 · cited 1×
“Increasing age is correlated with decreases in cognitive abilities such as explicit memory, reasoning, and processing speed (Salthouse, 1996, 2000; Schaie & Willis, 1993).”
BackgroundAmelia: A Program for Missing Data
Honaker, J., King, G., & Blackwell, M. (2007) · doi:10.32614/cran.package.amelia · Cited by 115
Detection of underreporting of psychopathology on the MMPI: A meta-analysis
Baer, R. A., Wetter, M. W., & Berry, D. T. R. (1992) · Clinical Psychology Review · doi:10.1016/0272-7358(92)90069-k · Cited by 98
Factor Structure of the Penn State Worry Questionnaire
Hazlett‐Stevens, H., Ullman, J. B., & Craske, M. G. (2004) · Assessment · doi:10.1177/1073191104269872 · Cited by 96
Outcomes of Subsyndromal Depression in Older Primary Care Patients
Grabovich, A., Lu, N., Tang, W., Tu, X. M., & Lyness, J. M. (2010) · American Journal of Geriatric Psychiatry · doi:10.1097/jgp.0b013e3181cb87d6 · Cited by 59 · cited 1×
“Moreover, even subthreshold mental health symptomatology can have negative effects on daily functioning and physical performance (Grabovich et al., 2010).”
BackgroundA Comparison of the PAI and MMPI-2 As Predictors of Faking Bad in College Students
Blanchard, D. D., McGrath, R. E., Pogge, D. L., & Khadivi, A. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8002_08 · Cited by 59
Woods, C. M., & Rodebaugh, T. L. (2005) · Psychological Assessment · doi:10.1037/1040-3590.17.3.385 · Cited by 9 · cited 1×
“…demonstrated problematic reliability and validity across multiple studies (Carleton et al., 2009; Duke, Krishnan, Faith, & Storch, 2006; Rodebaugh, Woods, & Heimberg, 2007; Rodebaugh, Woods, Heimberg, Liebowitz, & Schneier, 2006; Rodebaugh et al., 2004; Weeks et al., 2005; Woods & Rodebaugh, 2005).”
Self-citation
Cited by
Sorted by citations
Loneliness over time: The crucial role of social anxiety.
Lim, M. H., Rodebaugh, T. L., Zyphur, M. J., & Gleeson, J. F. M. (2016) · Journal of Abnormal Psychology · doi:10.1037/abn0000162 · Cited by 443
Self-citationSocial anxiety in young people: A prevalence study in seven countries
Jefferies, P., & Ungar, M. T. (2020) · PLoS ONE · doi:10.1371/journal.pone.0239133 · Cited by 413
“, 45] and found to accurately discriminate between clinical and non-clinical participants [53].”
BackgroundMethodWeidman, A. C., Fernandez, K. C., Levinson, C. A., Augustine, A. A., Larsen, R. J., & Rodebaugh, T. L. (2012) · Personality and Individual Differences · doi:10.1016/j.paid.2012.03.003 · Cited by 286
“Participants completed the 17 straightforward items of the Social Interaction Anxiety Scale (S-SIAS; Mattick & Clarke, 1998; Rodebaugh et al., 2011); items are on a 1 (Very inaccurate) to 5 (Very accurate) scale (M = 2.”
BackgroundMethodInfluentialSelf-citationRodebaugh, T. L., Tonge, N., Piccirillo, M. L., Fried, E. I., Horenstein, A., Morrison, A. S., Goldin, P. R., Gross, J. J., Lim, M. H., Fernandez, K. C., et al. (2018) · Journal of Consulting and Clinical Psychology · doi:10.1037/ccp0000336 · Cited by 245
“Furthermore, it has displayed strong construct validity in both undergraduate and clinical samples, as well as strong convergent validity with other measures of social anxiety and divergent validity with other psychological or personality constructs (Rodebaugh et al., 2007, 2011).”
Self-citationLevinson, C. A., Rodebaugh, T. L., White, E. K., Menatti, A. R., Weeks, J. W., McClendon, J., & Warren, C. S. (2013) · Appetite · doi:10.1016/j.appet.2013.04.002 · Cited by 198
“85; 22% of participants scored above the cutoff, which is similar to what has been reported in other undergraduate samples) (Rodebaugh et al., 2011).”
BackgroundResultInfluentialSelf-citation
Metadata
- Authors
- Rodebaugh, T. L., Heimberg, R. G., Brown, P. J., Fernandez, K. C., Blanco, C., Schneier, F. R., & Liebowitz, M. R.
- Affiliations
- Washington University in St. Louis (US)
- Temple University (US)
- New York State Psychiatric Institute (US)
- Corresponding author
- Rodebaugh, Thomas L.
- ORCID
- Venue
- Journal of Anxiety Disorders
- Publisher
- Elsevier BV
- Published
- 2011-06
- Volume
- 25
- Issue
- 5
- Pages
- 623-630
- ISSN
- 0887-6185 (ISSN-L)
- PMC
- PMC3090265
- OpenAlex
- W2002440697
- Cited by
- 200
- References
- 33
- Citations by year
- 2026: 5 · 2025: 5 · 2024: 11 · 2023: 14 · 2022: 4 · 2021: 17 · 2020: 23 · 2019: 33 · 2018: 8 · 2017: 8 · 2016: 18 · 2015: 19 · 2014: 16 · 2013: 11 · 2012: 5
- FWCI
- 14.43
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Journal of Anxiety Disorders (publishedVersion)
- PubMed (publishedVersion)
- Europe PMC (PubMed Central) (acceptedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institute on Aging (T32AG00030, T32AG000030)
- National Institute of Mental Health (T32MH020004, T32 MH 20004, R01MH064726, K23MH099097, R01MH064481)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Keywords
- social anxiety, Social Interaction Anxiety Scale, response bias, scale validity, age differences, educational attainment, reference values
- MeSH terms
- Adolescent, Adult, Age Factors, Aged, Aged, 80 and over, Anxiety, Female, Humans, Male, Middle Aged, Phobic Disorders, Psychiatric Status Rating Scales, Psychometrics, Surveys and Questionnaires, Reference Values, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
