Revising the BIS/BAS Scale to study development: Measurement invariance and normative effects of age and sex from childhood through adulthood.
Open accessThe DOI matches its Crossref record; 32 of the 32 references it cites were found in a registry or an index.
Abstract
Carver and White's (1994) Behavioral Inhibition System/Behavioral Activation System (BIS/BAS) Scales have been useful tools for studying individual differences in reward-punishment sensitivity; however, their factor structure and invariance across development have not been well tested. In the current study, we examined the factor structure of the BIS/BAS Scales across 5 age groups: 6- to 10-year-old children (N = 229), 11- to 13-year-old early adolescents (N = 311), 14- to 16-year-old late adolescents (N = 353), 18- to 22-year-old young adults (N = 844), and 30- to 45-year-old adults (N = 471). Given poor fit of the standard 4-factor model (BIS, Reward Responsivity, Drive, Fun Seeking) in the literature, we conducted exploratory factor analyses in half of the participants and identified problematic items across age groups. The 4-factor model showed poor fit in our sample, whereas removing the BAS Fun Seeking subscale and problematic items from the remaining subscales improved fit in confirmatory factor analyses conducted with the second half of the participants. The revised model showed strict invariance across age groups and by sex, indicating consistent factor structure, item loadings, thresholds, and unique or residual variances. Additionally, in our cross-sectional data, we observed nonlinear relations between age and subscale scores, where scores tended to be higher in young adulthood than in childhood and later adulthood. Furthermore, sex differences emerged across development; adolescent and adult females had higher BIS scores than males in this age range, whereas sex differences were not observed in childhood. These differences may help us to understand the rise in internalizing psychopathology in adolescence, particularly in females. Future developmental studies are warranted to examine the impact of rewording problematic items.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
lavaan : An R Package for Structural Equation Modeling
Rosseel, Y. (2012) · Journal of Statistical Software · doi:10.18637/jss.v048.i02 · Cited by 27,955
Evaluating Goodness-of-Fit Indexes for Testing Measurement Invariance
Cheung, G. W., & Rensvold, R. B. (2002) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem0902_5 · Cited by 16,280
Sensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217
Costello, A. B., & Osborne, J. (2005) · University of Massachusetts Amherst · doi:10.7275/jyj1-4868 · Cited by 10,297
Evaluating the use of exploratory factor analysis in psychological research.
Fabrigar, L. R., Wegener, D. T., MacCallum, R. C., & Strahan, E. J. (1999) · Psychological Methods · doi:10.1037/1082-989x.4.3.272 · Cited by 9,587
A Reliability Coefficient for Maximum Likelihood Factor Analysis
Tucker, L. R., & Lewis, C. (1973) · Psychometrika · doi:10.1007/bf02291170 · Cited by 7,330 · cited 1×
“While non-significant chi-squared tests can indicate good fit, they are sensitive to sample size and violations of normality assumptions and thus often falsely indicate poor model fit (Bollen, 1989; Tucker & Lewis, 1973).”
Carver, C. S., & White, T. L. (1994) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.67.2.319 · Cited by 7,306
Insel, T., Cuthbert, B., Garvey, M., Heinssen, R., Pine, D. S., Quinn, K., Sanislow, C., & Wang, P. (2010) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2010.09091379 · Cited by 7,067
The adolescent brain and age-related behavioral manifestations
Spear, L. P. (2000) · Neuroscience & Biobehavioral Reviews · doi:10.1016/s0149-7634(00)00014-2 · Cited by 5,433 · cited 1×
“Many behavioral changes associated with adolescence, such as increases in risk taking and affiliative behavior, have been linked to increases in reward responsivity thought to peak during this period (for reviews, see Galvan, 2010; Richards, Plate, & Ernst, 2013; Spear, 2000, 2011).”
Gender differences in personality: A meta-analysis.
Feingold, A. (1994) · Psychological Bulletin · doi:10.1037/0033-2909.116.3.429 · Cited by 2,240 · cited 1×
“This is consistent with other work suggesting that females tend to have higher neuroticism, anxiety, and extraversion scores, paralleling higher BIS and REWARD and also contributing to risk for certain forms of psychopathology (Feingold, 1994; McCrae, & Allik, 2002; McCrae, 2004).”
The Rediscovery of Bifactor Measurement Models
Reise, S. P. (2012) · Multivariate Behavioral Research · doi:10.1080/00273171.2012.715555 · Cited by 2,112 · cited 2×
“For example, we did not pursue hierarchical or bifactor models (for current guidelines, see Canivez ( in press ); Reise (2012)) currently, but given the observed factor correlations (see Supplement) this could be an interesting avenue for future investigation.”
A comparison of some methodologies for the factor analysis of non‐normal Likert variables
Muthén, B., & Kaplan, D. (1985) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.1985.tb00832.x · Cited by 1,778
The psychophysiological basis of introversion-extraversion
Gray, J. A. (1970) · Behaviour Research and Therapy · doi:10.1016/0005-7967(70)90069-0 · Cited by 1,558
Microstructural maturation of the human brain from childhood to adulthood
Lebel, C., Walker, L., Leemans, A., Phillips, L., & Beaulieu, C. (2008) · NeuroImage · doi:10.1016/j.neuroimage.2007.12.053 · Cited by 1,398
Longitudinal Development of Human Brain Wiring Continues from Childhood into Adulthood
Lebel, C., & Beaulieu, C. (2011) · Journal of Neuroscience · doi:10.1523/jneurosci.5302-10.2011 · Cited by 1,193
The Development of Hierarchical Factor Solutions
Schmid, J., & Leiman, J. M. (1957) · Psychometrika · doi:10.1007/bf02289209 · Cited by 1,098
Puberty and depression: the roles of age, pubertal status and pubertal timing.
ANGOLD, A., COSTELLO, E. J., & WORTHMAN, C. M. (1998) · Psychological Medicine · doi:10.1017/s003329179700593x · Cited by 989
Evaluating Dopamine Reward Pathway in ADHD: Clinical Implications
Volkow, N. D., Wang, G.-J., Kollins, S. H., Wigal, T. L., Newcorn, J. H., Telang, F., Fowler, J. S., Zhu, W., Logan, J., Ma, Y., et al. (2009) · JAMA · doi:10.1001/jama.2009.1308 · Cited by 728 · cited 2×
“Importantly, other incentive-processing research has linked alterations in reward–punishment responsivity to a variety of psychopathologies, including schizophrenia (Dowd & Barch, 2010), major depressive disorder (Eshel & Roiser, 2010), bipolar disorder (Urošević, Abramson, Harmon-Jones, & Alloy, 2008), anxiety disord…”
Reward and Punishment Processing in Depression
Eshel, N., & Roiser, J. P. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2010.01.027 · Cited by 575 · cited 1×
“…in reward/punishment responsivity to a variety of psychopathologies, including schizophrenia (Dowd & Barch, 2010), major depressive disorder (Eshel & Roiser, 2010), bipolar disorder (Urosevic, Abramson, Harmon-Jones, & Alloy, 2008), anxiety disorders (Johnson, Turner, & Iwata, 2003),…”
Adolescent development of the reward system
Galvan (2010) · Frontiers in Human Neuroscience · doi:10.3389/neuro.09.006.2010 · Cited by 521
BIS/BAS levels and psychiatric disorder: An epidemiological study
Johnson, S. L., Turner, R. J., & Iwata, N. (2003) · Journal of Psychopathology and Behavioral Assessment · doi:10.1023/a:1022247919288 · Cited by 458 · cited 5×
“relevance in the study of externalizing disorders (Colder & O'Connor, 2004) and substance use/abuse in adolescent populations (Hasking, 2007; Johnson et al., 2003; Loxton & Dawe, 2001).”
InfluentialBlunted neural response to rewards prospectively predicts depression in adolescent girls
Bress, J. N., Foti, D., Kotov, R., Klein, D. N., & Hajcak, G. (2013) · Psychophysiology · doi:10.1111/j.1469-8986.2012.01485.x · Cited by 317
Self-citationSpear, L. P. (2011) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2011.08.001 · Cited by 292
Campbell-Sills, L., Liverant, G. I., & Brown, T. A. (2004) · Psychological Assessment · doi:10.1037/1040-3590.16.3.244 · Cited by 280
Urošević, S., Collins, P., Muetzel, R., Lim, K., & Luciana, M. (2012) · Developmental Psychology · doi:10.1037/a0027502 · Cited by 258 · cited 3×
“In particular, females exhibited higher BIS scores, and this sex difference intensified from adolescence onward, a pattern also reported by Urosevic et al. (2012).”
Heym, N., Ferguson, E., & Lawrence, C. (2008) · Personality and Individual Differences · doi:10.1016/j.paid.2008.07.013 · Cited by 255
Neural response to reward and depressive symptoms in late childhood to early adolescence
Bress, J. N., Smith, E., Foti, D., Klein, D. N., & Hajcak, G. (2012) · Biological Psychology · doi:10.1016/j.biopsycho.2011.10.004 · Cited by 187 · cited 1×
“For example, adolescents with or at high risk for developing affective disorders tend to show reduced neural and behavioral responses to reward (Bress, Smith, Foti, Klein, & Hajcak, 2012; Forbes, Shaw, & Dahl, 2007; Foti, Kotov, Klein, & Hajcak, 2011; Gotlib et al., 2010; Olino et al., 2014).”
Self-citationAnhedonia and Emotional Experience in Schizophrenia: Neural and Behavioral Indicators
Dowd, E. C., & Barch, D. M. (2010) · Biological Psychiatry · doi:10.1016/j.biopsych.2009.10.020 · Cited by 184
Self-citationAlterations in reward-related decision making in boys with recent and future depression
Forbes, E. E., Shaw, D. S., & Dahl, R. E. (2007) · Biological Psychiatry · doi:10.1016/j.biopsych.2006.05.026 · Cited by 173
Enhanced striatal sensitivity to aversive reinforcement in adolescents versus adults
Galván, A., & McGlennen, K. M. (2013) · Journal of Cognitive Neuroscience · doi:10.1162/jocn_a_00326 · Cited by 111 · cited 1×
“…appetitive motivation and response to punishment/negative feedback will be fruitful for developmental researchers (for developmental studies investigating both reward and punishment/loss, see Barkley-Levenson, Van Leijenhorst, & Galvan, 2013; Galvan & McGlennen, 2013; Luking, Luby, & Barch, 2014).”
Psychometric properties of Carver and White's (1994) BIS/BAS Scales in a large sample of offenders
Poythress, N. G., Skeem, J. L., Weir, J., Lilienfeld, S. O., Douglas, K. S., Edens, J. F., & Kennealy, P. J. (2008) · Personality and Individual Differences · doi:10.1016/j.paid.2008.07.021 · Cited by 106 · cited 2×
“Freezing System (FFFS), (Beck, Smits, Claes, Vandereycken, & Bijttebier, 2009; Poythress et al., 2008; Johnson, Turner, & Iwata (2003). While a FFFS factor would characterize an interesting construct, given our results, we think that inconsistent/weak loading of BIS5 and BIS7 onto the larger BIS factor more likely rep…”
Cited by
Barch, D. M., Albaugh, M. D., Avenevoli, S., Chang, L., Clark, D. B., Glantz, M. D., Hudziak, J. J., Jernigan, T. L., Tapert, S. F., Yurgelun-Todd, D., et al. (2018) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2017.10.010 · Cited by 814
Self-citationKarcher, N. R., Barch, D. M., Avenevoli, S., Savill, M., Huber, R. S., Simon, T. J., Leckliter, I. N., Sher, K. J., & Loewy, R. L. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.1334 · Cited by 198
Self-citationLees, B., Mewton, L., Jacobus, J., Valadez, E. A., Stapinski, L. A., Teesson, M., Tapert, S. F., & Squeglia, L. M. (2020) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2020.20010086 · Cited by 185
“Motivation was examined using the four subscales of the behavioral avoidance and behavioral inhibition scales (23).”
MethodExploring influences on food choice in a large population sample: The Italian Taste project
Monteleone, E., Spinelli, S., Dinnella, C., Endrizzi, I., Laureati, M., Pagliarini, E., Sinesio, F., Gasperi, F., Torri, L., Aprea, E., et al. (2017) · Food Quality and Preference · doi:10.1016/j.foodqual.2017.02.013 · Cited by 178
“In a study that used the BIS/BAS scale developed by Carver and White (1994), Pagliaccio et al. (2016) observed that both sensitivity to reward and punishment scores tended to be higher in young adulthood (18–22 years old) than in later adulthood (30–45 years old) and in childhood.”
Jeong, B., Lee, J. Y., Kim, B. M., Park, E., Kwon, J.-G., Kim, D.-J., Lee, Y., Choi, J.-S., & Lee, D. (2020) · Addictive Behaviors · doi:10.1016/j.addbeh.2020.106485 · Cited by 62
Metadata
- Authors
- Pagliaccio, D., Luking, K. R., Anokhin, A. P., Gotlib, I. H., Hayden, E. P., Olino, T. M., Peng, C.-Z., Hajcak, G., & Barch, D. M.
- Venue
- Psychological Assessment
- Published
- 2016-04
- Volume
- 28
- Issue
- 4
- Pages
- 429-442
- ISSN
- 1040-3590 (ISSN-L)
- 1939-134X
- OpenAlex
- W1759961022
- Cited by
- 152
- References
- 32
- FWCI
- 6.65
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.