Measuring Depression in Autistic Adults: Psychometric Validation of the Beck Depression Inventory–II
Open accessThe DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.
Abstract
Depressive disorders are common in autistic adults, but few studies have examined the extent to which common depression questionnaires are psychometrically appropriate for use in this population. Using item response theory, this study examined the psychometric properties of the Beck Depression Inventory–II (BDI-II) in a sample of 947 autistic adults. BDI-II latent trait scores exhibited strong reliability, construct validity, and moderate ability to discriminate between depressed and nondepressed adults on the autism spectrum (area under the receiver operating characteristic curve = 0.796 [0.763, 0.826], sensitivity = 0.820 [0.785, 0.852], specificity = 0.653 [0.601, 0.699]). These results collectively indicate that the BDI-II is a valid measure of depressive symptoms in autistic adults, appropriate for quantifying depression severity in research studies or screening for depressive disorders in clinical settings. A free online score calculator has been created to facilitate the use of BDI-II latent trait scores for clinical and research applications (available at https://asdmeasures.shinyapps.io/bdi_score/ ).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482 · cited 1×
“DIF was tested using the iterative Wald test procedure proposed by Cao et al. (2017), with p values < .05 (FDR-corrected; Benjamini & Hochberg, 1995) used to flag items for DIF.”
MethodpROC: an open-source package for R and S+ to analyze and compare ROC curves
Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J.-C., & Müller, M. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-77 · Cited by 13,697
Development of the World Health Organization WHOQOL-BREF Quality of Life Assessment
THE WHOQOL GROUP (1998) · Psychological Medicine · doi:10.1017/s0033291798006667 · Cited by 7,933
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
What Is the Male-to-Female Ratio in Autism Spectrum Disorder? A Systematic Review and Meta-Analysis
Loomes, R., Hull, L., & Mandy, W. P. L. (2017) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1016/j.jaac.2017.03.013 · Cited by 2,804 · cited 4×
“Although the ASD and TD samples used to examine DIF by diagnostic group were relatively well-matched on demographic variables, these samples were both majority female and thus poorly representative of the overall ASD population as currently described by clinical research (i.e., a 3:1 male to female ratio; Loomes et al…”
MethodResultInfluentialMarginal Maximum Likelihood Estimation of Item Parameters: Application of an EM Algorithm
Bock, R. D., & Aitkin, M. (1981) · Psychometrika · doi:10.1007/bf02293801 · Cited by 2,339
Estimation of Latent Ability Using a Response Pattern of Graded Scores
Samejima, F. (1969) · Psychometrika · doi:10.1007/bf03372160 · Cited by 2,194
Which terms should be used to describe autism? Perspectives from the UK autism community
Kenny, L., Hattersley, C., Molins, B., Buckley, C., Povey, C., & Pellicano, E. (2016) · Autism · doi:10.1177/1362361315588200 · Cited by 1,941
Lai, M.-C., Kassee, C., Besney, R., Bonato, S., Hull, L., Mandy, W., Szatmari, P., & Ameis, S. H. (2019) · The Lancet Psychiatry · doi:10.1016/s2215-0366(19)30289-5 · Cited by 1,892
Evaluating Bifactor Models: Calculating and Interpreting Statistical Indices
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016) · Psychological Methods · doi:10.1037/met0000045 · Cited by 1,599
Psychometric properties of the Beck Depression Inventory-II: a comprehensive review
Wang, Y.-P., & Gorenstein, C. (2013) · Revista Brasileira de Psiquiatria · doi:10.1590/1516-4446-2012-1048 · Cited by 1,577
Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005) · Psychometrika · doi:10.1007/s11336-003-0974-7 · Cited by 1,439 · cited 2×
“In the current study, the BDI-II demonstrated strong model-based reliability and general factor saturation coefficients (Green & Yang, 2009; Rodriguez et al., 2016a, 2016b; Zinbarg et al., 2005) in both the ASD (ωt = 0.”
MethodInfluentialThe health status of adults on the autism spectrum
Croen, L. A., Zerbo, O., Qian, Y., Massolo, M. L., Rich, S., Sidney, S., & Kripke, C. (2015) · Autism · doi:10.1177/1362361315577517 · Cited by 1,110 · cited 1×
“By establishing the nomological network of the BDI-II in ASD (Cronbach & Meehl, 1955), we sought to establish the validity of this questionnaire as a measure of depressive symptoms suitable for general use in ASD research.”
MethodApplying Bifactor Statistical Indices in the Evaluation of Psychological Measures
Rodriguez, A., Reise, S. P., & Haviland, M. G. (2016) · Journal of Personality Assessment · doi:10.1080/00223891.2015.1089249 · Cited by 990
Hollocks, M. J., Lerh, J. W., Magiati, I., Meiser-Stedman, R., & Brugha, T. S. (2019) · Psychological Medicine · doi:10.1017/s0033291718002283 · Cited by 988
Psychiatric and psychosocial problems in adults with normal-intelligence autism spectrum disorders
Hofvander, B., Delorme, R., Chaste, P., Nydén, A., Wentz, E., Ståhlberg, O., Herbrecht, E., Stopin, A., Anckarsäter, H., Gillberg, C., et al. (2009) · BMC Psychiatry · doi:10.1186/1471-244x-9-35 · Cited by 812 · cited 2×
“Notably, co-occurring psychiatric conditions are quite common in this population, with the majority of autistic1 adults meeting criteria for one or more additional psychiatric diagnoses (Bishop-Fitzpatrick & Rubenstein, 2019; Croen et al., 2015; Davignon et al., 2018; Griffiths et al., 2019; Hofvander et al., 2009; Ho…”
BackgroundThe 52 symptoms of major depression: lack of content overlap among seven common depression scales
Fried, E. I. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.10.019 · Cited by 649 · cited 2×
“Fifth edition (DSM-5), and a recent study found that the BDI-II has the largest amount of symptom overlap with six other common depression questionnaires (Fried, 2017).”
BackgroundMethodRisk markers for suicidality in autistic adults
Cassidy, S., Bradley, L., Shaw, R., & Baron-Cohen, S. (2018) · Molecular Autism · doi:10.1186/s13229-018-0226-4 · Cited by 621 · cited 8×
“…autistic adults and TD controls, empirically testing the claim that individuals on the autism spectrum answer depression questionnaires in a qualitatively different manner from the general population (Cassidy et al., 2018b; Gotham et al., 2015; Pezzimenti et al., 2019; Uljarević et al., 2018).”
BackgroundMethodInfluentialHill, E., Berthoz, S., & Frith, U. (2004) · Journal of Autism and Developmental Disorders · doi:10.1023/b:jadd.0000022613.41399.14 · Cited by 619
Lever, A. G., & Geurts, H. M. (2016) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-016-2722-8 · Cited by 572 · cited 1×
“…additional psychiatric diagnoses (Bishop-Fitzpatrick & Rubenstein, 2019; Croen et al., 2015; Davignon et al., 2018; Griffiths et al., 2019; Hofvander et al., 2009; Hollocks et al., 2019; Howlin & Magiati, 2017; Lever & Geurts, 2016; Nylander et al., 2018; Supekar et al., 2017; Vohra et al., 2017).”
BackgroundAutism spectrum disorder: outcomes in adulthood
Howlin, P., & Magiati, I. (2017) · Current Opinion in Psychiatry · doi:10.1097/yco.0000000000000308 · Cited by 457 · cited 2×
“…additional psychiatric diagnoses (Bishop-Fitzpatrick & Rubenstein, 2019; Croen et al., 2015; Davignon et al., 2018; Griffiths et al., 2019; Hofvander et al., 2009; Hollocks et al., 2019; Howlin & Magiati, 2017; Lever & Geurts, 2016; Nylander et al., 2018; Supekar et al., 2017; Vohra et al., 2017).”
BackgroundCassidy, S., Bradley, P., Robinson, J., Allison, C., McHugh, M., & Baron-Cohen, S. (2014) · The Lancet Psychiatry · doi:10.1016/s2215-0366(14)70248-2 · Cited by 432 · cited 2×
“” Interestingly, this finding runs counter to previous results suggesting that autistic adults may endorse suicidal ideation at a relatively high rate even when not reporting depression (Cassidy et al., 2014).”
ResultGender differences in self-reported camouflaging in autistic and non-autistic adults
Hull, L., Lai, M.-C., Baron-Cohen, S., Allison, C., Smith, P., Petrides, K., & Mandy, W. (2020) · Autism · doi:10.1177/1362361319864804 · Cited by 337 · cited 2×
“, 2010), but its use in the ASD population has been limited (Hull et al., 2020; Russell et al., 2017).”
BackgroundMethodClark, D. A., Steer, R. A., & Beck, A. T. (1994) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.103.4.645 · Cited by 274
Griffiths, S., Allison, C., Kenny, R., Holt, R., Smith, P., & Baron‐Cohen, S. (2019) · Autism Research · doi:10.1002/aur.2162 · Cited by 246 · cited 4×
“…meeting criteria for one or more additional psychiatric diagnoses (Bishop-Fitzpatrick & Rubenstein, 2019; Croen et al., 2015; Davignon et al., 2018; Griffiths et al., 2019; Hofvander et al., 2009; Hollocks et al., 2019; Howlin & Magiati, 2017; Lever & Geurts, 2016; Nylander et al., 2018; Supekar…”
BackgroundResultInfluentialEnhancing the Validity of a Quality of Life Measure for Autistic People
McConachie, H., Mason, D., Parr, J. R., Garland, D., Wilson, C., & Rodgers, J. (2018) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-017-3402-z · Cited by 245
Comorbid Social Anxiety Disorder in Adults with Autism Spectrum Disorder
Maddox, B. B., & White, S. W. (2015) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-015-2531-5 · Cited by 223
Hirvikoski, T., Boman, M., Chen, Q., D'Onofrio, B. M., Mittendorfer-Rutz, E., Lichtenstein, P., Bölte, S., & Larsson, H. (2020) · Psychological Medicine · doi:10.1017/s0033291719001405 · Cited by 157 · cited 2×
“The functional impact of depression in autistic adults is substantial, with comorbid depressive symptoms predicting diminished quality of life, as well as increased rates of behavioral problems, self-injurious behaviors, and suicidality (Cassidy et al., 2018; M.-H. Chen et al., 2017; Hedley et al., 2018; Hirvikoski et…”
BackgroundHedley, D., Uljarević, M., Wilmot, M., Richdale, A., & Dissanayake, C. (2018) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2017.11.003 · Cited by 154 · cited 5×
“autism spectrum disorder, depression, psychometric, Beck Depression Inventory–II, item response theory & Acker, 2014), Montgomery–Åsberg Depression Rating Scale (Wentz et al., 2012), and Patient Health Questionnaire–9 (PHQ-9; Hedley et al., 2018) without assessing the validity of those measures in ASD.”
BackgroundMethodInfluentialGotham, K., Bishop, S. L., Brunwasser, S., & Lord, C. (2014) · Autism Research · doi:10.1002/aur.1377 · Cited by 149 · cited 2×
“This measure is also one of the most frequently used in studies of autistic adults (Burns et al., 2019; Cederlund et al., 2010; Crane et al., 2013; Gotham et al., 2014; Gotham et al., 2018; Han et al., 2019; Hill et al., 2004; Hillier et al., 2011; Limoges et al., 2005; Russell et al., 2017; Underwood et al., 2019; Un…”
BackgroundSelf-citationCederlund, M., Hagberg, B., & Gillberg, C. (2010) · Research in Developmental Disabilities · doi:10.1016/j.ridd.2009.09.006 · Cited by 145 · cited 2×
“This measure is also one of the most frequently used in studies of autistic adults (Burns et al., 2019; Cederlund et al., 2010; Crane et al., 2013; Gotham et al., 2014; Gotham et al., 2018; Han et al., 2019; Hill et al., 2004; Hillier et al., 2011; Limoges et al., 2005; Russell et al., 2017; Underwood et al., 2019; Un…”
BackgroundMethodCassidy, S. A., Bradley, L., Bowen, E., Wigham, S., & Rodgers, J. (2018) · Autism Research · doi:10.1002/aur.1922 · Cited by 144 · cited 9×
“…autistic adults and TD controls, empirically testing the claim that individuals on the autism spectrum answer depression questionnaires in a qualitatively different manner from the general population (Cassidy et al., 2018b; Gotham et al., 2015; Pezzimenti et al., 2019; Uljarević et al., 2018).”
BackgroundMethodInfluentialDepression in Youth with Autism Spectrum Disorder
Pezzimenti, F., Han, G. T., Vasa, R. A., & Gotham, K. (2019) · Child and Adolescent Psychiatric Clinics of North America · doi:10.1016/j.chc.2019.02.009 · Cited by 144
Self-citationDepression and its measurement in verbal adolescents and adults with autism spectrum disorder
Gotham, K., Unruh, K., & Lord, C. (2015) · Autism · doi:10.1177/1362361314536625 · Cited by 142 · cited 10×
“…autistic adults and TD controls, empirically testing the claim that individuals on the autism spectrum answer depression questionnaires in a qualitatively different manner from the general population (Cassidy et al., 2018b; Gotham et al., 2015; Pezzimenti et al., 2019; Uljarević et al., 2018).”
BackgroundMethodInfluentialSelf-citationHillier, A. J., Fish, T., Siegel, J. H., & Beversdorf, D. Q. (2011) · Journal of Developmental and Physical Disabilities · doi:10.1007/s10882-011-9226-4 · Cited by 121
Chen, M.-H., Pan, T.-L., Lan, W.-H., Hsu, J.-W., Huang, K.-L., Su, T.-P., Li, C.-T., Lin, W.-C., Wei, H.-T., Chen, T.-J., et al. (2017) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.16m11100 · Cited by 121
Everaert, J., & Joormann, J. (2019) · Clinical Psychological Science · doi:10.1177/2167702619859342 · Cited by 119
Self-citationCai, R. Y., Richdale, A. L., Dissanayake, C., & Uljarević, M. (2018) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-017-3318-7 · Cited by 107 · cited 1×
“As measures of depression and anxiety are highly correlated in the general population (Clark et al., 1994) and autistic individuals (R. Y. Cai et al., 2018; Griffiths et al., 2019; Nah et al., 2018), we examined the relationship between BDI-II and a measure of anxiety (Generalized Anxiety…”
BackgroundCassidy, S. A., Bradley, L., Bowen, E., Wigham, S., & Rodgers, J. (2018) · Clinical Psychology Review · doi:10.1016/j.cpr.2018.05.002 · Cited by 104 · cited 8×
“…autistic adults and TD controls, empirically testing the claim that individuals on the autism spectrum answer depression questionnaires in a qualitatively different manner from the general population (Cassidy et al., 2018b; Gotham et al., 2015; Pezzimenti et al., 2019; Uljarević et al., 2018).”
BackgroundMethodInfluentialMoseley, R. L., Gregory, N. J., Smith, P., Allison, C., & Baron-Cohen, S. (2019) · Molecular Autism · doi:10.1186/s13229-019-0267-3 · Cited by 97 · cited 2×
“The functional impact of depression in autistic adults is substantial, with comorbid depressive symptoms predicting diminished quality of life, as well as increased rates of behavioral problems, self-injurious behaviors, and suicidality (Cassidy et al., 2018; M.-H. Chen et al., 2017; Hedley et al., 2018; Hirvikoski et…”
BackgroundThe influence of sex and age on prevalence rates of comorbid conditions in autism
Supekar, K., Iyer, T., & Menon, V. (2017) · Autism Research · doi:10.1002/aur.1741 · Cited by 90
Quality of life for older autistic people: The impact of mental health difficulties
Mason, D., Mackintosh, J., McConachie, H., Rodgers, J., Finch, T., & Parr, J. R. (2019) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2019.02.007 · Cited by 89
Uljarević, M., Richdale, A. L., McConachie, H., Hedley, D., Cai, R. Y., Merrick, H., Parr, J. R., & Le Couteur, A. (2018) · Autism Research · doi:10.1002/aur.1872 · Cited by 85 · cited 12×
“Two of the aforementioned studies have examined the latent structures of depression questionnaires in samples of autistic individuals, finding similar structures to those reported in the general population (Arnold et al., 2020; Uljarević et al., 2018).”
BackgroundMethodResultInfluentialLay beliefs about autism spectrum disorder among the general public and childcare providers
Mitchell, G. E., & Locke, K. D. (2015) · Autism · doi:10.1177/1362361314533839 · Cited by 74 · cited 2×
“However, given the low prevalence of ASD in unselected samples recruited from MTurk (e.g., Mitchell & Locke, 2015; Skylark & BaronCohen, 2017), the number of “TD” adults with unrecognized ASD in our sample was likely too few to meaningfully affect any of the conducted DIF analyses.”
BackgroundHan, G. T., Tomarken, A. J., & Gotham, K. O. (2019) · Autism Research · doi:10.1002/aur.2088 · Cited by 67
Self-citationPrevalence and Risk-Markers of Self-Harm in Autistic Children and Adults
Licence, L., Oliver, C., Moss, J., & Richards, C. (2020) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-019-04260-1 · Cited by 45
Nylander, L., Axmon, A., Björne, P., Ahlström, G., & Gillberg, C. (2018) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-018-3567-0 · Cited by 43 · cited 2×
“…additional psychiatric diagnoses (Bishop-Fitzpatrick & Rubenstein, 2019; Croen et al., 2015; Davignon et al., 2018; Griffiths et al., 2019; Hofvander et al., 2009; Hollocks et al., 2019; Howlin & Magiati, 2017; Lever & Geurts, 2016; Nylander et al., 2018; Supekar et al., 2017; Vohra et al., 2017).”
BackgroundRussell, A., Cooper, K., Barton, S., Ensum, I., Gaunt, D., Horwood, J., Ingham, B., Kessler, D., Metcalfe, C., Parr, J., et al. (2017) · BMJ Open · doi:10.1136/bmjopen-2017-019545 · Cited by 16 · cited 1×
“The BDI-II item responses from all autistic participants (n = 947) were fit to a confirmatory bifactor graded response model (L. Cai, 2010; Samejima, 1969; Toland et al., 2017) based on the factor model of Brouwer et al. (2013).”
Method
Cited by
Bemmouna, D., Coutelle, R., Weibel, S., & Weiner, L. (2022) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-021-05317-w · Cited by 64
Schwartzman, J. M., Muscatello, R. A., & Corbett, B. A. (2023) · Autism · doi:10.1177/13623613231162154 · Cited by 50
“…validated in autistic adults without intellectual disability (e.g. validity of the Beck Depression Inventory for depression in autistic adults; Z. J. Williams et al., 2021) and youth (e.g. validity of the Revised Children’s Anxiety and Depression Scale in autistic youth; Sterling et al., 2015).”
Emotion regulation and executive function: Associations with depression and anxiety in autism
Conner, C. M., Elias, R., Smith, I. C., & White, S. W. (2023) · Research in Autism Spectrum Disorders · doi:10.1016/j.rasd.2023.102103 · Cited by 43
McVey, A. J., Schiltz, H. K., Coffman, M., Antezana, L., & Magnus, B. (2022) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-021-05018-4 · Cited by 37
Metadata
- Authors
- Williams, Z. J., Everaert, J., & Gotham, K. O.
- Venue
- Assessment
- Publisher
- SAGE Publications
- Published
- 2020-08-29
- Volume
- 28
- Issue
- 3
- Pages
- 858-876
- ISSN
- 1073-1911 (ISSN-L)
- 1552-3489
- OpenAlex
- W3082072280
- Cited by
- 83
- References
- 49
- FWCI
- 6.53
- Type
- journal article
- Language
- en
- Open access
- green
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.