Examining the Stability of the Hospital Anxiety and Depression Scale Factor Structure in Adolescents and Young Adults With Cystic Fibrosis: A Confirmatory Factor Analysis
The DOI matches its Crossref record; 53 of the 53 references it cites were found in a registry or an index.
Abstract
Objective: The Hospital Anxiety and Depression Scale (HADS) is a widely used screening measure of anxiety and depression symptoms. However, prior analyses of the measure have found heterogeneous factor structures and called into question its ability to differentiate between symptoms of anxiety and depression. As part of efforts to implement mental health screening in cystic fibrosis (CF) care, the European Cystic Fibrosis Society (ECFS) and Cystic Fibrosis Foundation (CFF) conducted an international survey of 1,454 CF professionals. The HADS was the most commonly used measure in Europe and third most across all 48 countries surveyed. However, the HADS has not been validated for CF. Thus, the objective of this study was to examine its factor structure in a sample of adolescents and young adults with CF. Methods: Three theory-based models were tested in 727 individuals with CF (ages 12-25 years, 54% female) using confirmatory factor analyses, with an additional two models tested to improve model fit. Results: Chi-square difference tests and majority of fit indices indicated a three-factor structure based on Clark and Watson's tripartite model best fit the data. Conclusions: The original HADS two-factor structure demonstrated problematic fit in this sample, indicating poor discrimination between symptoms of anxiety and depression. A three-factor structure demonstrated best fit, indicating existing scoring guidelines and cutoffs would be inappropriate for use with this patient population. Use of the HADS to screen for anxiety and depression in CF could lead to an underestimation of clinically relevant symptomatology for depression and potential overestimation of anxiety symptoms.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Furthermore, a recent study examining its factor structure found that it does yield the two factors of depression and anxiety [40].”
From Rates of depression and anxiety in Italian patients with cystic fibrosis and parent caregivers: Implementation of the Mental Health Guidelines (2020) · cites this paper as [40]
Citations
Cites
Diagnostic and Statistical Manual of Mental Disorders
American Psychiatric Association (2013) · doi:10.1176/appi.books.9780890425596 · Cited by 116,369
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. (2013) · Encyclopedia of Social Work · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,519
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788 · cited 1×
“CFI and TLI values >0.95 indicate good model fit, and RMSEA values of 0.05 indicate close model fit (Brown, 2006; Hu & Bentler, 1999).”
MethodInfluentialThe Hospital Anxiety and Depression Scale
Zigmond, A. S., & Snaith, R. P. (1983) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.1983.tb09716.x · Cited by 47,139
Principles and Practice of Structural Equation Modeling
Tabri, N., & Elliott, C. M. (2012) · Canadian Graduate Journal of Sociology and Criminology · doi:10.15353/cgjsc-rcessc.v1i1.25 · Cited by 38,891
(1998) · Cited by 36,049
Confirmatory factor analysis for applied research
(2007) · Choice Reviews Online · doi:10.5860/choice.44-2769 · Cited by 15,614 · cited 1×
“CFI and TLI values >0.95 indicate good model fit, and RMSEA values of 0.05 indicate close model fit (Brown, 2006; Hu & Bentler, 1999).”
MethodInfluentialSensitivity of Goodness of Fit Indexes to Lack of Measurement Invariance
Chen, F. F. (2007) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705510701301834 · Cited by 12,217
Tripartite model of anxiety and depression: psychometric evidence and taxonomic implications
Clark, L. A., & Watson, D. (1991) · Journal of Abnormal Psychology · doi:10.1037/0021-843x.100.3.316 · Cited by 4,601
Webb, A. K. (2006) · Cited by 4,369
Fan, X., Thompson, B., & Wang, L. (1999) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1080/10705519909540119 · Cited by 1,663
The Nature, Diagnosis, and Treatment of Neuroticism: Back to the Future
Barlow, D. H., Sauer-Zavala, S., Carl, J. R., Bullis, J. R., & Ellard, K. K. (2014) · Clinical Psychological Science · doi:10.1177/2167702613505532 · Cited by 850
Ratjen, F., Bell, S. C., Rowe, S. M., Goss, C. H., Quittner, A. L., & Bush, A. (2015) · Nature Reviews Disease Primers · doi:10.1038/nrdp.2015.10 · Cited by 546
Self-citationQuittner, A. L., Goldbeck, L., Abbott, J., Duff, A., Lambrecht, P., Solé, A., Tibosch, M. M., Bergsten Brucefors, A., Yüksel, H., Catastini, P., et al. (2014) · Thorax · doi:10.1136/thoraxjnl-2014-205983 · Cited by 524 · cited 6×
“Individuals living with CF are at risk for developing symptoms of anxiety and depression (Quittner et al., 2014).”
BackgroundMethodInfluentialSelf-citationQuittner, A. L., Abbott, J., Georgiopoulos, A. M., Goldbeck, L., Smith, B., Hempstead, S. E., Marshall, B., Sabadosa, K. A., & Elborn, S. (2016) · Thorax · doi:10.1136/thoraxjnl-2015-207488 · Cited by 465
Self-citationLatent structure of the Hospital Anxiety And Depression Scale: a 10-year systematic review
Cosco, T. D., Doyle, F., Ward, M., & McGee, H. (2012) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2011.06.008 · Cited by 417
The Hospital Anxiety and Depression Scale: A meta confirmatory factor analysis
Norton, S., Cosco, T., Doyle, F., Done, J., & Sacker, A. (2013) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2012.10.010 · Cited by 405
Construct validation of the hospital anxiety and depression scale with clinical populations
Johnston, M., Pollard, B., & Hennessey, P. (2000) · Journal of Psychosomatic Research · doi:10.1016/s0022-3999(00)00102-1 · Cited by 383
The Hospital Anxiety and Depression Scale: A diagnostic meta-analysis of case-finding ability
Brennan, C., Worrall-Davies, A., McMillan, D., Gilbody, S., & House, A. (2010) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2010.04.006 · Cited by 374
Riekert, K. A., Bartlett, S. J., Boyle, M. P., Krishnan, J. A., & Rand, C. S. (2007) · Chest · doi:10.1378/chest.06-2474 · Cited by 197 · cited 2×
“Depressive symptoms have also been associated with more hospitalizations (Snell, Fernandes, Bujoreanu, & Garcia, 2014), worse pulmonary function (Riekert et al., 2007), and poorer rates of adherence (Smith et al.”
BackgroundWhich instruments to support diagnosis of depression have sufficient accuracy? A systematic review
Pettersson, A., Boström, K. B., Gustavsson, P., & Ekselius, L. (2015) · Nordic Journal of Psychiatry · doi:10.3109/08039488.2015.1008568 · Cited by 187
Smith, B. A., Modi, A. C., Quittner, A. L., & Wood, B. L. (2010) · Pediatric Pulmonology · doi:10.1002/ppul.21238 · Cited by 185 · cited 2×
“, 2007), and poorer rates of adherence (Smith et al., 2010; Hilliard, Eakin, Borrelli, Green, & Riekert, 2015).”
BackgroundSelf-citationDunbar, M., Ford, G., Hunt, K., & Der, G. (2000) · British Journal of Clinical Psychology · doi:10.1348/014466500163121 · Cited by 177 · cited 3×
“The tripartite model was first tested in the HADS using CFA in a sample of 2,547 adults by Dunbar and colleagues (Dunbar et al., 2000) and was found to best fit the HADS as both a simple and a hierarchical three-factor structure.”
MethodResultAssessment of the structure of the Hospital Anxiety and Depression Scale in musculoskeletal patients
Pallant, J. F., & Bailey, C. M. (2005) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-3-82 · Cited by 166
Sawicki, G. S., Ren, C. L., Konstan, M. W., Millar, S. J., Pasta, D. J., & Quittner, A. L. (2013) · Journal of Cystic Fibrosis · doi:10.1016/j.jcf.2012.12.009 · Cited by 154 · cited 1×
“Because of its wide-ranging effects, this life-shortening illness requires daily treatments that can take 2–4 hr per day and high treatment burden (Sawicki et al., 2013).”
BackgroundSelf-citationMartin, C. R., Lewin, R. J. P., & Thompson, D. R. (2003) · Psychiatry Research · doi:10.1016/s0165-1781(03)00162-8 · Cited by 115
Validation of the hospital anxiety and depression scale in patients with acute low back pain
Turk, D. C., Dworkin, R. H., Trudeau, J. J., Benson, C., Biondi, D. M., Katz, N. P., & Kim, M. (2015) · The Journal of Pain · doi:10.1016/j.jpain.2015.07.001 · Cited by 115
Schönberger, M., & Ponsford, J. L. (2010) · Psychiatry Research · doi:10.1016/j.psychres.2009.07.003 · Cited by 113
Medical co-morbidity and validity of DSM-IV depression criteria
SIMON, G. E., & VON KORFF, M. (2006) · Psychological Medicine · doi:10.1017/s0033291705006136 · Cited by 112
Depression, illness severity, and healthcare utilization in cystic fibrosis
Snell, C., Fernandes, S., Bujoreanu, I. S., & Garcia, G. (2014) · Pediatric Pulmonology · doi:10.1002/ppul.22990 · Cited by 108
Roberts, S. B., Bonnici, D. M., Mackinnon, A. J., & Worcester, M. C. (2001) · British Journal of Health Psychology · doi:10.1348/135910701169278 · Cited by 104
Structural equation modeling: A second course, 2nd ed.
Hancock, G. R., & Mueller, R. O. (2013) · Cited by 103
Martin, C. R., Tweed, A. E., & Metcalfe, M. S. (2004) · British Journal of Clinical Psychology · doi:10.1348/014466504772812968 · Cited by 96
Relationship between anxiety, depression, and quality of life in adult patients with cystic fibrosis
Yohannes, A. M., Willgoss, T. G., Fatoye, F. A., Dip, M. D., & Webb, K. (2012) · Respiratory Care · doi:10.4187/respcare.01328 · Cited by 96
Rodgers, J., Martin, C. R., Morse, R. C., Kendell, K., & Verrill, M. (2005) · Health and Quality of Life Outcomes · doi:10.1186/1477-7525-3-41 · Cited by 96
Martin, C., & Newell, R. (2004) · Psychology, Health & Medicine · doi:10.1080/13548500410001721891 · Cited by 77
Medication beliefs mediate between depressive symptoms and medication adherence in cystic fibrosis.
Hilliard, M. E., Eakin, M. N., Borrelli, B., Green, A., & Riekert, K. A. (2015) · Health Psychology · doi:10.1037/hea0000136 · Cited by 77
Abbott, J., Elborn, J. S., Georgiopoulos, A. M., Goldbeck, L., Marshall, B. C., Sabadosa, K. A., Smith, B. A., & Quittner, A. L. (2015) · Journal of Cystic Fibrosis · doi:10.1016/j.jcf.2014.12.015 · Cited by 63 · cited 4×
“Results of the TIDES study led to the development of an international guidelines committee sponsored by the European Cystic Fibrosis Society (ECFS) and Cystic Fibrosis Foundation (CFF).”
BackgroundInfluentialSelf-citationMcCue, P., Buchanan, T., & Martin, C. R. (2006) · British Journal of Clinical Psychology · doi:10.1348/014466505x82379 · Cited by 58
Hunt-Shanks, T. T., Blanchard, C., Reid, R., Fortier, M., & Cappelli, M. (2009) · British Journal of Health Psychology · doi:10.1348/135910709x432745 · Cited by 55
Martin, C. R., Thompson, D. R., & Barth, J. (2008) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2007.00850.x · Cited by 53
Stott, J. C. H., Spector, A. E., Orrell, M. W., Scior, K., Sweeney, J., & Charlesworth, G. M. (2016) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.4530 · Cited by 47
McCue, P., Martin, C., Buchanan, T., Rodgers, J., & Scholey, A. (2003) · Psychology, Health & Medicine · doi:10.1080/1354850310001604568 · Cited by 41
Olveira, C., Solé, A., Girón, R. M., Quintana‐Gallego, E., Mondejar, P., Baranda, F., Alvarez, A., Prados, C., Rodríguez-González, J., Labarga, I. H., et al. (2016) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2016.02.002 · Cited by 35 · cited 2×
“In CF research, the HADS has been recently used to predict health-related quality of life (Olveira et al., 2016), distress while undergoing evaluation for lung transplantation (Søyseth et al., 2016), and physical activity and fatigue (Orava et al., 2017).”
BackgroundMethodSelf-citationSøyseth, T. S., Lund, M.-B., Bjørtuft, Ø., Heldal, A., Søyseth, V., Dew, M. A., Haugstad, G. K., & Malt, U. F. (2016) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2016.07.001 · Cited by 35 · cited 1×
“In CF research, the HADS has been recently used to predict health-related quality of life (Olveira et al., 2016), distress while undergoing evaluation for lung transplantation (Søyseth et al., 2016), and physical activity and fatigue (Orava et al., 2017).”
MethodDesmond, D. M., & MacLachlan, M. (2005) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.1289 · Cited by 32
Reliability and factor structure of the Hospital Anxiety and Depression Scale in a polytrauma clinic
Boxley, L., Flaherty, J. M., Spencer, R. J., Drag, L. L., Pangilinan, P. H., & Bieliauskas, L. A. (2016) · The Journal of Rehabilitation Research and Development · doi:10.1682/jrrd.2015.05.0088 · Cited by 30
Askew, K., Bamford, J., Hudson, N. A., Moratelli, J., Miller, R., Anderson, A. J. B., Doe, S. J., & Bourke, S. (2017) · Clinical Medicine · doi:10.7861/clinmedicine.17-2-121 · Cited by 30
Skilbeck, C., Holm, K., Slatyer, M., Thomas, M., & Bell, T. (2011) · Brain Impairment · doi:10.1375/brim.12.1.22 · Cited by 17
Relationship between Physical Activity and Fatigue in Adults with Cystic Fibrosis
Orava, C., Fitzgerald, J., Figliomeni, S., Lam, D., Naccarato, A., Szego, E., Yoshida, K., Fox, P., Sykes, J. R., & Wu, K. (2017) · Physiotherapy Canada · doi:10.3138/ptc.2016-75 · Cited by 16 · cited 4×
“, 2016), physical activity and fatigue (Orava et al., 2017), among other outcomes.”
BackgroundMethodInfluentialBackström-Eriksson, L., Brucefors, A. B., Hjelte, L., Melin, B., & Sorjonen, K. (2016) · BMJ Open Respiratory Research · doi:10.1136/bmjresp-2016-000141 · Cited by 12
Factor analysis of the hospital anxiety and depression scale among a Huntington's disease population
Dale, M., Maltby, J., Martucci, R., Shimozaki, S., & the REGISTRY investigators of the European Huntington's Disease Network (2015) · Movement Disorders · doi:10.1002/mds.26419 · Cited by 11
Letter to the editor: authors’ response
Quittner, A. L., Barker, D., Goldbeck, L., Duff, A. J. A., & Abbott, J. (2015) · Thorax · doi:10.1136/thoraxjnl-2014-206708 · Cited by 3 · cited 4×
“Individuals living with CF are at risk for developing symptoms of anxiety and depression (Quittner et al., 2014).”
BackgroundMethodInfluentialSelf-citation
Research works printed but not linked: 4
- Elsevier Science Publishers, 2017
- IBM, 2015, IBM spss statistics for Macintosh, version 24.0
- Muthén, 1998, Mplus user’s guide
- Quittner, 2015, Response to: ‘On the TIDES study’, Thorax, 70, 490
Cited by
Decreased survival in cystic fibrosis patients with a positive screen for depression
Schechter, M. S., Ostrenga, J. S., Fink, A. K., Barker, D. H., Sawicki, G. S., & Quittner, A. L. (2021) · Journal of Cystic Fibrosis · doi:10.1016/j.jcf.2020.07.020 · Cited by 71
Self-citationMaulitz, L., Stickeler, E., Stickel, S., Habel, U., Tchaikovski, S. N., & Chechko, N. (2022) · Frontiers in Neuroendocrinology · doi:10.1016/j.yfrne.2022.100988 · Cited by 71
“The most frequently cited theory, and the one most supported by evidence thus far, is Sampson’s theory of transplantation and implantation (Sampson, 1927), which suggests that endometriosis implants originate from eutopic endometrium alighting in the abdominal cavity during retrograde menstruation…”
BackgroundLloyd, M., Sugden, N. A., Thomas, M., McGrath, A., & Skilbeck, C. E. (2023) · British Journal of Psychology · doi:10.1111/bjop.12637 · Cited by 63
Lord, L., McKernon, D., Grzeskowiak, L. E., Kirsa, S. W., & Ilomäki, J. (2022) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-022-02307-w · Cited by 56
“A later study across 727 PwCF aged 12–25 years, suggested using HADS in the CF population could lead to underestimation of depression, but overestimation of anxiety [39].”
BackgroundMethodInfluentialA narrative review of recent literature of the quality of life in hereditary angioedema patients
Chong‐Neto, H. J. (2023) · World Allergy Organization Journal · doi:10.1016/j.waojou.2023.100758 · Cited by 52
“Saez-Flores et al (2018) assessed HADS’ factor structure in a sample of adolescents and young adults with cystic fibrosis and reported poor ability to distinguish between symptoms of anxiety and depression, suggesting that instruments such as Generalized Anxiety Disorder 7 (GAD-7) and Scale and the Patient Health Ques…”
Metadata
- Authors
- Saez-Flores, E., Tonarely, N. A., Barker, D. H., & Quittner, A. L.
- Affiliations
- University of Miami (US)
- Brown University (US)
- Miami Children's Hospital (US)
- Corresponding author
- Saez-Flores, Estefany
- Venue
- Journal of Pediatric Psychology
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-01-03
- Volume
- 43
- Issue
- 6
- Pages
- 625-635
- ISSN
- 0146-8693 (ISSN-L)
- 1465-735X
- OpenAlex
- W2781680819
- Cited by
- 25
- References
- 53
- Citations by year
- 2026: 3 · 2024: 1 · 2023: 2 · 2022: 4 · 2021: 5 · 2020: 5 · 2019: 5
- FWCI
- 3.56
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Journal of Pediatric Psychology (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Cystic Fibrosis Foundation (C0500098, QUITTN07A0)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Health Sciences › Medicine › Pulmonary and Respiratory Medicine › Cystic Fibrosis Research Advances
- Keywords
- Hospital Anxiety and Depression Scale, cystic fibrosis, adolescents and young adults, factor structure, anxiety, depression, mental health screening, tripartite model, psychometric validation, screening cut-off values
- MeSH terms
- Adolescent, Adult, Anxiety, Child, Cystic Fibrosis, Depression, Factor Analysis, Statistical, Female, Hospitalization, Humans, Male, Psychometrics, Reproducibility of Results, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.