Factorial invariance of the Patient Health Questionnaire and Generalized Anxiety Disorder Questionnaire
Open accessThe DOI matches its Crossref record; 16 of the 16 references it cites were found in a registry or an index.
Abstract
Objectives: The UK 's Improving Access to Psychological Therapies ( IAPT ) programme uses the Patient Health Questionnaire Depression Scale ( PHQ ‐9; Kroenke, Spitzer, & Williams, , J. Gen. Intern. Med ., 16, 606) and Generalized Anxiety Disorder Scale ( GAD ‐7; Spitzer et al ., , Arch. Intern. Med ., 166, 1092) to assess patients' symptoms of depression and anxiety respectively. Data are typically collected via telephone or face‐to‐face; however, no study has statistically investigated whether the questionnaires' items operate equivalently across these modes of data collection. This study aimed to address this omission. Methods & Results: Questionnaire data from patients registered with an IAPT service in London ( N = 23,672) were examined. Confirmatory factor analyses suggested that unidimensional factor structures adequately matched observed face‐to‐face and telephone data for the PHQ ‐9 and GAD ‐7. Invariance analyses revealed that while the PHQ ‐9 had equivalent factor loadings and latent means across data collection methods, the GAD ‐7 had equivalent factor loadings but unequal latent means. In support of the scales' convergent validity, positive associations between scores on the PHQ ‐9 and GAD ‐7 emerged. Conclusions: With the exception of the GAD ‐7's latent means, the questionnaires' factor loadings and latent means were equivalent. This suggests that clinicians may meaningfully compare PHQ ‐9 data collected face‐to‐face and by telephone; however, such comparisons with the GAD ‐7 should be done with caution. Practitioner points: The PHQ‐9 and GAD‐7's factor loadings were equivalent across data collection methods. Only the PHQ‐9's latent means were equivalent across data collection methods. Clinicians may be confident collecting PHQ‐9 data by telephone and face‐to‐face and, then, comparing such data. Caution is recommended when determining clinical effectiveness using telephone and face‐to‐face GAD‐7 data. More psychometric research is warranted.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Hu, L., & Bentler, P. M. (1999) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519909540118 · Cited by 108,788
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
The PHQ-8 as a measure of current depression in the general population
Kroenke, K., Strine, T. W., Spitzer, R. L., Williams, J. B. W., Berry, J. T., & Mokdad, A. H. (2009) · Journal of Affective Disorders · doi:10.1016/j.jad.2008.06.026 · Cited by 5,121 · cited 2×
“(2006) documented a positive correlation between the GAD-7 and the PHQ-8 (Kroenke et al., 2009), a positive association was likewise anticipated between the GAD-7 and the PHQ-9.”
BackgroundAnxiety disorders in primary care: prevalence, impairment, comorbidity, and detection
Kroenke, K., Spitzer, R. L., Williams, J. B. W., Monahan, P. O., & Löwe, B. (2007) · Annals of Internal Medicine · doi:10.7326/0003-4819-146-5-200703060-00004 · Cited by 4,741
Löwe, B., Decker, O., Müller, S., Brähler, E., Schellberg, D., Herzog, W., & Herzberg, P. Y. (2008) · Medical Care · doi:10.1097/mlr.0b013e318160d093 · Cited by 4,527
An Ultra-Brief Screening Scale for Anxiety and Depression: The PHQ–4
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2009) · Psychosomatics · doi:10.1016/s0033-3182(09)70864-3 · Cited by 4,261
Kroenke, K., Spitzer, R. L., Williams, J. B. W., & Löwe, B. (2010) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2010.03.006 · Cited by 4,057
Best practices for missing data management in counseling psychology
Schlomer, G. L., Bauman, S., & Card, N. A. (2010) · Journal of Counseling Psychology · doi:10.1037/a0018082 · Cited by 1,835 · cited 1×
“Therefore, as recommended by researchers (Jeli ci c et al., 2009; Schlomer et al., 2010), multiple imputation was used.”
MethodDepression, anxiety and somatization in primary care: Syndrome overlap and functional impairment
Löwe, B., Spitzer, R. L., Williams, J. B. W., Mussell, M., Schellberg, D., & Kroenke, K. (2008) · General Hospital Psychiatry · doi:10.1016/j.genhosppsych.2008.01.001 · Cited by 706
Hirschfeld, R. M. A. (2001) · The Primary Care Companion For CNS Disorders · doi:10.4088/pcc.v03n0609 · Cited by 661 · cited 1×
“This common type of comorbidity may predict negative health outcomes such as increased risk of suicide and treatment non-adherence (Hirschfeld, 2001), and research has found that overlap between depression, anxiety, and somatisation accounted for greater variance in functional impairment than the…”
BackgroundImproving access to psychological therapy: initial evaluation of two UK demonstration sites
Clark, D. M., Layard, R., Smithies, R., Richards, D. A., Suckling, R., & Wright, B. (2009) · Behaviour Research and Therapy · doi:10.1016/j.brat.2009.07.010 · Cited by 599
Psychometric comparison of PHQ-9 and HADS for measuring depression severity in primary care
Cameron, I. M., Crawford, J. R., Lawton, K., & Reid, I. C. (2008) · British Journal of General Practice · doi:10.3399/bjgp08x263794 · Cited by 590 · cited 1×
“…alphas indicated that the PHQ-9 and GAD-7 yielded internally consistent scores and, in support of previous psychometric work on the PHQ-9 (e.g., Cameron et al., 2008) and GAD-7 (e.g., Dear et al., 2011), confirmatory factor analyses suggested the questionnaires’ one-factor models adequately…”
ResultTitov, N., Dear, B. F., McMillan, D., Anderson, T., Zou, J., & Sunderland, M. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2010.550059 · Cited by 342
Donker, T., van Straten, A., Marks, I., & Cuijpers, P. (2011) · Psychiatry Research · doi:10.1016/j.psychres.2011.01.016 · Cited by 273
Roth, A. D., & Pilling, S. (2008) · Behavioural and Cognitive Psychotherapy · doi:10.1017/s1352465808004141 · Cited by 260
EVANS, M., KESSLER, D., LEWIS, G., PETERS, T. J., & SHARP, D. (2004) · Psychological Medicine · doi:10.1017/s0033291703008055 · Cited by 80
Cited by
Validation of the PHQ-9 in a psychiatric sample
Beard, C., Hsu, K. J., Rifkin, L. S., Busch, A. B., & Björgvinsson, T. (2016) · Journal of Affective Disorders · doi:10.1016/j.jad.2015.12.075 · Cited by 467
Tiirikainen, K., Haravuori, H., Ranta, K., Kaltiala-Heino, R., & Marttunen, M. (2019) · Psychiatry Research · doi:10.1016/j.psychres.2018.12.004 · Cited by 345
Scholten, S., Velten, J., Bieda, A., Zhang, X. C., & Margraf, J. (2017) · Psychological Assessment · doi:10.1037/pas0000440 · Cited by 165
Trajectories of depression and anxiety symptom change during psychological therapy
Saunders, R., Buckman, J. E. J., Cape, J., Fearon, P., Leibowitz, J., & Pilling, S. (2019) · Journal of Affective Disorders · doi:10.1016/j.jad.2019.02.043 · Cited by 99
“Previous studies have reported high correlations between depression and anxiety symptom scores in patients attending treatment services (Ryan et al., 2013) and have suggested that the overall trajectory of depression and anxiety change is similar for adolescents receiving psychological therapy (Queen et al.”
ResultSelf-citation
Metadata
- Authors
- Ryan, T. A., Bailey, A., Fearon, P., & King, J.
- Venue
- British Journal of Clinical Psychology
- Publisher
- Wiley
- Published
- 2013-08-20
- Volume
- 52
- Issue
- 4
- Pages
- 438-449
- ISSN
- 0144-6657 (ISSN-L)
- 2044-8260
- OpenAlex
- W2069330916
- Cited by
- 36
- References
- 16
- FWCI
- 1.36
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.