An item response theory evaluation of three depression assessment instruments in a clinical sample
Open accessThe DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
BACKGROUND: This study investigates whether an analysis, based on Item Response Theory (IRT), can be used for initial evaluations of depression assessment instruments in a limited patient sample from an affective disorder outpatient clinic, with the aim to finding major advantages and deficiencies of the instruments. METHODS: Three depression assessment instruments, the depression module from the Patient Health Questionnaire (PHQ9), the depression subscale of Affective Self Rating Scale (AS-18-D) and the Montgomery-Åsberg Depression Rating Scale (MADRS) were evaluated in a sample of 61 patients with affective disorder diagnoses, mainly bipolar disorder. A '3- step IRT strategy' was used. RESULTS: In a first step, the Mokken non-parametric analysis showed that PHQ9 and AS-18-D had strong overall scalabilities of 0.510 [C.I. 0.42, 0.61] and 0,513 [C.I. 0.41, 0.63] respectively, while MADRS had a weak scalability of 0.339 [C.I. 0.25, 0.43]. In a second step, a Rasch model analysis indicated large differences concerning the item discriminating capacity and was therefore considered not suitable for the data. In third step, applying a more flexible two parameter model, all three instruments showed large differences in item information and items had a low capacity to reliably measure respondents at low levels of depression severity. CONCLUSIONS: We conclude that a stepwise IRT-approach, as performed in this study, is a suitable tool for studying assessment instruments at early stages of development. Such an analysis can give useful information, even in small samples, in order to construct more precise measurements or to evaluate existing assessment instruments. The study suggests that the PHQ9 and AS-18-D can be useful for measurement of depression severity in an outpatient clinic for affective disorder, while the MADRS shows weak measurement properties for this type of patients.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Löwe, B., Kroenke, K., Herzog, W., & Gräfe, K. (2004) · Journal of Affective Disorders · doi:10.1016/s0165-0327(03)00198-8 · Cited by 1,558 · cited 1×
“The PHQ9 have mainly been evaluated in primary health care and different medical samples showing good psychometric properties in these settings [1-8].”
BackgroundMonitoring Depression Treatment Outcomes With the Patient Health Questionnaire-9
L??we, B., Un??tzer, J., Callahan, C. M., Perkins, A. J., & Kroenke, K. (2004) · Medical Care · doi:10.1097/00005650-200412000-00006 · Cited by 1,354 · cited 1×
“The PHQ9 have mainly been evaluated in primary health care and different medical samples showing good psychometric properties in these settings [1-8].”
BackgroundThe Hamilton Depression Rating Scale: Has the Gold Standard Become a Lead Weight?
Bagby, R. M., Ryder, A. G., Schuller, D. R., & Marshall, M. B. (2004) · American Journal of Psychiatry · doi:10.1176/appi.ajp.161.12.2163 · Cited by 1,148
LOWE, B. (2004) · Journal of Affective Disorders · doi:10.1016/s0165-0327(02)00237-9 · Cited by 1,060
Grunze, H., Vieta, E., Goodwin, G. M., Bowden, C., Licht, R. W., Möller, H.-J., Kasper, S., & WFSBP Task Force On Treatment Guidelines For Bipolar Disorders (2010) · The World Journal of Biological Psychiatry · doi:10.3109/15622970903555881 · Cited by 399 · cited 1×
“disorder, MADRS are commonly used for clinical evaluation of depression in bipolar disorder and has become the most widely used severity outcome measure in recent clinical trials of bipolar depression [11,12].”
Method
Cited by
The severity of psychiatric disorders
Zimmerman, M., Morgan, T. A., & Stanton, K. (2018) · World Psychiatry · doi:10.1002/wps.20569 · Cited by 227
Timmerby, N., Andersen, J. H., Søndergaard, S., Østergaard, S. D., & Bech, P. (2017) · Psychotherapy and Psychosomatics · doi:10.1159/000457131 · Cited by 134
Establishing the measurement precision of the patient health questionnaire in an adolescent sample
Hodgson, C. G., Bonifay, W., Yang, W., & Herman, K. C. (2023) · Journal of Affective Disorders · doi:10.1016/j.jad.2023.09.013 · Cited by 13
Metadata
- Authors
- Adler, M., Hetta, J., Isacsson, G., & Brodin, U.
- Venue
- BMC Medical Research Methodology
- Published
- 2012-06-21
- Volume
- 12
- Issue
- 1
- Pages
- 84-84
- ISSN
- 1471-2288 (ISSN-L)
- OpenAlex
- W2166516248
- Cited by
- 39
- References
- 6
- FWCI
- 1.99
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: An item response theory evaluation of three depression assessment instruments in a clinical sample. https://app.cochat.ai/papers/10.1186/1471-2288-12-84
- The paper
- Adler, M., Hetta, J., Isacsson, G., & Brodin, U. (2012). An item response theory evaluation of three depression assessment instruments in a clinical sample. BMC Medical Research Methodology. https://doi.org/10.1186/1471-2288-12-84
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.