Cited by 62Anxiety, Depression, Psychometrics, Treatment, Cognitive ProcessesTreatment of Major DepressionPsychometric Methodologies and Testing

Reference values for major depression questionnaires: The Leiden Routine Outcome Monitoring Study

Open access
Schulte-van Maaren, Yvonne W.M., Carlier, Ingrid V.E., Zitman, Frans G., van Hemert, Albert M., de Waal, Margot W.M., van der Does, A.J. Willem, van Noorden, Martijn S., Giltay, Erik J.·2013·Journal of Affective Disorders

Abstract

Background The Beck Depression Inventory-II (BDI-II), the Inventory of Depressive Symptoms (self-report) (IDS-SR) and the Montgomery-Äsberg Depression Rating Scale (MADRS) are questionnaires that assess symptom severity in patients with a depressive disorder, often part of Routine Outcome Monitoring (ROM). We aimed to generate reference values for both "healthy" and "clinically depressed" populations.Methods We included 1295 subjects from the general population (ROM reference-group) recruited through general practitioners, and 4627 psychiatric outpatients diagnosed with Major Depressive Disorder (MDD) or dysthymia (ROM patient-group). The outermost 5% of observations were used to define limits for one-sided reference intervals (95th percentiles; P95). Receiver Operating Characteristics (ROC) analyses were used to yield alternative cut-off values. Internal consistency was assessed.Results The mean age was 40.3yr (SD=12.6) and 39.3 (SD=12.3) for the ROM reference and patient-groups, respectively, and 62.8% versus 61.0% were female. Cut-off (P95) values differed for women and men, being respectively 15 and 12 for the BDI-II, 23 and 18 for the IDS-SR, and 12.5 and 9 for the MADRS. ROC analyses yielded almost equal reference values. The discriminative power of the BDI-II, IDS-SR and MADRS scores was very high. Internal consistency was excellent for total scores and satisfactory for all subscales, except for the IDS-SR subscale Atypical Characteristics.Limitations Substantial non-response and limited generalizability.Conclusions For the BDI-II, IDS-SR and MADRS a comprehensive set of reference values were provided. Reference values were higher in women than in men, implying the use of sex-specific cut-off values. Either instrument can be offered to every patient with MAS disorders to make responsible decisions about continuing, changing or terminating therapy.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1016/j.jad.2013.02.009

Cites

68 of 68 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

1 of the 69 references couldn’t be matched to a known paper.

Research works printed but not linked: 4

  1. Segal, D.L., Coolidge, F.L., Cahill, B.S., O′Riley, A.A., 2008b. Psychometric properties of the Beck Depression Inventory II (BDI-II) among community-dwelling older adults. Behavior Modification 32 (1), 3-20, Available from: PM:18096969.
  2. Steer, R.A., Ball, R., Ranieri, W.F., Beck, A.T., 1999. Dimensions of the Beck Depression Inventory-II in clinically depressed outpatients. Journal of Clinical Psychology 55 (1), 117-128, Available from: PM:10100838.
  3. Steer, R.A., Beck, A.T., Brown, G., Berchick, R.J., 1987. Self-reported depressive symptoms that differentiate recurrent-episode major depression from dysthy- mic disorders. Journal of Clinical Psychology 43 (2), 246-250.
  4. Whisman, M.A., Perez, J.E., Ramel, W., 2000. Factor structure of the Beck Depression Inventory-Second Edition (BDI-II) in a student sample. Journal of Clinical Psychology 56 (4), 545-551, Available from: PM:10775046.

Cited by

Sorted by citations

Authors
Schulte-van Maaren, Y. W. M., Carlier, I. V. E., Zitman, F. G., van Hemert, A. M., de Waal, M. W. M., van der Does, A. J. W., van Noorden, M. S., & Giltay, E. J.
Affiliations
Leiden University Medical Center (NL)
Venue
Journal of Affective Disorders
Publisher
Elsevier BV
Published
2013-07
Volume
149
Issue
1-3
Pages
342-349
ISSN
0165-0327 (ISSN-L)
OpenAlex
W2091522611
Cited by
62
References
69
Citations by year
2026: 1 · 2025: 1 · 2024: 9 · 2023: 4 · 2022: 4 · 2021: 11 · 2020: 8 · 2019: 4 · 2018: 7 · 2017: 4 · 2016: 3 · 2015: 2 · 2014: 3 · 2013: 1
FWCI
4.06
Type
journal article
Language
en
Open access
Locations
  • Journal of Affective Disorders (publishedVersion)
  • PubMed (publishedVersion)
  • Data Archiving and Networked Services (DANS) (submittedVersion)
  • Leiden Repository (Leiden University) (submittedVersion)
Funders
Rivierduinen, a regional mental health care provider in the Netherlands
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
  • Health Sciences › Medicine › Pharmacology › Treatment of Major Depression
  • Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
Keywords
reference values, major depressive disorder, dysthymia, Beck Depression Inventory-II, Montgomery-Asberg Depression Rating Scale, routine outcome monitoring, cut-off values, sex differences, depression severity, general population, psychiatric outpatients
MeSH terms
Adult, Major Depressive Disorder, Female, Humans, Male, Middle Aged, Psychiatric Status Rating Scales, Surveys and Questionnaires, Reference Values, Outcome Assessment, Health Care

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review