Reference values for major depression questionnaires: The Leiden Routine Outcome Monitoring Study
Open accessAbstract
Background The Beck Depression Inventory-II (BDI-II), the Inventory of Depressive Symptoms (self-report) (IDS-SR) and the Montgomery-Äsberg Depression Rating Scale (MADRS) are questionnaires that assess symptom severity in patients with a depressive disorder, often part of Routine Outcome Monitoring (ROM). We aimed to generate reference values for both "healthy" and "clinically depressed" populations.Methods We included 1295 subjects from the general population (ROM reference-group) recruited through general practitioners, and 4627 psychiatric outpatients diagnosed with Major Depressive Disorder (MDD) or dysthymia (ROM patient-group). The outermost 5% of observations were used to define limits for one-sided reference intervals (95th percentiles; P95). Receiver Operating Characteristics (ROC) analyses were used to yield alternative cut-off values. Internal consistency was assessed.Results The mean age was 40.3yr (SD=12.6) and 39.3 (SD=12.3) for the ROM reference and patient-groups, respectively, and 62.8% versus 61.0% were female. Cut-off (P95) values differed for women and men, being respectively 15 and 12 for the BDI-II, 23 and 18 for the IDS-SR, and 12.5 and 9 for the MADRS. ROC analyses yielded almost equal reference values. The discriminative power of the BDI-II, IDS-SR and MADRS scores was very high. Internal consistency was excellent for total scores and satisfactory for all subscales, except for the IDS-SR subscale Atypical Characteristics.Limitations Substantial non-response and limited generalizability.Conclusions For the BDI-II, IDS-SR and MADRS a comprehensive set of reference values were provided. Reference values were higher in women than in men, implying the use of sex-specific cut-off values. Either instrument can be offered to every patient with MAS disorders to make responsible decisions about continuing, changing or terminating therapy.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The QIDS-SR16 has been validated in a Dutch clinical population.
“The QIDS-SR16 has been validated in a Dutch clinical population [33].”
From Personalized exposure and experience sampling method feedback versus exposure as usual for obsessive–compulsive disorder: a study protocol for a randomized controlled trial (2024) · cites this paper as [33]
The Procedures and instruments section describes the 30-item IDS-SR, not the QIDS-SR16; the Discussion and conclusion identifies reference values and reliability coefficients for the BDI-II, IDS-SR, and MADRS. A QIDS-SR psychometric evaluation appears in the References, but no passage found in our copy says the QIDS-SR16 was validated in a Dutch clinical population (searched: QIDS-SR16, QIDS-SR, and Dutch validation). (LLM, conf=0.76)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
Diagnostic and Statistical Manual of Mental Disorders
Williams, J. B. W., & First, M. B. (2013) · Oxford University Press eBooks · doi:10.1093/acrefore/9780199975839.013.104 · Cited by 109,841 · see citing works
(1998) · The Journal of Clinical Psychiatry · Cited by 19,139 · see citing works
A new depression scale designed to be sensitive to change
Montgomery, S. A., & Åsberg, M. (1979) · British Journal of Psychiatry · doi:10.1192/bjp.134.4.382 · Cited by 13,962 · see citing works
Jacobson, N. S., & Truax, P. (1991) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.59.1.12 · Cited by 7,770 · see citing works
Beck, A. T., Steer, R. A., & Brown, G. (2011) · PsycTESTS Dataset · doi:10.1037/t00742-000 · Cited by 7,535 · see citing works
The brief symptom inventory: an introductory report.
Derogatis, L. R., & Melisaratos, N. (1983) · Psychological Medicine · doi:10.1017/s0033291700048017 · Cited by 6,650 · see citing works
Comparison of Beck Depression Inventories -IA and -II in psychiatric outpatients
Beck, A. T., Steer, R. A., Ball, R., & Ranieri, W. F. (1996) · Journal of Personality Assessment · doi:10.1207/s15327752jpa6703_13 · Cited by 5,965 · see citing works
The mini international neuropsychiatric interview
Lecrubier, Y., Sheehan, D. V., Hergueta, T., & Weiller, E. (1998) · European Psychiatry · doi:10.1016/s0924-9338(99)80239-9 · Cited by 5,882 · see citing works
Fundamentals of Clinical Chemistry.
(1977) · Annals of Internal Medicine · doi:10.7326/0003-4819-87-1-142_1 · Cited by 2,622 · see citing works
The Inventory of Depressive Symptomatology (IDS): Psychometric properties
Rush, A. J., Gullion, C. M., Basco, M. R., Jarrett, R. B., & Trivedi, M. H. (1996) · Psychological Medicine · doi:10.1017/s0033291700035558 · Cited by 2,177 · see citing works
Handbook of Psychiatric Measures
Salzman, C. (2001) · American Journal of Psychiatry · doi:10.1176/appi.ajp.158.8.1343 · Cited by 1,172 · see citing works
Diagnostic and Statistical Manual of Mental Disorders
Preedy, V., & Watson, R. (2010) · Springer eBooks · doi:10.1007/978-0-387-78665-0_5485 · Cited by 1,146 · see citing works
Kazdin, A. E. (2008) · American Psychologist · doi:10.1037/0003-066x.63.3.146 · Cited by 1,112 · see citing works
TRIVEDI, M. H., RUSH, A. J., IBRAHIM, H. M., CARMODY, T. J., BIGGS, M. M., SUPPES, T., CRISMON, M. L., SHORES-WILSON, K., TOPRAC, M. G., DENNEHY, E. B., et al. (2004) · Psychological Medicine · doi:10.1017/s0033291703001107 · Cited by 968 · cited 1× · see citing works
“IDS-SR reference values were reported for depressed outpatients (Biggs et al., 2000; Rush et al., 1986; Rush et al., 1996; Trivedi et al. 2004) and inpatients (Corruble et al. 1999).”
BackgroundThe inventory for depressive symptomatology (IDS): Preliminary findings
Rush, A. J., Giles, D. E., Schlesser, M. A., Fulton, C. L., Weissenburger, J. E., & Burns, C. (1986) · Psychiatry Research · doi:10.1016/0165-1781(86)90060-0 · Cited by 908 · see citing works
Handbook of Psychiatric Measures
Rush, A. J., First, M. B., & Blacker, D. (2000) · Medical Entomology and Zoology · Cited by 846 · see citing works
Understanding receiver operating characteristic (ROC) curves
Fan, J., Upadhye, S., & Worster, A. (2006) · Canadian Journal of Emergency Medicine · doi:10.1017/s1481803500013336 · Cited by 843 · see citing works
Storch, E. A., Roberti, J. W., & Roth, D. A. (2004) · Depression and Anxiety · doi:10.1002/da.20002 · Cited by 694 · see citing works
Influence of statistical method used on the resulting estimate of normal range.
Reed, A. H., Henry, R. J., & Mason, W. B. (1971) · Clinical Chemistry · doi:10.1093/clinchem/17.4.275 · Cited by 598 · see citing works
THE COMPOSITE INTERNATIONAL DIAGNOSTIC INTERVIEW (CIDI)
Robins, L. N. (1994) · IX World Congress of Psychiatry · doi:10.1142/9789814440912_0056 · Cited by 574 · see citing works
Normative comparisons for the evaluation of clinical significance.
Kendall, P. C., Marrs, A. L., Nath, S. R., & Sheldrick, R. C. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.67.3.285 · Cited by 468 · see citing works
Fundamentals of Clinical Chemistry.
(1971) · Annals of Internal Medicine · doi:10.7326/0003-4819-74-4-654_2 · Cited by 446 · see citing works
Dowse, T. S. (2013) · Elsevier eBooks · doi:10.1016/b978-1-4832-2804-4.50011-9 · Cited by 360 · see citing works
Geffré, A., Friedrichs, K. R., Harr, K. E., Concordet, D., Trumel, C., & Braun, J.-P. D. (2009) · Veterinary Clinical Pathology · doi:10.1111/j.1939-165x.2009.00179.x · Cited by 350 · see citing works
Normative comparisons for the evaluation of clinical significance.
Kendall, P. C., Marrs-Garcia, A., Nath, S. R., et al. (1999) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.67.3.285 · Cited by 350 · see citing works
Adult and geriatric normative data and validation of the profile of mood states
Nyenhuis, D. L., Yamamoto, C., Luchetta, T., Terrien, A., & Parmentier, A. H. (1999) · Journal of Clinical Psychology · doi:10.1002/(sici)1097-4679(199901)55:1 · Cited by 337 · see citing works
Segal, D. L., Coolidge, F. L., Cahill, B. S., & O'Riley, A. A. (2008) · Behavior Modification · doi:10.1177/0145445507303833 · Cited by 335 · see citing works
Methods for Validating and Norming Translations of Health Status Questionnaires
Gandek, B., & Ware, J. E. (1998) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00086-9 · Cited by 325 · see citing works
(2007) · PubMed · Cited by 324 · see citing works
Effect of Outliers and Nonhealthy Individuals on Reference Interval Estimation
Horn, P. S., Feng, L., Li, Y., & Pesce, A. J. (2001) · Clinical Chemistry · doi:10.1093/clinchem/47.12.2137 · Cited by 301 · see citing works
Müller, M. (2003) · Journal of Affective Disorders · doi:10.1016/s0165-0327(02)00120-9 · Cited by 282 · see citing works
Establishing Reference Intervals for Clinical Laboratory Test Results
Katayev, A., Balciza, C., & Seccombe, D. W. (2010) · American Journal of Clinical Pathology · doi:10.1309/ajcpn5bmtsf1cdyp · Cited by 280 · see citing works
Routine outcome monitoring and feedback on physical or mental health status: evidence and theory
Carlier, I. V. E., Meuldijk, D., van Vliet, I. M., van Fenema, E. M., van der Wee, N. J. A., & Zitman, F. G. (2010) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01543.x · Cited by 277 · see citing works
Self-citationDefining remission by cut off score on the MADRS: selecting the optimal value
Hawley, C. J., Gale, T. M., & Sivakumaran, T. (2002) · Journal of Affective Disorders · doi:10.1016/s0165-0327(01)00451-7 · Cited by 270 · see citing works
Use of the Beck Depression Inventory-II with depressed geriatric inpatients
Steer, R. A., Rissmiller, D. J., & Beck, A. T. (2000) · Behaviour Research and Therapy · doi:10.1016/s0005-7967(99)00068-6 · Cited by 238 · see citing works
Sasse, E. A. (2000) · Medical Entomology and Zoology · Cited by 236 · see citing works
Zimmerman, M., Posternak, M. A., & Chelminski, I. (2004) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2004.03.007 · Cited by 229 · see citing works
Sagen, U., Vik, T. G., Moum, T., Mørland, T. J., Finset, A., & Dammen, T. (2009) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2009.03.007 · Cited by 228 · see citing works
Are the Laboratory Results (Phenotype) Indicative of a True Genotype Abnormality?
Marlar, R. A. (2012) · American Journal of Clinical Pathology · doi:10.1309/ajcp7sbb6mqkhsfh · Cited by 224 · see citing works
Novick, J. S., Stewart, J. W., Wisniewski, S. R., Cook, I. A., Manev, R. M., Nierenberg, A. A., Rosenbaum, J. F., Shores‐Wilson, K., Balasubramani, G. K., Biggs, M. M., et al. (2005) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.v66n0807 · Cited by 211 · see citing works
de Beurs, E., den Hollander-Gijsman, M. E., van Rood, Y. R., van der Wee, N. J. A., Giltay, E. J., van Noorden, M. S., van der Lem, R., van Fenema, E. M., & Zitman, F. G. (2010) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.696 · Cited by 195 · see citing works
Self-citationWardenaar, K. J., van Veen, T., Giltay, E. J., de Beurs, E., Penninx, B. W. J. H., & Zitman, F. G. (2010) · Psychiatry Research · doi:10.1016/j.psychres.2009.03.005 · Cited by 192 · see citing works
Self-citationMontgomery, S., Rasmussen, J., & Tanghøj, P. (1993) · International Clinical Psychopharmacology · doi:10.1097/00004850-199300830-00008 · Cited by 165 · see citing works
Khan, A., Khan, S., Shankles, E. B., & Polissar, N. L. (2002) · International Clinical Psychopharmacology · doi:10.1097/00004850-200211000-00003 · Cited by 162 · see citing works
Zimmerman, M., Chelminski, I., & Posternak, M. (2004) · Journal of Nervous and Mental Disease · doi:10.1097/01.nmd.0000138226.22761.39 · Cited by 150 · see citing works
Establishment and Use of Reference Values
Horowitz, G. L. (2012) · Elsevier eBooks · doi:10.1016/b978-1-4160-6164-9.00005-6 · Cited by 142 · see citing works
Associations Between Serum Lipids and Major Depressive Disorder
Dortland, A. K. B. V. R., Giltay, E. J., van Veen, T., PELT, J. V., Zitman, F. G., & Penninx, B. W. J. H. (2009) · The Journal of Clinical Psychiatry · doi:10.4088/jcp.08m04865blu · Cited by 127 · see citing works
Self-citationModerate and severe depression
Müller, M. J., Szegedi, A., Wetzel, H., & Benkert, O. (2000) · Journal of Affective Disorders · doi:10.1016/s0165-0327(99)00162-7 · Cited by 116 · see citing works
Heo, M., Murphy, C. F., & Meyers, B. S. (2007) · American Journal of Geriatric Psychiatry · doi:10.1097/jgp.0b013e318098614e · Cited by 97 · see citing works
Kumar, G., Steer, R. A., Teitelman, K. B., & Villacis, L. (2002) · Assessment · doi:10.1177/10791102009002007 · Cited by 95 · see citing works
Solberg, H. E., & Gräsbeck, R. (1989) · Advances in clinical chemistry · doi:10.1016/s0065-2423(08)60181-x · Cited by 91 · see citing works
Self- and clinician-rated montgomery-asberg depression rating scale: evaluation in clinical practice
Bondolfi, G., Jermann, F., Rouget, B. W., Gex-Fabry, M., McQuillan, A., Dupont-Willemin, A., Aubry, J.-M., & Nguyen, C. (2010) · Journal of Affective Disorders · doi:10.1016/j.jad.2009.06.037 · Cited by 90 · see citing works
Concordance between self-report and clinician’s assessment of depression
Corruble, E., Legrand, J. M., Zvenigorowski, H., Duret, C., & Guelfi, J. (1999) · Journal of Psychiatric Research · doi:10.1016/s0022-3956(99)00011-4 · Cited by 80 · see citing works
Deriving reference values in electrodiagnostic medicine
Campbell, W. W., & Robinson, L. R. (1993) · Muscle & Nerve · doi:10.1002/mus.880160414 · Cited by 72 · see citing works
van Kampen, D., de Beurs, E., & Andrea, H. (2008) · Psychiatry Research · doi:10.1016/j.psychres.2007.05.002 · Cited by 57 · see citing works
Engedal, K., Kvaal, K. S., Korsnes, M. S., Barca, M. L., Borza, T., Selbæk, G., & Aakhus, E. (2012) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.02.042 · Cited by 52 · see citing works
Maaren, Y. W. M. S.-V., Carlier, I. V. E., Zitman, F. G., van Hemert, A. M., de Waal, M. W. M., van Noorden, M. S., & Giltay, E. J. (2012) · BMC Psychiatry · doi:10.1186/1471-244x-12-203 · Cited by 45 · see citing works
Self-citationvan Noorden, M. S., Giltay, E. J., den Hollander-Gijsman, M. E., van der Wee, N. J. A., van Veen, T., & Zitman, F. G. (2010) · Journal of Affective Disorders · doi:10.1016/j.jad.2009.12.007 · Cited by 43 · see citing works
Self-citationA comparison of alternative assessments of depressive symptom severity: a pilot study
Biggs, M. M., Shores‐Wilson, K., Rush, A. J., Carmody, T. J., Trivedi, M. H., Crismon, M. L., Toprac, M. G., & Mason, M. (2000) · Psychiatry Research · doi:10.1016/s0165-1781(00)00159-1 · Cited by 38 · see citing works
de Beurs, E., Rinne, T., van Kampen, D., Verheul, R., & Andrea, H. (2009) · Journal of Personality Disorders · doi:10.1521/pedi.2009.23.3.308 · Cited by 38 · see citing works
A comparison of alternative assessments of depressive symptom severity: a pilot study
Biggs, M. M., Shores‐Wilson, K., Rush, A. J., Carmody, T. J., Trivedi, M. H., Crismon, M. L., Toprac, M. G., & Mason, M. (2000) · Psychiatry Research · doi:10.1016/s0165-1781(00)00235-3 · Cited by 30 · see citing works
Maaren, Y. W. M. S.-V., Carlier, I. V. E., Giltay, E. J., van Noorden, M. S., de Waal, M. W. M., van der Wee, N. J. A., & Zitman, F. G. (2012) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2012.01830.x · Cited by 20 · see citing works
Self-citationvan Fenema, E. M., van der Wee, N. J. A., Giltay, E. J., den Hollander-Gijsman, M. E., & Zitman, F. G. (2010) · Journal of Evaluation in Clinical Practice · doi:10.1111/j.1365-2753.2010.01593.x · Cited by 14 · see citing works
Self-citationBarnabei, L., Marazìa, S., & Caterina, R. D. (2007) · Journal of Cardiovascular Medicine · doi:10.2459/jcm.0b013e3280126615 · Cited by 14 · see citing works
The effect of the content of suicide notes on grief reactions
Rudestam, K. E., & Agnelli, P. (1987) · Journal of Clinical Psychology · doi:10.1002/1097-4679(198703)43:2 · Cited by 9 · see citing works
Poortvliet, M., Lamkaddem, M., & Devillé, W. L. J. M. (2005) · Data Archiving and Networked Services (DANS) · Cited by 8 · see citing works
Instruments for measuring mood disorders
Nolen, W. A., & Dingemans, P. M. A. J. (2004) · University of Groningen research database (University of Groningen / Centre for Information Technology) · Cited by 6 · see citing works
Flagged first, then by citations
1 of the 69 references couldn’t be matched to a known paper.
Research works printed but not linked: 4
- Segal, D.L., Coolidge, F.L., Cahill, B.S., O′Riley, A.A., 2008b. Psychometric properties of the Beck Depression Inventory II (BDI-II) among community-dwelling older adults. Behavior Modification 32 (1), 3-20, Available from: PM:18096969.
- Steer, R.A., Ball, R., Ranieri, W.F., Beck, A.T., 1999. Dimensions of the Beck Depression Inventory-II in clinically depressed outpatients. Journal of Clinical Psychology 55 (1), 117-128, Available from: PM:10100838.
- Steer, R.A., Beck, A.T., Brown, G., Berchick, R.J., 1987. Self-reported depressive symptoms that differentiate recurrent-episode major depression from dysthy- mic disorders. Journal of Clinical Psychology 43 (2), 246-250.
- Whisman, M.A., Perez, J.E., Ramel, W., 2000. Factor structure of the Beck Depression Inventory-Second Edition (BDI-II) in a student sample. Journal of Clinical Psychology 56 (4), 545-551, Available from: PM:10775046.
Cited by
Sorted by citations
Stanford Accelerated Intelligent Neuromodulation Therapy for Treatment-Resistant Depression
Cole, E. J., Stimpson, K. H., Bentzley, B. S., Gulser, M., Cherian, K., Tischler, C., Nejad, R., Pankow, H., Choi, E., Aaron, H., et al. (2020) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2019.19070720 · Cited by 802 · see citing works
Association of Testosterone Treatment With Alleviation of Depressive Symptoms in Men
Walther, A., Breidenstein, J., & Miller, R. E. (2018) · JAMA Psychiatry · doi:10.1001/jamapsychiatry.2018.2734 · Cited by 178 · see citing works
von Glischinski, M., von Brachel, R., & Hirschfeld, G. H. F. (2018) · Quality of Life Research · doi:10.1007/s11136-018-2050-x · Cited by 148 · see citing works
Cassidy, S. A., Bradley, L., Bowen, E., Wigham, S., & Rodgers, J. (2018) · Autism Research · doi:10.1002/aur.1922 · Cited by 144 · see citing works
Henry, S. K., Grant, M. M., & Cropsey, K. L. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.02.071 · Cited by 123 · see citing works
The Prevalence of Burnout Among US Neurosurgery Residents
Shakir, H. J., McPheeters, M. J., Shallwani, H., Pittari, J. E., & Reynolds, R. M. (2018) · Neurosurgery · doi:10.1093/neuros/nyx494 · Cited by 71 · see citing works
Defining asthma–COPD overlap syndrome: a population-based study
Bonten, T. N., Kasteleyn, M. J., de Mutsert, R., Hiemstra, P. S., Rosendaal, F. R., Chavannes, N. H., Slats, A. M., & Taube, C. (2017) · European Respiratory Journal · doi:10.1183/13993003.02008-2016 · Cited by 67 · see citing works
Common measures or common metrics? A plea to harmonize measurement results
de Beurs, E., Boehnke, J. R., & Fried, E. I. (2022) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.2742 · Cited by 55 · see citing works
Leerssen, J., Lakbila-Kamal, O., Dekkers, L. M. S., Ikelaar, S. L. C., Albers, A. C. W., Blanken, T. F., Lancee, J., van der Lande, G. J. M., Maksimovic, T., Mastenbroek, S. E., et al. (2022) · Psychotherapy and Psychosomatics · doi:10.1159/000520282 · Cited by 54 · see citing works
Lacruz, M. E., Schmidt‐Pokrzywniak, A., Dragano, N., Moebus, S., Deutrich, S. E., Möhlenkamp, S., Schmermund, A., Kälsch, H., Erbel, R., & Stang, A. (2016) · BMJ Open · doi:10.1136/bmjopen-2015-007919 · Cited by 54 · see citing works
Riese, H., von Klipstein, L., Schoevers, R. A., van der Veen, D. C., & Servaas, M. N. (2021) · BMC Psychiatry · doi:10.1186/s12888-021-03123-3 · Cited by 52 · see citing works
Kok, L., Hillegers, M. H. J., Veldhuijzen, D. S., Cornelisse, S., Nierich, A. P., van der Maaten, J. M., Rosseel, P. M. J., Hofland, J., Sep, M. S. C., Dieleman, J. M., et al. (2015) · Critical Care Medicine · doi:10.1097/ccm.0000000000001419 · Cited by 46 · see citing works
Ebrahimi, O. V., Borsboom, D., Hoekstra, R. H. A., Epskamp, S., Ostinelli, E. G., Bastiaansen, J. A., & Cipriani, A. (2024) · The British Journal of Psychiatry · doi:10.1192/bjp.2024.19 · Cited by 44 · see citing works
Risk and protective factors for psychotic experiences in adolescence: a population-based study
McMahon, E. M., Corcoran, P. E., Keeley, H., Clarke, M. C., Coughlan, H., Wasserman, D., Hoven, C. W., Carli, V., Sarchiapone, M., Healy, C., et al. (2020) · Psychological Medicine · doi:10.1017/s0033291719004136 · Cited by 43 · see citing works
Scheffers, M., van Duijn, M. A. J., Beldman, M., Bosscher, R. J., van Busschbach, J. T., & Schoevers, R. A. (2018) · Journal of Affective Disorders · doi:10.1016/j.jad.2018.08.074 · Cited by 37 · see citing works
Prevalence and correlates of current suicidal ideation in women with premenstrual dysphoric disorder
Wikman, A., Sacher, J., Bixo, M., Hirschberg, A. L., Kallner, H. K., Epperson, C. N., Comasco, E., & Poromaa, I. S. (2022) · BMC Women s Health · doi:10.1186/s12905-022-01612-5 · Cited by 37 · see citing works
Jo, K. B., Lee, Y. J., Lee, I. G., Lee, S. C., Park, J. Y., & Ahn, R. S. (2016) · Psychoneuroendocrinology · doi:10.1016/j.psyneuen.2016.03.017 · Cited by 38 · see citing works
Sverdlov, O., Curcic, J., Hannesdottir, K., Gou, L., De Luca, V., Ambrosetti, F., Zhang, B., Praestgaard, J., Vallejo, V., Dolman, A., et al. (2021) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2021.640741 · Cited by 34 · see citing works
Günther, V., Ihme, K. A., Kersting, A., Hoffmann, K., Lobsien, D., & Suslow, T. (2018) · Neuroscience · doi:10.1016/j.neuroscience.2018.01.034 · Cited by 36 · see citing works
Seasonality of mood and affect in a large general population sample
Winthorst, W. H., Bos, E. H., Roest, A. M., & de Jonge, P. (2020) · PLoS ONE · doi:10.1371/journal.pone.0239033 · Cited by 36 · see citing works
Effects of methylphenidate on reinforcement learning depend on working memory capacity
Kandroodi, M. R., Cook, J. L., Swart, J. C., Froböse, M. I., Geurts, D. E. M., Vahabie, A., Ahmadabadi, M. N., Cools, R., & den Ouden, H. E. M. (2021) · Psychopharmacology · doi:10.1007/s00213-021-05974-w · Cited by 32 · see citing works
Cole, E., Gulser, M., Stimpson, K., Bentzley, B., Hawkins, J., Xiao, X., Schatzberg, A., Sudheimer, K., & Williams, N. (2019) · Brain Stimulation · doi:10.1016/j.brs.2018.12.299 · Cited by 31 · see citing works
Characterization of depressed bipolar patients with current suicidal ideation
Nobile, B., Dubois, J., Aouizerate, B., Aubin, V., Loftus, J., Bellivier, F., Belzeaux-R, R., Dubertret, C., Gard, S., Haffen, É., et al. (2020) · Australian & New Zealand Journal of Psychiatry · doi:10.1177/0004867420963744 · Cited by 30 · see citing works
Comorbid depression and treatment of anxiety disorders, OCD, and PTSD: Diagnosis versus severity
Breteler, J. K., Ikani, N., Becker, E. S., Spijker, J., & Hendriks, G. (2021) · Journal of Affective Disorders · doi:10.1016/j.jad.2021.08.146 · Cited by 29 · see citing works
Koenders, M., Mesbah, R., Spijker, A. T., Boere, E., de Leeuw, M., van Hemert, B., & Giltay, E. J. (2021) · Brain and Behavior · doi:10.1002/brb3.2326 · Cited by 28 · see citing works
Self-citationFatigue in chronic inflammatory demyelinating polyneuropathy
Gable, K., Attarian, H. P., & Allen, J. A. (2020) · Muscle & Nerve · doi:10.1002/mus.27038 · Cited by 22 · see citing works
Jakobsen, H., Andersson, G., Havik, O., & Nordgreen, T. (2016) · Internet Interventions · doi:10.1016/j.invent.2016.11.002 · Cited by 23 · see citing works
Screening of depression in cardiology: A study on 617 cardiovascular patients.
Tesio, V., Marra, S., Molinaro, S., Torta, R., Gaita, F., & Castelli, L. (2017) · International Journal of Cardiology · doi:10.1016/j.ijcard.2017.07.065 · Cited by 18 · see citing works
Cavalcanti, L. G., Steindl, S. R., Matos, M., & Boschen, M. J. (2021) · Current Psychology · doi:10.1007/s12144-021-01510-3 · Cited by 20 · see citing works
Takeuchi, H., Shiota, Y., Yaoi, K., Taki, Y., Nouchi, R., Yokoyama, R., Kotozaki, Y., Nakagawa, S., Sekiguchi, A., Iizuka, K., et al. (2022) · Communications Biology · doi:10.1038/s42003-022-03464-z · Cited by 19 · see citing works
Weijers, A., Rasing, S. P. A., Creemers, D. H. M., Vermulst, A. A., Schellekens, A., & Westerhof, G. J. (2020) · Journal of Clinical Psychology · doi:10.1002/jclp.23083 · Cited by 16 · see citing works
Maaren, Y. W. M. S.-V., Giltay, E. J., van Hemert, A. M., Zitman, F. G., de Waal, M. W. M., van Rood, Y. R., & Carlier, I. V. E. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.03.013 · Cited by 14 · see citing works
Self-citationFrequency and characteristic features of REM sleep without atonia
Dijkstra, F., Viaene, M. K., Crosiers, D., Volder, I. D., & Cras, P. P. (2019) · Clinical Neurophysiology · doi:10.1016/j.clinph.2019.07.018 · Cited by 13 · see citing works
Anxiety in Late-Life Depression: Determinants of the Course of Anxiety and Complete Remission
van der Veen, D. C., Gulpers, B. J. A., van Zelst, W. H., Köhler, S., Comijs, H. C., Schoevers, R. A., & Voshaar, R. C. O. (2020) · American Journal of Geriatric Psychiatry · doi:10.1016/j.jagp.2020.12.023 · Cited by 13 · see citing works
Kataoka, J., Olsson, M., Lindgren, E., Larsson, I., Schmidt, J., Benrick, A., & Stener‐Victorin, E. (2024) · Scientific Reports · doi:10.1038/s41598-024-63166-w · Cited by 14 · see citing works
Characterization of suicidal depression: A 1 year prospective study
Nobile, B., Olié, É., Dubois, J., Benramdane, M., Guillaume, S., & Courtet, P. (2022) · European Psychiatry · doi:10.1192/j.eurpsy.2022.16 · Cited by 10 · see citing works
Kok, G., van Rijsbergen, G., Burger, H., Elgersma, H., Riper, H., Cuijpers, P., Dekker, J., Smit, F., & Bockting, C. (2014) · PLoS ONE · doi:10.1371/journal.pone.0111711 · Cited by 9 · see citing works
Cano, J. F., Gómez–Restrepo, C., & Rondón, M. (2015) · Revista Colombiana de Psiquiatría · doi:10.1016/j.rcp.2015.08.006 · Cited by 9 · see citing works
Reference values for anxiety questionnaires: The Leiden Routine Outcome Monitoring Study
Maaren, Y. W. M. S.-V., Giltay, E. J., van Hemert, A. M., Zitman, F. G., de Waal, M. W. M., & Carlier, I. V. E. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2013.05.031 · Cited by 9 · see citing works
Self-citationUse of outcome measurements in clinical practice: How specific should one be?
Nugter, A., Hermens, M. L., Robbers, S. C. C., van Son, G. E., Theunissen, J., & Engelsbel, F. (2017) · Psychotherapy Research · doi:10.1080/10503307.2017.1408975 · Cited by 9 · see citing works
Riedinger, M. A., Mesbah, R., Koenders, M., Henderickx, J. G. E., Smits, W. K., Filali, E. E., Geleijnse, J. M., van der Wee, N. J. A., de Leeuw, M., & Giltay, E. J. (2024) · Journal of Affective Disorders · doi:10.1016/j.jad.2024.03.105 · Cited by 8 · see citing works
Self-citationNowrouzi‐Kia, B., Bani‐Fatemi, A., Jackson, T., Li, A., Chattu, V. K., Lytvyak, E., Deibert, D., Dennett, L., Ferguson-Pell, M., Hagtvedt, R., et al. (2024) · Journal of Occupational Rehabilitation · doi:10.1007/s10926-024-10246-3 · Cited by 7 · see citing works
Treating winter depressive episodes in bipolar disorder: an open trial of light therapy
van Hout, L. J. E., Rops, L., & Simons, C. J. P. (2020) · International Journal of Bipolar Disorders · doi:10.1186/s40345-020-00182-5 · Cited by 9 · see citing works
Gräper, P. J., Scafoglieri, A., Clark, J. R., & Hallegraeff, J. M. (2024) · Journal of Clinical Medicine · doi:10.3390/jcm13164677 · Cited by 7 · see citing works
Predictive value of baseline resistance in early response to antidepressants
Icick, R., Millet, É., Curis, E., Bellivier, F., & Lépine, J. (2014) · Journal of Affective Disorders · doi:10.1016/j.jad.2014.03.002 · Cited by 6 · see citing works
Ambivalence over Expression of Anger and Sadness Mediates Gender Differences in Depressive Symptoms
Kunst, L., de Groot, J. D., & van der Does, A. J. W. (2018) · Cognitive Therapy and Research · doi:10.1007/s10608-018-9937-2 · Cited by 5 · see citing works
Ebrahimi, O. V., Borsboom, D., Hoekstra, R. H. A., Epskamp, S., Ostinelli, E. G., Bastiaansen, J. A., & Cipriani, A. (2023) · doi:10.31234/osf.io/wh6cf · Cited by 6 · see citing works
Economou, A., Konsolaki, E., Kalsi, I. A., & Psychountaki, M. (2024) · SAGE Open · doi:10.1177/21582440241252264 · Cited by 4 · see citing works
Huisman, S. M., Kraiss, J. T., & de Vos, J. A. (2024) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2024.1275236 · Cited by 4 · see citing works
Xu, Y., & Cao, C. (2023) · Journal of Youth and Adolescence · doi:10.1007/s10964-023-01849-9 · Cited by 3 · see citing works
Psychopathology in premanifest C9orf72 repeat expansion carriers
Vocht, J. D., Stam, D., Nicolini, M., Lamaire, N., Laroy, M., Casteele, T. V., de Vliet, L. V., Vansteelandt, K., D’Hondt, A., Emsell, L., et al. (2021) · Journal of Neurology Neurosurgery & Psychiatry · doi:10.1136/jnnp-2021-327774 · Cited by 3 · see citing works
Gulpers (2019) · doi:10.26481/dis.20190626bg · Cited by 2 · see citing works
Hoogerwerf, E., Greeven, A., Goekoop, R., & Spinhoven, P. (2024) · Trials · doi:10.1186/s13063-023-07780-5 · Cited by 1 · see citing works
“The QIDS-SR16 has been validated in a Dutch clinical population [33].”
MethodPsychometric approach in psychiatry: excess or necessity?
Ассанович, М. А. (2021) · Neurology Bulletin · doi:10.17816/nb43686 · Cited by 1 · see citing works
Kataoka, J., Olsson, M., Lindgren, E., Larsson, I., Schmidt, J., Benrick, A., & Stener‐Victorin, E. (2023) · Research Square · doi:10.21203/rs.3.rs-3542002/v1 · Cited by 1 · see citing works
Tselichtchev, P. (2019) · TSpace (University of Toronto)
Anxiety in late-life depression
van der Veen, D. C. (2021) · doi:10.33612/diss.179793202
de Vocht, A. M. R., Witteman, C. L. M., de Vocht, F., & Spijker, J. (2023) · Journal of Psychiatric Practice · doi:10.1097/pra.0000000000000691 · Cited by 1 · see citing works
Pfeffer, L. K., Ramien, C., Harrison, A., Patas, K., Grentzenberg, K., Reinhardt, S., Mönch, A., Kaufmann, M., Gold, S. M., & Heesen, C. (2025) · Frontiers in Neurology · doi:10.3389/fneur.2025.1619021
Hoogerwerf, E., Greeven, A., Goekoop, R., & Spinhoven, P. (2024) · Figshare · doi:10.6084/m9.figshare.24993705
Riese, H., von Klipstein, L., Schoevers, R. A., van der Veen, D. C., & Servaas, M. N. (2021) · Figshare · doi:10.6084/m9.figshare.14196433
Yang, J., Yang, L., & Cao, C. (2026) · Psychophysiology · doi:10.1111/psyp.70406
- Authors
- Schulte-van Maaren, Y. W. M., Carlier, I. V. E., Zitman, F. G., van Hemert, A. M., de Waal, M. W. M., van der Does, A. J. W., van Noorden, M. S., & Giltay, E. J.
- Affiliations
- Leiden University Medical Center (NL)
- Venue
- Journal of Affective Disorders
- Publisher
- Elsevier BV
- Published
- 2013-07
- Volume
- 149
- Issue
- 1-3
- Pages
- 342-349
- ISSN
- 0165-0327 (ISSN-L)
- OpenAlex
- W2091522611
- Cited by
- 62
- References
- 69
- Citations by year
- 2026: 1 · 2025: 1 · 2024: 9 · 2023: 4 · 2022: 4 · 2021: 11 · 2020: 8 · 2019: 4 · 2018: 7 · 2017: 4 · 2016: 3 · 2015: 2 · 2014: 3 · 2013: 1
- FWCI
- 4.06
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- Locations
- Journal of Affective Disorders (publishedVersion)
- PubMed (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Leiden Repository (Leiden University) (submittedVersion)
- Funders
- Rivierduinen, a regional mental health care provider in the Netherlands
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Health Sciences › Medicine › Pharmacology › Treatment of Major Depression
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Keywords
- reference values, major depressive disorder, dysthymia, Beck Depression Inventory-II, Montgomery-Asberg Depression Rating Scale, routine outcome monitoring, cut-off values, sex differences, depression severity, general population, psychiatric outpatients
- MeSH terms
- Adult, Major Depressive Disorder, Female, Humans, Male, Middle Aged, Psychiatric Status Rating Scales, Surveys and Questionnaires, Reference Values, Outcome Assessment, Health Care
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review