The DOI matches its Crossref record; 66 of the 66 references it cites were found in a registry or an index.
Screening for Depression in the General Population with the Center for Epidemiologic Studies Depression (CES-D): A Systematic Review with Meta-Analysis
Open accessAbstract
OBJECTIVE: We aimed to collect and meta-analyse the existing evidence regarding the performance of the Center for Epidemiologic Studies Depression (CES-D) for detecting depression in general population and primary care settings. METHOD: Systematic literature search in PubMed and PsychINFO. Eligible studies were: a) validation studies of screening questionnaires with information on the accuracy of the CES-D; b) samples from general populations or primary care settings; c) standardized diagnostic interviews following standard classification systems used as gold standard; and d) English or Spanish language of publication. Pooled sensitivity, specificity, likelihood ratios and diagnostic odds ratio were estimated for several cut-off points using bivariate mixed effects models for each threshold. The summary receiver operating characteristic curve was estimated with Rutter and Gatsonis mixed effects models; area under the curve was calculated. Quality of the studies was assessed with the QUADAS tool. Causes of heterogeneity were evaluated with the Rutter and Gatsonis mixed effects model including each covariate at a time. RESULTS: 28 studies (10,617 participants) met eligibility criteria. The median prevalence of Major Depression was 8.8% (IQ range from 3.8% to 12.6%). The overall area under the curve was 0.87. At the cut-off 16, sensitivity was 0.87 (95% CI: 0.82-0.92), specificity 0.70 (95% CI: 0.65-0.75), and DOR 16.2 (95% CI: 10.49-25.10). Better trade-offs between sensitivity and specificity were observed (Sensitivity = 0.83, Specificity = 0.78, diagnostic odds ratio = 16.64) for cut-off 20. None of the variables assessed as possible sources of heterogeneity was found to be statistically significant. CONCLUSION: The CES-D has acceptable screening accuracy in the general population or primary care settings, but it should not be used as an isolated diagnostic measure of depression. Depending on the test objectives, the cut-off 20 may be more adequate than the value of 16, which is typically recommended.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267
QUADAS-2: a revised tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Rutjes, A. W. S., Westwood, M. E., Mallett, S., Deeks, J. J., Reitsma, J. B., Leeflang, M. M. G., Sterne, J. A. C., Bossuyt, P. M. M., & the QUADAS-2 Group* (2011) · Annals of Internal Medicine · doi:10.7326/0003-4819-155-8-201110180-00009 · Cited by 14,199
KESSLER, R. C., ANDREWS, G., COLPE, L. J., HIRIPI, E., MROCZEK, D. K., NORMAND, S.-L. T., WALTERS, E. E., & ZASLAVSKY, A. M. (2002) · Psychological Medicine · doi:10.1017/s0033291702006074 · Cited by 10,327
Murray, C. J. L., Vos, T., Lozano, R., Naghavi, M., Flaxman, A. D., Michaud, C., Ezzati, M., Shibuya, K., Salomon, J. A., Abdalla, S., et al. (2012) · The Lancet · doi:10.1016/s0140-6736(12)61689-4 · Cited by 8,888
The Validity of Two Versions of the GHQ in the WHO Study of Mental Illness in General Health Care
GOLDBERG, D. P., GATER, R., SARTORIUS, N., USTUN, T. B., PICCINELLI, M., GUREJE, O., & RUTTER, C. (1997) · Psychological Medicine · doi:10.1017/s0033291796004242 · Cited by 3,657
Reitsma, J. B., Glas, A. S., Rutjes, A. W. S., Scholten, R. J. P. M., Bossuyt, P. M., & Zwinderman, A. H. (2005) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2005.02.022 · Cited by 3,369 · cited 1×
“Also, for the subsample of studies that provided diagnostic accuracy results for the cut-off point 16 (n = 22), we estimated a bivariate meta-regression [27], which allowed us to obtain pooled estimates of a range of summary performance measures of the test’s ability to detect the presence of a disease for a given cut…”
Towards complete and accurate reporting of studies of diagnostic accuracy: The STARD Initiative.
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., de Vet, H. C. W., et al. (2003) · Annals of Internal Medicine · doi:10.7326/0003-4819-138-1-200301070-00010 · Cited by 3,219
Towards complete and accurate reporting of studies of diagnostic accuracy: the STARD initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · BMJ · doi:10.1136/bmj.326.7379.41 · Cited by 3,215
Towards Complete and Accurate Reporting of Studies of Diagnostic Accuracy: The STARD Initiative
Bossuyt, P. M., Reitsma, J. B., Bruns, D. E., Gatsonis, C. A., Glasziou, P. P., Irwig, L. M., Lijmer, J. G., Moher, D., Rennie, D., & de Vet, H. C. W. (2003) · Radiology · doi:10.1148/radiol.2261021292 · Cited by 3,215
Cross-national epidemiology of DSM-IV major depressive episode
Bromet, E., Andrade, L. H., Hwang, I., Sampson, N. A., Alonso, J., de Girolamo, G., de Graaf, R., Demyttenaere, K., Hu, C., Iwata, N., et al. (2011) · BMC Medicine · doi:10.1186/1741-7015-9-90 · Cited by 2,221
Self-citationASSESSING DEPRESSIVE SYMPTOMS IN FIVE PSYCHIATRIC POPULATIONS: A VALIDATION STUDY
WEISSMAN, M. M., SHOLOMSKAS, D., POTTENGER, M., PRUSOFF, B. A., & LOCKE, B. Z. (1977) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112455 · Cited by 2,185
Empirical evidence of design-related bias in studies of diagnostic tests.
Lijmer, J. G. (1999) · JAMA · doi:10.1001/jama.282.11.1061 · Cited by 1,861
Lewinsohn, P. M., Seeley, J. R., Roberts, R. E., & Allen, N. B. (1997) · Psychology and Aging · doi:10.1037/0882-7974.12.2.277 · Cited by 1,782
A hierarchical regression approach to meta‐analysis of diagnostic test accuracy evaluations
Rutter, C. M., & Gatsonis, C. A. (2001) · Statistics in Medicine · doi:10.1002/sim.942 · Cited by 1,505
Moses, L. E., Shapiro, D., & Littenberg, B. (1993) · Statistics in Medicine · doi:10.1002/sim.4780121403 · Cited by 1,405
Gilbody, S., Richards, D., Brealey, S., & Hewitt, C. (2007) · Journal of General Internal Medicine · doi:10.1007/s11606-007-0333-y · Cited by 1,290 · cited 5×
“Perhaps the CES-D can be more fairly compared with the depression module of the Patient Health Questionnaire (PHQ-9), which has become increasingly popular over the past decade for detecting major depressive disorders in various clinical settings.”
InfluentialClinical diagnosis of depression in primary care: a meta-analysis
Mitchell, A. J., Vaze, A., & Rao, S. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60879-5 · Cited by 1,251
BEEKMAN, A. T. F., DEEG, D. J. H., VAN LIMBEEK, J., BRAAM, A. W., DE VRIES, M. Z., & VAN TILBURG, W. (1997) · Psychological Medicine · doi:10.1017/s0033291796003510 · Cited by 1,115
Pignone, M. P., Gaynes, B. N., Rushton, J. L., Burchell, C. M., Orleans, C. T., Mulrow, C. D., & Lohr, K. N. (2002) · Annals of Internal Medicine · doi:10.7326/0003-4819-136-10-200205210-00013 · Cited by 1,086
Screening for Adolescent Depression: A Comparison of Depression Scales
ROBERTS, R. E., LEWINSOHN, P. M., & SEELEY, J. R. (1991) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199101000-00009 · Cited by 850
Evaluation of QUADAS, a tool for the quality assessment of diagnostic accuracy studies
Whiting, P. F., Weswood, M. E., Rutjes, A. W., Reitsma, J. B., Bossuyt, P. N., & Kleijnen, J. (2006) · BMC Medical Research Methodology · doi:10.1186/1471-2288-6-9 · Cited by 769
Properties of the summary receiver operating characteristic (SROC) curve for diagnostic test data
Walter, S. D. (2002) · Statistics in Medicine · doi:10.1002/sim.1099 · Cited by 672
Evidence of bias and variation in diagnostic accuracy studies
Rutjes, A. W. S., Reitsma, J. B., Di Nisio, M., Smidt, N., van Rijn, J. C., & Bossuyt, P. M. M. (2006) · Canadian Medical Association Journal · doi:10.1503/cmaj.050090 · Cited by 611
Screening for Depression in Primary Care Clinics: The CES-D and the BDI
Zich, J. M., Attkisson, C. C., & Greenfield, T. K. (1990) · The International Journal of Psychiatry in Medicine · doi:10.2190/lykr-7vhp-yjem-mkm2 · Cited by 569
Lyness, J. M. (1997) · Archives of Internal Medicine · doi:10.1001/archinte.1997.00440250107012 · Cited by 484 · cited 1×
“Lyness, 1997 [46] 130 SCID, DSM-III-R Primary care Middle Age/ Elderly 9.”
Alonso, J., Petukhova, M., Vilagut, G., Chatterji, S., Heeringa, S., Üstün, T. B., Alhamzawi, A. O., Viana, M. C., Angermeyer, M., Bromet, E., et al. (2011) · Molecular Psychiatry · doi:10.1038/mp.2010.101 · Cited by 482
Self-citationThe Burden of Mental Disorders
Eaton, W. W., Martins, S. S., Nestadt, G., Bienvenu, O. J., Clarke, D., & Alexandre, P. (2008) · Epidemiologic Reviews · doi:10.1093/epirev/mxn011 · Cited by 460
Giese-Davis, J., Collie, K., Rancourt, K. M. S., Neri, E., Kraemer, H. C., & Spiegel, D. (2011) · Journal of Clinical Oncology · doi:10.1200/jco.2010.28.4455 · Cited by 458
The CES-D as a Screen for Depression and Other Psychiatric Disorders in Adolescents
GARRISON, C. Z., ADDY, C. L., JACKSON, K. L., McKEOWN, R. E., & WALLER, J. L. (1991) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199107000-00017 · Cited by 357
Depression in Medical Outpatients: Underrecognition and Misdiagnosis
Pérez-Stable, E. J. (1990) · Archives of Internal Medicine · doi:10.1001/archinte.1990.00390170113024 · Cited by 350
Leeflang, M. M. G., Moons, K. G. M., Reitsma, J. B., & Zwinderman, A. H. (2008) · Clinical Chemistry · doi:10.1373/clinchem.2007.096032 · Cited by 346
Is This Patient Clinically Depressed?
Williams, Jr. (2002) · JAMA · doi:10.1001/jama.287.9.1160 · Cited by 323
Identifying depression in primary care: a literature synthesis of case-finding instruments
Williams, J. W., Pignone, M., Ramirez, G., & Perez Stellato, C. (2002) · General Hospital Psychiatry · doi:10.1016/s0163-8343(02)00195-0 · Cited by 289
The relationship of self-reported distress to depressive disorders and other psychopathology
Fechner-Bates, S., Coyne, J. C., & Schwenk, T. L. (1994) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.62.3.550 · Cited by 273
Thomas, J. L., Jones, G. N., Scarinci, I. C., Mehan, D. J., & Brantley, P. J. (2001) · The International Journal of Psychiatry in Medicine · doi:10.2190/fufr-pk9f-6u10-jxrk · Cited by 237
Harbord, R. M., Whiting, P., Sterne, J. A. C., Egger, M., Deeks, J. J., Shang, A., & Bachmann, L. M. (2008) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2007.09.013 · Cited by 217
YANG, H. (2004) · Journal of Affective Disorders · doi:10.1016/j.jad.2004.04.008 · Cited by 200
The chronic depressive in the community: Unrecognized and poorly treated
Weissman, M. M., & Klerman, G. L. (1977) · Comprehensive Psychiatry · doi:10.1016/s0010-440x(97)90002-x · Cited by 181
Gerety, M. B., Williams, J. W., Mulrow, C. D., Cornell, J. E., Kadri, A. A., Rosenberg, J., Chiodo, L. K., & Long, M. (1994) · Journal of the American Geriatrics Society · doi:10.1111/j.1532-5415.1994.tb06217.x · Cited by 175
Sex differences in late-life depression
Sonnenberg, C., Beekman, A. T. F., Deeg, D. J. H., & van Tilburg, W. (2000) · Acta Psychiatrica Scandinavica · doi:10.1034/j.1600-0447.2000.101004286.x · Cited by 166
Spijker, J., de Graaf, R., Bijl, R. V., Beekman, A. T. F., Ormel, J., & Nolen, W. A. (2004) · Acta Psychiatrica Scandinavica · doi:10.1111/j.1600-0447.2004.00335.x · Cited by 158
Cuijpers, P. J., Boluijt, P., & van Straten, A. (2007) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-007-0631-2 · Cited by 150
Screening accuracy for late-life depression in primary care: a systematic review.
Watson, L. C., & Pignone, M. P. (2003) · PubMed · Cited by 147
Prediction of Major Depression and Dysthymia From CES-D Scores Among Ethnic Minority Adolescents
Prescott, C. A., McArdle, J. J., Hishinuma, E. S., Johnson, R. C., Miyamoto, R. H., Andrade, N. N., Edman, J. L., Makini, G. K., Nahulu, L. B., Yuen, N. Y. C., et al. (1998) · Journal of the American Academy of Child & Adolescent Psychiatry · doi:10.1097/00004583-199805000-00012 · Cited by 130
Li, Z., & Hicks, M. H.-R. (2010) · Psychiatry Research · doi:10.1016/j.psychres.2009.03.007 · Cited by 127
Under-treatment of depression in older persons
Barry, L. C., Abou, J. J., Simen, A. A., & Gill, T. M. (2011) · Journal of Affective Disorders · doi:10.1016/j.jad.2011.09.038 · Cited by 125
Blank, K., Gruman, C., & Robison, J. T. (2004) · The Journals of Gerontology Series A · doi:10.1093/gerona/59.4.m378 · Cited by 115
Screening for Depression in Middle-Aged and Older Puerto Rican Primary Care Patients
Robison, J. T., Gruman, C., Gaztambide, S., & Blank, K. (2002) · The Journals of Gerontology Series A · doi:10.1093/gerona/57.5.m308 · Cited by 113
Role of common mental and physical disorders in partial disability around the world
Bruffaerts, R., Vilagut, G., Demyttenaere, K., Alonso, J., AlHamzawi, A., Andrade, L. H., Benjet, C., Bromet, E., Bunting, B., de Girolamo, G., et al. (2012) · British Journal of Psychiatry · doi:10.1192/bjp.bp.111.097519 · Cited by 96
Self-citationHead, J. A., Stansfeld, S. A., Ebmeier, K. P., Geddes, J. R., Allan, C. L., Lewis, G., & Mika Kivimaki, B. (2013) · Psychological Medicine · doi:10.1017/s0033291713000342 · Cited by 93
Cho, M. J., Mościcki, E. K., Narrow, W. E., Rae, D. S., Locke, B. Z., & Regier, D. A. (1993) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/bf00797317 · Cited by 82
Dozeman, E., van Schaik, A., van Marwijk, H., Stek, M. L., van der Horst, H. E., & Beekman, A. T. F. (2010) · International Journal of Geriatric Psychiatry · doi:10.1002/gps.2519 · Cited by 80
MetaDAS: A SAS macro for meta-analysis of diagnostic accuracy studies
Takwoingi, Y., & Deeks, J. J. (2010) · Cited by 80
Ros, L., Latorre, J. M., Aguilar, M. J., Serrano, J. P., Bravo, B. N., & Ricarte, J. J. (2011) · The International Journal of Aging and Human Development · doi:10.2190/ag.72.2.a · Cited by 79
Kato, N., Kinugawa, K., Shiga, T., Hatano, M., Takeda, N., Imai, Y., Watanabe, M., Yao, A., Hirata, Y., Kazuma, K., et al. (2012) · Journal of Cardiology · doi:10.1016/j.jjcc.2012.01.010 · Cited by 66
Psychometric Properties of the CES-D Scale Among Colombian Adults from the General Population
Campo‐Arias, A., Díaz‐Martínez, L. A., Rueda-Jaimes, G. E., Afanador, L. D. P. C., & Hernandez, N. (2007) · Revista Colombiana de Psiquiatría · Cited by 57
Use of brief psychiatric screening measures in a primary care sample
McQuaid, J. R., Stein, M. B., McCahill, M. E., Laffaye, C., & Ramel, W. (2000) · Depression and Anxiety · doi:10.1002/1520-6394(2000)12:1<21::aid-da3>3.0.co;2-u · Cited by 55
Christensen, H. M., Batterham, P. J., Grant, J. B., Griffiths, K. M., & Mackinnon, A. J. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-154 · Cited by 52
Brugha, T. S., Matthews, R. J., Morgan, Z., Hill, T., Alonso, J., & Jones, D. R. H. (2012) · The British Journal of Psychiatry · doi:10.1192/bjp.bp.111.098103 · Cited by 51
Self-citationPapassotiropoulos, A., & Heun, R. (1999) · Progress in Neuro-Psychopharmacology and Biological Psychiatry · doi:10.1016/s0278-5846(99)00007-x · Cited by 50
Hendrie, H. C., Callahan, C. M., Levitt, E. E., Hui, S. L., Mustek, B., Austrom, M. G., Nürnberger, J. I., & Tierney, W. M. (1995) · American Journal of Geriatric Psychiatry · doi:10.1097/00019442-199500320-00004 · Cited by 47
Rueda-Jaimes, G. E., Camacho, P. A., Latorre, J. F., Navarro-Mancilla, Á. A., Escobar, M., & Franco, J. A. (2009) · Biomédica · doi:10.7705/biomedica.v29i2.28 · Cited by 31
Li, X., Wang, W., Gao, Q., Wu, L., Luo, Y., Tang, Z., & Guo, X. (2012) · PLoS ONE · doi:10.1371/journal.pone.0042999 · Cited by 28
Interpretation of diagnostic data: 5. How to do it with simple maths.
(1983) · PubMed · Cited by 23
Research works printed but not linked: 1
- JM Ring, 1991, Depression in a Latino immigrant medical population: an exploratory screening and diagnosis, The American Journal of Orthopsychiatry, 61, 298, 10.1037/h0079242 · doi:10.1037/h0079242
Cited by
Cénat, J. M., Blais-Rochette, C., Kokou-Kpolou, C. K., Noorishad, P.-G., Mukunzi, J. N., McIntee, S.-E., Dalexis, R. D., Goulet, M.-A., & Labelle, P. R. (2021) · Psychiatry Research · doi:10.1016/j.psychres.2020.113599 · Cited by 952
Clark, L. A., Cuthbert, B., Lewis-Fernández, R., Narrow, W. E., & Reed, G. M. (2017) · Psychological Science in the Public Interest · doi:10.1177/1529100617727266 · Cited by 688
Marroquín, B., Vine, V., & Morgan, R. (2020) · Psychiatry Research · doi:10.1016/j.psychres.2020.113419 · Cited by 624
Salari, N., Khazaie, H., Hosseinian-Far, A., Khaledi-Paveh, B., Kazeminia, M., Mohammadi, M., Shohaimi, S., Daneshkhah, A., & Eskandari, S. (2020) · Human Resources for Health · doi:10.1186/s12960-020-00544-1 · Cited by 577
Huang, R., Wang, K., & Hu, J. (2016) · Nutrients · doi:10.3390/nu8080483 · Cited by 505
Metadata
- Authors
- Vilagut, G., Forero, C. G., Barbaglia, G., & Alonso, J.
- Venue
- PLOS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2016-05-16
- Volume
- 11
- Issue
- 5
- Pages
- e0155431
- ISSN
- 1932-6203 (ISSN-L)
- OpenAlex
- W2398010472
- Cited by
- 982
- References
- 66
- FWCI
- 10.02
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- Instituto de Salud Carlos III (FEDER (PI08/90724))
- Department of Health, Generalitat de Catalunya (AGAUR 2014 SGR 748; AGAUR 2009 SGR 1095)
- Instituto de Salud Carlos III (ES) ((ECA07/059))
- Ministerio de Ciencia e Innovación (FSE (JCI-2009-05486), Rio Hortega grant (CM 10-00099))
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.