The DOI matches its Crossref record; 73 of the 74 references it cites were found in a registry or an index.
Establishing a common metric for depressive symptoms: linking the BDI-II, CES-D, and PHQ-9 to PROMIS depression
Open accessAbstract
Interest in measuring patient-reported outcomes has increased dramatically in recent decades. This has simultaneously produced numerous assessment options and confusion. In the case of depressive symptoms, there are many commonly used options for measuring the same or a very similar concept. Public and professional reporting of scores can be confused by multiple scale ranges, normative levels, and clinical thresholds. A common reporting metric would have great value and can be achieved when similar instruments are administered to a single sample and then linked to each other to produce cross-walk score tables (e.g., Dorans, 2007; Kolen & Brennan, 2004). Using multiple procedures based on item response theory and equipercentile methods, we produced cross-walk tables linking 3 popular "legacy" depression instruments-the Center for Epidemiologic Studies Depression Scale (Radloff, 1977; N = 747), the Beck Depression Inventory-II (Beck, Steer, & Brown, 1996; N = 748), and the 9-item Patient Health Questionnaire (Kroenke, Spitzer, & Williams, 2001; N = 1,120)-to the depression metric of the National Institutes of Health (NIH) Patient-Reported Outcomes Measurement Information System (PROMIS; Cella et al., 2010). The PROMIS Depression metric is centered on the U.S. general population, matching the marginal distributions of gender, age, race, and education in the 2000 U.S. census (Liu et al., 2010). The linking relationships were evaluated by resampling small subsets and estimating confidence intervals for the differences between the observed and linked PROMIS scores; in addition, PROMIS cutoff scores for depression severity were estimated to correspond with those commonly used with the legacy measures. Our results allow clinicians and researchers to retrofit existing data of 3 popular depression measures to the PROMIS Depression metric and vice versa.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“There is strong evidence of construct validity for the PROMIS depression scale, which has been validated against the Center for Epidemiological Studies Depression Scale (CES-D), the Beck Depression Inventory (BDI-II), and the Patient Health Questionnaire (PHQ-9) (Choi et al., 2014; Pilkonis et al., 2014).”
From Problematic social media use and depressive symptoms among U.S. young adults: A nationally-representative study (2017) · cites this paper as Choi et al., 2014
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2000) · doi:10.32614/r.manuals · Cited by 355,893
The CES-D Scale: A Self-Report Depression Scale for Research in the General Population
Radloff, L. S. (1977) · Applied Psychological Measurement · doi:10.1177/014662167700100306 · Cited by 53,267
The PHQ-9: Validity of a brief depression severity measure
Kroenke, K., Spitzer, R. L., & Williams, J. B. W. (2001) · Journal of General Internal Medicine · doi:10.1046/j.1525-1497.2001.016009606.x · Cited by 44,910
Hamilton, M. (1960) · Journal of Neurology, Neurosurgery & Psychiatry · doi:10.1136/jnnp.23.1.56 · Cited by 32,817
Cognitive Therapy for Depression
(2012) · PsycEXTRA Dataset · doi:10.1037/e675542012-001 · Cited by 9,678
Marsh, H. W., Hau, K.-T., & Wen, Z. (2004) · Structural Equation Modeling: A Multidisciplinary Journal · doi:10.1207/s15328007sem1103_2 · Cited by 6,691
Cella, D., Riley, W., Stone, A., Rothrock, N., Reeve, B., Yount, S., Amtmann, D., Bode, R., Buysse, D., Choi, S., et al. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2010.04.011 · Cited by 5,128
Self-citationCognitive Therapy of Depression
HOLLON, S. D., & BECK, A. T. (1979) · Cognitive-Behavioral Interventions · doi:10.1016/b978-0-12-404480-7.50012-5 · Cited by 4,685
Test Theory: A Unified Treatment
Zwick, R., & McDonald, R. P. (2000) · Journal of the American Statistical Association · doi:10.2307/2669496 · Cited by 3,641
Depression: Causes and treatment
Beck, A. T. (1973) · Behavior Therapy · doi:10.1016/s0005-7894(73)80054-1 · Cited by 3,163
Cella, D., Yount, S., Rothrock, N., Gershon, R., Cook, K., Reeve, B., Ader, D., Fries, J. F., Bruce, B., & Rose, M. (2007) · Medical Care · doi:10.1097/01.mlr.0000258615.42478.55 · Cited by 3,118
Self-citationReinsch, C. H. (1967) · Numerische Mathematik · doi:10.1007/bf02162161 · Cited by 2,270
Assessing depressive symptoms in five psychiatric populations: a validation study.
Weissman, M., Sholomskas, D., Pottenger, M., Prusoff, B., & Locke, B. Z. (1977) · American Journal of Epidemiology · doi:10.1093/oxfordjournals.aje.a112455 · Cited by 2,232
Pilkonis, P. A., Choi, S. W., Reise, S. P., Stover, A. M., Riley, W. T., Cella, D., & PROMIS Cooperative Group (2011) · Assessment · doi:10.1177/1073191111411667 · Cited by 2,132
Self-citationThe Sources of Four Commonly Reported Cutoff Criteria: What Did They Really Say?
Lance, C. E., Butts, M. M., & Michels, L. C. (2006) · Organizational Research Methods · doi:10.1177/1094428105284919 · Cited by 2,053
Psychometric Evaluation and Calibration of Health-Related Quality of Life Item Banks
Reeve, B. B., Hays, R. D., Bjørner, J. B., Cook, K. F., Crane, P. K., Teresi, J. A., Thissen, D., Revicki, D. A., Weiss, D. J., Hambleton, R. K., et al. (2007) · Medical Care · doi:10.1097/01.mlr.0000250483.85507.04 · Cited by 1,491
Self-citationDetecting and monitoring depression with a two-item questionnaire (PHQ-2)
Löwe, B., Kroenke, K., & Gräfe, K. (2005) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2004.09.006 · Cited by 1,473
Zinbarg, R. E., Revelle, W., Yovel, I., & Li, W. (2005) · Psychometrika · doi:10.1007/s11336-003-0974-7 · Cited by 1,439
The Development of Hierarchical Factor Solutions
Schmid, J., & Leiman, J. M. (1957) · Psychometrika · doi:10.1007/bf02289209 · Cited by 1,098
NIH Toolbox for Assessment of Neurological and Behavioral Function
Gershon, R. C., Wagster, M. V., Hendrie, H. C., Fox, N. A., Cook, K. F., & Nowinski, C. J. (2013) · Neurology · doi:10.1212/wnl.0b013e3182872e5f · Cited by 895
Self-citationLocal Dependence Indexes for Item Pairs Using Item Response Theory
Chen, W.-H., & Thissen, D. (1997) · Journal of Educational and Behavioral Statistics · doi:10.3102/10769986022003265 · Cited by 855
Buysse, D. J., Yu, L., Moul, D. E., Germain, A., Stover, A., Dodds, N. E., Johnston, K. L., Shablesky-Cade, M. A., & Pilkonis, P. A. (2010) · Sleep · doi:10.1093/sleep/33.6.781 · Cited by 850
Depression: causes and treatment
Mascella, V. (2013) · Estudos de Psicologia (Campinas) · doi:10.1590/s0103-166x2013000200016 · Cited by 833
Use of a self-report symptom scale to detect depression in a community sample
Myers, J. K., & Weissman, M. M. (1980) · American Journal of Psychiatry · doi:10.1176/ajp.137.9.1081 · Cited by 777
Reise, S. P., Scheines, R., Widaman, K. F., & Haviland, M. G. (2013) · Educational and Psychological Measurement · doi:10.1177/0013164412449831 · Cited by 766
Developing a Common Metric in Item Response Theory
Stocking, M. L., & Lord, F. M. (1983) · Applied Psychological Measurement · doi:10.1177/014662168300700208 · Cited by 744
Evaluation of Item Candidates: The PROMIS Qualitative Item Review
DeWalt, D. A., Rothrock, N., Yount, S., & Stone, A. A. (2007) · Medical Care · doi:10.1097/01.mlr.0000254567.79743.e2 · Cited by 719
Test Equating, Scaling, and Linking: Methods and Practices
Kolen, M. J., & Brennan, R. L. (2004) · Springer eBooks · doi:10.1007/978-1-4757-4310-4 · Cited by 708
How Should the Internal Structure of Personality Inventories Be Evaluated?
Hopwood, C. J., & Donnellan, M. B. (2010) · Personality and Social Psychology Review · doi:10.1177/1088868310361240 · Cited by 671
Adaptive EAP Estimation of Ability in a Microcomputer Environment
Bock, R. D., & Mislevy, R. J. (1982) · Applied Psychological Measurement · doi:10.1177/014662168200600405 · Cited by 664
Standardized or simple effect size: what should be reported?
Baguley, T. (2009) · British Journal of Psychology · doi:10.1348/000712608x377117 · Cited by 619
Representativeness of the Patient-Reported Outcomes Measurement Information System Internet panel
Liu, H., Cella, D. F., Gershon, R. C., Shen, J., Morales, L. S., Riley, W. T., & Hays, R. D. (2010) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2009.11.021 · Cited by 454
Self-citationThe community mental health assessment survey and the CES-D scale
Radloff, L. (1983) · Medical Entomology and Zoology · Cited by 442
Titov, N., Dear, B. F., McMillan, D., Anderson, T., Zou, J., & Sunderland, M. (2011) · Cognitive Behaviour Therapy · doi:10.1080/16506073.2010.550059 · Cited by 342
Comparison of IRT True-Score and Equipercentile Observed-Score "Equatings"
Lord, F. M., & Wingersky, M. S. (1984) · Applied Psychological Measurement · doi:10.1177/014662168400800409 · Cited by 337
Cook, K., Kallen, M., & Amtmann, D. (2009) · Quality of Life Research · doi:10.1007/s11136-009-9464-4 · Cited by 300
Self-citationEQUATING LOGISTIC ABILITY SCALES BY A WEIGHTED LEAST SQUARES METHOD
Haebara, T. (1980) · Japanese Psychological Research · doi:10.4992/psycholres1954.22.144 · Cited by 273
Gershon, R. C., Rothrock, N. E., Hanrahan, R. T., Bass, M., & Cella, D. F. (2010) · PubMed · Cited by 267
Self-citationChoi, S. W., Reise, S. P., Pilkonis, P. A., Hays, R. D., & Cella, D. F. (2009) · Quality of Life Research · doi:10.1007/s11136-009-9560-5 · Cited by 266
Self-citationFries, J. F., Cella, D. F., Rose, M., Krishnan, E., & Bruce, B. (2009) · The Journal of Rheumatology · doi:10.3899/jrheum.090358 · Cited by 244
Self-citationDevelopment and psychometric analysis of the PROMIS pain behavior item bank
Revicki, D. A., Chen, W.-H., Harnam, N., Cook, K. F., Amtmann, D., Callahan, L. F., Jensen, M. P., & Keefe, F. J. (2009) · Pain · doi:10.1016/j.pain.2009.07.029 · Cited by 239
Self-citationPopulation Invariance and the Equatability of Tests: Basic Theory and The Linear Case
Dorans, N. J., & Holland, P. W. (2000) · Journal of Educational Measurement · doi:10.1111/j.1745-3984.2000.tb01088.x · Cited by 239
Getting What You Ask For: On the Selectivity of Depression Rating Scales
Demyttenaere, K., & De Fruyt, J. (2003) · Psychotherapy and Psychosomatics · doi:10.1159/000068690 · Cited by 206
Naughton, M. J., & Wiklund, I. E. (1993) · Quality of Life Research · doi:10.1007/bf00422216 · Cited by 197
Equating Health Status Measures With Item Response Theory
McHorney, C. A., & Cohen, A. S. (2000) · Medical Care · doi:10.1097/00005650-200009002-00008 · Cited by 182
Sensitivity and Specificity of Depression Questionnaires in a College-Age Sample
Shean, G. D., & Baldwin, G. (2008) · The Journal of Genetic Psychology · doi:10.3200/gntp.169.3.281-292 · Cited by 176
Choi, S. W. (2009) · Applied Psychological Measurement · doi:10.1177/0146621608329892 · Cited by 175
Self-citationKung, S., Alarcón, R. D., Williams, M. D., Poppe, K. A., Moore, M. J., & Frye, M. (2013) · Journal of Affective Disorders · doi:10.1016/j.jad.2012.08.017 · Cited by 149
Milette, K., Hudson, M., Baron, M., & Thombs, B. D. (2010) · Lara D. Veeken · doi:10.1093/rheumatology/kep443 · Cited by 147
Comparing the BDI-II and the PHQ-9 with outpatient substance abusers
Dum, M., Pickren, J., Sobell, L. C., & Sobell, M. B. (2007) · Addictive Behaviors · doi:10.1016/j.addbeh.2007.09.017 · Cited by 141
plink: AnRPackage for Linking Mixed-Format Tests Using IRT-Based Methods
Weeks, J. P. (2010) · Journal of Statistical Software · doi:10.18637/jss.v035.i12 · Cited by 136
Entwicklung des Fragebogens »ICD-10-Symptom-Rating« (ISR)
Tritt, K., von Heymann, F., Zaudig, M., Zacharias, I., Söllner, W., & Loew, T. (2008) · Zeitschrift für Psychosomatische Medizin und Psychotherapie · doi:10.13109/zptm.2008.54.4.409 · Cited by 123
Equating, Concordance, and Expectation
Dorans, N. J. (2004) · Applied Psychological Measurement · doi:10.1177/0146621604265031 · Cited by 119
Linking scores from multiple health outcome instruments
Dorans, N. J. (2007) · Quality of Life Research · doi:10.1007/s11136-006-9155-3 · Cited by 119
Summed-score linking using item response theory: Application to depression measurement.
Orlando, M., Sherbourne, C. D., & Thissen, D. (2000) · Psychological Assessment · doi:10.1037//1040-3590.12.3.354 · Cited by 118
Summed-score linking using item response theory: Application to depression measurement.
Orlando, M., Sherbourne, C. D., & Thissen, D. (2000) · Psychological Assessment · doi:10.1037/1040-3590.12.3.354 · Cited by 98
A Framework and History for Score Linking
Holland, P. W. (2007) · Springer eBooks · doi:10.1007/978-0-387-49771-6_2 · Cited by 83
Equating EORTC QLQ-C30 and FACT-G scores and its use in oncological research
Holzner, B., Bode, R. K., Hahn, E. A., Cella, D. F., Kopp, M., Sperner‐Unterweger, B., & Kemmler, G. (2006) · European Journal of Cancer · doi:10.1016/j.ejca.2006.08.016 · Cited by 83
Self-citationScreening for major depressive disorder in the community: A comparison of measures.
Zimmerman, M., & Coryell, W. H. (1994) · Psychological Assessment · doi:10.1037/1040-3590.6.1.71 · Cited by 82
Assessment of self-reported negative affect in the NIH Toolbox
Pilkonis, P. A., Choi, S. W., Salsman, J. M., Butt, Z. A., Moore, T. L., Lawrence, S. M., Zill, N., Cyranowski, J. M., Kelly, M. A. R., Knox, S. S., et al. (2012) · Psychiatry Research · doi:10.1016/j.psychres.2012.09.034 · Cited by 72
Self-citationThe Standard Error of Equipercentile Equating
Lord, F. M. (1982) · Journal of Educational Statistics · doi:10.3102/10769986007003165 · Cited by 66
Equating the MOS SF36 and the LSU HSI Physical Functioning Scales.
Fisher, W. P., Eubanks, R. L., & Marier, R. L. (1997) · PubMed · Cited by 64
Gibbons, L. E., Feldman, B. J., Crane, H. M., Mugavero, M. J., Willig, J. H., Patrick, D. L., Schumacher, J. E., Saag, M. S., Kitahata, M. M., & Crane, P. K. (2011) · Quality of Life Research · doi:10.1007/s11136-011-9882-y · Cited by 60
Noonan, V. K., Cook, K. F., Bamer, A. M., Choi, S. W., Kim, J., & Amtmann, D. (2012) · Quality of Life Research · doi:10.1007/s11136-011-0040-3 · Cited by 54
Self-citationThissen, D., Varni, J. W., Stucky, B. D., Liu, Y., Irwin, D. E., & DeWalt, D. A. (2011) · Quality of Life Research · doi:10.1007/s11136-011-9874-y · Cited by 52
Evaluating the Impact of Multidimensionality on Unidimensional Item Response Theory Model Parameters
Stucky, B. D., & Edelen, M. O. (2014) · Routledge eBooks · doi:10.4324/9781315736013-11 · Cited by 47
Hepner, K. A., Hunter, S. B., Edelen, M. O., Zhou, A. J., & Watkins, K. E. (2009) · Journal of Substance Abuse Treatment · doi:10.1016/j.jsat.2009.03.005 · Cited by 44
Fischer, F. H., Tritt, K., Klapp, B. F., & Fliege, H. (2011) · International Journal of Methods in Psychiatric Research · doi:10.1002/mpr.350 · Cited by 41
Linking Pain Items from Two Studies Onto a Common Scale Using Item Response Theory
Chen, W.-H., Revicki, D. A., Lai, J., Cook, K. F., & Amtmann, D. (2009) · Journal of Pain and Symptom Management · doi:10.1016/j.jpainsymman.2008.11.016 · Cited by 31
Self-citationIdentifying Local Dependence With a Score Test Statistic Based on the Bifactor Logistic Model
Liu, Y., & Thissen, D. (2012) · Applied Psychological Measurement · doi:10.1177/0146621612458174 · Cited by 29
Describing depression: Congruence between patient experiences and clinical assessments
Kelly, M. A. R., Morse, J. Q., Stover, A., Hofkens, T., Huisman, E., Shulman, S. W., Eisen, S., Becker, S. J., Weinfurt, K., Boland, E. M., et al. (2011) · British Journal of Clinical Psychology · doi:10.1348/014466510x493926 · Cited by 28
Patient-Centered Revisions to the DSM-5
Kuhl, E. A., Kupfer, D. J., & Regier, D. A. (2011) · The AMA Journal of Ethic · doi:10.1001/virtualmentor.2011.13.12.stas1-1112 · Cited by 11
Gibbons, L. E., Feldman, B. J., Crane, H. M., Mugavero, M. J., Willig, J. H., Patrick, D. L., Schumacher, J. E., Saag, M. S., Kitahata, M. M., & Crane, P. K. (2012) · Quality of Life Research · doi:10.1007/s11136-012-0313-5 · Cited by 2
Research works printed but not linked: 1
- Quilty LC Bagby R 2008 The assessment of depressive severity: A review Directions in Psychiatry 28 135 146
Cited by
Sorted by citations
Lin, L. Y., Sidani, J. E., Shensa, A., Radovic, A., Miller, E., Colditz, J. B., Hoffman, B. L., Giles, L. M., & Primack, B. A. (2016) · Depression and Anxiety · doi:10.1002/da.22466 · Cited by 1,111
Primack, B. A., Shensa, A., Escobar-Viera, C. G., Barrett, E. L., Sidani, J. E., Colditz, J. B., & James, A. E. (2017) · Computers in Human Behavior · doi:10.1016/j.chb.2016.11.013 · Cited by 581
Shensa, A., Escobar-Viera, C. G., Sidani, J. E., Bowman, N. D., Marshal, M. P., & Primack, B. A. (2017) · Social Science & Medicine · doi:10.1016/j.socscimed.2017.03.061 · Cited by 469
Digital interventions for the treatment of depression: a meta-analytic review
Moshe, I., Terhorst, Y., Philippi, P., Domhardt, M., Cuijpers, P., Cristea, I., Pulkki-Råback, L., Baumeister, H., & Sander, L. B. (2021) · Psychological Bulletin · doi:10.1037/bul0000334 · Cited by 390
Li, H., Zheng, D., Li, Z., Wu, Z., Feng, W., Cao, X., Wang, J., Gao, Q., Li, X., Wang, W., et al. (2019) · JAMA Network Open · doi:10.1001/jamanetworkopen.2019.16591 · Cited by 399
Metadata
- Authors
- Choi, S. W., Schalet, B., Cook, K. F., & Cella, D.
- Affiliations
- Northwestern University (US)
- Venue
- Psychological Assessment
- Published
- 2014
- Volume
- 26
- Issue
- 2
- Pages
- 513-527
- ISSN
- 1040-3590 (ISSN-L)
- 1939-134X
- PMC
- PMC5515387
- OpenAlex
- W2069518888
- Cited by
- 480
- References
- 74
- Citations by year
- 2026: 25 · 2025: 36 · 2024: 42 · 2023: 44 · 2022: 52 · 2021: 61 · 2020: 48 · 2019: 53 · 2018: 43 · 2017: 22 · 2016: 24 · 2015: 21 · 2014: 7
- FWCI
- 31.16
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Psychological Assessment (publishedVersion)
- PubMed (publishedVersion)
- Pure Amsterdam UMC (publishedVersion)
- PubMed Central (acceptedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- Funders
- National Cancer (1RC4CA157236-01)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Mental Health Research Topics
- Keywords
- depressive symptoms, scale linking, Beck Depression Inventory-II, CES-D, PHQ-9, patient-reported outcomes, item response theory, equipercentile linking
- MeSH terms
- Depressive Disorder, Female, Humans, Male, Middle Aged, Psychiatric Status Rating Scales, Psychometrics, Surveys and Questionnaires, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review