The DOI matches its Crossref record; 152 of the 152 references it cites were found in a registry or an index.
Assessing the Reliability of Beck Depression Inventory Scores: Reliability Generalization across Studies
Abstract
The reliability estimates for the Beck Depression Inventory (BDI) scores across studies were accumulated and summarized in a meta-analysis. Only 7.5% of the articles reviewed reported meaningful reliability estimates, indicating that the logic of “test score reliability” generally has not prevailed in clinical psychology regarding application of BDI. Analyses revealed that for BDI, the measurement error due to time sampling as captured by test-retest reliability estimate is considerably larger than the measurement error due to item heterogeneity and content sampling as captured by internal consistency reliability estimate. Also, reliability estimates involving substance addicts were consistently lower than reliability estimates involving normal subjects, possibly due to restriction of range problems. Correlation analyses revealed that standard errors of measurement (SEMs) were not correlated with reliability estimates but were substantially related to standard deviations of BDI scores, suggesting that SEMs should be considered in addition to reliability estimates when interpreting individual BDI scores.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Beck Depression Inventory is a 21-item scale (α=.81 for non-psychiatric, α=.86 for psychiatric patients, with good test-retest reliability (r=.72)(55))”
Citations
Cites
An inventory for measuring depression
BECK, A. T. (1961) · Archives of General Psychiatry · doi:10.1001/archpsyc.1961.01710120031004 · Cited by 38,032
Wasserman, S. S., Hedges, L. V., & Olkin, I. (1988) · Journal of Educational Statistics · doi:10.2307/1164953 · Cited by 10,377
Introduction to Classical and Modern Test Theory
Crocker, L. M., & Algina, J. J. (1986) · Cited by 5,090
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890 · cited 3×
“Since the introduction of meta-analysis (Glass, 1976, 1977), more and more researchers have used this approach for synthesizing research literature (Jackson, 1980; Shaver, 1991; Wolf, 1986).”
BackgroundMethodMeasurement, Design, and Analysis: An Integrated Approach.
Funk, S. G., Pedhazur, E. J., & Schmelkin, L. P. (1992) · Journal of the American Statistical Association · doi:10.2307/2290248 · Cited by 4,007
Depression: Causes and treatment
Beck, A. T. (1973) · Behavior Therapy · doi:10.1016/s0005-7894(73)80054-1 · Cited by 3,163
Sæverot, H. (2021) · Routledge eBooks · doi:10.4324/9781003193463-8 · Cited by 3,090
Hunter, J., & Schmidt, F. (2004) · doi:10.4135/9781412985031 · Cited by 3,023
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Statistical Methods for Meta-Analysis
(1985) · Elsevier eBooks · doi:10.1016/c2009-0-03396-0 · Cited by 2,570
Research works printed but not linked: 5
- Beck, A. T., 1996, Manual for Beck Depression Inventory-II
- 10.2466/pr0.1986.59.1.331 · DOI · Paper page
- Love, A. W., 1987, Journal of Clinical Psychology, 43, 84, 10.1002/1097-4679(198701)43:1<84::AID-JCLP2270430111>3.0.CO;2-# · DOI
- Watkins, A. J., annual meeting of the Gerontological Society of America
- Willson, V. L., 1980, Educational Researcher, 9, 5
Cited by
Sorted by citations
Starting at the beginning: an introduction to coefficient alpha and internal consistency
Streiner, D. L. (2003) · Journal of Personality Assessment · doi:10.1207/s15327752jpa8001_18 · Cited by 3,794
“As a number of authors have pointed out, how- ever, reliability is a characteristic of the test scores, not of the test itself (e.g., Caruso, 2000; Pedhazur & Schmelkin, 1991; Yin & Fan, 2000).”
BackgroundPsychometric properties of the Beck Depression Inventory-II: a comprehensive review
Wang, Y.-P., & Gorenstein, C. (2013) · Revista Brasileira de Psiquiatria · doi:10.1590/1516-4446-2012-1048 · Cited by 1,577
A meta-analytic examination of the goal orientation nomological net.
Payne, S. C., Youngcourt, S. S., & Beaubien, J. M. (2007) · Journal of Applied Psychology · doi:10.1037/0021-9010.92.1.128 · Cited by 1,242
Onwuegbuzie, A. J., & Leech, N. L. (2005) · International Journal of Social Research Methodology · doi:10.1080/13645570500402447 · Cited by 1,421
“Consistent with this contention, several researchers (e.g. Yin & Fan, 2000) have documented examples of score reliability estimates that have varied significantly upon different administrations of the same instrument.”
Understanding Internal Consistency Reliability Estimates: A Conceptual Primer on Coefficient Alpha
Henson, R. K. (2001) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2002.12069034 · Cited by 1,067
Ramel1, W., Goldin, P. R., Carmona, P. E., & McQuaid, J. R. (2004) · Cognitive Therapy and Research · doi:10.1023/b:cotr.0000045557.15923.96 · Cited by 580
“The BDI has been found to correlate .68 with interview-based assessments of depression (Rabkin & Klein, 1987) and has good internal consistency (α = .84) and moderate test-retest reliability (r = .69; Yin & Fan, 2000).”
MethodKaryotaki, E., Ebert, D. D., Donkin, L., Riper, H., Twisk, J., Burger, S., Rozental, A., Lange, A., Williams, A. D., Zarski, A. C., et al. (2018) · Clinical Psychology Review · doi:10.1016/j.cpr.2018.06.007 · Cited by 303
A Reliability Generalization Study of the Teacher Efficacy Scale and Related Instruments
Henson, R. K., Kogan, L. R., & Vacha‐Haase, T. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971284 · Cited by 306
Reliability of the Hamilton Rating Scale for Depression: A meta-analysis over a period of 49years
Trajković, G., Starčević, V., Latas, M., Leštarević, M., Ille, T., Bukumirić, Z., & Marinković, J. (2011) · Psychiatry Research · doi:10.1016/j.psychres.2010.12.007 · Cited by 303
“A similar relationship between test–retest reliability and theperiod between the two administrations of the scale was observed in a metaanalysis of reliability of the Beck Depression Inventory (Beck et al., 1961), with the correlation coefficient of r=–0.59 (Yin and Fan, 2000).”
InfluentialMeta-analysis of Cohen’s kappa
Sun, S. (2011) · Health Services and Outcomes Research Methodology · doi:10.1007/s10742-011-0077-3 · Cited by 282
Treating Cronbach’s Alpha Reliability Coefficients as Data in Counseling Research
Helms, J. E., Henze, K. T., Sass, T. L., & Mifsud, V. A. (2006) · The Counseling Psychologist · doi:10.1177/0011000006288308 · Cited by 276
“We use the DG and referent data, summarized in Table 1 to illustrate several types of RG studies that are easily accomplished and, as Yin and Fan (2000) point out, will make it possible to understand how and why the reliability of measurements obtained from a particular scale vary across studies.”
MethodDeyo, M., Wilson, K. A., Ong, J., & Koopman, C. (2009) · EXPLORE · doi:10.1016/j.explore.2009.06.005 · Cited by 265
Hess, T. J., McNab, A. L., & Basoglu, K. A. (2014) · MIS Quarterly · doi:10.25300/misq/2014/38.1.01 · Cited by 242
“Further, measurement characteristics such as scale version (Yin and Fan 2000) and reliability type (Capraro et al.”
BackgroundMethodInfluentialThe robust reliability of neuropsychological measures: meta-analyses of test-retest correlations
Calamia, M., Markon, K., & Tranel, D. (2013) · The Clinical Neuropsychologist · doi:10.1080/13854046.2013.809795 · Cited by 207
“Numerous reliability generalization studies have since been conducted for a variety of tests (e.g., the BDI, Yin & Fan, 2000; and the MMPI, Vacha-Haase, Kogan, Tani, & Woodall, 2001).”
BackgroundSignificance, Effect Sizes, Stepwise Methods, and Other Issues: Strong Arguments Move the Field
Thompson, B. (2001) · The Journal of Experimental Education · doi:10.1080/00220970109599499 · Cited by 241
Multilevel Meta-analysis: a comparison with traditional meta-analytical procedures
Van Den Noortgate, W., & Onghena, P. (2003) · Educational and Psychological Measurement · doi:10.1177/0013164403251027 · Cited by 218
“…studies include those reported by Capraro, Capraro, and Henson (2001); Caruso (2000); Caruso, Witkiewitz, Belcourt-Dittloff, and Gottlieb (2001); Helms (1999); Henson, Kogan, and Vacha-Haase (2001); Vacha-Haase, Kogan, Tani, and Woodall (2001); Viswesvaran and Ones (2000); and Yin and Fan (2000).”
BackgroundA Reliability Generalization Meta-Analysis of Coefficient Alpha for the Maslach Burnout Inventory
Wheeler, D., Vassar, M. B., Worley, J. A., & Barnes, L. L. B. (2011) · Educational and Psychological Measurement · doi:10.1177/0013164410391579 · Cited by 185
“Sample characteristics can be tabulated in an attempt to account for the variability in reliability scores when used as a dependent variable (e.g., Yin & Fan, 2000).”
BackgroundThe Balanced Inventory of Desirable Responding (BIDR)
Li, A., & Bagger, J. (2007) · Educational and Psychological Measurement · doi:10.1177/0013164406292087 · Cited by 175
“For example, Yin and Fan (2000) identified over 1,200 studies that used the Beck Depression Inventory.”
BackgroundMethodReliability Generalization of Working Alliance Inventory Scale Scores
Hanson, W. E., Curry, K. T., & Bandalos, D. L. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402062004008 · Cited by 161
“Nevertheless, RG studies have been conducted on a number of wellknown, clinically-oriented psychological tests, including, to name a few, symptom-based tests, such as the Beck Depression Inventory (BDI) ( Yin & Fan, 2000 ), and personality tests, such as the Minnesota Multiphasic Personality Inventory (MMPI/MMPI-2) (V…”
BackgroundReliability Generalization: Moving Toward Improved Understanding and Use of Score Reliability
Vacha‐Haase, T., Henson, R. K., & Caruso, J. C. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402062004002 · Cited by 157
“Yin and Fan (2000): Beck Depression Inventory 5.6 7.5 6.8 80.1 Youngstrom and Green (in press): Differential Emotions Scale — 0 — — Note.”
BackgroundInfluentialPsychometric Properties of “Community Assessment of Psychic Experiences”: Review and Meta-analyses
Mark, W., & Toulopoulou, T. (2015) · Schizophrenia Bulletin · doi:10.1093/schbul/sbv088 · Cited by 166
Capraro, R. M., & Capraro, M. M. (2002) · Educational and Psychological Measurement · doi:10.1177/001316402128775030 · Cited by 153
Young, H. R., Glerum, D. R., Joseph, D. L., & McCord, M. A. (2021) · Journal of Management · doi:10.1177/0149206320908646 · Cited by 143
“When reliabilities were missing from primary studies, we imputed sample-weighted reliabilities that we calculated following recommendations by Yin and Fan (2000).”
MethodGinting, H., Näring, G. W. B., van der Veld, W. M., Srisayekti, W., & Becker, E. S. (2013) · International Journal of Clinical and Health Psychology · doi:10.1016/s1697-2600(13)70028-0 · Cited by 133
“The moderate value of test-retest reliability was probably because the long interval between test and retest produced more measurement error (Yin & Fan, 2000).”
BackgroundLeahey, T. M., Crowther, J. H., & Irwin, S. R. (2008) · Cognitive and Behavioral Practice · doi:10.1016/j.cbpra.2008.01.004 · Cited by 127
A Framework for Reporting and Interpreting Internal Consistency Reliability Estimates
Onwuegbuzie, A. J., & Daniel, L. G. (2002) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2002.12069052 · Cited by 130
“…with this assertion, several researchers (e.g., Caruso, 2000; Henson, Kogan, & Vacha-Haase, 2001; VachaHaase, 1998; Viswesvaran & Ones, 2000; Yin & Fan, 2000) have provided examples of score reliability estimates that have varied significantly among different administrations of the same…”
BackgroundImproving the reporting quality of reliability generalization meta‐analyses: The REGEMA checklist
Sánchez‐Meca, J., Marín‐Martínez, F., López-López, J. A., Núñez, R. M. N., Rubio‐Aparicio, M., García, J. J. L., Pina, J. A. L., Blázquez-Rincón, D., López‐Ibáñez, C., & López‐Nicolás, R. (2021) · Research Synthesis Methods · doi:10.1002/jrsm.1487 · Cited by 137
“Another analytical approach is that advocated by Schmidt and Hunter,(27) consisting of assuming a random-effects model and weighting the reliability estimates by sample size.(16) Random-effects models have also been proposed,(12,56) weighting the reliability coefficients by its inverse variance, the latter defined as…”
MethodThe Reliability of the Wisconsin Card Sorting Test in Clinical Practice
Kopp, B., Lange, F., & Steinke, A. (2019) · Assessment · doi:10.1177/1073191119866257 · Cited by 122
“…variance maximize reliability, whereas lower amounts of interindividual variance minimize reliability, with the consequence that the same test may demonstrate different reliabilities in different contexts (Caruso, 2000; Cooper et al., 2017; Feldt & Brennan, 1989; Wilkinson, 1999; Yin & Fan, 2000).”
BackgroundHenson, R. K., & Thompson, B. (2002) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.2002.12069054 · Cited by 122
“For example, in their RG study of the Beck Depression Inventory, Yin and Fan (2000) chose to code whether the sample represented (a) clinical psychiatric patients versus nonclinical respondents, (b) respondents with physical diseases versus those without physical disease, and (c) respondents with a substance addiction…”
MethodReliability of Scores from the Eysenck Personality Questionnaire: A Reliability Generalization Study
Caruso, J. C., Witkiewitz, K. A., Belcourt-Dittloff, A., & Gottlieb, J. D. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971437 · Cited by 108
“…the reliability of scores does, in fact, vary as a function of participant and study characteristics (e.g., Caruso, 2000; Caruso & Edwards, in press; Vacha-Haase, 1998; Yin & Fan, 2000; but see Viswesvaran & Ones, 2000), supporting the notion that reliability is a property of scores and not tests.”
BackgroundSánchez‐Meca, J., López-López, J. A., & Pina, J. A. L. (2012) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/j.2044-8317.2012.02057.x · Cited by 106
“This model, explicitly recommended by Yin and Fan (2000) for carrying out RG studies, implies analysing untransformed coefficients alpha andweighting them by sample size, in order to givemoreweight to the studies with larger sample sizes.”
BackgroundMethodFokkema, M., Smits, N., Kelderman, H., & Cuijpers, P. J. (2013) · Psychological Assessment · doi:10.1037/a0031669 · Cited by 104
Cooper, S. R., Gonthier, C., Barch, D. M., & Braver, T. S. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01482 · Cited by 112
“…the scores produced by a test in a particular setting, not the test itself, and though this point has been frequently reiterated in the psychometric literature (Feldt and Brennan, 1989; Wilkinson and Task Force on Statistical Inference, 1999; Caruso, 2000; Yin and Fan, 2000), it bears repeating.”
BackgroundA Reliability Induction and Reliability Generalization Study of the Cage Questionnaire
Shields, A. L., & Caruso, J. C. (2004) · Educational and Psychological Measurement · doi:10.1177/0013164403261814 · Cited by 103
“…diverging opinions exist (e.g., Sawilowsky, 2000), behavioral scientists have demonstrated the empirical (e.g., Lord & Novick, 1968), logical (e.g., Yin & Fan, 2000), and practical (e.g., Thompson, 1994; Wilkinson & the American Psychological Association Task Force on Statistical Inference…”
BackgroundArmey, M. F., Fresco, D. M., Moore, M., Mennin, D. S., Turk, C. L., Heimberg, R. G., Kecmanovic, J., & Alloy, L. B. (2009) · Assessment · doi:10.1177/1073191109340388 · Cited by 111
“Meta-analysis of BDI studies has demonstrated good internal consistency (α = .84) and moderate test–retest reliability (r = .69; Yin & Fan, 2000).”
Sun, S., & Wang, S. (2014) · Journal of Child and Family Studies · doi:10.1007/s10826-014-0038-x · Cited by 97
Fan, X. (2003) · Educational and Psychological Measurement · doi:10.1177/0013164403251319 · Cited by 95
“The fact that only such a small percentage of studies reported their measurement reliabilities “shows that the concept of test score reliability has not generally prevailed . . . and research practice . . . still leaves much to be desired” (Yin & Fan, 2000, p. 210).”
BackgroundInfluentialSelf-citationLandau, S., & Stahl, D. R. (2012) · Statistical Methods in Medical Research · doi:10.1177/0962280212439578 · Cited by 101
“For example, the commonly used Beck depression inventory scale II categorises a quasi continuous scale into minimal, mild, moderate and severe depression symptoms.(52) The categorised outcomes are then analysed based on a model for such an outcome (e.”
MethodA randomized trial of massage therapy after heart surgery
Albert, N. M., Gillinov, A. M., Lytle, B. W., Feng, J., Cwynar, R. E., & Blackstone, E. H. (2009) · Heart & Lung · doi:10.1016/j.hrtlng.2009.03.001 · Cited by 89
Meta‐Analysis of Coefficient Alpha: A Reliability Generalization Study
Greco, L., O’Boyle, E. H., Cockburn, B. S., & Yuan, Z. (2017) · Journal of Management Studies · doi:10.1111/joms.12328 · Cited by 103
Meerwijk, E. L., Ford, J. M., & Weiss, S. J. (2015) · Biological Psychology · doi:10.1016/j.biopsycho.2015.01.003 · Cited by 84
Score Reliability: A Retrospective Look Back at 12 Years of Reliability Generalization Studies
Vacha‐Haase, T., & Thompson, B. (2011) · Measurement and Evaluation in Counseling and Development · doi:10.1177/0748175611409845 · Cited by 83
Chentsova-Dutton, Y. E., Tsai, J. L., & Gotlib, I. H. (2010) · Cultural Diversity & Ethnic Minority Psychology · doi:10.1037/a0017562 · Cited by 81
“These measures have adequate reliability and validity (Beck, Steer, & Carbin, 1988; Morriss, Leese, Chatwin, & Baldwin, 2008; Yin & Fan, 2000; but also see Bagby, Ryder, Schuller, & Marshall, 2004, for concerns regarding psychometric qualities of the HDRS).”
Rexrode, K. R., Petersen, S., & O’Toole, S. K. (2007) · Educational and Psychological Measurement · doi:10.1177/0013164407310128 · Cited by 80
Measurement Error of Scores on the Mathematics Anxiety Rating Scale across Studies
Capraro, M. M., Capraro, R. M., & Henson, R. K. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971266 · Cited by 79
“Examples of RG studies include examinations of the Bem Sex Role Inventory (Vacha-Haase, 1998), Beck Depression Inventory (Yin & Fan, 2000), “Big Five Factors” of personality across various tests (Viswesvaran & Ones, 2000), NEO–”
MethodResultInfluentialA Reliability Generalization Study on the Survey of Perceived Organizational Support
Hellman, C. M., Fuqua, D. R., & Worley, J. A. (2006) · Educational and Psychological Measurement · doi:10.1177/0013164406288158 · Cited by 78
Henson, R. K., & Hwang, D.-Y. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402062004011 · Cited by 74
“Although this would be expected (see Yin & Fan, 2000), many alpha coefficients were quite low and most test-retest estimates were marginal at best.”
BackgroundReliability Generalization: An Examination of the Career Decision-Making Self-Efficacy Scale
Nilsson, J. E., Schmidt, C. K., & Meek, W. D. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402062004007 · Cited by 74
“Authors are even less likely to provide actual score reliability estimates of their own data (see Thompson & Snyder, 1998; Vacha-Haase, 1998; Vacha-Haase, Ness, Nilsson, & Reetz, 1999; Yin & Fan, 2000).”
BackgroundMethodResultInfluentialMcPherson, A., & Martin, C. R. (2009) · Journal of Psychiatric and Mental Health Nursing · doi:10.1111/j.1365-2850.2009.01469.x · Cited by 71
Vîslă, A., Constantino, M. J., Newkirk, K., Ogrodniczuk, J. S., & Söchting, I. (2016) · Psychotherapy Research · doi:10.1080/10503307.2016.1218089 · Cited by 75
“A meta-analysis of the reliability of the BDI indicated an average Cronbach alpha of .84 (Yin & Fan, 2000).”
MethodShields, A., Howell, R. T., Potter, J., & Weiss, R. (2007) · Substance Use & Misuse · doi:10.1080/10826080701212295 · Cited by 62
“These include such commonly used instruments as the Beck Depression Inventory (Yin and Fan, 2000) and the Minnesota Multiphasic Personality Inventory (Vacha-Haase, Kogan, Tani, and Woodall, 2001).”
MethodMeasuring eating disorder attitudes and behaviors: a reliability generalization study
Gleaves, D. H., Pearson, C. A., Ambwani, S., & Morey, L. C. (2014) · Journal of Eating Disorders · doi:10.1186/2050-2974-2-6 · Cited by 82
“As with other types of meta-analysis, RG allows researchers to understand a large body of literature which may be producing inconsistent findings, in this case helping to understand differences in score reliability across multiple studies [6].”
BackgroundResultInfluentialReproductive Correlates of Depressive Symptoms Among Low-Income Minority Women
Berenson, A. B., Breitkopf, C. R., & Wu, Z. H. (2003) · Obstetrics and Gynecology · doi:10.1016/j.obstetgynecol.2003.08.012 · Cited by 60
“90) with the original, 21-item (long) version(17,21) and demonstrates strong psychometric properties.(22) The sensitivity (83%), specificity (73%), and positive (81%) and negative (75%) predictive values of the short form have been established.”
BackgroundUsing Mixed-Effects Models In Reliability Generalization Studies
Beretvas, S. N., & Pastor, D. A. (2003) · Educational and Psychological Measurement · doi:10.1177/0013164402239318 · Cited by 76
“…correlation (Vacha-Haase, 1998), multiple regression (Capraro et al., 2001; Caruso et al., 2001; Vacha-Haase, 1998; Vacha-Haase et al., 2001; Yin & Fan, 2000), and ANOVA (Caruso, 2000) to describe and investigate patterns of relationships between score reliabilities and study or sample…”
BackgroundMethodResultInfluentialOgrodniczuk, J. S., Sochting, I., Piper, W. E., & Joyce, A. S. (2012) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/j.2044-8341.2011.02032.x · Cited by 56
Tsai, M. V., Ogrodniczuk, J. S., Söchting, I., & Mirmiran, J. (2012) · Clinical Psychology & Psychotherapy · doi:10.1002/cpp.1831 · Cited by 50
“A metaanalysis of the reliability of the BDI indicated an average Cronbach alpha of 0.84 (Yin & Fan, 2000).”
MethodInfluentialThe Hamilton Rating Scale for Depression: A meta-analytic reliability generalization study
Pina, J. A. L., Sánchez‐Meca, J., & Alcázar, A. I. R. (2009) · Redalyc (Universidad Autónoma del Estado de México) · Cited by 50
Reliability generalization of the Multigroup Ethnic Identity Measure-Revised (MEIM-R).
Herrington, H. M., Smith, T. B., Feinauer, E., & Griner, D. (2016) · Journal of Counseling Psychology · doi:10.1037/cou0000148 · Cited by 63
Leue, A., & Lange, S. (2010) · Assessment · doi:10.1177/1073191110374917 · Cited by 48
“The trait-like PANAS stability coefficients were comparable to those of the Beck Depression Inventory (Yin & Fan, 2000), which is a short inventory with low situational specificity like the PANAS.”
MethodTung, I., Brammer, W. A., Li, J. J., & Lee, S. S. (2014) · Journal of Clinical Child & Adolescent Psychology · doi:10.1080/15374416.2014.913250 · Cited by 52
“The Beck Depression Inventory has been extensively validated and possesses excellent psychometric properties (Beck, Steer, & Garbin, 1988; Yin & Fan, 2000).”
MethodStability of the Reliability of LibQUAL+™ Scores: A Reliability Generalization Meta-Analysis Study
Thompson, B., & Cook, C. (2002) · Educational and Psychological Measurement · doi:10.1177/001316402128775003 · Cited by 47
Dimitrov, D. M. (2002) · Educational and Psychological Measurement · doi:10.1177/001316402236878 · Cited by 47
“In fact, recent RG studies also report substantial reliability variation due to type of reliability coefficients (e.g., Vacha-Haase, 1998; Yin & Fan, 2000).”
BackgroundMethodResultInfluentialChithambo, T. P., & Huey, S. J. (2017) · International Journal of Eating Disorders · doi:10.1002/eat.22762 · Cited by 39
“The BDI-II exhibits adequate internal consistency (a5 .84; Yin & Fan, 2000), as well as concurrent validity with alternate self-report measures of depression (Storch, Roberti, & Roth, 2004).”
BackgroundA Reliability Generalization Study of the Self-Description Questionnaire
Leach, L. F., Henson, R. K., Odom, L. R., & Cagle, L. S. (2006) · Educational and Psychological Measurement · doi:10.1177/0013164405284030 · Cited by 39
“Therefore, we considered the context in which the SDQ is often used and other published RG studies that also investigated psychological or educational instruments (see, e.g., Henson & Hwang, 2002; Yin & Fan, 2000) when determining which characteristics to code.”
BackgroundMethodAllen, A. N., Kilgus, S. P., Burns, M. K., & Hodgson, C. (2018) · School Mental Health · doi:10.1007/s12310-018-9290-3 · Cited by 38
Meseguer-Henarejos, A. B., Rubio‐Aparicio, M., Pina, J. A. L., Hernández, R. M. C., & Gómez‐Conesa, A. (2019) · European Journal of Physical and Rehabilitation Medicine · doi:10.23736/s1973-9087.19.05363-2 · Cited by 38
The Maudsley Obsessive-Compulsive Inventory: A reliability generalization meta-analysis
Sánchez‐Meca, J., Pina, J. A. L., López-López, J. A., Marín‐Martínez, F., Alcázar, A. I. R., & Gómez‐Conesa, A. (2011) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 37
Lindegaard, T., Brohede, D., Koshnaw, K., Osman, S. S., Johansson, R., & Andersson, G. (2019) · Journal of Clinical Psychology · doi:10.1002/jclp.22753 · Cited by 38
Lane, G. G., White, A. E., & Henson, R. K. (2002) · Educational and Psychological Measurement · doi:10.1177/001316402128774978 · Cited by 34
Tamul, D., Elson, M., Ivory, J., Hotter, J., Lanier, M., Wolf, J., & Martínez‐Carrillo, N. I. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/shcgv · Cited by 38
A Reliability Generalization Study for a Multidimensional Loneliness Scale
Maes, M., Noortgate, W. V. D., & Goossens, L. (2015) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000237 · Cited by 35
How Days Between Tests Impacts Alternate Forms Reliability in Computerized Adaptive Tests
Wyse, A. E. (2020) · Educational and Psychological Measurement · doi:10.1177/0013164420979656 · Cited by 32
“…coefficients for the Big Five (Gnambs, 2014; Viswesvaran & Ones, 2000), the Beck Depression Inventory (de Ayala et al., 2005; Erford et al., 2016; Yin & Fan, 2000), the Minnesota Multiphasic Personal Inventory (Vacha-Haase et al., 2001), the Myers-Briggs Type Indicator (Capraro & Capraro,…”
BackgroundMethodInfluentialRouse, S. V. (2007) · Journal of Personality Assessment · doi:10.1080/00223890701293908 · Cited by 32
“Because previous research (Caruso, 2000; Vacha-Haase et al., 2001; Yin & Fan, 2000) has found that data collected in clinical settings yielded different reliability estimates than data collected in nonclinical settings, the possibility exists that reliability for PSY–5 scores is similarly affected.”
MethodResultInfluentialAlternatives for Mixed-Effects Meta-Regression Models in the Reliability Generalization Approach
López-López, J. A., Botella, J., Sánchez‐Meca, J., & Marín‐Martínez, F. (2012) · Journal of Educational and Behavioral Statistics · doi:10.3102/1076998612466142 · Cited by 37
“When weights were included in the analyses, some researchers chose the sample size as the weighting factor (e.g., Victorson, Barocas, & Song, 2008; Yin & Fan, 2000; Zangaro & Soeken, 2005), according to the proposal of Hunter and Schmidt (2004), while some others chose the inverse variance of the…”
BackgroundResultSandoval, L. R., Buckey, J. C., Ainslie, R. C., Tombari, M. L., Stone, W. S., & Hegel, M. T. (2016) · Behavior Therapy · doi:10.1016/j.beth.2016.04.001 · Cited by 32
“The standard error of measurement (SEM) for the BDI was obtained from the meta-analysis performed by Yin and Fan (2000).”
MethodExploring Factors That Affect Score Reliability and Variability
Kieffer, K. M., & MacDonald, G. F. (2011) · Journal of Individual Differences · doi:10.1027/1614-0001/a000031 · Cited by 36
Lazarevic, V., Wiley, A. R., & Pleck, J. H. (2012) · Journal of Comparative Family Studies · doi:10.3138/jcfs.43.2.217 · Cited by 30
High sex ratios in rural China: declining well-being with age in never-married men
Zhou, X., & Hesketh, T. M. (2017) · Philosophical Transactions of the Royal Society B Biological Sciences · doi:10.1098/rstb.2016.0324 · Cited by 29
The File Drawer Problem in Reliability Generalization
Howell, R. T., & Shields, A. L. (2007) · Educational and Psychological Measurement · doi:10.1177/0013164407301528 · Cited by 30
“If the researcher wishes to use weighted reliability coefficients (see Yin & Fan, 2000, for information on computing weighted reliability coefficients), the following equation can be used: aW Population = (NRG Sample × aW RG Sample ×WeightRG SampleÞ+ ðNNR Sample × aW NR Sample ×WeightNR SampleÞ NRG…”
MethodInfluentialA Reliability Generalization on the Children’s Hope Scale
Hellman, C. M., Muñoz, R. T., Worley, J. A., Feeley, J. A., & Gillert, J. E. (2017) · Child Indicators Research · doi:10.1007/s12187-017-9467-6 · Cited by 30
Sieh, D. S., van Loon-Dikkers, L., Visser‐Meily, J. M. A., & Meijer, A. M. (2012) · Journal of Developmental and Physical Disabilities · doi:10.1007/s10882-012-9291-3 · Cited by 30
“87) (Beck et al. 1961; Visser et al. 2006; Yin and Fan 2000).”
Jackman, S. D. (2009) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199286546.003.0006 · Cited by 29
Dozois, D. J. A. (2010) · The Corsini Encyclopedia of Psychology · doi:10.1002/9780470479216.corpsy0113 · Cited by 29
Goltermann, J., Emden, D., Leehr, E. J., Dohm, K., Redlich, R., Dannlowski, U., Hahn, T., & Opel, N. (2021) · JMIR Mental Health · doi:10.2196/24333 · Cited by 28
“Lower variance in depression scores in nonaffective clinical samples has previously been suggested to account for findings of low reliability among substance addiction patients [34].”
A Reliability Generalization Study of Select Measures of Adult Attachment Style
Reese, R. J., Kieffer, K. M., & Briggs, B. K. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402062004006 · Cited by 30
“RG can help identify (a) the typical score reliability for an instrument across studies, (b) factors that contribute to score variability across studies, and (c) upper and lower bounds of score reliability estimates in relation to measurement conditions and factors (Yin & Fan, 2000).”
BackgroundGordon, J. L., Ditto, B., & D’Antono, B. (2012) · Psychophysiology · doi:10.1111/j.1469-8986.2012.01397.x · Cited by 35
Reliability Reporting Across Studies Using the Buss Durkee Hostility Inventory
Vassar, M. B., & Hale, W. (2008) · Journal of Interpersonal Violence · doi:10.1177/0886260508314931 · Cited by 27
“Yin and Fan (2000) found that only 7.5% of studies using the Beck Depression Inventory reported reliability from their own data.”
BackgroundInfluentialA tutorial on the meta-analytic structural equation modeling of reliability coefficients.
Scherer, R., & Teo, T. P. (2020) · Psychological Methods · doi:10.1037/met0000261 · Cited by 29
Makhubela, M. S., & Mashegoane, S. (2015) · South African Journal of Psychology · doi:10.1177/0081246315611016 · Cited by 25
“While this stability of the BDI-II across time is relatively lower than in some findings (e.g., Aasen, 2001; Byrne et al., 2004), it is nevertheless consistent with others (Kuhner, Burger, Keller, & Hautzinger, 2007; Yin & Fan, 2000).”
ResultMeerwijk, E. L., Chesla, C. A., & Weiss, S. J. (2014) · Psychophysiology · doi:10.1111/psyp.12175 · Cited by 25
How to Meta-Analyze Coefficient-of-Stability Estimates
Mason, C., Allam, R., & Brannick, M. Τ. (2007) · Educational and Psychological Measurement · doi:10.1177/0013164407301532 · Cited by 25
Reliability Generalization of the Revised Children's Manifest Anxiety Scale
Ryngala, D. J., Shields, A. L., & Caruso, J. C. (2005) · Educational and Psychological Measurement · doi:10.1177/0013164404272495 · Cited by 25
“…applications have identified psychometric strengths and weakness in a variety of psychological measures (Caruso, 2000; Caruso & Edwards, 2001; Henson, Kogan, & Vacha-Haase, 2001; Shields & Caruso, 2003; Vacha-Haase, Tani, Kogan, Woodall, & Thompson, 2001; Viswesvaran & Ones, 2000; Yin & Fan, 2000).”
Reliability generalization of the Texas revised inventory of grief (TRIG)
Montano, S. A., Lewey, J. H., O’Toole, S. K., & Graves, D. (2016) · Death Studies · doi:10.1080/07481187.2015.1129370 · Cited by 23
“This finding is consistent with previous reliability generalization studies; Yin and Fan (2000) found that only 8% of studies using the Beck Depression Inventory reported reliability data for their scores.”
ResultA Reliability Generalization Study of the Political Skill Inventory
Jacobson, R. K., & Viswesvaran, C. (2017) · SAGE Open · doi:10.1177/2158244017706714 · Cited by 24
Enggasser, J. L., & Young, M. A. (2007) · Cognitive Therapy and Research · doi:10.1007/s10608-006-9076-z · Cited by 22
“Young et al. (1991) based this theory on findings regarding the pattern of symptom onset in the fall.”
BackgroundKieffer, K. M., Cronin, C. J., & Fister, M. C. (2004) · Journal of Studies on Alcohol · doi:10.15288/jsa.2004.65.663 · Cited by 22
Huprich, S. K., & Roberts, C. R. D. (2012) · Journal of Personality Assessment · doi:10.1080/00223891.2011.645930 · Cited by 21
“In a later article, Yin and Fan ( 2000 ) found the average test–retest reliability of the BDI in 23 studies to be 0.”
BackgroundInfluentialRomano, J. L., & Kromrey, J. D. (2008) · Educational and Psychological Measurement · doi:10.1177/0013164408323237 · Cited by 21
Reliability Generalization: Exploring Reliability Variations on MMPI/MMPI-2 Validity Scale Scores
Vacha‐Haase, T., Tani, C. R., Kogan, L. R., et al. (2001) · Assessment · doi:10.1177/107319110100800404 · Cited by 21
Do negative emotional factors have independent associations with excess adiposity?
Hawkins, M. A. W., & Stewart, J. C. (2012) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2012.07.009 · Cited by 20
“81, respectively) [33,39,40].”
Background
Metadata
- Authors
- Yin, P., & Fan, X.
- Affiliations
- University of Iowa (US)
- Utah State University (US)
- ORCID
- Venue
- Educational and Psychological Measurement
- Publisher
- SAGE Publications
- Published
- 2000-04
- Volume
- 60
- Issue
- 2
- Pages
- 201-223
- ISSN
- 0013-1644 (ISSN-L)
- 1552-3888
- OpenAlex
- W2030323646
- Cited by
- 197
- References
- 142
- Citations by year
- 2026: 1 · 2025: 3 · 2024: 8 · 2023: 6 · 2022: 1 · 2021: 6 · 2020: 9 · 2019: 5 · 2018: 4 · 2017: 9 · 2016: 7 · 2015: 6 · 2014: 8 · 2013: 12 · 2012: 17
- FWCI
- 17.54
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Educational and Psychological Measurement (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Management Science and Operations Research › Psychometric Methodologies and Testing
- Social Sciences › Psychology › Applied Psychology › Psychological Testing and Assessment
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Anxiety, Depression, Psychometrics, Treatment, Cognitive Processes
- Keywords
- Beck Depression Inventory, test-retest reliability, internal consistency, standard error of measurement, restriction of range, measurement error, clinical psychology assessment, depression assessment
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
