Varying coefficient meta-analytic methods for alpha reliability.
The DOI matches its Crossref record; 5 of the 5 references it cites were found in a registry or an index.
Abstract
The conventional fixed-effects (FE) and random-effects (RE) confidence intervals that are used to assess the average alpha reliability across multiple studies have serious limitations. The FE method, which is based on a constant coefficient model, assumes equal reliability coefficients across studies and breaks down under minor violations of this assumption. The RE method, which is based on a random coefficient model, assumes that the selected studies are a random sample from a normally distributed superpopulation. The RE method performs poorly in typical meta-analytic applications where the studies have not been randomly sampled from a normally distributed superpopulation or have been randomly sampled from a nonnormal superpopulation. A new confidence interval for the average reliability coefficient of a specific measurement scale is based on a varying coefficient statistical model and is shown to perform well under realistic conditions of reliability heterogeneity and nonrandom sampling of studies. New methods are proposed for assessing reliability moderator effects. The proposed methods are especially useful in meta-analyses that involve a small number of carefully selected studies for the purpose of obtaining a more accurate reliability estimate or to detect factors that moderate the reliability of a scale.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890
The Handbook of Research Synthesis and Meta-Analysis
(2019) · doi:10.7758/9781610448864 · Cited by 4,553
Fixed-and random-effects models in meta-analysis.
Hedges, L. V., & Vevea, J. L. (1998) · Psychological Methods · doi:10.1037/1082-989x.3.4.486 · Cited by 2,977
Measuring the self-stigma associated with seeking psychological help
Vogel, D. L., Wade, N. G., & Haake, S. (2006) · Journal of Counseling Psychology · doi:10.1037/0022-0167.53.3.325 · Cited by 1,190 · cited 3×
“Suppose another researcher, inspired by the results of Vogel et al. (2006, 2007) and Cantazaro (2009), wants to obtain accurate alpha reliability estimates of the SSSH questionnaire for Caucasian and Latino/Latina populations under both paper-and-pencil and Internet formats.”
BackgroundResultThe moderating influence of service use on negative caregiving consequences
Bass, D. M., Noelker, L. S., & Rechlin, L. R. (1996) · The Journals of Gerontology Series B: Psychological Sciences and Social Sciences · doi:10.1093/geronb/51b.3.s121 · Cited by 160
Cited by
Cronbach's alpha reliability: Interval estimation, hypothesis testing, and sample size planning
Bonett, D. G., & Wright, T. A. (2015) · Journal of Organizational Behavior · doi:10.1002/job.1960 · Cited by 1,237
Self-citationOn the relationship between anxiety and error monitoring: a meta-analysis and conceptual framework
Moser, J. S., Moran, T. P., Schroder, H. S., Donnellan, M. B., & Yeung, N. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00466 · Cited by 445
“For the present analysis, we used the varying-coefficient model2 recommended by Bonett (2008, 2009, 2010) and Krizan (2010) because (1) it does not rely on the unrealistic assumptions made by other fixed effects meta-analytic models (e.g., the existence of a single population effect size), (2)…”
BackgroundMethodJob Burnout and Employee Engagement: A Meta-Analytic Examination of Construct Proliferation
Cole, M. S., Walter, F., Bedeian, A. G., & O’Boyle, E. H. (2012) · Journal of Management · doi:10.1177/0149206311415252 · Cited by 377
Kelley, K., & Pornprasertmanit, S. (2016) · Psychological Methods · doi:10.1037/a0040086 · Cited by 259
“The second variation is that the transformation formula is log!1 ( $̂" ( log'N⁄!N ( 1"( (Bonett, 2010).”
BackgroundKrieglstein, F., Beege, M., Rey, G. D., Ginns, P., Krell, M., & Schneider, S. (2022) · Educational Psychology Review · doi:10.1007/s10648-022-09683-4 · Cited by 118
Metadata
- Authors
- Bonett, D. G.
- Venue
- Psychological Methods
- Published
- 2010-12
- Volume
- 15
- Issue
- 4
- Pages
- 368-385
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W1985193141
- Cited by
- 97
- References
- 5
- FWCI
- 8.28
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Varying coefficient meta-analytic methods for alpha reliability. https://app.cochat.ai/papers/10.1037/a0020142
- The paper
- Bonett, D. G. (2010). Varying coefficient meta-analytic methods for alpha reliability. Psychological Methods. https://doi.org/10.1037/a0020142
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.