Power and Measures of Effect Size in Analysis of Variance With Fixed Versus Random Nested Factors.
The DOI matches its Crossref record; 6 of the 6 references it cites were found in a registry or an index.
Abstract
Ignoring a nested factor can influence the validity of statistical decisions about treatment effectiveness. Previous discussions have centered on consequences of ignoring nested factors versus treating them as random factors on Type I errors and measures of effect size (B. E. Wampold & R. C. Serlin). The authors (a) discuss circumstances under which the treatment of nested provider effects as fixed as opposed to random is appropriate; (b) present 2 formulas for the correct estimation of effect sizes when nested factors are fixed; (c) present the results of Monte Carlo simulations of the consequences of treating providers as fixed versus random on effect size estimates, Type I error rates, and power; and (d) discuss implications of mistaken considerations of provider effects for the study of differential treatment effects in psychotherapy research.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
The effectiveness of psychotherapy: the Consumer Reports study
Seligman, M. E. P. (1995) · American Psychologist · doi:10.1037/0003-066x.50.12.965 · Cited by 1,608
Comparative Studies of Psychotherapies: Is It True That "Everyone Has Won and All Must Have Prizes"?
Luborsky, L. (1975) · Archives of General Psychiatry · doi:10.1001/archpsyc.1975.01760260059004 · Cited by 1,485
Wampold, B. E., Mondin, G. W., Moody, M., Stich, F., Benson, K., & Ahn, H.-N. (1997) · Psychological Bulletin · doi:10.1037/0033-2909.122.3.203 · Cited by 1,091 · cited 1×
“It should be emphasized that Wampold (2001) reported that in the meta-analysis he and his coworkers conducted on comparative treatment studies with nested providers (Wampold et al., 1997), the median number of therapists was two per treatment (i.”
BackgroundStatistical analysis and optimal design for cluster randomized trials.
Raudenbush, S. W. (1997) · Psychological Methods · doi:10.1037/1082-989x.2.2.173 · Cited by 636
Standard Errors and Sample Sizes for Two-Level Research
Snijders, T. A. B., & Bosker, R. J. (1993) · Journal of Educational Statistics · doi:10.3102/10769986018003237 · Cited by 487
Cited by
Baldwin, S. A., Wampold, B. E., & Imel, Z. E. (2007) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.75.6.842 · Cited by 646
Wampold, B. E., & Brown, G. S. (. (2005) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.73.5.914 · Cited by 476
Bickman, L., Kelley, S. D., Breda, C., de Andrade, A. R., & Riemer, M. (2011) · Psychiatric Services · doi:10.1176/appi.ps.002052011 · Cited by 421
Kim, D.-M., Wampold, B. E., & Bolt, D. M. (2006) · Psychotherapy Research · doi:10.1080/10503300500264911 · Cited by 330
Design and analysis of clinical trials with clustering effects due to treatment
Roberts, C., & Roberts, S. A. (2005) · Clinical Trials · doi:10.1191/1740774505cn076oa · Cited by 299
“Recently, Siemer and Joorman [32] suggested using a fixed effect model, with the fixed coefficients averaging to zero in each arm, arguing that this would give estimates with greater precision.”
Background
Metadata
- Authors
- Siemer, M., & Joormann, J.
- Venue
- Psychological Methods
- Published
- 2003
- Volume
- 8
- Issue
- 4
- Pages
- 497-517
- ISSN
- 1082-989X (ISSN-L)
- 1939-1463
- OpenAlex
- W2016629715
- Cited by
- 42
- References
- 6
- FWCI
- 3.91
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Power and Measures of Effect Size in Analysis of Variance With Fixed Versus Random Nested Factors. https://app.cochat.ai/papers/10.1037/1082-989x.8.4.497
- The paper
- Siemer, M., & Joormann, J. (2003). Power and Measures of Effect Size in Analysis of Variance With Fixed Versus Random Nested Factors. Psychological Methods. https://doi.org/10.1037/1082-989x.8.4.497
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.