The DOI matches its Crossref record; 2 of the 2 references it cites were found in a registry or an index.
Confidence Intervals for Standardized Effect Sizes: Theory, Application, and Implementation
Open accessAbstract
The behavioral, educational, and social sciences are undergoing a paradigmatic shift in methodology, from disciplines that focus on the dichotomous outcome of null hypothesis significance tests to disciplines that report and interpret effect sizes and their corresponding confidence intervals. Due to the arbitrariness of many measurement instruments used in the behavioral, educational, and social sciences, some of the most widely reported effect sizes are standardized. Although forming confidence intervals for standardized effect sizes can be very beneficial, such confidence interval procedures are generally difficult to implement because they depend on noncentral t, F, and x2 distributions. At present, no main-stream statistical package provides exact confidence intervals for standardized effects without the use of specialized programming scripts. Methods for the Behavioral, Educational, and Social Sciences (MBESS) is an R package that has routines for calculating confidence intervals for noncentral t, F, and x2 distributions, which are then used in the calculation of exact confidence intervals for standardized effect sizes by using the confidence interval transformation and inversion principles. The present article discusses the way in which confidence intervals are formed for standardized effect sizes and illustrates how such confidence intervals can be easily formed using MBESS in R.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Outline of a Theory of Statistical Estimation Based on the Classical Theory of Probability
Neyman, J. (1937) · Philosophical Transactions of the Royal Society of London. Series A, Mathematical and Physical Sciences · doi:10.1098/rsta.1937.0005 · Cited by 1,087
Cited by
Preacher, K. J., & Kelley, K. (2011) · Psychological Methods · doi:10.1037/a0022658 · Cited by 3,060
Self-citationLakens, D. (2022) · Collabra Psychology · doi:10.1525/collabra.33267 · Cited by 1,962
Kelley, K., & Preacher, K. J. (2012) · Psychological Methods · doi:10.1037/a0028086 · Cited by 994
Self-citationA strategy to apply machine learning to small datasets in materials science
Zhang, Y., & Ling, C. (2018) · npj Computational Materials · doi:10.1038/s41524-018-0081-z · Cited by 776
The fallacy of placing confidence in confidence intervals
Morey, R. D., Hoekstra, R., Rouder, J. N., Lee, M. D., & Wagenmakers, E.-J. (2016) · Psychonomic Bulletin & Review · doi:10.3758/s13423-015-0947-8 · Cited by 577
Alternatives to P value: confidence interval and effect size
Lee, D. K. (2016) · Korean Journal of Anesthesiology · doi:10.4097/kjae.2016.69.6.555 · Cited by 479
Computation of measures of effect size for neuroscience data sets
Hentschke, H., & Stüttgen, M. C. (2011) · European Journal of Neuroscience · doi:10.1111/j.1460-9568.2011.07902.x · Cited by 410
Minimum sample size for developing a multivariable prediction model: Part I – Continuous outcomes
Riley, R. D., Snell, K. I. E., Ensor, J., Burke, D. L., Harrell, F. E., Moons, K. G. M., & Collins, G. S. (2019) · Statistics in Medicine · doi:10.1002/sim.7993 · Cited by 351
A primer on investigating the after effects of acute bouts of physical activity on cognition
Pontifex, M. B., McGowan, A. L., Chandler, M. C., Gwizdala, K. L., Parks, A. C., Fenn, K., & Kamijo, K. (2019) · Psychology of Sport and Exercise · doi:10.1016/j.psychsport.2018.08.015 · Cited by 339
A novel measure of effect size for mediation analysis
Lachowicz, M. J., Preacher, K. J., & Kelley, K. (2018) · Psychological Methods · doi:10.1037/met0000165 · Cited by 271
Self-citationBootES: An R package for bootstrap confidence intervals on effect sizes
Kirby, K. N., & Gerlanc, D. (2013) · Behavior Research Methods · doi:10.3758/s13428-013-0330-5 · Cited by 269
Kelley, K., & Pornprasertmanit, S. (2016) · Psychological Methods · doi:10.1037/a0040086 · Cited by 259
Self-citationMethods for the Behavioral, Educational, and Social Sciences: An R package
Kelley, K. (2007) · Behavior Research Methods · doi:10.3758/bf03192993 · Cited by 255
Self-citationMeta-analysis of molecular imaging of serotonin transporters in major depression
Gryglewski, G., Lanzenberger, R., Kranz, G. S., & Cumming, P. (2014) · Journal of Cerebral Blood Flow & Metabolism · doi:10.1038/jcbfm.2014.82 · Cited by 227
Meron, D., Hedger, N., Garner, M., & Baldwin, D. S. (2015) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2015.07.012 · Cited by 220
Agarwal, P. K., Nunes, L. D., & Blunt, J. R. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09595-9 · Cited by 211
Statistical properties of four effect-size measures for mediation models
Miočević, M., O’Rourke, H. P., MacKinnon, D. P., & Brown, H. C. (2018) · Behavior Research Methods · doi:10.3758/s13428-017-0870-1 · Cited by 200
Minimum sample size for external validation of a clinical prediction model with a continuous outcome
Archer, L., Snell, K. I. E., Ensor, J., Hudda, M. T., Collins, G. S., & Riley, R. D. (2021) · Statistics in Medicine · doi:10.1002/sim.8766 · Cited by 198
Farrer, L., Christensen, H., Griffiths, K. M., & Mackinnon, A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0028099 · Cited by 140
Glozier, N., Christensen, H., Naismith, S., Cockayne, N., Donkin, L., Neal, B., Mackinnon, A., & Hickie, I. (2013) · PLoS ONE · doi:10.1371/journal.pone.0059139 · Cited by 129
“[28] Binary and ordered categorical outcomes were analysed using mixed effects logistic models analogous to the”
Quantification of interlaboratory cell-free protein synthesis variability
Cole, S. D., Beabout, K., Turner, K. B., Smith, Z. K., Funk, V. L., Harbaugh, S. V., Liem, A. T., Roth, P. A., Geier, B. A., Emanuel, P. A., et al. (2019) · ACS Synthetic Biology · doi:10.1021/acssynbio.9b00178 · Cited by 103
Sneck, S., Viholainen, H., Syväoja, H., Kankaapää, A., Hakonen, H., Poikkeus, A.-M., & Tammelin, T. (2019) · International Journal of Behavioral Nutrition and Physical Activity · doi:10.1186/s12966-019-0866-6 · Cited by 90
Executive functioning in children and adolescents with symptoms of sluggish cognitive tempo and ADHD
Araujo Jiménez, E. A., Jané Ballabriga, M. C., Bonillo Martin, A., Arrufat, F. J., & Serra Giacobo, R. (2015) · Journal of Attention Disorders · doi:10.1177/1087054713495442 · Cited by 55
Fitts, D. A. (2020) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.16.4.p281 · Cited by 17
Perrig, S. A. C., Scharowski, N., Brühlmann, F., von Felten, N., Opwis, K., & Aeschbach, L. F. (2024) · Proceedings of the CHI Conference on Human Factors in Computing Systems · doi:10.1145/3613904.3642270 · Cited by 10
Metadata
- Authors
- Kelley, K.
- Venue
- Journal of Statistical Software
- Publisher
- Foundation for Open Access Statistic
- Published
- 2007
- Volume
- 20
- Issue
- 8
- ISSN
- 1548-7660 (ISSN-L)
- OpenAlex
- W1933140117
- Cited by
- 236
- References
- 2
- FWCI
- 4.59
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.