Effect Sizes for Research
Abstract
Noted for its comprehensive coverage, this greatly expanded new edition now covers the use of univariate and multivariate effect sizes. Many measures and estimators are reviewed along with their application, interpretation, and limitations. Noted for its practical approach, the book features numerous examples using real data for a variety of variables and designs, to help readers apply the material to their own data. Tips on the use of SPSS, SAS, R, and S-Plus are provided. The book's broad disciplinary appeal results from its inclusion of a variety of examples from psychology, medicine, education, and other social sciences. Special attention is paid to confidence intervals, the statistical assumptions of the methods, and robust estimators of effect sizes. The extensive reference section is appreciated by all. With more than 40% new material, highlights of the new editon include: three new multivariate chapters covering effect sizes for analysis of covariance, multiple regression/correlation, and multivariate analysis of variance more learning tools in each chapter including introductions, summaries, "Tips and Pitfalls" and more conceptual and computational questions more coverage of univariate effect sizes, confidence intervals, and effect sizes for repeated measures to reflect their increased use in research more software references for calculating effect sizes and their confidence intervals including SPSS, SAS, R, and S-Plus the data used in the book are now provided on the web along with new data and suggested calculations with IBM SPSS syntax for computational practice. Effect Sizes for Research covers standardized and unstandardized differences between means, correlational measures, strength of association, and parametric and nonparametric measures for between- and within-groups data. Intended as a resource for professionals, researchers, and advanced students in a variety of fields, this book is also an excellent supplement for advanced statistics courses in psychology, education, the social sciences, business, and medicine. A prerequisite of introductory statistics through factorial analysis of variance and chi-square is recommended.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
An accepted measure of effect size for the Wilcoxon rank-sum test is Cliff's delta measure, also known as Cliff's dominance measure.
“An accepted measure of effect size for the Wilcoxon rank-sum test is Cliff ' s delta measure, also known as Cliff ' s dominance measure (Grissom, 2015; Grissom & Kim, 2012).”
From Increasing high school teachers self-efficacy for integrated STEM instruction through a collaborative community of practice (2020) · cites this paper as Grissom & Kim, 2012
Cited by
Sorted by citations
The New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200 · see citing works
A review of effect sizes and their confidence intervals, Part I: The Cohen's d family
Goulet‐Pelletier, J., & Cousineau, D. (2018) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.14.4.p242 · Cited by 419 · see citing works
Buchholz, I., Janssen, M. F., Kohlmann, T., & Feng, Y. (2018) · PharmacoEconomics · doi:10.1007/s40273-018-0642-5 · Cited by 357 · see citing works
“To evaluate how the instruments capture changes in health over time, we collected all reported distribution-based effect sizes (ESs), such as the standardized ES and the standardized response mean (SRM), and non-parametric test statistics, such as the Wilcoxon signed-rank order test or the probability of superiority (…”
BackgroundMethodInfluentialKelley, T. R., Knowles, J. G., Holland, J. D., & Han, J. (2020) · International Journal of STEM Education · doi:10.1186/s40594-020-00211-w · Cited by 238 · see citing works
Lacroix, A., Kressig, R. W., Muehlbauer, T., Gschwind, Y. J., Pfenninger, B., Brügger, O., & Granacher, U. (2015) · Gerontology · doi:10.1159/000442087 · Cited by 217 · see citing works
Brief report: Cognitive flexibility in autism spectrum disorders: A quantitative review
Leung, R. C., & Zakzanis, K. K. (2014) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-014-2136-4 · Cited by 192 · see citing works
Eta- and partial eta-squared in L2 research: A cautionary review and guide to more appropriate usage
Norouzian, R., & Plonsky, L. (2017) · Second language Research · doi:10.1177/0267658316684904 · Cited by 193 · see citing works
“With this position in mind, some have gone as far as to argue that failing to appropriately report estimates of effect sizes amounts to ‘a kind of withholding of evidence’ (Grissom and Kim, 2012: 9).”
BackgroundMethodInfluentialWhich process metrics can significantly improve defect prediction models? An empirical study
Madeyski, L., & Jureczko, M. (2014) · Software Quality Journal · doi:10.1007/s11219-014-9241-7 · Cited by 180 · see citing works
“Hence, we also provide a nonparametric effect size measure referred to as probability of superiority (PS) recommended by Grissom and Kim (2012).”
MethodInfluentialDunster, G. P., de la Iglesia, L., Ben-Hamo, M., Nave, C., Fleischer, J. G., Panda, S., & de la Iglesia, H. O. (2018) · Science Advances · doi:10.1126/sciadv.aau6200 · Cited by 168 · see citing works
On Automatically Generating Commit Messages via Summarization of Source Code Changes
Cortes-Coy, L. F., Linares‐Vásquez, M., Aponte, J., & Poshyvanyk, D. (2014) · IEEE International Working Conference on Source Code Analysis and Manipulation (SCAM) · doi:10.1109/scam.2014.14 · Cited by 165 · see citing works
“We also computed the Cliff's delta d effect size [12] to measure the magnitude of the difference.”
MethodKRAEMER, H. C. (2013) · Statistics in Medicine · doi:10.1002/sim.5734 · Cited by 161 · see citing works
Dankbaar, M. E. W., Alsma, J., Jansen, E. E. H., van Merrienboer, J. J. G., van Saase, J. L. C. M., & Schuit, S. C. E. (2016) · Advances in Health Sciences Education · doi:10.1007/s10459-015-9641-x · Cited by 147 · see citing works
“Effect sizes (ES) were calculated using Glass’s delta, as homoscedasticity (same variance) is not assumed (Grissom and Kim 2012).”
MethodBreakdown of the brain’s functional network modularity with awareness
Godwin, D., Barry, R. L., & Marois, R. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1414466112 · Cited by 145 · see citing works
Maselli, A., & Slater, M. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00693 · Cited by 132 · see citing works
“…given in terms of the probability of superiority of dependent measures, PS dep , defined as the probability that the score from the condition that most frequently has the higher score will be greater than the score from the condition that most frequently has the lower score (Grissom and Kim, 2012).”
BackgroundSchlosser, R. W., & Koul, R. (2015) · Augmentative and Alternative Communication · doi:10.3109/07434618.2015.1063689 · Cited by 131 · see citing works
“…and a PZd 80 shows high effectiveness (Scotti et al., 1991). for effect size calculation involving group designs we followed the methods proposed by Grissom and Kim (2012). in terms of interpretation guidelines, we applied cohen’s (1988) interpretation of the magnitude of the effect sizes, with…”
MethodMordkoff, J. T. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919855053 · Cited by 122 · see citing works
“…2013) and at least one of these alternatives has been strongly recommended in most detailed, statistical discussions (e.g., Carroll & Nordholm, 1975; Grissom & Kim, 2012; Hays, 1963; Keppel, 1991; Maxwell & Delaney, 2004; see also Bakeman, 2005; Olejnik & Algina, 2003), neither of these…”
BackgroundMessages for Clinicians: Moderators and Mediators of Treatment Outcome in Randomized Clinical Trials
KRAEMER, H. C. (2016) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2016.15101333 · Cited by 121 · see citing works
Acute Care for Elders Components of Acute Geriatric Unit Care: Systematic Descriptive Review
Fox, M. T., Sidani, S., Persaud, M., Tregunno, D., Maimets, I., Brooks, D., & O’Brien, K. K. (2013) · Journal of the American Geriatrics Society · doi:10.1111/jgs.12282 · Cited by 120 · see citing works
Wacker, M. E., Jörres, R. A., Karch, A., Wilke, S., Heinrich, J., Karrasch, S., Koch, A., Schulz, H., Watz, H., Leidl, R., et al. (2016) · BMC Pulmonary Medicine · doi:10.1186/s12890-016-0238-9 · Cited by 118 · see citing works
“Standardized mean differences were calculated as the mean adjusted difference between two COPD grades divided by their pooled (unadjusted) standard deviation (SD) [23] in order to assess the magnitude of the difference and to judge the ability of HRQL instruments for discrimination.”
MethodEstrada, E., Ferrer, E. E., & Pardo, A. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02696 · Cited by 125 · see citing works
“…of using effect size measures both to quantify the amount of change experienced by a group across several time points, and for comparing such change in multiple groups (Cohen, 1988; Richardson, 1996; Fritz et al., 2012; Grissom and Kim, 2012; Kelley and Preacher, 2012; Pek and Flora, 2018).”
BackgroundMethodSex differences in language competence of 3- to 6-year-old children
Lange, B. P., Euler, H. Α., & Zaretsky, E. V. (2016) · Applied Psycholinguistics · doi:10.1017/s0142716415000624 · Cited by 108 · see citing works
State anxiety biases estimates of uncertainty and impairs reward learning in volatile environments
Hein, T. P., de Fockert, J., & Ruiz, M. H. (2021) · NeuroImage · doi:10.1016/j.neuroimage.2020.117424 · Cited by 99 · see citing works
“Below, in the Results section, we present the mean and standard error of the mean (SEM) for our dependent variables (either in text or in a figure), alongside non-parametric effect sizes for pair-wise comparisons and corresponding bootstrapped confidence intervals (Grissom and Kim, 2012; Ruscio and Mullen, 2012).”
MethodMigratory animals feel the cost of getting sick: A meta‐analysis across species
Risely, A., Klaassen, M., & Hoye, B. J. (2017) · Journal of Animal Ecology · doi:10.1111/1365-2656.12766 · Cited by 99 · see citing works
Dankbaar, M. E. W., Richters, O., Kalkman, C. J., Prins, G., ten Cate, O., van Merriënboer, J. J. G., & Schuit, S. C. E. (2017) · BMC Medical Education · doi:10.1186/s12909-016-0836-5 · Cited by 104 · see citing works
“Effect sizes (ES) were calculated using Glass’s delta [30]; ES ≥ 0.”
MethodWang, G., Rajpurohit, S. K., Delaspre, F., Walker, S. L., White, D. T., Ceasrine, A. M., Kuruvilla, R., Li, R., Shim, J. S., Liu, J. O., et al. (2015) · eLife · doi:10.7554/elife.08261 · Cited by 96 · see citing works
“DOI: 10.7554/eLife.08261.001”
BackgroundInfluentialSanchis‐Segura, C., Ibáñez, M. V., Aguirre, N., Cruz-Gómez, Á. J., & Forn, C. (2020) · Scientific Reports · doi:10.1038/s41598-020-69361-9 · Cited by 92 · see citing works
Dunst, C. J., & Hamby, D. W. (2012) · Journal of Intellectual & Developmental Disability · doi:10.3109/13668250.2012.673575 · Cited by 97 · see citing works
Toomer, M., & Elgort, I. (2019) · Language Learning · doi:10.1111/lang.12335 · Cited by 101 · see citing works
Sex differences in gray matter volume: how many and how large are they really?
Sanchis‐Segura, C., Ibáñez, M. V., Adrián‐Ventura, J., Aguirre, N., Cruz-Gómez, Á. J., Ávila, C., & Forn, C. (2019) · Biology of Sex Differences · doi:10.1186/s13293-019-0245-7 · Cited by 95 · see citing works
Berlim, M. T., & Van den Eynde, F. (2014) · The Canadian Journal of Psychiatry · doi:10.1177/070674371405900905 · Cited by 96 · see citing works
Warren, D. E., Jones, S. H., Duff, M. C., & Tranel, D. (2014) · Journal of Neuroscience · doi:10.1523/jneurosci.0119-14.2014 · Cited by 97 · see citing works
“Effect size was measured with an unbiased variant of Cohen’s d that accounts for small sample sizes (dunb) (Grissom and Kim, 2012, p 70).”
MethodThe Digital Gender Gap in Teacher Education: The TPACK Framework for the 21st Century
Trigueros, I. M. G., & de Aldecoa, C. Y. (2021) · European Journal of Investigation in Health Psychology and Education · doi:10.3390/ejihpe11040097 · Cited by 96 · see citing works
On using machine learning to automatically classify software applications into domain categories
Linares‐Vásquez, M., McMillan, C., Poshyvanyk, D., & Grechanik, M. (2012) · Empirical Software Engineering · doi:10.1007/s10664-012-9230-z · Cited by 95 · see citing works
“by Grissom and Kim (Grissom and Kim 2012), to measure the size effect of the difference in pairwise comparisons for the samples in the research questions; it is an estimate of the probability that a value randomly drawn from one sample will be greater than a value randomly drawn from other sample.”
BackgroundStatistical reform in information retrieval?
Sakai, T. (2014) · ACM SIGIR Forum · doi:10.1145/2641383.2641385 · Cited by 89 · see citing works
“Finally, I pose a speci.c question for the IR community: should IR journal editors and SIGIR PC chairs require (rather than encourage) reporting of e.ect sizes and con.dence intervals?”
BackgroundBeyond Cohen's d : Alternative Effect Size Measures for Between-Subject Designs
Peng, C. J., & Chen, L. (2013) · The Journal of Experimental Education · doi:10.1080/00220973.2012.745471 · Cited by 87 · see citing works
Comparison of normalized gain and Cohen’s d for analyzing gains on concept inventories
Nissen, J. M., Talbot, R. M., III, Thompson, A. N., & Dusen, B. V. (2018) · Physical Review Physics Education Research · doi:10.1103/physrevphyseducres.14.010115 · Cited by 130 · see citing works
Vaessen, J., Rivas, A., Duvendack, M., Jones, R. P., Leeuw, F. L., Gils, G. H. C. V., Lukach, R., Holvoet, N., Bastiaensen, J., Hombrados, J. G., et al. (2014) · Campbell Systematic Reviews · doi:10.4073/csr.2014.8 · Cited by 89 · see citing works
Favrod, C., du Chêne, L. J., Martin-Söelch, C., Garthus‐Niegel, S., Tolsa, J., Legault, F., Briet, V., & Horsch, A. (2018) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2018.00364 · Cited by 82 · see citing works
Revisiting Android reuse studies in the context of code obfuscation and library usages
Linares‐Vásquez, M., Holtzhauer, A., Bernal-Cárdenas, C., & Poshyvanyk, D. (2014) · International Conference on Mining Software Repositories (MSR) · doi:10.1145/2597073.2597109 · Cited by 77 · see citing works
“We also computed the Cliff’s delta d effect size [8] to measure the magnitude of the difference in the three cases.”
MethodAn Explicit Strategy to Scaffold Novice Program Tracing
Xie, B., Nelson, G. L., & Ko, A. J. (2018) · ACM Technical Symposium on Computer Science Education (SIGCSE) · doi:10.1145/3159450.3159527 · Cited by 82 · see citing works
“We calculated a Common Language (CL) effect size from Cohen’s d [7, 20] for the parametric test and by dividing the test statistic U by the product of the sample sizes for the non-parametric test [7].”
MethodEffect sizes in memory research
Morris, P. E., & Fritz, C. O. (2013) · Memory · doi:10.1080/09658211.2013.763984 · Cited by 78 · see citing works
“…texts for psychologists (e.g., Aron, Aron, & Coups, 2008; Howell, 2008; Howitt & Cramer, 2011; Keppel & Wickens, 2004; Tabachnick & Fidell, 2007) as well as by books devoted to the measuring and interpretation of effect sizes (Cohen, 1988; Cumming, 2012; Ellis, 2010; Grissom & Kim, 2012).”
BackgroundInferential statistics in Language Teaching Research : A review and ways forward
Lindstromberg, S. (2016) · Language Teaching Research · doi:10.1177/1362168816649979 · Cited by 75 · see citing works
“For discussion, see Grissom and Kim (2012); Kelly and Preacher (2012).”
BackgroundEstimating Population Mean Power Under Conditions of Heterogeneity and Selection for Significance
Brunner, J., & Schimmack, U. (2020) · Meta-Psychology · doi:10.15626/mp.2018.874 · Cited by 76 · see citing works
“This usage is consistent with that of Cohen (1988), who freely uses “effect size" to describe various functions of the model parameters, even for the same statistical test (Grissom & Kim, 2012).”
MethodPostoperative cognitive change after cardiac surgery predicts long‐term cognitive outcome
Relander, K., Hietanen, M., Rantanen, K. K., et al. (2020) · Brain and Behavior · doi:10.1002/brb3.1750 · Cited by 74 · see citing works
The sense of body ownership relaxes temporal constraints for multisensory integration
Maselli, A., Kilteni, K., López‐Moliner, J., & Slater, M. (2016) · Scientific Reports · doi:10.1038/srep30628 · Cited by 67 · see citing works
Alessandri, G., Zuffianò, A., & Perinelli, E. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.00223 · Cited by 88 · see citing works
“Likewise, homoschedasticy assumption is rarely met in randomized control trial as a result of the experimental variable causing differences in variability between groups (Grissom and Kim, 2012).”
BackgroundConstraints and consequences of the emergence of amino acid repeats in eukaryotic proteins
Chavali, S., Chavali, P. L., Chalancon, G., de Groot, N. S., Gemayel, R., Latysheva, N. S., Ing‐Simmons, E., Verstrepen, K. J., Santhanam, B., & Babu, M. M. (2017) · Nature Structural & Molecular Biology · doi:10.1038/nsmb.3441 · Cited by 66 · see citing works
Vingerhoets, G., Verhelst, H., Gerrits, R., Badcock, N. A., Bishop, D., Carey, D. P., Flindall, J. W., Grimshaw, G. M., Harris, L. J., Hausmann, M., et al. (2023) · Laterality Asymmetries of Body Brain and Cognition · doi:10.1080/1357650x.2023.2199963 · Cited by 78 · see citing works
“While most statements on “Reporting LIs” were acceptable to more than 70% of experts, commenters considered some as being too prescriptive, not always feasible or appropriate (e.g., measures of effect size (Grissom & Kim, 2012), or dependent on the research questions.”
BackgroundThe Bayesian Revolution in Second Language Research: An Applied Approach
Norouzian, R., de Miranda, M., & Plonsky, L. (2018) · Language Learning · doi:10.1111/lang.12310 · Cited by 70 · see citing works
Endocrine stress responses and risk of type 2 diabetes mellitus
Siddiqui, A., Madhu, S. V., Sharma, S. B., & Desai, N. G. (2015) · Stress · doi:10.3109/10253890.2015.1067677 · Cited by 68 · see citing works
Barber, L. A., Hastings‐Ison, T., Baker, R. J., et al. (2013) · Journal of Children s Orthopaedics · doi:10.1007/s11832-013-0503-x · Cited by 66 · see citing works
“2, the ratio of the Z-score and the square root of the total number of samples (N) [38]:”
BackgroundVestibular and corticospinal control of human body orientation in the gravitational field
Zhang, L., Feldman, A. G., & Levin, M. F. (2018) · Journal of Neurophysiology · doi:10.1152/jn.00483.2018 · Cited by 65 · see citing works
“Effect sizes were determined using the probability of superiority (PS) analysis for nonparametric data (Grissom and Kim 2012; Ruscio 2008), where PS 0.7 is considered a large effect size, implying that differences in EMG or GVS scores in the two body positions were strong.”
MethodInfluentialHirsch, O., Chavanon, M., & Christiansen, H. (2019) · Scientific Reports · doi:10.1038/s41598-019-42018-y · Cited by 67 · see citing works
Kallestad, H., Scott, J. L., Vedaa, Ø., Lydersen, S., Vethe, D., Morken, G., Stiles, T. C., Sivertsen, B., & Langsrud, K. (2020) · SLEEP · doi:10.1093/sleep/zsab185 · Cited by 64 · see citing works
“Cohen’s d was estimated as the difference in mean scores divided by the baseline SD [33].”
MethodSundell, K., Ferrer‐Wreder, L., & Fräser, M. W. (2013) · Evaluation & the Health Professions · doi:10.1177/0163278712469813 · Cited by 65 · see citing works
How to calculate, use, and report variance explained effect size indices and not die trying
Iacobucci, D., Popovich, D. L., Moon, S., & Román, S. (2022) · Journal of Consumer Psychology · doi:10.1002/jcpy.1292 · Cited by 66 · see citing works
Asymmetric mRNA localization contributes to fidelity and sensitivity of spatially localized systems
Weatheritt, R. J., Gibson, T. J., & Babu, M. M. (2014) · Nature Structural & Molecular Biology · doi:10.1038/nsmb.2876 · Cited by 61 · see citing works
Jackson-Maldonado, D., & Maldonado, R. (2017) · International journal of language and communication disorders · doi:10.1111/1460-6984.12312 · Cited by 59 · see citing works
Anthropometric Variables and Somatotype of Young and Professional Male Basketball Players
Gryko, K., Kopiczko, A., Mikołajec, K., Šťastný, P., & Musálek, M. (2018) · Sports · doi:10.3390/sports6010009 · Cited by 60 · see citing works
Censabella, S., Claes, S., Robijns, J., et al. (2016) · Supportive Care in Cancer · doi:10.1007/s00520-016-3232-0 · Cited by 58 · see citing works
Sporn, S., Hein, T. P., & Ruiz, M. H. (2020) · eLife · doi:10.7554/elife.50654 · Cited by 56 · see citing works
“Non-parametric effect size estimators were used in association with our pair-wise nonparametric statistics, following Grissom and Kim (2012).”
MethodDevelopment of the Biological Experimental Design Concept Inventory (BEDCI)
Deane, T., Nomme, K., Jeffery, E., Pollock, C. A., & Bírol, G. (2014) · CBE—Life Sciences Education · doi:10.1187/cbe.13-11-0218 · Cited by 56 · see citing works
Manolov, R., Losada, J., Chacón-Moscoso, S., & Sanduvete-Chaves, S. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.00032 · Cited by 53 · see citing works
“Moreover, SLC yields unstandardized results, which help assessing the practical importance of the behavior change when using meaningful measures (Grissom and Kim, 2012) such as the number of tantrums or the number of self-injurious behaviors.”
BackgroundCoffey, E. B. J., Arseneau-Bruneau, I., Zhang, X., Baillet, S., & Zatorre, R. J. (2021) · Journal of Neuroscience · doi:10.1523/jneurosci.2313-20.2021 · Cited by 55 · see citing works
Gill, S. D., & Stella, J. (2013) · Emergency Medicine Australasia · doi:10.1111/1742-6723.12134 · Cited by 55 · see citing works
Chinman, M., Acosta, J., Ebener, P. A., Malone, P. S., & Slaughter, M. E. (2015) · Implementation Science · doi:10.1186/s13012-016-0446-y · Cited by 56 · see citing works
Buchholz, I., Thielker, K., Feng, Y., Kupatz, P., & Kohlmann, T. (2014) · Quality of Life Research · doi:10.1007/s11136-014-0838-x · Cited by 53 · see citing works
Assessing ‘what works’ in international development: meta-analysis for sophisticated dummies
Duvendack, M., Hombrados, J. G., Palmer-Jones, R., & Waddington, H. (2012) · Journal of Development Effectiveness · doi:10.1080/19439342.2012.710642 · Cited by 52 · see citing works
“It is also important to bear in mind that the effect sizes and their confidence intervals derived from zero-order analyses are reliable only when certain conditions are met, specifically normality and homoscedasticity and independence (see Grissom and Kim 2012 and Wilcox 2012 for an introduction).”
BackgroundQuantifying Soil Erosion from Hiking Trail in a Protected Natural Area in the Spanish Pyrenees
Bodoque, J. M., Ballesteros‐Cánovas, J. A., Jiménez, J. M. R., et al. (2017) · Land Degradation and Development · doi:10.1002/ldr.2755 · Cited by 50 · see citing works
“To this end, we calculated the epsilonsquared (E2RÞ estimate of effect size, which depends on the value H obtained in the Kruskal–Wallis test and the total number (n) of observations (Grissom & Kim, 2012).”
MethodKia, F. S., Teasley, S. D., Hatala, M., Karabenick, S. A., & Kay, M. (2020) · International Conference on Learning Analytics and Knowledge (LAK) · doi:10.1145/3375462.3375472 · Cited by 56 · see citing works
Quarta, S., Massaro, M., Chervenkov, M., Ivanova, T., Dimitrova, D., Jorge, R., Andrade, V., Philippou, E., Zisimou, C., Maksimova, V., et al. (2021) · Nutrients · doi:10.3390/nu13051432 · Cited by 51 · see citing works
“We additionally quantified the effect size by means of the standardized mean difference [38].”
MethodSibling conflict and dishonest signaling in birds
Caro, S. M., West, S. A., & Griffin, A. S. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1606378113 · Cited by 46 · see citing works
The Impact of APA and AERA Guidelines on effect size reporting
Peng, C.-Y. J., Chen, L.-T., Chiang, H.-M., & Chiang, Y.-C. (2013) · Educational Psychology Review · doi:10.1007/s10648-013-9218-2 · Cited by 46 · see citing works
I’m not the person I used to be: The self and autobiographical memories of immoral actions.
Stanley, M. L., Henne, P., Iyengar, V., Sinnott-Armstrong, W. P., & Brigard, F. D. (2017) · Journal of Experimental Psychology General · doi:10.1037/xge0000317 · Cited by 46 · see citing works
“To assess effect sizes, we used PSdep (Grissom & Kim, 2012), which is the probability that in a randomly sampled pair of scores, the score from one condition (the condition which most frequently has the higher score) will be greater than the score from the other condition (the condition which most…”
MethodInfluentialSanchis‐Segura, C., Aguirre, N., Cruz-Gómez, Á. J., Félix, S., & Forn, C. (2022) · NeuroImage · doi:10.1016/j.neuroimage.2022.119343 · Cited by 45 · see citing works
Métodos estadísticos para el análisis del tamaño del efecto
Macías, M. E. R., Zarco-Villavicencio, I. S., & Villasís-Keever, M. Á. (2021) · Revista Alergia México · doi:10.29262/ram.v658i2.949 · Cited by 60 · see citing works
Assisted closed-loop optimization of SSVEP-BCI efficiency
Fernández-Vargas, J., Pfaff, H. U., Rodrı́guez, F. B., & Varona, P. (2013) · Frontiers in Neural Circuits · doi:10.3389/fncir.2013.00027 · Cited by 46 · see citing works
Jaschinski, W., König, M., Mekontso, T. M., Ohlendorf, A., & Welscher, M. (2015) · Clinical and Experimental Optometry · doi:10.1111/cxo.12259 · Cited by 45 · see citing works
Is alliteration mnemonic without awareness-raising?
Boers, F., Lindstromberg, S., & Eyckmans, J. (2013) · Language Awareness · doi:10.1080/09658416.2013.774008 · Cited by 45 · see citing works
“In behavioural and educational studies a d-value as high as 0.88 certainly qualifies as substantive (e.g. Grissom & Kim, 2012, pp. 128–130).”
BackgroundInfluentialCohen’s d needs to be readily interpretable: Comment on Shieh (2013)
Cumming, G. (2013) · Behavior Research Methods · doi:10.3758/s13428-013-0392-4 · Cited by 44 · see citing works
Dobie, A., Tucker, A., Ferrari, M., & Rogers, J. M. (2016) · Australasian Psychiatry · doi:10.1177/1039856215618524 · Cited by 43 · see citing works
On automatically detecting similar Android apps
Linares-Vasquez, M., Holtzhauer, A., & Poshyvanyk, D. (2016) · 2016 IEEE 24th International Conference on Program Comprehension (ICPC) · doi:10.1109/icpc.2016.7503721 · Cited by 43 · see citing works
“We followed the guidelines in [27] to interpret the effect size values: negligible for |d| < 0.”
MethodGaskin, J. E., Ogbeibu, S., & Lowry, P. B. (2023) · Springer eBooks · doi:10.1007/978-3-031-37772-3_8 · Cited by 49 · see citing works
Salamanna, F., Giavaresi, G., Parrilli, A., Martini, L., Aldini, N. N., Abatangelo, G., Frizziero, A., & Fini, M. (2019) · Journal of Orthopaedic Research® · doi:10.1002/jor.24259 · Cited by 42 · see citing works
Does the type of foam roller influence the recovery rate, thermal response and DOMS prevention?
Adamczyk, J. G., Gryko, K., & Boguszewski, D. (2020) · PLoS ONE · doi:10.1371/journal.pone.0235195 · Cited by 43 · see citing works
Askell‐Williams, H., Dix, K., Lawson, M. J., & Slee, P. T. (2012) · School Effectiveness and School Improvement · doi:10.1080/09243453.2012.692697 · Cited by 44 · see citing works
“Similarly, Grissom and Kim (2012) stated, ‘‘The designations of small, medium and large effect sizes do not necessarily correspond to the degree of practical or theoretical significance of an effect’’ (p. 130), arguing that small but consistent effects can have considerable impact over time.”
BackgroundPagani, S., Liverani, E., Giavaresi, G., Luca, A. D., Belvedere, C., Fortunato, A., Leardini, A., Fini, M., Tomesani, L., & Caravaggi, P. (2021) · Journal of Biomedical Materials Research Part B Applied Biomaterials · doi:10.1002/jbm.b.34857 · Cited by 42 · see citing works
Hirsch, O., & Christiansen, H. (2018) · Journal of Attention Disorders · doi:10.1177/1087054715596577 · Cited by 42 · see citing works
“The size of the resulting effects was examined with the effect sizes probability of superiority (PS) and eta2 (Grissom & Kim, 2012).”
MethodThe New Statistics: A How‐To Guide
Cumming, G. (2013) · Australian Psychologist · doi:10.1111/ap.12018 · Cited by 40 · see citing works
Fox, M. T., Butler, J. I., Persaud, M., Tregunno, D., Sidani, S., & McCague, H. (2015) · Research in Nursing & Health · doi:10.1002/nur.21699 · Cited by 39 · see citing works
Reich, H., Bockel, L., & Mewes, R. (2014) · Journal of Racial and Ethnic Health Disparities · doi:10.1007/s40615-014-0054-y · Cited by 39 · see citing works
“, estimating the “pure” contribution [59].”
MethodOutcomes of an Advanced Ultrasound Elective
Prats, M. I., Royall, N. A., Panchal, A. R., et al. (2016) · Journal of Ultrasound in Medicine · doi:10.7863/ultra.15.06060 · Cited by 39 · see citing works
Effects of Visual Aids for End-of-Life Care on Decisional Capacity of People With Dementia
Chang, W.-Z. D., & Bourgeois, M. S. (2019) · American Journal of Speech-Language Pathology · doi:10.1044/2019_ajslp-19-0028 · Cited by 39 · see citing works
Gómez, G. R., Serra, V. Q., & Sáiz, M. S. I. (2014) · Assessment & Evaluation in Higher Education · doi:10.1080/02602938.2014.979132 · Cited by 38 · see citing works
Klobušiaková, P., Mareček, R., Fousek, J., Výtvarová, E., & Rektorová, I. (2019) · Journal of Alzheimer s Disease · doi:10.3233/jad-180834 · Cited by 38 · see citing works
“Effect size (p̂) was calculated according to Grissom and Kim (2012) [49], for details see the Supplementary Material.”
MethodTurville, M. L., Cahill, L. S., Matyas, T. A., Blennerhassett, J. M., & Carey, L. M. (2019) · Clinical Rehabilitation · doi:10.1177/0269215519829795 · Cited by 39 · see citing works
Stochastic simulation of time-biased gain
Smucker, M. D., & Clarke, C. L. A. (2012) · ACM International Conference on Information and Knowledge Management (CIKM) · doi:10.1145/2396761.2398568 · Cited by 37 · see citing works
A Single Counterexample Leads to Moral Belief Revision
Horne, Z., Powell, D., & Hummel, J. E. (2015) · Cognitive Science · doi:10.1111/cogs.12223 · Cited by 36 · see citing works
Kilgus, S. P., Sims, W. A., von der Embse, N. P., & Taylor, C. N. (2016) · Assessment for Effective Intervention · doi:10.1177/1534508415623269 · Cited by 37 · see citing works
“Each test yields a Mann– Whitney U statistic and corresponding p value, as well as an effect size statistic (Grissom & Kim, 2012).”
BackgroundMethodInfluentialShame and the psychosis continuum: A systematic review of the literature
Carden, L. J., Saini, P., Seddon, C., Watkins, M., & Taylor, P. J. (2018) · Psychology and Psychotherapy Theory Research and Practice · doi:10.1111/papt.12204 · Cited by 38 · see citing works
- Authors
- Grissom, R. J., & Kim, J. J.
- Affiliations
- San Francisco State University (US)
- ORCID
- Kim, John J.
- Venue
- Routledge eBooks
- Publisher
- Routledge
- Published
- 2012-04-23
- OpenAlex
- W2892211387
- Cited by
- 470
- References
- 0
- Citations by year
- 2026: 41 · 2025: 27 · 2024: 27 · 2023: 31 · 2022: 37 · 2021: 23 · 2020: 34 · 2019: 40 · 2018: 44 · 2017: 24 · 2016: 47 · 2015: 31 · 2014: 33 · 2013: 23 · 2012: 8
- FWCI
- 12.17
- Type
- book
- Language
- en
- Open access
- closed
- Locations
- Routledge eBooks (publishedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
- Keywords
- effect size, confidence intervals, standardized mean difference, correlation measures, associative strength, covariance analysis, multiple linear regression, multivariate analysis of variance, repeated measures, robust estimators, statistical assumptions
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
