Persons as Effect Sizes
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
Traditional indices of effect size are designed to answer questions about average group differences, associations between variables, and relative risk. For many researchers, an additional, important question is, “How many people in my study behaved or responded in a manner consistent with theoretical expectation?” We show how the answer to this question can be computed and reported as a straightforward percentage for a wide variety of study designs. This percentage essentially treats persons as an effect size, and it can easily be understood by scientists, professionals, and laypersons alike. For instance, imagine that in addition to d or η 2, a researcher reports that 80% of participants matched theoretical expectation. No statistical training is required to understand the basic meaning of this percentage. By analyzing recently published studies, we show how computing this percentage can reveal novel patterns within data that provide insights for extending and developing the theory under investigation.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
An effect size primer: A guide for clinicians and researchers.
Ferguson, C. J. (2009) · Professional Psychology: Research and Practice · doi:10.1037/a0015808 · Cited by 3,467 · cited 4×
“To provide an example of these challenges, Ferguson (2009b) reprinted data on the Salk vaccine that Rosnow and Rosenthal (2003) had used to argue that even small correlations can be interpreted as providing convincing evidence for an effect.”
BackgroundMethodInfluentialEvaluating Effect Size in Psychological Research: Sense and Nonsense
Funder, D. C., & Ozer, D. J. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919847202 · Cited by 3,295 · cited 2×
“It should be noted that the goal in computing personcentered effect sizes is to engage the data in novel ways and to describe the results of a study in a meaningful or sensible manner (see Funder & Ozer, 2019).”
BackgroundThe New Statistics: Why and How
Cumming, G. (2014) · Psychological Science · doi:10.1177/0956797613504966 · Cited by 3,200 · cited 4×
“In its place, scholars and statisticians have developed alternative methods for drawing inferences in regard to population parameters, such as the estimation (Cumming, 2014), a priori (Trafimow, 2019), and statistical-sameness (Hubbard, 2016) approaches, among others (see Wasserstein, Schirm, & Lazar, 2019b).”
MethodInfluentialMoving to a World Beyond “ p < 0.05”
Wasserstein, R. L., Schirm, A. L., & Lazar, N. A. (2019) · The American Statistician · doi:10.1080/00031305.2019.1583913 · Cited by 2,976
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Molenaar, P. C. M. (2004) · Measurement: Interdisciplinary Research & Perspective · doi:10.1207/s15366359mea0204_1 · Cited by 1,943 · cited 1×
“Statistical inferences drawn from groups of individuals may not accurately describe the individuals themselves (see also Lamiell, 2013; Molenaar, 2004).”
BackgroundPractical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778 · cited 1×
“For these types of comparisons, then, the PCC is an effect size that incorporates the underlying ordinal question, “Is one score higher or lower than another?” If one is wedded to a strict parametric analysis or to describing group differences or relationships between variables in the aggregate, this question may be t…”
MethodLack of group-to-individual generalizability is a threat to human subjects research
Fisher, A. J., Medaglia, J. D., & Jeronimus, B. F. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1711978115 · Cited by 1,099
A common language effect size statistic
McGraw, K. O., & Wong, S. P. (1992) · Psychological Bulletin · doi:10.1037/0033-2909.111.2.361 · Cited by 934 · cited 1×
“This state of affairs may reflect a certain inadequacy of many effect-size indices in providing researchers with meaningful statistics (McGraw & Wong, 1992).”
Background
Cited by
Social media use and well-being: What we know and what we need to know
Valkenburg, P. M. (2022) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2021.12.006 · Cited by 373
Methodological considerations for studying neural oscillations
Donoghue, T., Schaworonkow, N., & Voytek, B. (2022) · European Journal of Neuroscience · doi:10.1111/ejn.15361 · Cited by 309
Valkenburg, P. M., Beyens, I., Pouwels, J. L., van Driel, I. I., & Keijsers, L. (2021) · Journal of Computer-Mediated Communication · doi:10.1093/jcmc/zmab015 · Cited by 123
Dietvorst, E., Legerstee, J. S., Vreeker, A., Koval, S., Mens, M. M., Keijsers, L., & Hillegers, M. H. J. (2023) · European Child & Adolescent Psychiatry · doi:10.1007/s00787-022-01982-z · Cited by 24
Garel, N., Greenway, K. T., Dinh-Williams, L.-A. L., Thibault-Levesque, J., Jutras-Aswad, D., Turecki, G., Rej, S., & Richard-Devantoy, S. (2023) · Neuropsychopharmacology · doi:10.1038/s41386-023-01689-y · Cited by 13
Metadata
- Authors
- Grice, J. W., Medellin, E., Jones, I., Horvath, S., McDaniel, H., O’lansen, C., & Baker, M.
- Venue
- Advances in Methods and Practices in Psychological Science
- Publisher
- SAGE Publications
- Published
- 2020-10-09
- Volume
- 3
- Issue
- 4
- Pages
- 443-455
- ISSN
- 2515-2459 (ISSN-L)
- 2515-2467
- OpenAlex
- W3092133607
- Cited by
- 96
- References
- 14
- FWCI
- 7.66
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Persons as Effect Sizes. https://app.cochat.ai/papers/10.1177/2515245920922982
- The paper
- Grice, J. W., Medellin, E., Jones, I., Horvath, S., McDaniel, H., O’lansen, C., & Baker, M. (2020). Persons as Effect Sizes. Advances in Methods and Practices in Psychological Science. https://doi.org/10.1177/2515245920922982
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.