The DOI matches its Crossref record; 24 of the 24 references it cites were found in a registry or an index.
Using anchor-based methods to determine the smallest effect size of interest
Open accessAbstract
Effect sizes are an important outcome of quantitative research, but few guidelines exist that explain how researchers can determine which effect sizes are meaningful. Psychologists often want to study effects that are large enough to make a difference to people’s subjective experience. Thus, subjective experience is one way to gauge meaningfulness of an effect. We illustrate how to quantify the minimum subjectively experienced difference—the smallest change in an outcome measure that individuals consider to be meaningful enough in their subjective experience such that they are willing to rate themselves as feeling different—using an anchor-based method with a global rating of change question applied to the positive and negative affect scale. For researchers interested in people’s subjective experiences, this anchor-based method provides one way to specify a smallest effect size of interest, which allows researchers to interpret observed results in terms of their theoretical and practical significance.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Jaeschke, R., Singer, J., & Guyatt, G. H. (1989) · Controlled Clinical Trials · doi:10.1016/0197-2456(89)90005-6 · Cited by 4,982
New well-being measures: Short scales to assess flourishing and positive and negative feelings
Diener, E., Wirtz, D., Tov, W., Kim-Prieto, C., Choi, D.-W., Oishi, S., & Biswas-Diener, R. (2010) · Social Indicators Research · doi:10.1007/s11205-009-9493-y · Cited by 4,980
Norman, G. R., Sloan, J. A., & Wyrwich, K. W. (2003) · Medical Care · doi:10.1097/01.mlr.0000062554.74615.4c · Cited by 4,700
Dworkin, R. H., Turk, D. C., Wyrwich, K. W., Beaton, D., Cleeland, C. S., Farrar, J. T., Haythornthwaite, J. A., Jensen, M. P., Kerns, R. D., Ader, D. N., et al. (2008) · The Journal of Pain · doi:10.1016/j.jpain.2007.09.005 · Cited by 3,471
An effect size primer: A guide for clinicians and researchers.
Ferguson, C. J. (2009) · Professional Psychology: Research and Practice · doi:10.1037/a0015808 · Cited by 3,467
Evaluating Effect Size in Psychological Research: Sense and Nonsense
Funder, D. C., & Ozer, D. J. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919847202 · Cited by 3,295
Equivalence Tests: A Practical Primer for t Tests, Correlations, and Meta-Analyses
Lakens, D. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617697177 · Cited by 3,001
Self-citationEquivalence Testing for Psychological Research: A Tutorial
Lakens, D., Scheel, A. M., & Isager, P. M. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918770963 · Cited by 1,560
Self-citationGlobal Rating of Change Scales: A Review of Strengths and Weaknesses and Considerations for Design
Kamper, S. J., Maher, C. G., & Mackay, G. (2009) · Journal of Manual & Manipulative Therapy · doi:10.1179/jmt.2009.17.3.163 · Cited by 1,458
Investigating Variation in Replicability: A “Many Labs” Replication Project
Klein, R. A., Ratliff, K. A., Vianello, M., Adams, R. B., Bahník, Š., Bernstein, M. J., Bocian, K., Brandt, M. J., Brooks, B., Brumbaugh, C. C., et al. (2014) · Social Psychology · doi:10.1027/1864-9335/a000178 · Cited by 1,208
Redelmeier, D. A., Bayoumi, A. M., Goldstein, R. S., & Guyatt, G. H. (1997) · American journal of respiratory and critical care medicine · doi:10.1164/ajrccm.155.4.9105067 · Cited by 1,029
Empirical Benchmarks for Interpreting Effect Sizes in Research
Hill, C. J., Bloom, H. S., Black, A. R., & Lipsey, M. W. (2008) · Child Development Perspectives · doi:10.1111/j.1750-8606.2008.00061.x · Cited by 950
Many Labs 2: Investigating variation in replicability across samples and settings
Klein, R. A., Vianello, M., Hasselman, F., Adams, B. G., Adams, R. B., Alper, S., Aveyard, M., Axt, J. R., Babalola, M. T., Bahník, Š., et al. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918810225 · Cited by 944
Self-citationLeDoux, J. E. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1400335111 · Cited by 891
Standardized or simple effect size: what should be reported?
Baguley, T. (2009) · British Journal of Psychology · doi:10.1348/000712608x377117 · Cited by 619
Acceptability and suppression of negative emotion in anxiety and mood disorders.
Campbell-Sills, L., Barlow, D. H., Brown, T. A., & Hofmann, S. G. (2006) · Emotion · doi:10.1037/1528-3542.6.4.587 · Cited by 579
Sample Size Planning for Statistical Power and Accuracy in Parameter Estimation
Maxwell, S. E., Kelley, K., & Rausch, J. R. (2008) · Annual Review of Psychology · doi:10.1146/annurev.psych.59.103006.093735 · Cited by 542
Performing high‐powered studies efficiently with sequential analyses
Lakens, D. (2014) · European Journal of Social Psychology · doi:10.1002/ejsp.2023 · Cited by 414
Self-citationButton, K. S., Kounali, D., Thomas, L., Wiles, N. J., Peters, T. J., Welton, N. J., Ades, A. E., & Lewis, G. (2015) · Psychological Medicine · doi:10.1017/s0033291715001270 · Cited by 332
The subjective experience of emotion: a fearful view
LeDoux, J. E., & Hofmann, S. G. (2018) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.09.011 · Cited by 268
Cuijpers, P., Turner, E. H., Koole, S. L., van Dijke, A., & Smit, F. (2014) · Depression and Anxiety · doi:10.1002/da.22249 · Cited by 242
Initial elevation bias in subjective reports
Shrout, P. E., Stadler, G., Lane, S. P., McClure, M. J., Jackson, G. L., Clavél, F. D., Iida, M., Gleason, M. E. J., Xu, J. H., & Bolger, N. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1712277115 · Cited by 190
How much change is enough? Evidence from a longitudinal study on depression in UK primary care
Kounali, D., Button, K. S., Lewis, G., Gilbody, S., Kessler, D., Araya, R., Duffy, L., Lanham, P., Peters, T. J., Wiles, N., et al. (2022) · Psychological Medicine · doi:10.1017/s0033291720003700 · Cited by 164
Forgetting feelings: opposite biases in reports of the intensity of past emotion and mood
Kaplan, R. L., Levine, L. J., Lench, H. C., & Safer, M. A. (2016) · Emotion · doi:10.1037/emo0000127 · Cited by 47
Cited by
Teenagers, screens and social media: a narrative review of reviews and key studies
Orben, A. (2020) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-019-01825-4 · Cited by 706
Small Effects: The Indispensable Foundation for a Cumulative Psychological Science
Götz, F. M., Gosling, S. D., & Rentfrow, P. J. (2022) · Perspectives on Psychological Science · doi:10.1177/1745691620984483 · Cited by 538
Video game play is positively correlated with well-being
Johannes, N., Vuorre, M., & Przybylski, A. K. (2021) · Royal Society Open Science · doi:10.1098/rsos.202049 · Cited by 330
Vuorre, M., Orben, A., & Przybylski, A. K. (2021) · Clinical Psychological Science · doi:10.1177/2167702621994549 · Cited by 158
Sommet, N., Weissman, D. L., Cheutin, N., & Elliot, A. (2022) · doi:10.31219/osf.io/xhe3u · Cited by 36
Metadata
- Authors
- Anvari, F., & Lakens, D.
- Venue
- Journal of Experimental Social Psychology
- Publisher
- Elsevier BV
- Published
- 2021-09
- Volume
- 96
- Pages
- 104159
- ISSN
- 0022-1031 (ISSN-L)
- OpenAlex
- W3162971299
- Cited by
- 231
- References
- 24
- FWCI
- 22.72
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.