The DOI matches its Crossref record; 21 of the 21 references it cites were found in a registry or an index.
Things I have learned (so far).
Abstract
This is an account of what I have learned (so far) about the application of statistics to psychology and the other sociobiomedical sciences. It includes the principles less is (fewer variables, more highly targeted issues, sharp rounding off), simple is better (graphic representation, unit weighting for linear composites), and some things you learn aren't so. I have learned to avoid the many misconceptions that surround Fisherian null hypothesis testing. I have also learned the importance of power analysis and the determination of just how big (rather than how statistically significant) are the effects that we study. Finally, I have learned that there is no royal road to statistical induction, that the informed judgment of the investigator is the crucial element in the interpretation of data, and that things take time.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Self-citationDavid, F. N., & Tukey, J. W. (1977) · Biometrics · doi:10.2307/2529486 · Cited by 12,708
The Logic of Scientific Discovery
(2013) · A Realist Theory of Science · doi:10.4324/9780203090732-9 · Cited by 7,731
The robust beauty of improper linear models in decision making.
Dawes, R. M. (1979) · American Psychologist · doi:10.1037/0003-066x.34.7.571 · Cited by 1,966
Meehl, P. E. (1978) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.46.4.806 · Cited by 1,947
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Self-citationCohen, J. (1983) · Applied Psychological Measurement · doi:10.1177/014662168300700301 · Cited by 1,564
Self-citationON THE USE AND INTERPRETATION OF CERTAIN TEST CRITERIA FOR PURPOSES OF STATISTICAL INFERENCE
NEYMAN, J., & PEARSON, E. S. (1928) · Biometrika · doi:10.1093/biomet/20a.3-4.263 · Cited by 1,070
9: Integrating Findings: The Meta-Analysis of Research
Glass, G. V. (1977) · Review of Research in Education · doi:10.3102/0091732x005001351 · Cited by 832
Cited by
Cohen, J. (1992) · Psychological Bulletin · doi:10.1037//0033-2909.112.1.155 · Cited by 8,771
Self-citationCorporate Social and Financial Performance: A Meta-Analysis
Orlitzky, M., Schmidt, F. L., & Rynes, S. L. (2003) · Organization Studies · doi:10.1177/0170840603024003910 · Cited by 7,641
Cohen, J. (1992) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep10768783 · Cited by 5,870
Self-citationRequired sample size to detect the mediated effect
Fritz, M. S., & MacKinnon, D. P. (2007) · Psychological Science · doi:10.1111/j.1467-9280.2007.01882.x · Cited by 4,810
Issues and opinion on structural equation modeling
Chin, W. W. (1998) · Journal of the Association for Information Systems · doi:10.5555/290231.290235 · Cited by 4,577
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Self-citationEffect size, confidence interval and statistical significance: a practical guide for biologists
Nakagawa, S., & Cuthill, I. C. (2007) · Biological Reviews · doi:10.1111/j.1469-185x.2007.00027.x · Cited by 3,835
Understanding Power and Rules of Thumb for Determining Sample Sizes
Wilson Van Voorhis, C. R., & Morgan, B. L. (2007) · Tutorials in Quantitative Methods for Psychology · doi:10.20982/tqmp.03.2.p043 · Cited by 1,939
Babyak, M. A. (2004) · Psychosomatic Medicine · doi:10.1097/01.psy.0000127692.23278.a9 · Cited by 2,061
El análisis factorial exploratorio de los ítems: una guía práctica, revisada y actualizada
Lloret-Segura, S., Ferreres-Traver, A., Hernández-Baeza, A., & Tomás-Marco, I. (2014) · Anales de Psicología · doi:10.6018/analesps.30.3.199361 · Cited by 1,616
How to Select, Calculate, and Interpret Effect Sizes
Durlak, J. A. (2009) · Journal of Pediatric Psychology · doi:10.1093/jpepsy/jsp004 · Cited by 1,446
Gupta, V. K., Turban, D. B., Wasti, S. A., & Sikdar, A. (2009) · Entrepreneurship Theory and Practice · doi:10.1111/j.1540-6520.2009.00296.x · Cited by 1,169
Predicting voice behavior in work groups.
LePine, J. A., & Van Dyne, L. (1998) · Journal of Applied Psychology · doi:10.1037/0021-9010.83.6.853 · Cited by 1,192
Impact of a Confounding Variable on a Regression Coefficient
FRANK, K. A. (2000) · Sociological Methods & Research · doi:10.1177/0049124100029002001 · Cited by 1,032
Kelley, K., & Preacher, K. J. (2012) · Psychological Methods · doi:10.1037/a0028086 · Cited by 994
Research Commentary —Too Big to Fail: Large Samples and the p -Value Problem
Lin, M., Lucas, H. C., & Shmueli, G. (2013) · Information Systems Research · doi:10.1287/isre.2013.0480 · Cited by 972
Effects of psychotherapy for depression in children and adolescents: A meta-analysis
Weisz, J. R., McCarty, C. A., & Valeri, S. M. (2006) · Psychological Bulletin · doi:10.1037/0033-2909.132.1.132 · Cited by 942
Schmidt, F. L. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.115 · Cited by 830
Grych, J. H., Seid, M., & Fincham, F. D. (1992) · Child Development · doi:10.1111/j.1467-8624.1992.tb01646.x · Cited by 817
Using confidence intervals for graphically based data interpretation.
Masson, M. E. J., & Loftus, G. R. (2003) · Canadian Journal of Experimental Psychology / Revue canadienne de psychologie expérimentale · doi:10.1037/h0087426 · Cited by 730
Bivariate median splits and spurious statistical significance.
Maxwell, S. E., & Delaney, H. D. (1993) · Psychological Bulletin · doi:10.1037//0033-2909.113.1.181 · Cited by 665
How Should the Internal Structure of Personality Inventories Be Evaluated?
Hopwood, C. J., & Donnellan, M. B. (2010) · Personality and Social Psychology Review · doi:10.1177/1088868310361240 · Cited by 659
Keselman, H. J., Huberty, C. J., Lix, L. M., Olejnik, S., Cribbie, R. A., Donahue, B., Kowalchuk, R. K., Lowman, L. L., Petoskey, M. D., Keselman, J. C., et al. (1998) · Review of Educational Research · doi:10.2307/1170601 · Cited by 627
Weiss, B., Dodge, K. A., Bates, J. E., & Pettit, G. S. (1992) · Child Development · doi:10.1111/j.1467-8624.1992.tb01697.x · Cited by 550
The Big Five Personality Traits and the Life Course: A 45-Year Longitudinal Study
Soldz, S., & Vaillant, G. E. (1999) · Journal of Research in Personality · doi:10.1006/jrpe.1999.2243 · Cited by 531
Cumming, G., & Finch, S. (2001) · Educational and Psychological Measurement · doi:10.1177/0013164401614002 · Cited by 528
Choice and performance of governance mechanisms: matching alliance governance to asset type
Hoetker, G., & Mellewigt, T. (2009) · Strategic Management Journal · doi:10.1002/smj.775 · Cited by 525
Jodoin, M. G., & Gierl, M. J. (2001) · Applied Measurement in Education · doi:10.1207/s15324818ame1404_2 · Cited by 515
Ellis, P. D. (2011) · Journal of International Business Studies · doi:10.1057/jibs.2010.20 · Cited by 512
Beaton, D. (2001) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(01)00407-3 · Cited by 487
The ironic effect of significant results on the credibility of multiple-study articles.
Schimmack, U. (2012) · Psychological Methods · doi:10.1037/a0029487 · Cited by 455
Middel, B., & Van Sonderen, E. (2002) · International Journal of Integrated Care · doi:10.5334/ijic.65 · Cited by 464
Fraley, R. C., & Vazire, S. (2014) · PLoS ONE · doi:10.1371/journal.pone.0109019 · Cited by 409
Effect Size, Practical Importance, and Social Policy for Children
McCartney, K., & Rosenthal, R. (2000) · Child Development · doi:10.1111/1467-8624.00131 · Cited by 429
Effect sizes for experimenting psychologists.
Rosnow, R. L., & Rosenthal, R. (2003) · Canadian Journal of Experimental Psychology / Revue canadienne de psychologie expérimentale · doi:10.1037/h0087427 · Cited by 416
Uncertainty measures of rough set prediction
Düntsch, I., & Gediga, G. (1998) · Artificial Intelligence · doi:10.1016/s0004-3702(98)00091-5 · Cited by 415
Researchers Misunderstand Confidence Intervals and Standard Error Bars.
Belia, S., Fidler, F., Williams, J., & Cumming, G. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.4.389 · Cited by 390
A systematic review of effect size in software engineering experiments
Kampenes, V. B., Dybå, T., Hannay, J. E., & Sjøberg, D. I. K. (2007) · Information and Software Technology · doi:10.1016/j.infsof.2007.02.015 · Cited by 370
Kim, J., Wigram, T., & Gold, C. (2008) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-008-0566-6 · Cited by 370
Persistent millennial-scale climatic variability over the past 25,000 years in Southern Africa
Holmgren, K., Lee-Thorp, J. A., Cooper, G. R. J., Lundblad, K., Partridge, T. C., Scott, L., Sithaldeen, R., Siep Talma, A., & Tyson, P. D. (2003) · Quaternary Science Reviews · doi:10.1016/s0277-3791(03)00204-x · Cited by 367
Teaching Bayesian reasoning in less than two hours.
Sedlmeier, P., & Gigerenzer, G. (2001) · Journal of Experimental Psychology: General · doi:10.1037//0096-3445.130.3.380 · Cited by 366
Psychology Will Be a Much Better Science When We Change the Way We Analyze Data
Loftus, G. R. (1996) · Current Directions in Psychological Science · doi:10.1111/1467-8721.ep11512376 · Cited by 361
The relation between statistical power and inference in fMRI
Cremers, H. R., Wager, T. D., & Yarkoni, T. (2017) · PLOS ONE · doi:10.1371/journal.pone.0184923 · Cited by 349
Online banking adoption: an empirical analysis
Yee‐Loong Chong, A., Ooi, K., Lin, B., & Tan, B. (2010) · International Journal of Bank Marketing · doi:10.1108/02652321011054963 · Cited by 343
Sun, S., Pan, W., & Wang, L. L. (2010) · Journal of Educational Psychology · doi:10.1037/a0019507 · Cited by 342
Fair Statistical Communication in HCI
Dragicevic, P. (2016) · Human–Computer Interaction Series · doi:10.1007/978-3-319-26633-6_13 · Cited by 325
A prospective study of pediatric loss of control eating and psychological outcomes
Tanofsky-Kraff, M., Shomaker, L. B., Olsen, C., Roza, C. A., Wolkoff, L. E., Columbo, K. M., Raciti, G., Zocca, J. M., Wilfley, D. E., Yanovski, S. Z., et al. (2011) · Journal of Abnormal Psychology · doi:10.1037/a0021406 · Cited by 319
Reporting and Interpreting Effect Size in Quantitative Agricultural Education Research
Kotrlik, J. W., Williams, H. A., & Jabor, M. K. (2011) · Journal of Agricultural Education · doi:10.5032/jae.2011.01132 · Cited by 314
Kelley, K., & Maxwell, S. E. (2003) · Psychological Methods · doi:10.1037/1082-989x.8.3.305 · Cited by 310
Cross-modal interactions in the perception of musical performance
VINES, B., KRUMHANSL, C., WANDERLEY, M., & LEVITIN, D. (2006) · Cognition · doi:10.1016/j.cognition.2005.09.003 · Cited by 306
Psychosocial Factors and Sport Injuries: Meta-analyses for Prediction and Prevention
Ivarsson, A., Johnson, U., Andersen, M. B., Tranaeus, U., Stenling, A., & Lindwall, M. (2017) · Sports Medicine · doi:10.1007/s40279-016-0578-x · Cited by 292
Bayesian tests to quantify the result of a replication attempt.
Verhagen, J., & Wagenmakers, E.-J. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0036731 · Cited by 291
Null hypothesis significance testing: On the survival of a flawed method.
Krueger, J. (2001) · American Psychologist · doi:10.1037//0003-066x.56.1.16 · Cited by 282
Masculine voices signal men's threat potential in forager and industrial societies
Puts, D. A., Apicella, C. L., & Cárdenas, R. A. (2012) · Proceedings of the Royal Society B: Biological Sciences · doi:10.1098/rspb.2011.0829 · Cited by 270
Evaluating Results Using Corrected and Uncorrected Effect Size Estimates
Snyder, P., & Lawson, S. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.10806594 · Cited by 265
Biglan, A., & Hayes, S. C. (1996) · Applied and Preventive Psychology · doi:10.1016/s0962-1849(96)80026-6 · Cited by 234
Women's attractiveness changes with estradiol and progesterone across the ovulatory cycle
Puts, D. A., Bailey, D. H., Cárdenas, R. A., Burriss, R. P., Welling, L. L. M., Wheatley, J. R., & Dawood, K. (2013) · Hormones and Behavior · doi:10.1016/j.yhbeh.2012.11.007 · Cited by 209
Brossart, D. F., Parker, R. I., Olson, E. A., & Mahadevan, L. (2006) · Behavior Modification · doi:10.1177/0145445503261167 · Cited by 217
Palermo, T. M., & Kiska, R. (2005) · The Journal of Pain · doi:10.1016/j.jpain.2004.12.005 · Cited by 173
On the logic and purpose of significance testing.
Cortina, J. M., & Dunlap, W. P. (1997) · Psychological Methods · doi:10.1037/1082-989x.2.2.161 · Cited by 166
Significance tests as sorcery: Science is empirical—significance tests are not
Lambdin, C. (2012) · Theory & Psychology · doi:10.1177/0959354311429854 · Cited by 143
Radtke, K. M., Schauer, M., Gunter, H. M., Ruf-Leuschner, M., Sill, J., Meyer, A., & Elbert, T. (2015) · Translational Psychiatry · doi:10.1038/tp.2015.63 · Cited by 128
Theoretical and research support for the Duluth Model: A reply to dutton and corvo
Gondolf, E. W. (2007) · Aggression and Violent Behavior · doi:10.1016/j.avb.2007.03.001 · Cited by 124
Rodríguez-García, J. D., Moreno-León, J., Román-González, M., & Robles, G. (2021) · Proceedings of the 52nd ACM Technical Symposium on Computer Science Education · doi:10.1145/3408877.3432393 · Cited by 104
BRAATEN, A. J., PARSONS, T. D., McCUE, R., SELLERS, A., & BURNS, W. J. (2006) · International Journal of Neuroscience · doi:10.1080/00207450600920928 · Cited by 98
Malignant side effects of null-hypothesis significance testing
Branch, M. (2014) · Theory & Psychology · doi:10.1177/0959354314525282 · Cited by 81
Smith, R. A., Levine, T. R., Lachlan, K. A., & Fediuk, T. A. (2002) · Human Communication Research · doi:10.1111/j.1468-2958.2002.tb00821.x · Cited by 77
Pousette Lundgren, G., Karsten, A., & Dahllöf, G. (2015) · Health and Quality of Life Outcomes · doi:10.1186/s12955-015-0393-3 · Cited by 60
Parenting Stress and Parenting Competence Among Latino Men Who Batter
BAKER, C. K., PERILLA, J. L., & NORRIS, F. H. (2001) · Journal of Interpersonal Violence · doi:10.1177/088626001016011003 · Cited by 53
Finch, S., Cumming, G., & Thomason, N. (2001) · Educational and Psychological Measurement · doi:10.1177/0013164401612001 · Cited by 52
Tablets for teaching and learning: A systematic review and meta-analysis
Tamim, R., Borokhovski, E., Pickup, D., Bernard, R. M., & Saadi, L. E. (2015) · Commonwealth of Learning · doi:10.13140/rg.2.1.3670.5042 · Cited by 31
(2006) · PubMed · Cited by 23
The Impact of Quality of Big Data Marketing Analytics (BDMA) on the Market and Financial Performance
Haverila, M., Haverila, K. C., Mohiuddin, M., & Su, Z. (2022) · Journal of Global Information Management · doi:10.4018/jgim.315646 · Cited by 20
(2015) · HAL · Cited by 20
Monterde-i-Bort, H., Frías-Navarro, D., & Pascual-Llobell, J. (2010) · European Journal of Psychology of Education · doi:10.1007/s10212-010-0021-x · Cited by 14
(2009) · PubMed · Cited by 13
Haverila, M. J., & Haverila, K. C. (2024) · Marketing Intelligence & Planning · doi:10.1108/mip-07-2023-0319 · Cited by 11
Metadata
- Authors
- Cohen, J.
- Venue
- Methodological issues & strategies in clinical research.
- Publisher
- American Psychological Association
- Published
- 1992
- Pages
- 315-333
- OpenAlex
- W1597188168
- Cited by
- 553
- References
- 21
- FWCI
- 5.47
- Type
- book chapter
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.