The DOI matches its Crossref record; 33 of the 33 references it cites were found in a registry or an index.
Reporting and Interpreting Effect Size in Quantitative Agricultural Education Research
Open accessAbstract
The Journal of Agricultural Education (JAE) requires authors to follow the guidelines stated in the Publication Manual of the American Psychological Association [APA] (2009) in preparing research manuscripts, and to utilize accepted research and statistical methods in conducting quantitative research studies. The APA recommends the reporting of effect sizes in quantitative research, when appropriate. JAE now requires the reporting of effect size when reporting statistical significance in quantitative manuscripts. The purposes of this manuscript are to describe the research foundation supporting the reporting of effect size in quantitative research and to provide examples of how to calculate effect size for some of the most common statistical analyses utilized in agricultural education research. Recommendations for appropriate effect size measures and interpretation are included. The assumptions and limitations inherent in the reporting of effect size in research are also incorporated.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Statistical power analysis for the behavioral sciences
(1990) · Computers, Environment and Urban Systems · doi:10.1016/0198-9715(90)90050-4 · Cited by 65,269
Statistical Power Analysis for the Behavioral Sciences (2nd ed.).
Lachenbruch, P. A., & Cohen, J. (1989) · Journal of the American Statistical Association · doi:10.2307/2290095 · Cited by 37,395
Statistical Methods for Research Workers
(1945) · American Journal of Clinical Pathology · doi:10.1093/ajcp/15.11.552b · Cited by 10,880
Multivariate Data Analysis, 6th ed
Tatham, R. L., Anderson, R. E., Babin, B. J., Black, W. C., & Hair, J. F. (2006) · Cited by 9,807
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Applied statistics for the behavioral sciences
Hinkle, D. E., Wiersma, W., & Jurs, S. G. (1979) · Cited by 2,282
Parametric measures of effect size.
Rosenthal, R. (1994) · Cited by 1,847
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Practical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778 · cited 4×
“Kirk (1996) cited the need to report effect size and an APA Task Force indicated that researchers should “Always provide some effect–size estimate when reporting a p value.”
BackgroundResultInfluentialMeta-analysis of experiments with matched groups or repeated measures designs
Dunlap, W. P., Cortina, J. M., Vaslow, J. B., & Burke, M. J. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.2.170 · Cited by 1,693
Designing Experiments and Analysing Data: A Model Comparison Perspective.
Freeman, G. H., Maxwell, S. E., & Delaney, H. D. (1991) · Biometrics · doi:10.2307/2532173 · Cited by 1,229
Null hypothesis significance testing: a review of an old and continuing controversy
Nickerson, R. S. (2000) · Psychological Methods · doi:10.1037/1082-989x.5.2.241 · Cited by 1,090
Designing Experiments and Analyzing Data: A Model Comparison Perspective, Third Edition
Maxwell, S. E., & Delaney, H. D. (1999) · Medical Entomology and Zoology · Cited by 975
Carter, L. F., & Davis, J. A. (1973) · Social Forces · doi:10.2307/2577148 · Cited by 750
Design and analysis: A researcher's handbook, 3rd ed.
Keppel, G. (1991) · Cited by 703
Measures of Effect Size for Comparative Studies: Applications, Interpretations, and Limitations
Olejnik, S., & Algina, J. (2000) · Contemporary Educational Psychology · doi:10.1006/ceps.2000.1040 · Cited by 701
Things I have learned (so far).
Cohen, J. (1992) · Methodological issues & strategies in clinical research. · doi:10.1037/10109-028 · Cited by 553
Thompson, B. (2002) · Educational Researcher · doi:10.3102/0013189x031003025 · Cited by 538
AERA Editorial Policies regarding Statistical Significance Testing: Three Suggested Reforms
Thompson, B. (1996) · Educational Researcher · doi:10.2307/1176337 · Cited by 339
THE INCORPORATION OF EFFECT SIZE IN INFORMATION TECHNOLOGY, LEARNING, AND PERFORMANCE RESEARCH
Kotrlik, J. W., & Williams, H. A. (2003) · Cited by 329
Self-citationThe Case Against Statistical Significance Testing, Revisited
Carver, R. P. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.10806591 · Cited by 319
Becoming a behavioral science researcher: a guide to producing research that matters
(2009) · Choice Reviews Online · doi:10.5860/choice.46-3545 · Cited by 237
Statistical Significance and Effect Size in Education Research: Two Sides of a Coin
Fan, X. (2001) · The Journal of Educational Research · doi:10.1080/00220670109598763 · Cited by 220
What Statistical Significance Testing Is, and What It Is Not
Shaver, J. P. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.10806592 · Cited by 196
Promoting good statistical practices: Some suggestions
Kirk, R. E. (2001) · Educational and Psychological Measurement · doi:10.1177/00131640121971185 · Cited by 184
Reporting effect size estimates in school psychology research
Volker, M. A. (2006) · Psychology in the Schools · doi:10.1002/pits.20176 · Cited by 182
Reflections on Statistical and Substantive Significance, with a Slice of Replication
Robinson, D. H., & Levin, J. R. (1997) · Educational Researcher · doi:10.2307/1176544 · Cited by 125
Baugh, F. G. (2002) · Educational and Psychological Measurement · doi:10.1177/0013164402062002004 · Cited by 86
A Call for Greater Use of Nonparametric Statistics
Leech, N. L., & Onwuegbuzie, A. J. (2002) · Cited by 82
In praise of brilliance: Where that praise really belongs.
Thompson, B. (1998) · American Psychologist · doi:10.1037//0003-066x.53.7.799 · Cited by 54
Statistical Significance, Effect Size Reporting, and Confidence Intervals: Best Reporting Strategies
Capraro, R. M. (2004) · Journal for Research in Mathematics Education · doi:10.2307/30034803 · Cited by 45
Reviewer bias for statistically significant results: A reexamination.
Fagley, N. S., & McKinney, I. J. (1983) · Journal of Counseling Psychology · doi:10.1037//0022-0167.30.2.298 · Cited by 15
Cited by
Alternatives to P value: confidence interval and effect size
Lee, D. K. (2016) · Korean Journal of Anesthesiology · doi:10.4097/kjae.2016.69.6.555 · Cited by 479
Supported employment adapted for people with affective disorders—A randomized controlled trial
Bejerholm, U., Larsson, M. E., & Johanson, S. (2017) · Journal of Affective Disorders · doi:10.1016/j.jad.2016.08.028 · Cited by 94
Adaptive learning: Helpful to the flipped classroom in the online environment of COVID?
Clark, R. M., Kaw, A. K., & Braga Gomes, R. (2022) · Computer Applications in Engineering Education · doi:10.1002/cae.22470 · Cited by 63
Indigenous plants for informal greywater treatment and reuse by some households in Ghana
Dwumfour-Asare, B., Nyarko, K. B., Awuah, E., Essandoh, H. M. K., Gyan, B. A., & Ofori-Addo, H. (2018) · Journal of Water Reuse and Desalination · doi:10.2166/wrd.2018.061 · Cited by 12
Metadata
- Authors
- Kotrlik, J. W., Williams, H. A., & Jabor, M. K.
- Venue
- Journal of Agricultural Education
- Published
- 2011-03-28
- Volume
- 52
- Issue
- 1
- Pages
- 132-142
- ISSN
- 1042-0541 (ISSN-L)
- OpenAlex
- W2010050882
- Cited by
- 314
- References
- 33
- FWCI
- 5.40
- Type
- journal article
- Language
- en
- Open access
- diamond
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.