The DOI matches its Crossref record; 36 of the 36 references it cites were found in a registry or an index.
AERA Editorial Policies regarding Statistical Significance Testing: Three Suggested Reforms
Abstract
comments on Thompson (1996), it is ar-gued that describing results as "signifi-cant " rather than "statistically signifi-cant " is confusing to those persons most susceptible to misinterpreting this tele-graphic wording. Contrary to Robinson and Levin's view, it is noted that the util-ity of the characterization of results as being due to "nonchance " is limited by the nature of the null hypothesis assumed to be true. It is suggested that effect sizes are important to interpret, even though they too can be misinterpreted; recent empirical studies of publications indicate that effect sizes are still too rarely reported. Finally, the value of "external " replicability analy-ses is acknowledged, but it is argued that "internal " replicability analyses can also be useful, and certainly are superior to statistical significance tests regarding evaluating result replicability, because sta-tistical significance tests do not evaluate replicability.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Casella, G., & Berger, R. (2024) · Chapman & Hall/CRC eBooks · doi:10.1201/9781003456285 · Cited by 5,711
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Design and Analysis of Experiments in Psychology and Education.
Ehrenberg, A. S. C., & Lindquist, E. F. (1954) · Journal of the Royal Statistical Society. Series A (General) · doi:10.2307/2342775 · Cited by 2,623
Meehl, P. E. (1978) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.46.4.806 · Cited by 1,947
Things I have learned (so far).
Cohen, J. (1990) · American Psychologist · doi:10.1037/0003-066x.45.12.1304 · Cited by 1,781
An Inquiry concerning human understanding
Hume, D. (1955) · Cited by 1,775
Consequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022
The case against statistical significance testing
Carver, R. (1978) · Harvard Educational Review · doi:10.17763/haer.48.3.t490261645281841 · Cited by 931
The test of significance in psychological research.
Bakan, D. (1966) · Psychological Bulletin · doi:10.1037/h0020412 · Cited by 911
The Philosophy of Multiple Comparisons
Tukey, J. W. (1991) · Statistical Science · doi:10.1214/ss/1177011945 · Cited by 773
The fallacy of the null-hypothesis significance test.
Rozeboom, W. W. (1960) · Psychological Bulletin · doi:10.1037/h0042040 · Cited by 729
Statistical procedures and the justification of knowledge in psychological science.
Rosnow, R. L., & Rosenthal, R. (1992) · Methodological issues & strategies in clinical research. · doi:10.1037/10109-027 · Cited by 652
Russek, E., & Hays, W. L. (1982) · Journal of the American Statistical Association · doi:10.2307/2287811 · Cited by 460
The Significance Test Controversy.
Carter, L. F., Morrison, D. E., & Henkel, R. E. (1971) · Social Forces · doi:10.2307/2576949 · Cited by 437
Statistical analysis and the illusion of objectivity
(1988) · Infectious Diseases Newsletter · doi:10.1016/0278-2316(88)90057-6 · Cited by 408
Evaluating Results Using Corrected and Uncorrected Effect Size Estimates
Snyder, P., & Lawson, S. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.10806594 · Cited by 265
What Statistical Significance Testing Is, and What It Is Not
Shaver, J. P. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.10806592 · Cited by 196
(1969) · Palgrave Macmillan UK eBooks · doi:10.1007/978-1-349-15336-7 · Cited by 196
The Place of Statistics in Psychology
Nunnally, J. (1960) · Educational and Psychological Measurement · doi:10.1177/001316446002000401 · Cited by 189
Effect sizes: Pearson's correlation, its display via the BESD, and alternative indices.
Rosenthal, R. (1991) · American Psychologist · doi:10.1037//0003-066x.46.10.1086 · Cited by 188
The Use of Statistical Significance Tests in Research: Bootstrap and Other Alternatives
Thompson, B. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.10806596 · Cited by 183
Self-citationA Primer on the Logic and Use of Canonical Correlation Analysis.
Thompson, B. (1991) · Measurement and Evaluation in Counseling and Development · Cited by 167
Self-citationYates, F. (1951) · Journal of the American Statistical Association · doi:10.1080/01621459.1951.10500764 · Cited by 154
Thompson, B. (1994) · Journal of Personality · doi:10.1111/j.1467-6494.1994.tb00289.x · Cited by 130
Self-citationImproving what is published: A model in search of an editor.
Kupfersmid, J. H. (1988) · American Psychologist · doi:10.1037/0003-066x.43.8.635 · Cited by 126
Planning Educational Research: Determining the Necessary Sample Size
Olejnik, S. F. (1984) · The Journal of Experimental Education · doi:10.1080/00220973.1984.10806360 · Cited by 123
Two and One‐Half Decades of Leadership in Measurement and Evaluation
THOMPSON, B. (1992) · Journal of Counseling & Development · doi:10.1002/j.1556-6676.1992.tb01631.x · Cited by 97
Self-citationThompson, B. (1989) · Measurement and Evaluation in Counseling and Development · doi:10.1080/07481756.1990.12022905 · Cited by 89
Self-citationHuberty, C. J. (1993) · The Journal of Experimental Education · doi:10.1080/00220973.1993.10806593 · Cited by 83
Huberty, C. J. (1987) · Educational Researcher · doi:10.3102/0013189x016008004 · Cited by 78
Another look at Meehl, Lakatos, and the scientific practices of psychologists.
Dar, R. (1987) · American Psychologist · doi:10.1037//0003-066x.42.2.145 · Cited by 64
A Single Contrast Test Procedure
Huberty, C. J., & Morris, J. D. (1988) · Educational and Psychological Measurement · doi:10.1177/0013164488483001 · Cited by 33
An Epistemology of Practical Research
Strike, K. A. (1979) · Educational Researcher · doi:10.3102/0013189x008001010 · Cited by 31
Cohen, L. H. (1979) · Journal of Consulting and Clinical Psychology · doi:10.1037//0022-006x.47.2.421 · Cited by 23
A comprehensive power-analytic investigation of research in medical education
Woolley, T. W. (1983) · Academic Medicine · doi:10.1097/00001888-198309000-00005 · Cited by 12
Cited by
Exploratory and confirmatory factor analysis: Understanding concepts and applications.
Thompson, B. (2004) · doi:10.1037/10694-000 · Cited by 3,469
Self-citationEta squared and partial eta squared as measures of effect size in educational research
Richardson, J. T. E. (2011) · Educational Research Review · doi:10.1016/j.edurev.2010.12.001 · Cited by 3,465
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791
Effectiveness of L2 instruction: A research synthesis and quantitative meta-analysis
Norris, J. M., & Ortega, L. (2000) · Language Learning · doi:10.1111/0023-8333.00136 · Cited by 2,569
Practical significance: a concept whose time has come
Kirk, R. E. (1996) · Educational and Psychological Measurement · doi:10.1177/0013164496056005002 · Cited by 1,778
Metadata
- Authors
- Thompson, B.
- Venue
- Educational Researcher
- Published
- 1996-03
- Volume
- 25
- Issue
- 2
- Pages
- 26
- ISSN
- 0013-189X (ISSN-L)
- OpenAlex
- W2094675405
- Cited by
- 339
- References
- 36
- FWCI
- 37.31
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.