CoChat

Sample Size in Psychological Research over the Past 30 Years

Marszalek, Jacob M., Barber, Carolyn, Kohlhart, Julie, Cooper, B. Holmes · 2011 · Perceptual and Motor Skills

The DOI matches its Crossref record; 29 of the 29 references it cites were found in a registry or an index.

Abstract

The American Psychological Association (APA) Task Force on Statistical Inference was formed in 1996 in response to a growing body of research demonstrating methodological issues that threatened the credibility of psychological research, and made recommendations to address them. One issue was the small, even dramatically inadequate, size of samples used in studies published by leading journals. The present study assessed the progress made since the Task Force's final report in 1999. Sample sizes reported in four leading APA journals in 1955, 1977, 1995, and 2006 were compared using nonparametric statistics, while data from the last two waves were fit to a hierarchical generalized linear growth model for more in-depth analysis. Overall, results indicate that the recommendations for increasing sample sizes have not been integrated in core psychological research, although results slightly vary by field. This and other implications are discussed in the context of current methodological critique and practice.

Overview

Integrity signals

Registry

Crossref · 10.2466/03.11.pms.112.2.331-348

Cites

29 of 29 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 29 references

Research works printed but not linked: 4

  1. American Psychological Association, 2001, Publication manual
  2. Cochrane R., 1974, Bulletin of the British Psychological Society, 27, 117
  3. 10.1037/0278-6133.20.1.76 · doi:10.1037/0278-6133.20.1.76 · Paper page
  4. Raudenbush S. W., 2004, HLM 6: Hierarchical linear and nonlinear modeling

Cited by

Items 101–188 of 188

Metadata

Authors
Marszalek, J. M., Barber, C., Kohlhart, J., & Cooper, B. H.
Affiliations
  • University of Missouri–Kansas City (US)
  • Emporia State University (US)
Corresponding author
Marszalek, Jacob M.
Venue
Perceptual and Motor Skills
Published
2011-04
Volume
112
Issue
2
Pages
331-348
ISSN
  • 0031-5125 (ISSN-L)
  • 1558-688X
OpenAlex
W2126053474
Cited by
167
References
29
Citations by year
2026: 6 · 2025: 9 · 2024: 10 · 2023: 11 · 2022: 9 · 2021: 10 · 2020: 17 · 2019: 21 · 2018: 11 · 2017: 15 · 2016: 19 · 2015: 12 · 2014: 8 · 2013: 6 · 2012: 3
FWCI
7.03
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
  • Perceptual and Motor Skills (publishedVersion)
  • PubMed (publishedVersion)
  • MOspace Institutional Repository (University of Missouri) (submittedVersion)
Topics
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Psychology › General Psychology › Academic and Historical Perspectives in Psychology
Keywords
sample size, statistical power, methodological critique, research credibility, APA journals, methodological recommendations
MeSH terms
Data Interpretation, Statistical, Forecasting, Humans, Periodicals as Topic, Psychology, Publishing, Research, Reproducibility of Results, Bias, Linear Models, Sample Size, Statistics, Nonparametric, Editorial Policies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.