CoChat

The DOI matches its Crossref record; 37 of the 37 references it cites were found in a registry or an index.

Analytic Review as a Solution to the Misreporting of Statistical Results in Psychological Science

Sakaluk, John, Williams, Alexander, Biernat, Monica · 2014 · Perspectives on Psychological Science

Published version of a preprint

Abstract

In this article, we propose analytic review (AR) as a solution to the problem of misreporting statistical results in psychological science. AR requires authors submitting manuscripts for publication to also submit the data file and syntax used during analyses. Regular reviewers or statistical experts then review reported analyses in order to verify that the analyses reported were actually conducted and that the statistical values are accurately reported. We begin by describing the problem of misreporting in psychology and introduce the basic AR process. We then highlight both primary and secondary benefits of adopting AR and describe different permutations of the AR system, each of which has its own strengths and limitations. We conclude by attempting to dispel three anticipated concerns about AR: that it will increase the workload placed on scholars, that it will infringe on the traditional peer-review process, and that it will hurt the image of the discipline of psychology. Although implementing AR will add one more step to the bureaucratic publication process, we believe it can be implemented in an efficient manner that would greatly assist in decreasing the frequency and impact of misreporting while also providing secondary benefits in other domains of scientific integrity.

Overview

Integrity signals

Registry

Crossref · 10.1177/1745691614549257

Cites

37 of 37 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

2 retracted

Show all 37 references

Research works printed but not linked: 2

  1. Herndon T., 2013, Cambridge Journal of Economics, 38, 1
  2. Simonsohn U., Journal of Experimental Psychology: General

Cited by

See all 32

Metadata

Authors
Sakaluk, J., Williams, A., & Biernat, M.
Affiliations
University of Kansas (US)
Venue
Perspectives on Psychological Science
Published
2014-11
Volume
9
Issue
6
Pages
652-660
ISSN
  • 1745-6916 (ISSN-L)
  • 1745-6924
OpenAlex
W2133343019
Cited by
32
References
37
Citations by year
2025: 1 · 2024: 2 · 2022: 3 · 2021: 3 · 2020: 2 · 2019: 4 · 2018: 4 · 2017: 4 · 2016: 4 · 2015: 4 · 2014: 1
FWCI
12.07
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
  • Perspectives on Psychological Science (publishedVersion)
  • PubMed (publishedVersion)
  • OSF Preprints (OSF Preprints) (submittedVersion)
Topics
  • Social Sciences › Education › Academic integrity and plagiarism
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords
statistical reporting, data transparency, peer review, scientific integrity, reproducibility, publication process
MeSH terms
Humans, Psychology, Statistics as Topic, Scientific Misconduct, Peer Review, Research, Editorial Policies

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Analytic Review as a Solution to the Misreporting of Statistical Results in Psychological Science. https://app.cochat.ai/papers/10.1177/1745691614549257
The paper
Sakaluk, J., Williams, A., & Biernat, M. (2014). Analytic Review as a Solution to the Misreporting of Statistical Results in Psychological Science. Perspectives on Psychological Science. https://doi.org/10.1177/1745691614549257

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.