CoChat

The Sources of Four Commonly Reported Cutoff Criteria: What Did They Really Say?

Lance, Charles E., Butts, Marcus M., Michels, Lawrence C. · 2006 · Organizational Research Methods

The DOI matches its Crossref record; 128 of the 128 references it cites were found in a registry or an index.

Abstract

Everyone can recite methodological “urban legends” that were taught in graduate school, learned over the years through experience publishing, or perhaps just heard through the grapevine. In this article, the authors trace four widely cited and reported cutoff criteria to their (alleged) original sources to determine whether they really said what they are cited as having said about the cutoff criteria, and if not, what the original sources really said. The authors uncover partial truths in tracing the history of each cutoff criterion and in the end endorse a set of 12 specific guidelines for effective academic referencing provided by Harzing that, if adopted, should help prevent the further perpetuation of methodological urban legends.

Overview

Integrity signals

Registry

Crossref · 10.1177/1094428105284919

Cites

128 of 128 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Verification

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Citations

Cites

Show all 128 references

Research works printed but not linked: 24

  1. 10.1037/0033-2909.112.3.400 · doi:10.1037/0033-2909.112.3.400 · Paper page
  2. 10.1037/0033-2909.88.3.588 · DOI · Paper page
  3. 10.1177/014920639802400202 · doi:10.1177/014920639802400202 · Paper page
  4. 10.1037/0033-2909.103.2.276 · doi:10.1037/0033-2909.103.2.276 · Paper page
  5. Dixon, W. J., 1992, BMDP statistical software manual
  6. 10.1037/0021-9010.75.6.698 · doi:10.1037/0021-9010.75.6.698 · Paper page
  7. Gorsuch, R. L., 1983, Factor analysis
  8. Harvey, R. J., meeting of the Society for Industrial and Organizational Psychology
  9. 10.1037/0022-3514.52.1.134 · doi:10.1037/0022-3514.52.1.134
  10. Hays, W. H., 1994, Statistics
  11. 10.1037/0033-2909.103.3.391 · doi:10.1037/0033-2909.103.3.391 · Paper page
  12. McAnally, M., 1999, Beach house on the moon [CD]
  13. 10.1037/0033-2909.105.3.430 · DOI · Paper page
  14. Nunnally, J. C., 1967, Psychometric theory
  15. Nunnally, J. C., 1978, Psychometric theory
  16. Nunnally, J. C., 1994, Psychometric theory
  17. 10.1037/0022-3514.83.3.735 · doi:10.1037/0022-3514.83.3.735 · Paper page
  18. SAS Institute Inc., 1999, SAS online Doc® [Computer software and manual]
  19. 10.1037/0021-9010.74.2.368 · doi:10.1037/0021-9010.74.2.368 · Paper page
  20. SPSS, 1999, SPSS 10.0 syntax reference guide
  21. 10.1037/0022-0167.34.4.414 · doi:10.1037/0022-0167.34.4.414 · Paper page
  22. 10.1016/S0149-2063_03_00033-3 · DOI · Paper page
  23. 10.1037/1082-989X.1.4.354 · doi:10.1037/1082-989x.1.4.354 · Paper page
  24. 10.1037/0033-2909.99.3.432 · DOI · Paper page

Cited by

See all 2,053

Metadata

Authors
Lance, C. E., Butts, M. M., & Michels, L. C.
Affiliations
University of Georgia (US)
Venue
Organizational Research Methods
Published
2006-04
Volume
9
Issue
2
Pages
202-220
ISSN
  • 1094-4281 (ISSN-L)
  • 1552-7425
OpenAlex
W1987634243
Cited by
2,053
References
128
Citations by year
2026: 105 · 2025: 134 · 2024: 153 · 2023: 151 · 2022: 175 · 2021: 161 · 2020: 131 · 2019: 111 · 2018: 136 · 2017: 115 · 2016: 129 · 2015: 107 · 2014: 86 · 2013: 74 · 2012: 56
FWCI
38.46
Type
journal article
Language
en
Open access
closed
Licence
journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations
Organizational Research Methods (publishedVersion)
Topics
  • Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
  • Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
  • Social Sciences › Business, Management and Accounting › Strategy and Management › Business Strategies and Management Research
Keywords
statistical significance thresholds, citation accuracy

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: The Sources of Four Commonly Reported Cutoff Criteria: What Did They Really Say? https://app.cochat.ai/papers/10.1177/1094428105284919
The paper
Lance, C. E., Butts, M. M., & Michels, L. C. (2006). The Sources of Four Commonly Reported Cutoff Criteria: What Did They Really Say? Organizational Research Methods. https://doi.org/10.1177/1094428105284919

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.