Just Post It: The Lesson From Two Cases of Fabricated Data Detected by Statistics Alone
The DOI matches its Crossref record; 52 of the 53 references it cites were found in a registry or an index.
Abstract
I argue that requiring authors to post the raw data supporting their published results has the benefit, among many others, of making fraud much less likely to go undetected. I illustrate this point by describing two cases of suspected fraud I identified exclusively through statistical analysis of reported means and standard deviations. Analyses of the raw data behind these published results provided invaluable confirmation of the initial suspicions, ruling out benign explanations (e.g., reporting errors, unusual distributions), identifying additional signs of fabrication, and also ruling out one of the suspected fraud's explanations for his anomalous results. If journals, granting agencies, universities, or other entities overseeing research promoted or required data posting, it seems inevitable that fraud would be reduced.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Researchers who fabricated randomised trials have been discovered because their baseline tables were not realistic. 3 -5”
From Automated detection of over- and under-dispersion in baseline tables in randomised controlled trials. (2022) · cites this paper as [3]
In the citing paper
“Statistical approaches have been used to detect fraud in trials using individual patient data. 3,6,48”
From Automated detection of over- and under-dispersion in baseline tables in randomised controlled trials. (2022) · cites this paper as [3]
Citations
Cites
5 retracted
Mixed-motive conflict in social dilemmas: Mood as input to competitive and cooperative goals.
Sanna, L. J., Parks, C. D., & Chang, E. C. (2003) · Group Dynamics Theory Research and Practice · doi:10.1037/1089-2699.7.1.26 · Cited by 39
RetractedSanna, L. J., Chang, E. C., Miceli, P. M., & Lundberg, K. B. (2010) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2010.12.013 · Cited by 29
RetractedSauna, L. J., Chang, E. C., Parks, C. D., & Kennedy, L. A. (2009) · Psychological Science · doi:10.1111/j.1467-9280.2009.02458.x · Cited by 28
RetractedSmeesters, D., & Liu, J. (. (2011) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2011.02.010 · Cited by 24
RetractedRETRACTED: Effects of Messiness on Preferences for Simplicity
Liu, J., Smeesters, D., & Trampe, D. (2011) · Journal of Consumer Research · doi:10.1086/662139 · Cited by 10
RetractedAn Introduction to the Bootstrap
Efron, B., & Tibshirani, R. J. (1994) · doi:10.1201/9780429246593 · Cited by 40,500
Proceedings of the American philosophical society
(1838) · Journal of the Franklin Institute · doi:10.1016/s0016-0032(38)92229-x · Cited by 5,524
Ego depletion: Is the active self a limited resource?
Baumeister, R. F., Bratslavsky, E., Muraven, M., & Tice, D. M. (1998) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.74.5.1252 · Cited by 5,312
Instructional manipulation checks: Detecting satisficing to increase statistical power
Oppenheimer, D. M., Meyvis, T., & Davidenko, N. (2009) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2009.03.009 · Cited by 3,493
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246 · cited 1×
“One of the most well-known judgment biases is the belief in the law of small numbers (Tversky & Kahneman, 1971)—the belief that even small samples closely resemble underlying populations.”
Background
Research works printed but not linked: 2
- Kalai G., 1998, The two famous rabbis experiments: How similar is too similar (Discussion Paper 182)
- Zwaan R. A., Groenen P. J. F., van der Heijden A. J., te Lindert R. (2012). Report by the Committee for Inquiry into Scientific Integrity. Retrieved from http://www.eur.nl/fileadmin/ASSETS/press/2012/Juli/report_Committee_for_inquiry_prof._Smeesters.publicversion.28_6_2012.pdf
Cited by
Items 201–228 of 228
Liao, T. F. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.004
Elman, C., Gerring, J., & Mahoney, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.019
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.013
Rejection Fallacies: Who’s Exaggerating What?
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.010
More Auditing: Objectivity and Model Checking
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.012
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.018
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.006
Error Probing Tools versus Logics of Evidence
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.003
Auditing: Biasing Selection Effects and Randomization
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.011
Capability and Severity: Deeper Concepts
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.008
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.007
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.001
Deconstructing the N-P versus Fisher Debates
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.015
Mayo, D. G. (2018) · Cambridge University Press eBooks · doi:10.1017/9781107286184.019
Pittelkow, M.-M. (2023) · University of Groningen research database (University of Groningen / Centre for Information Technology) · doi:10.33612/diss.762945985
Decision Errors, Effect Sizes, and Power
Janczyk, M., & Pfister, R. (2023) · Springer eBooks · doi:10.1007/978-3-662-66786-6_7
Code and dataset used for the paper "The Economics of Research Reproducibility"
Colliard, J.-É., Hurlin, C., & Pérignon, C. (2021) · Zenodo (CERN European Organization for Nuclear Research) · doi:10.5281/zenodo.5211327
Comments to the Editor on “The Willingness to Pay for Diversification”
Pitkäjärvi, A., & Vacca, M. (2024) · Management Science · doi:10.1287/mnsc.2023.01581
Franses, P. H. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009428033.003
Improving transparency in observational social science research: A pre-analysis plan approachPreprint
Burlig, F. (2017) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/qemkz_v1
Replications in Judgment and Decision Making: A Critical Review and Future Pathways
Sobków, A., Jurewicz, K., & Traczyk, J. (2025) · Integrated science · doi:10.1007/978-3-031-88415-3_2
Digital tools and services to support research replicability and verifiability
(2018) · JISC Information Environment Repository (Jisc)
Bilingualism, Hypothetical Norms & Misperceptions
Hill, J. (2025) · UEA Digital Repository (University of East Anglia)
Psychology’s RenaissancePreprint
Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2022) · OSF Preprints (OSF Preprints)
Self-citationA Guide to Reanalyzing Data From Psychology Articles for Verification, Meta‐Analysis, and Reuse
Wicherts, J. M. (2026) · Social and Personality Psychology Compass · doi:10.1111/spc3.70152
Quantifying Undetected Severe Misconduct in Medical ResearchPreprint
Hussinger, K., & Pellens, M. (2026) · SSRN Electronic Journal · doi:10.2139/ssrn.7690518
Quantifying undetected severe misconduct in medical research
Hussinger, K., & Pellens, M. (2026) · Research Policy · doi:10.1016/j.respol.2026.105660
Metadata
- Authors
- Simonsohn, U.
- Affiliations
- University of Pennsylvania (US)
- Corresponding author
- Simonsohn, Uri
- ORCID
- Simonsohn, Uri
- Venue
- Psychological Science
- Publisher
- SAGE Publications
- Published
- 2013-08-27
- Volume
- 24
- Issue
- 10
- Pages
- 1875-1888
- ISSN
- 0956-7976 (ISSN-L)
- 1467-9280
- OpenAlex
- W2142075785
- Cited by
- 216
- References
- 53
- Citations by year
- 2026: 1 · 2025: 7 · 2024: 9 · 2023: 8 · 2022: 11 · 2021: 14 · 2020: 24 · 2019: 18 · 2018: 41 · 2017: 11 · 2016: 25 · 2015: 19 · 2014: 11 · 2013: 13
- FWCI
- 59.78
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
- Locations
- Psychological Science (publishedVersion)
- PubMed (publishedVersion)
- Funders
- University of Michigan
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Physical Sciences › Mathematics › Statistics and Probability › Benford’s Law and Fraud Detection
- Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
- Keywords
- data sharing, scientific fraud, fraud detection, fabrication, research integrity
- MeSH terms
- Data Interpretation, Statistical, Humans, Psychology, Publishing, Research, Universities, Scientific Misconduct, Information Dissemination
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.