The DOI matches its Crossref record; 10 of the 10 references it cites were found in a registry or an index.
False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant: (519702015-014)
Abstract
This data is being made available as part of The Data Ark project (https://osf.io/view/DataArk/) and has been shared with the authors' permission. Citation for original article: Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011). False-positive psychology: Undisclosed flexibility in data collection and analysis allows presenting anything as significant. Psychological science, 22(11), 1359-1366.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The case for motivated reasoning.
Kunda, Z. (1990) · Psychological Bulletin · doi:10.1037/0033-2909.108.3.480 · Cited by 9,022
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702
Group sequential methods in the design and analysis of clinical trials
POCOCK, S. J. (1977) · Biometrika · doi:10.1093/biomet/64.2.191 · Cited by 1,831
Zuckerman, M. (1979) · Journal of Personality · doi:10.1111/j.1467-6494.1979.tb00202.x · Cited by 1,136
Explaining Bargaining Impasse: The Role of Self-Serving Biases
Babcock, L., & Loewenstein, G. (1997) · Journal of Economic Perspectives · doi:10.1257/jep.11.1.109 · Cited by 1,071
Wagenmakers, E.-J., Wetzels, R., Borsboom, D., & van der Maas, H. L. J. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0022790 · Cited by 977
Hastorf, A. H., & Cantril, H. (1954) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0057880 · Cited by 882
Biased evaluation and persistence in gambling.
Gilovich, T. D. (1983) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.44.6.1110 · Cited by 408
Motivated Reasoning and Performance on the was on Selection Task
Dawson, E., Gilovich, T., & Regan, D. T. (2002) · Personality and Social Psychology Bulletin · doi:10.1177/014616702236869 · Cited by 235
Measuring the Prevalence of Questionable Research Practices with Incentives for Truth-TellingPreprint
John, L. K., Loewenstein, G. F., & Prelec, D. (2012) · SSRN Electronic Journal · doi:10.2139/ssrn.1996631 · Cited by 59
Cited by
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
The ASA Statement on p -Values: Context, Process, and Purpose
Wasserstein, R. L., & Lazar, N. A. (2016) · The American Statistician · doi:10.1080/00031305.2016.1154108 · Cited by 6,306
Evaluating replicability of laboratory experiments in economics
Camerer, C. F., Dreber, A., Forsell, E., Ho, T.-H., Huber, J., Johannesson, M., Kirchler, M., Almenberg, J., Altmejd, A., Chan, T., et al. (2016) · Science · doi:10.1126/science.aaf0918 · Cited by 1,314
Sensitivity and specificity of information criteria
(2019) · doi:10.1093/bib/bbz016 · Cited by 718
Seriousness checks are useful to improve data validity in online research
Aust, F., Diedenhofen, B., Ullrich, S., & Musch, J. (2013) · Behavior Research Methods · doi:10.3758/s13428-012-0265-2 · Cited by 524
Contextual sensitivity in scientific reproducibility
Van Bavel, J. J., Mende-Siedlecki, P., Brady, W. J., & Reinero, D. A. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1521897113 · Cited by 398
On the Plurality of (Methodological) Worlds: Estimating the Analytic Flexibility of fMRI Experiments
Carp, J. (2012) · Frontiers in Neuroscience · doi:10.3389/fnins.2012.00149 · Cited by 381
Simonsohn, U., Simmons, J. P., & Nelson, L. D. (2015) · Journal of Experimental Psychology General · doi:10.1037/xge0000104 · Cited by 343
Self-citationRegularized Evolution for Image Classifier Architecture Search
Real, E., Aggarwal, A., Huang, Y., & Le, Q. V. (2019) · Proceedings of the AAAI Conference on Artificial Intelligence · doi:10.1609/aaai.v33i01.33014780 · Cited by 328
Agarwal, P. K., Nunes, L. D., & Blunt, J. R. (2021) · Educational Psychology Review · doi:10.1007/s10648-021-09595-9 · Cited by 211
Deep problems with neural network models of human vision
Bowers, J. S., Malhotra, G., Dujmović, M., Llera Montero, M., Tsvetkov, C., Biscione, V., Puebla, G., Adolfi, F., Hummel, J. E., Heaton, R. F., et al. (2023) · Behavioral and Brain Sciences · doi:10.1017/s0140525x22002813 · Cited by 204
Statistical considerations for reporting and planning heart rate variability case‐control studies
Quintana, D. S. (2017) · Psychophysiology · doi:10.1111/psyp.12798 · Cited by 192
Divergent Effects of Beliefs in Heaven and Hell on National Crime Rates
Shariff, A. F., & Rhemtulla, M. (2012) · PLoS ONE · doi:10.1371/journal.pone.0039048 · Cited by 147
Inzlicht, M., Gervais, W., & Berkman, E. (2015) · SSRN Electronic Journal · doi:10.2139/ssrn.2659409 · Cited by 82
Neural systems for cognitive and emotional processing in posttraumatic stress disorder.
Brown, V. M., & Morey, R. A. (2012) · Frontiers in Psychology · doi:10.3389/fpsyg.2012.00449 · Cited by 67
There’s Nothing Social about Social Priming: Derailing the “Train Wreck”
Sherman, J. W., & Rivers, A. M. (2021) · Psychological Inquiry · doi:10.1080/1047840x.2021.1889312 · Cited by 62
Does preregistration improve the credibility of research findings?
Rubin, M. (2020) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.16.4.p376 · Cited by 61
O'Connor, D. B., Branley-Bell, D., Green, J. A., Ferguson, E., O'Carroll, R. E., & O'Connor, R. C. (2020) · Journal of Abnormal Psychology · doi:10.1037/abn0000482 · Cited by 60
Molecular Neurobiology of Depression: PET Findings on the Elusive Correlation with Symptom Severity
Smith, D. F., & Jakobsen, S. (2013) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2013.00008 · Cited by 25
Dunlop, W. L., Bühler, J. L., Maghsoodi, A., Harake, N., Wilkinson, D., & McAdams, D. P. (2021) · Journal of Social and Personal Relationships · doi:10.1177/0265407520969900 · Cited by 18
Warning Signals for Poor Performance Improve Human-Robot Interaction
Van den Brule, R., Bijlstra, G., Dotsch, R., Haselager, P., & Wigboldus, D. H. J. (2016) · Journal of Human-Robot Interaction · doi:10.5898/jhri.5.2.van_den_brule · Cited by 17
Open Minded: Searching for Truth about the Unconscious Mind
Newell, B. R., & Shanks, D. R. (2023) · doi:10.7551/mitpress/14922.001.0001 · Cited by 17
Chen, L., Benjamin, R., Lai, A., & Heine, S. (2022) · doi:10.31234/osf.io/kuhy6 · Cited by 14
Quantifying the prevalence and impact of overreaching causal claims in social science
Isch, C., Dörr, T., Fasching, N., Jennings, G., & Watts, D. J. (2026) · Nature Human Behaviour · doi:10.1038/s41562-026-02553-x
Metadata
- Authors
- Simmons, J., Nelson, L., & Simonsohn, U.
- Venue
- PsycEXTRA Dataset
- Published
- 2011
- OpenAlex
- W3125960483
- Cited by
- 454
- References
- 10
- Type
- dataset
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.