Blind analysis: Hide results to seek the truth
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Eliminating false positives entirely is likely to be impossible [86].”
From The natural selection of bad science (2016) · cites this paper as [86]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Considering the opposite: A corrective strategy for social judgment.
Lord, C. G., Lepper, M. R., & Preston, E. (1984) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.47.6.1231 · Cited by 740
Promoting Transparency in Social Science Research
Miguel, E., Camerer, C., Casey, K., Cohen, J., Esterling, K. M., Gerber, A., Glennerster, R., Green, D. P., Humphreys, M., Imbens, G., et al. (2014) · Science · doi:10.1126/science.1245317 · Cited by 540
BIASES IN THE INTERPRETATION AND USE OF RESEARCH RESULTS
MacCoun, R. J. (1998) · Annual Review of Psychology · doi:10.1146/annurev.psych.49.1.259 · Cited by 417
Self-citationLikelihood of Null Effects of Large NHLBI Clinical Trials Has Increased over Time
Kaplan, R. M., & Irvin, V. L. (2015) · PLOS ONE · doi:10.1371/journal.pone.0132382 · Cited by 356
Simonton, D. K. (2011) · Review of General Psychology · doi:10.1037/a0022912 · Cited by 199
BLIND ANALYSIS IN NUCLEAR AND PARTICLE PHYSICS
Klein, J. R., & Roodman, A. (2005) · Annual Review of Nuclear and Particle Science · doi:10.1146/annurev.nucl.55.090704.151521 · Cited by 156
The blind leading the blind: Use and misuse of blinding in randomized controlled trials
Miller, L. E., & Stewart, M. E. (2010) · Contemporary Clinical Trials · doi:10.1016/j.cct.2010.11.004 · Cited by 117
Conley, A., Goldhaber, G., Wang, L., Aldering, G., Amanullah, R., Commins, E. D., Fadeyev, V., Folatelli, G., Garavini, G., Gibbons, R., et al. (2006) · The Astrophysical Journal · doi:10.1086/503533 · Cited by 75
Self-citationMasked Monitoring in Clinical Trials — Blind Stupidity?
Meinert, C. L. (1998) · New England Journal of Medicine · doi:10.1056/nejm199805073381911 · Cited by 58
Research works printed but not linked: 1
- Lord, C. G., Lepper, M. R. & Preston, E. J. Pers. Soc. Psychol. 47, 1231-1243 (1984). · doi:10.1037/0022-3514.47.6.1231 · Paper page
Cited by
Items 201–235 of 235
Veldkamp, C. L. S., Hartgerink, C. H. J., van Assen, M. A. L. M., & Wicherts, J. M. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/uk6ju
The p-value Case, a Review of the Debate: Issues and Plausible Remedies
Pauli, F. (2018) · Springer proceedings in mathematics & statistics · doi:10.1007/978-3-319-73906-9_9
Research Integrity in Public Health
Gorman, D. M. (2018) · Oxford University Press eBooks · doi:10.1093/obo/9780199756797-0189
A Human-Computer Interaction Approach for Integrity in EconomicsPreprint
Opoku-Agyemang, K. A. (2017) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/ra3cs
Natural capital and distributive justice; a multidisciplinary, multi-scalar assessment
Althor, G. (2020) · The University of Queensland · doi:10.14264/uql.2020.499
Doing Science: Methods and PhilosophyPreprint
van Dongen, N. N. N. (2021) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/yegvs
Erickson, K. E. (2021) · Journal of Scientific Exploration · doi:10.31275/20212193
Liao, T. F. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.004
Elman, C., Gerring, J., & Mahoney, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.019
Nucci, R. A. B. (2022) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/t.5.2022.tde-20072022-125234
The Influence of Information Added to Data
zu Berlin, H.-U., Chroszczinsky, S., Priemer, B., zu Berlin, H.-U., & Masnick, A. M. (2022) · Bridging the Gap: Empowering and Educating Today’s Learners in Statistics. Proceedings of the Eleventh International Conference on Teaching Statistics · doi:10.52041/iase.icots11.t8e3
Lierl, M. M. (2022) · AEA Randomized Controlled Trials · doi:10.1257/rct.10357
(2024) · Frontiers research topics · doi:10.3389/978-2-8325-4330-6
A new unit of measurement for introductory physics lab
Aubin, C., Bierowiec, J. C., & Saunders, J. (2024) · American Journal of Physics · doi:10.1119/5.0159531
Model-based experiments as epistemic evidence in paleoecology
Traylor, W. (2024) · Ecological Modelling · doi:10.1016/j.ecolmodel.2024.110895
Ávila, C. G., May, E. S., Bott, F. S., Tiemann, L., Hohn, V. D., Heitmann, H., Zebhauser, P. T., Groß, J., & Ploner, M. (2025) · eLife · doi:10.7554/elife.101727.3.sa3
Morrow, I., Sunohara-Neilson, J., Baert, S., Randall, M. S., Gygax, M., & Mason, G. J. (2025) · Animal Behaviour and Welfare Cases · doi:10.1079/abwcases.2025.0018
Integrated paleoecological modeling of Pleistocene vegetation and megafauna
Traylor, W. (2025) · Publication Server of Goethe University Frankfurt am Main (Goethe University Frankfurt) · doi:10.21248/gups.91933
Bruttel, L. V., & Nithammer, J. (2025) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2025.102414
Improving Statistical Reporting in PsychologyPreprint
Schubert, A., Snijder-Steinhilber, M., Kang, H., & Quintana, D. S. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/5gr9n_v2
East Asians and Leader Self-Nomination:Can Changing the Default Break the Bamboo Ceiling?Preprint
Hu, J., Zhang, L., & LuBowden, L. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5784428
Blind regression analysis to counter p-hacking in psychology
Verhees, V. (2020) · Leiden Repository (Leiden University)
Perceived Implicit Theories of Intelligence and Academic Help-Seeking
Mehta, S. (2023) · eScholarship (California Digital Library) · Cited by 2
Validation of the post-hoc method to estimate snout-vent length in the order Caudata
Marzocca, S., Cialente, E., Pierorazio, M. R., Coppari, L., Torres‐Sánchez, M., Beamer, D. A., & Lunghi, E. (2026) · Acta Herpetologica · doi:10.36253/a_h-18890
Are Semantic Representations Stable? A Bayesian Framework Applied to the Study of Quantifier Meaning
Sarafoglou, A., Giacobello, A., Godmann, H. R., Johnson, T., Visser, I., Haaf, J. M., & Szymanik, J. (2026) · Computational Brain & Behavior · doi:10.1007/s42113-026-00302-x · Cited by 1
“…any exploitation of researchers’ degrees of freedom, the authors determined peculiar patterns through visual inspection of the blinded data (e.g., MacCoun & Perlmutter, 2015; Dutilh et al., 2019 ), that is, data where the quantifier and session could not be identified and quantifier labels were…”
Flexible Yet Fair: Blinding Analyses in Experimental PsychologyPreprint
Wagenmakers, E., Sarafoglou, A., & Dutilh, G. (2019) · OSF Preprints (OSF Preprints)
Deschamps, L., Paillassa, J., Lévesque, E., & Maire, V. (2026) · Journal of Geophysical Research Biogeosciences · doi:10.1029/2025jg009082
“To avoid the impact of confirmation bias during data preparation and model development (Nuzzo, 2015), we used a data blinding approach (Figure 4, MacCoun & Perlmutter, 2015).”
Thiébaut, A. C. M., Perperoglou, A., Sedki, M., Guerra, S. F., Gustafson, P., Harrell, F. E., Sauerbrei, W., Abrahamowicz, M., Freedman, L. S., & Selection of Variables and Functional Forms in Multivariable Analysis Topic Group (TG2) and Measurement Error and Misclassification Topic Group (TG4) of the international STRengthening Analytical Thinking for Observational Studies (STRATOS) initiative (2026) · Biometrical Journal · doi:10.1002/bimj.70155
“In the face of such surprising results, the blinded design helped to insure against risks of conscious or unconscious biases (MacCoun and Perlmutter 2015 ).”
Tacet: A Language and Type System for Automatic Statistical Validity AccountingPreprint
Abuah, C. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2608.27451
On Confederate Monuments, Their Removal and Racial Bias
Primbs, M. A., Sommet, N., Bijlstra, G., Payne, B. K., Faure, R., Lansu, T. A. M., Holland, R. W., Diekman, A. B., & Vuletich, H. A. (2026) · Personality and Social Psychology Bulletin · doi:10.1177/01461672261480534
Language-model ratings of depression reflect the rater more than the patientPreprint
Lin, B. (2026) · arXiv (Cornell University) · doi:10.48550/arxiv.2610.08501
“Analysis code was fixed at pre-registration before comparison with the criterion 39,40 .”
Paul, K., Paping, J., & Wacker, J. (2026) · Psychophysiology · doi:10.1111/psyp.70402
“Increased variability would further highlight the necessity of approaches to reduce researcher degrees of freedom like preregistration (Clayson, Mcdonald, et al. 2025; Paul et al. 2021) or blind analysis (MacCoun and Perlmutter 2015).”
Analysis Blinding as a Complement to Preregistration: A Tutorial for Network Analysis
Hoekstra, R. H. A., Huth, K. B. S., Sekulovski, N., Delhalle, M., & Sarafoglou, A. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459261481079
Metadata
- Authors
- MacCoun, R., & Perlmutter, S.
- Affiliations
- Stanford University (US)
- University of California, Berkeley (US)
- Corresponding author
- MacCoun, Robert
- Perlmutter, Saul
- Venue
- Nature
- Published
- 2015-10-07
- Volume
- 526
- Issue
- 7572
- Pages
- 187-189
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2192523408
- Cited by
- 218
- References
- 9
- Citations by year
- 2026: 14 · 2025: 15 · 2024: 19 · 2023: 22 · 2022: 12 · 2021: 17 · 2020: 43 · 2019: 19 · 2018: 14 · 2017: 23 · 2016: 20
- FWCI
- 17.33
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- blind analysis, research bias, publication bias, information hiding, scientific integrity, particle physics, reproducibility
- MeSH terms
- Biological Science Disciplines, Double-Blind Method, Humans, Models, Theoretical, Motivation, Physics, Prejudice, Psychology, Research Design, Research Personnel, Social Sciences, Reproducibility of Results, Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.