Blind analysis: Hide results to seek the truth
The DOI matches its Crossref record; 9 of the 9 references it cites were found in a registry or an index.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Eliminating false positives entirely is likely to be impossible [86].”
From The natural selection of bad science (2016) · cites this paper as [86]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Considering the opposite: A corrective strategy for social judgment.
Lord, C. G., Lepper, M. R., & Preston, E. (1984) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.47.6.1231 · Cited by 740
Promoting Transparency in Social Science Research
Miguel, E., Camerer, C., Casey, K., Cohen, J., Esterling, K. M., Gerber, A., Glennerster, R., Green, D. P., Humphreys, M., Imbens, G., et al. (2014) · Science · doi:10.1126/science.1245317 · Cited by 540
BIASES IN THE INTERPRETATION AND USE OF RESEARCH RESULTS
MacCoun, R. J. (1998) · Annual Review of Psychology · doi:10.1146/annurev.psych.49.1.259 · Cited by 417
Self-citationLikelihood of Null Effects of Large NHLBI Clinical Trials Has Increased over Time
Kaplan, R. M., & Irvin, V. L. (2015) · PLOS ONE · doi:10.1371/journal.pone.0132382 · Cited by 356
Simonton, D. K. (2011) · Review of General Psychology · doi:10.1037/a0022912 · Cited by 199
BLIND ANALYSIS IN NUCLEAR AND PARTICLE PHYSICS
Klein, J. R., & Roodman, A. (2005) · Annual Review of Nuclear and Particle Science · doi:10.1146/annurev.nucl.55.090704.151521 · Cited by 156
The blind leading the blind: Use and misuse of blinding in randomized controlled trials
Miller, L. E., & Stewart, M. E. (2010) · Contemporary Clinical Trials · doi:10.1016/j.cct.2010.11.004 · Cited by 117
Conley, A., Goldhaber, G., Wang, L., Aldering, G., Amanullah, R., Commins, E. D., Fadeyev, V., Folatelli, G., Garavini, G., Gibbons, R., et al. (2006) · The Astrophysical Journal · doi:10.1086/503533 · Cited by 75
Self-citationMasked Monitoring in Clinical Trials — Blind Stupidity?
Meinert, C. L. (1998) · New England Journal of Medicine · doi:10.1056/nejm199805073381911 · Cited by 58
Research works printed but not linked: 1
- Lord, C. G., Lepper, M. R. & Preston, E. J. Pers. Soc. Psychol. 47, 1231-1243 (1984). · doi:10.1037/0022-3514.47.6.1231 · Paper page
Cited by
Items 101–200 of 235
A framework for assessing the trustworthiness of scientific research findings
Nosek, B. A., Allison, D. B., Jamieson, K. H., Mcnutt, M. K., Nielsen, A. B., & Wolf, S. M. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2536736123 · Cited by 18
Making Research Data Accessible
Kapiszewski, D., & Karcher, S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.008 · Cited by 16
Deep learning approach for recognizing cold and warm thermal discomfort cues from videos
Bucarelli, N., & El-Gohary, N. (2023) · Building and Environment · doi:10.1016/j.buildenv.2023.110277 · Cited by 15
Reproducibility and transparency versus privacy and confidentiality: Reflections from a data editor
Vilhuber, L. (2023) · Journal of Econometrics · doi:10.1016/j.jeconom.2023.05.001 · Cited by 15
“In addition, such methods might allow for more robust inferences, because the analysis is “blind” (MacCoun and Perlmutter, 2015, see also Dwork et al., 2016, 2021).”
MethodA Systems Approach to Understanding and Improving Research Integrity
Gorman, D. M., Elkins, A. D., & Lawley, M. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9986-z · Cited by 14
Quantification of Mitochondrial Network Characteristics in Health and Disease
Valente, A. J. F., Fonseca, J., Moradi, F., Foran, G., Necakov, A., & Stuart, J. A. (2019) · Advances in experimental medicine and biology · doi:10.1007/978-981-13-8367-0_10 · Cited by 17
Quantifying cognitive bias in educational researchers
Bierema, A. M. ‐., Hoskinson, A.-M., Moscarella, R. A., Lyford, A., Haudek, K. C., MERRILL, J. E., & Urban‐Lurain, M. (2020) · International Journal of Research & Method in Education · doi:10.1080/1743727x.2020.1804541 · Cited by 15
“Journals from particle physics and cosmology sometimes use a strategy called blind analysis (MacCoun and Perlmutter 2015), where data labels are removed, then other experts are invited to analyze the same datasets without access to expected results.”
BackgroundMorphometrics of eight Chinese cavefish species
Lunghi, E., Zhao, Y., Sun, X., & Zhao, Y. (2019) · Scientific Data · doi:10.1038/s41597-019-0257-5 · Cited by 14
Blixt, S., Mukka, S., Försth, P., Westin, O., Gerdhem, P., & SunBurst study group (2022) · Acta Orthopaedica · doi:10.2340/17453674.2022.1614 · Cited by 13
“All statistical analyses will be performed without knowledge of the actual treatment (surgical or non-surgical) to minimize bias (56).”
MethodShaping Science for Increasing Interdependence and Specialization
Utzerath, C., & Fernández, G. (2017) · Trends in Neurosciences · doi:10.1016/j.tins.2016.12.005 · Cited by 16
Researcher Bias in Software Engineering Experiments: a Qualitative Investigation
Romano, S., Fucci, D., Scanniello, G., Baldassarre, M. T., Turhan, B., & Juristo, N. (2020) · Euromicro Conference on Software Engineering and Advanced Applications (SEAA) · doi:10.1109/seaa51224.2020.00054 · Cited by 16
“Although extensively used in other research fields like medicine and physics [6], [7], SE researchers have used these techniques in few occasions [8], [9].”
BackgroundDeressa, T. K., Stern, D. I., Vangronsveld, J., Minx, J. C., Lizin, S., Malina, R. M., & Bruns, S. B. (2023) · EcoEvoRxiv · doi:10.32942/x24g6z · Cited by 13
Bishop, D. (2016) · Royal Society Open Science · doi:10.1098/rsos.160109 · Cited by 12
Lunghi, E., Cianferoni, F., Giachello, S., Zhao, Y., Manenti, R., Corti, C., & Ficetola, G. F. (2021) · Scientific Data · doi:10.1038/s41597-021-00931-w · Cited by 12
The Inner Workings of Registered Reports
Dienes, Z. P. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009000796.015 · Cited by 11
Manolov, R. (2017) · Anuario de Psicología/The UB Journal of Psychology · doi:10.1016/j.anpsic.2017.05.004 · Cited by 13
“Moreover, this tool includes all methodological criteria reviewed by Maggin et al. (2014) for documenting an experimental effect and establishing generality.”
BackgroundMethodInfluentialAbrahin, O., Abrahin, R. P., Guimarães, M., de Holanda, V. B. T., Figueiredo, F. A. D. P. L., Rosa, B. V., Neto, I. V. D. S., Rolnick, N. D., de Melo, G. F., Prestes, E. F., et al. (2024) · Blood Pressure Monitoring · doi:10.1097/mbp.0000000000000690 · Cited by 11
“The statistic was performed in a single-blind manner using the per protocol (omits all older participants who do not follow the RT protocol) for method for analyzing a randomized controlled trial, the statistician did not know who was the control and intervention group (RT) [20].”
BackgroundMethodHow Can We Record Reliable Information on Animal Colouration in the Wild?
Lunghi, E., Bacci, F., & Zhao, Y. (2021) · Diversity · doi:10.3390/d13080356 · Cited by 10
“Adopting an appropriate methodology is crucial to collect unbiased and comparable data on wild animals useful in zoological and evolutionary studies [37].”
The human risks of bias in medical and rehabilitation research and practice: the eight Is
Malmivaara, A. V. (2019) · European Journal of Physical and Rehabilitation Medicine · doi:10.23736/s1973-9087.19.05807-6 · Cited by 7
Varying alpha, blinding, and bias in existing measurements
Lee, C.-C., Webb, J. K., Carswell, R. F., Dzuba, V. A., Flambaum, V. V., & Milaković, D. (2023) · Monthly Notices of the Royal Astronomical Society · doi:10.1093/mnras/stad600 · Cited by 9
AMICO galaxy clusters in KiDS-1000: Cosmological sample
Maturi, M., Radovich, M., Moscardini, L., Lesci, G. F., Castignani, G., Marulli, F., Puddu, E., Romanello, M., Sereno, M., Giocoli, C., et al. (2025) · Astronomy and Astrophysics · doi:10.1051/0004-6361/202554340 · Cited by 10
Using routinely collected data for research purposes: challenges and mitigation strategies
Hoffmann, S., Morris, T. P., Herrmann, M., Heinze, G., Wynants, L., CALSTER, B. V., Bischl, B., Schmid, M., Shaw, P. A., Mathes, T., et al. (2026) · BMJ · doi:10.1136/bmj-2025-087812 · Cited by 12
“58 162 Similar problems may arise when a flexible algorithm is used to estimate individual treatment effects on claims data, for instance.”
Outcome-Based blind tests for leakage diagnosis in underground watermains by acoustic technologies
Lai, W. W., Lau, T. C.-W., Cheng, A. Y.-C., Liu, P. K.-C., & Leung, J. W.-C. (2023) · Tunnelling and Underground Space Technology · doi:10.1016/j.tust.2023.105413 · Cited by 8
Enhancing research credibility when replication is not feasible
MacCoun, R. J. (2018) · Behavioral and Brain Sciences · doi:10.1017/s0140525x18000778 · Cited by 8
Self-citationHoffmann, S., Schönbrodt, F. D., Elsas, R., Wilson, R., Strasser, U., & Boulesteix, A. (2020) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/afb9p · Cited by 8
Bestiary of Questionable Research Practices in PsychologyPreprint
Nagy, T., Hergert, J., Elsherif, M. M., Wallrich, L., Schmidt, K., Waltzer, T., Payne, J. W., Gjoneska, B., Seetahul, Y., Wang, Y. A., et al. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/fhk98_v2 · Cited by 8
Fitzpatrick, B. G., Gorman, D. M., & Trombatore, C. (2024) · PLoS ONE · doi:10.1371/journal.pone.0303262 · Cited by 7
“…to confirmation bias, multiple testing using P values to determine “significance” is not among the questionable research practices used to achieve desirable results, and therefore the solutions in these disciplines are different, albeit with potential application to the soft sciences [45,46].”
MethodDesigning Successful Proteomics Experiments
Ruderman, D. (2016) · Methods in molecular biology · doi:10.1007/978-1-4939-6747-6_19 · Cited by 7
Patterson, A., Dickerson, C. R., & Ribeiro, D. C. (2020) · Journal of Manipulative and Physiological Therapeutics · doi:10.1016/j.jmpt.2019.11.006 · Cited by 7
Facing the Unknown Unknowns of Data Analysis
Wagenmakers, E., Sarafoglou, A., & Aczél, B. (2023) · Current Directions in Psychological Science · doi:10.1177/09637214231168565 · Cited by 8
Nature of Scientific Knowledge and Nature of Scientific Inquiry in Physics Lessons
Priemer, B., & Lederman, N. G. (2021) · Challenges in physics education · doi:10.1007/978-3-030-87391-2_5 · Cited by 6
Smith, C., Joly, S., Antoine, C. M., Hyjazie, B. F., & Forrest, J. R. K. (2023) · Ecology · doi:10.1002/ecy.4122 · Cited by 6
The Diversity of Adaptation in a Multilevel Governance Setting
Campos, I. S., Ng, K., Penha‐Lopes, G., Pedersen, A. B., Capriolo, A., Olazabal, M., Meyer, V., Gebhardt, O., Weiland, S., Nielsen, H. Ø., et al. (2018) · Elsevier eBooks · doi:10.1016/b978-0-12-849887-3.00003-4 · Cited by 7
Reliability of Inference: Analogs of Replication in Qualitative Research
Fairfield, T., & Charman, A. E. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.012 · Cited by 6
Ehsani, S. (2020) · Future of business and finance · doi:10.1007/978-3-030-41309-5_13 · Cited by 10
Mind-Matter Entanglement Correlations: Blind Analysis of a new Correlation Matrix Experiment
Grote, H. (2021) · Journal of Scientific Exploration · doi:10.31275/20211931 · Cited by 6
Thibault, R. T., Kovács, M., Hardwicke, T. E., Sarafoglou, A., Ioannidis, J. P. A., & Munafo, M. R. (2023) · Royal Society Open Science · doi:10.1098/rsos.230568 · Cited by 6
“10 : 230568 3 D o w n l o a d e d fr o m h tt p s :// r oy a l s o c i e t ypub li s h i ng . o r g / on 02 J a nu a r y 2024 Some disciplines, such as particle physics, implement blind data analyses regularly [9,10].”
The behavioural ecology of optimism: judgement bias and foraging under predation risk in mice
Bračić, M., Bierbaum, L., Peng, M., Nimalavachchlan, L., Siewert, V., Kaiser, S., Sachser, N., & Richter, S. H. (2024) · Animal Behaviour · doi:10.1016/j.anbehav.2024.10.005 · Cited by 7
Veldkamp, C. L. S. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/g8cjq · Cited by 6
Catalog-level blinding on the bispectrum for DESI-like galaxy surveys
Novell-Masot, S., Gil-Marín, H., Verde, L., Aguilar, J., Ahlen, S. P., Brieden, S., Brooks, D., Claybaugh, T., de la Macorra, A., Forero-Romero, J. E., et al. (2024) · Journal of Cosmology and Astroparticle Physics · doi:10.1088/1475-7516/2024/10/089 · Cited by 5
Interim design analysis using Bayes factor forecasts.
Stefan, A. M., Gronau, Q. F., & Wagenmakers, E. (2025) · Psychological Methods · doi:10.1037/met0000641 · Cited by 6
Why multiple hypothesis test corrections provide poor control of false positives in the real world.
Lazic, S. E. (2024) · Psychological Methods · doi:10.1037/met0000678 · Cited by 5
“A better but more involved option is to perform a blind data analysis [35].”
BackgroundGerring, J., Mahoney, J., & Elman, C. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.001 · Cited by 6
The implicit epistemology ofWhite Fragility
Sokal, A. D. (2023) · Journal of Philosophy of Education · doi:10.1093/jopedu/qhad025 · Cited by 5
Memmer, N., Snijder-Steinhilber, M., Burkhardt, H., Hellmund, C., Jansen, C.-P., Kölsch, V., Krönung, J., Kuhlmann, B. G., Masia, L., Oswald, F., et al. (2026) · Trials · doi:10.1186/s13063-026-09641-3 · Cited by 4
“Thus, a blinded analyst [63] will screen study partners’ app usage after the data is collected to propose appropriate criteria.”
Elevating the importance of Risk of Bias assessment for ecology and evolutionary biology
Čulina, A., Foster, D., Grainger, M., O’Dea, R. E., Pescott, O. L., Sánchez‐Tójar, A., Boyd, R. J., Koricheva, J., Nakagawa, S., & Stewart, G. B. (2026) · Methods in Ecology and Evolution · doi:10.1111/2041-210x.70356 · Cited by 4
“…is difficult to implement in any given study and/or quantitative measurements are made, the resulting RoB re - mains non-zero: unconscious expectations can still subtly influence data processing or interpretation even when a device generates nu - meric outputs (MacCoun & Perlmutter, 2015 ).”
Replication for Quantitative Research
Freese, J., & Peterson, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.010 · Cited by 4
Internal replication of computational workflows in scientific research
Benjamin‐Chung, J., Colford, J. M., Mertens, A., Hubbard, A., & Arnold, B. F. (2020) · Gates Open Research · doi:10.12688/gatesopenres.13108.2 · Cited by 5
Transparency and Reproducibility: Conceptualizing the Problem
Christensen, G., & Miguel, E. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.006 · Cited by 4
Measurement Replication in Qualitative and Quantitative Studies
Reiter, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.011 · Cited by 4
Bioinformatics and Precision Medicine
Manrai, A. K., & Kohane, I. S. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-809523-2.00011-x · Cited by 4
Sigweni, B. (2016) · Brunel University Research Archive (BURA) (Brunel University London) · Cited by 6
Bestiary of Questionable Research Practices in PsychologyPreprint
Nagy, T., Hergert, J., Elsherif, M. M., Wallrich, L., Schmidt, K., Waltzer, T., Payne, J. W., Gjoneska, B., Seetahul, Y., Wang, Y. A., et al. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/fhk98 · Cited by 7
Law and Psychology Grows Up, Goes Online, and Replicates
Firth, K., Hoffman, D. A., & WilkinsonnRyan, T. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3020401 · Cited by 4
Predicting the Impact of Polysulfone Dialyzers and Binder Dialysate Flow Rate on Bilirubin Removal
Novokhodko, A., Du, N., Hao, S., Wang, Z., Shu, Z., Ahmad, S., & Gao, D. Y. (2024) · Bioengineering · doi:10.3390/bioengineering11121262 · Cited by 4
Delios, A., Hu, T., Yu, S., Zhou, N., Ahsan, F. M., Bahl, M., Bai, T., Basu, M., Bathula, H., Batsakis, G. K., et al. (2025) · Journal of International Business Studies · doi:10.1057/s41267-025-00808-9 · Cited by 6
“…some of the key variables before conducting her analysis, such that she is unaware of the direction and nature of the observed relationships (MacCoun & Perlmutter, 2015) Strategic Prevents Independent re-analysis Independent researcher uses an alternative analytic approach to test the same…”
Axt, J. R., Connor, P. R., Hoogeveen, S., Clark, C. J., Vianello, M., Lahey, J., Hahn, A., To, J., Petty, R. E., Costello, T. H., et al. (2026) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000480 · Cited by 3
La reproducibilidad de las investigaciones biomédicas: Quo vadis?
Dal‐Ré, R., Bernad, A., & Garesse, R. (2016) · Medicina Clínica · doi:10.1016/j.medcli.2015.11.029 · Cited by 4
Combating Biased Decisionmaking & Promoting Justice & Equal Treatment
Sah, S., Tannenbaum, D., Cleary, H. M. D., Feldman, Y., Glaser, J., Lerman, A. E., MacCoun, R. J., Maguire, E. R., Slovic, P., Spellman, B. A., et al. (2016) · Behavioral Science & Policy · doi:10.1353/bsp.2016.0017 · Cited by 3
Self-citationIntegrating open education practices with data analysis of open science in an undergraduate course
Bakermans, M. H. (2024) · Ecology and Evolution · doi:10.1002/ece3.70129 · Cited by 3
“For example, blinding the research in data collection or analyses can improve the robustness of a study and reduce wasted (i.e., non-reusable) data (MacCoun & Perlmutter, 2015; Purgar et al., 2022), and incentives and evaluation around publishing (Alberts et al., 2015; Barbosa et al., 2020;…”
BackgroundPredictive modeling for U and Th concentrations in mineral and thermal waters, Serbia
Cuk, M., Jemcov, I., Todorović, M., Mladenović, A., Papić, P., & Štrbački, J. (2020) · Environmental Earth Sciences · doi:10.1007/s12665-020-09204-y · Cited by 3
“A blind analysis was performed during statistical analysis, as the optimal way to reduce or eliminate the experimenter’s bias (Klein and Roodman 2005; MacCoun and Perlmutter 2015).”
MethodGerring, J., Karcher, S., & Apfeld, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.015 · Cited by 3
Fadrigon, B. H., Tseng, A., Weisenburger, R. L., Levihn‐Coon, A., McNamara, M. E., Shumake, J., Smits, J. A. J., Dennis‐Tiwary, T. A., & Beevers, C. G. (2024) · Contemporary Clinical Trials · doi:10.1016/j.cct.2024.107797 · Cited by 3
An unbiased attitude is vital to exploring the Beijing genotype of Mycobacterium tuberculosis
Zheng, Q., & Werngren, J. (2018) · Tuberculosis · doi:10.1016/j.tube.2018.06.014 · Cited by 3
Learning from Our Study Organisms about Sexual Selection: Lessons from the Ocellated Wrasse
Alonzo, S. H. (2022) · The American Naturalist · doi:10.1086/723109 · Cited by 3
“While a common method for dealing with human cognitive bias is blind analysis (e.g., MacCoun and Perlmutter 2015), well-established alternatives do exist (e.g., Glaser and Strauss 1967, 1999; Gilgun 2019).”
MethodA framework for philosophical biologyPreprint
Ehsani, S. (2016) · arXiv (Cornell University) · doi:10.48550/arxiv.1605.00033 · Cited by 4
“This cannot be the case, since no process of data collection, however carefully planned, can be completely devoid of bias [14].”
BackgroundPredicting violent behavior: What can neuroscience add?Preprint
Poldrack, R. A., Monahan, J., Imrey, P., Reyna, V., Raichle, M., Faigman, D. L., & Buckholtz, J. W. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/ba3du · Cited by 3
Admissible History Deformations and Central 2-Torsion Residues: The 𝘈₅/2𝘐 CasePreprint
Numagaki, M. (2026) · Qeios · doi:10.32388/8wfj48 · Cited by 3
What’s Wrong with Replicating the Old Boys’ Networks?
Teele, D. L. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.016 · Cited by 2
Ku, N., Lin, B., Sun, J. W., Wang, A., Mahmoudinobar, F., & Montclare, J. (2024) · E-Learning and Digital Media · doi:10.1177/20427530241276153 · Cited by 3
“By minimizing the risk of bias, blind data analysis helps maintain the integrity of the study, strengthening its internal validity, and leading to more accurate and reliable conclusions (MacCoun and Perlmutter, 2015).”
Akuoko, E. A., Fulmer, G. W., Hand, B. M., Suh, J. K., & Gardner, G. E. (2025) · Frontiers in Education · doi:10.3389/feduc.2025.1508207 · Cited by 3
Si, Y., Mullen, B. R., Vargová, G., Ito, S., Litke, A. M., & Feldheim, D. A. (2025) · Journal of Neuroscience · doi:10.1523/jneurosci.0084-25.2025 · Cited by 2
Transparency and Reproducibility: Potential Solutions
Christensen, G., & Miguel, E. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.007 · Cited by 3
Effects of conspecific density on tadpole risk assessment and defensive behaviour
Gazzola, A., Balestrieri, A., Brazzale, G., & Pellitteri‐Rosa, D. (2021) · Behaviour · doi:10.1163/1568539x-bja10114 · Cited by 2
Gerring, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.013 · Cited by 2
Lieberman, E. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.003 · Cited by 3
Scientists in silico?Preprint
McBride, C. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1711.00678 · Cited by 2
“[28] Robert MacCoun and Saul Perlmutter, “Blind analysis: Hide results to seek the truth,” Nature 526, 187–189 (2015).”
BackgroundMethodSpectral cues are necessary to encode azimuthal auditory space in the mouse superior colliculusPreprint
Ito, S., Si, Y., Feldheim, D. A., & Litke, A. M. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/704031 · Cited by 3
Smoking Intensity Increases Diaphragm Muscle Injury: A Clinicopathologic Study
Nucci, R. A. B., Busse, A. L., de Souza, R. R., Maifrino, L. B. M., Pasqualucci, C. A., Anaruma, C. A., Leite, R. E. P., Rodriguez, R. D., Suemoto, C. K., & Filho, W. J. (2023) · Journal of Clinical Medicine · doi:10.3390/jcm12113823 · Cited by 1
“Histopathology was analyzed by morphologists blinded to clinical data [25].”
MethodSarafoglou, A., & Hoogeveen, S. (2025) · Collabra Psychology · doi:10.1525/collabra.136869 · Cited by 1
“We believe that analysis blinding (Dutilh et al., 2019; MacCoun & Perlmutter, 2015) can have great merit in replication projects, in addition to preregistration.”
Weckstein, A. R., Frajzyngier, V., Vititoe, S. E., Baglivo, A., Beebe, E., Govil, P., Bradley, M. C., Pérez-Vilar, S., Liu, W., Rivera, D. R. R., et al. (2025) · Epidemiology · doi:10.1097/ede.0000000000001901 · Cited by 1
“54,71,72 Promising extensions to this simple adaptive design demonstration include simulation-based phasing strategies to compare different analytic strategies 73 as well as more comprehensive diagnostic metrics, such as negative control outcomes.”
Schweitzer, Y., Berkovich‐Ohana, A., Dor‐Ziderman, Y., Nave, O., Fulder, S. J., & Trautwein, F. (2025) · Consciousness and Cognition · doi:10.1016/j.concog.2025.103960 · Cited by 2
Brain Association Studies in 2024: A Systematic Review of Sample Sizes and Preregistrations
Wacker, J., Paul, K., & Scharfenecker, A. (2026) · Psychophysiology · doi:10.1111/psyp.70365 · Cited by 1
“One way to avoid this problem while still constraining flexibility is blind analysis (i.e., ensuring “that all analytical decisions have been completed, and all programs and procedures debugged, before relevant results are revealed”, MacCoun and Perlmutter 2015, 188).”
Reproducibility of biomedical research: Quo vadis?
Dal‐Ré, R., Bernad, A., & Garesse, R. (2016) · Medicina Clínica (English Edition) · doi:10.1016/j.medcle.2016.06.029 · Cited by 1
Blinded Inference: an Opportunity for Mathematical Modelers to Lead the Way in Research Reform
Starns, J. J., Cataldo, A. M., & Rotello, C. M. (2019) · Computational Brain & Behavior · doi:10.1007/s42113-019-00040-3 · Cited by 1
TATTER: A hypothesis testing tool for multi-dimensional data
Farahi, A., & Chen, Y. (2021) · Astronomy and Computing · doi:10.1016/j.ascom.2020.100445 · Cited by 1
Gerring, J., Mahoney, J., & Elman, C. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.018 · Cited by 2
Gerring, J., & Cojocaru, L. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.005 · Cited by 1
Howard, J. (2018) · Springer eBooks · doi:10.1007/978-3-319-93224-8_30 · Cited by 1
Gerring, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.014 · Cited by 2
Gross, N., & Robertson, C. T. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.017 · Cited by 2
Ávila, C. G., May, E. S., Bott, F. S., Tiemann, L., Hohn, V. D., Heitmann, H., Zebhauser, P. T., Groß, J., & Ploner, M. (2025) · eLife · doi:10.7554/elife.101727.3 · Cited by 5
A self-governing, self-regulating system for assessing scientific predictive powerPreprint
Rogers, T. C. (2022) · arXiv (Cornell University) · doi:10.48550/arxiv.2205.04503 · Cited by 1
“Fields like experimental high energy particle physics use blind analysis [33] to mitigate confirmation bias.”
The Implicit Relational Assessment Procedure’s trial-types are not independentPreprint
Hussey, I. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/4gsxq · Cited by 1
Lierl, M. M., & Holmlund, M. (2022) · AEA Randomized Controlled Trials · doi:10.1257/rct.10357-1.2 · Cited by 1
Preventing Strategic Manipulation with Redundant InformationPreprint
Silva, F., Figueroa, N., Jara, R., & Nicholas, A. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4479201 · Cited by 1
Ávila, C. G., May, E. S., Bott, F. S., Tiemann, L., Hohn, V. D., Heitmann, H., Zebhauser, P. T., Groß, J., & Ploner, M. (2024) · eLife · doi:10.7554/elife.101727.1 · Cited by 1
Ávila, C. G., May, E. S., Bott, F. S., Tiemann, L., Hohn, V. D., Heitmann, H., Zebhauser, P. T., Groß, J., & Ploner, M. (2024) · eLife · doi:10.7554/elife.101727.2 · Cited by 2
vazul: Analysis Blinding Tools
Nagy, T., Sarafoglou, A., & Kovács, M. (2026) · doi:10.32614/cran.package.vazul · Cited by 1
Socio-economic benefits and limitations of irrigated family farming in Brazil’s semi-arid region
Hagel, H. (2017) · University writing server of the University of Hohenheim (Universität Hohenheim) · Cited by 2
Metadata
- Authors
- MacCoun, R., & Perlmutter, S.
- Affiliations
- Stanford University (US)
- University of California, Berkeley (US)
- Corresponding author
- MacCoun, Robert
- Perlmutter, Saul
- Venue
- Nature
- Published
- 2015-10-07
- Volume
- 526
- Issue
- 7572
- Pages
- 187-189
- ISSN
- 0028-0836 (ISSN-L)
- 1476-4687
- OpenAlex
- W2192523408
- Cited by
- 218
- References
- 9
- Citations by year
- 2026: 14 · 2025: 15 · 2024: 19 · 2023: 22 · 2022: 12 · 2021: 17 · 2020: 43 · 2019: 19 · 2018: 14 · 2017: 23 · 2016: 20
- FWCI
- 17.33
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springernature.com/gp/researchers/text-and-data-mining (tdm)
- www.springernature.com/gp/researchers/text-and-data-mining (vor)
- Locations
- Nature (publishedVersion)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Physical Sciences › Mathematics › Statistics and Probability › Advanced Causal Inference Techniques
- Keywords
- blind analysis, research bias, publication bias, information hiding, scientific integrity, particle physics, reproducibility
- MeSH terms
- Biological Science Disciplines, Double-Blind Method, Humans, Models, Theoretical, Motivation, Physics, Prejudice, Psychology, Research Design, Research Personnel, Social Sciences, Reproducibility of Results, Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.