Cited by 1,042Meta-analysis and systematic reviewsPsychology Research and BibliometricsStatistical Methods and Bayesian Inference

The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.

An Agenda for Purely Confirmatory Research

Wagenmakers, Eric-Jan, Wetzels, Ruud, Borsboom, Denny, van der Maas, Han L. J., Kievit, Rogier A.·2012·Perspectives on Psychological Science

DOI 10.1177/1745691612463078

Open this paper in CoChat — free account

Abstract

The veracity of substantive research claims hinges on the way experimental data are collected and analyzed. In this article, we discuss an uncomfortable fact that threatens the core of psychology's academic enterprise: almost without exception, psychologists do not commit themselves to a method of data analysis before they see the actual data. It then becomes tempting to fine tune the analysis to the data in order to obtain a desired result-a procedure that invalidates the interpretation of the common statistical tests. The extent of the fine tuning varies widely across experiments and experimenters but is almost impossible for reviewers and readers to gauge. To remedy the situation, we propose that researchers preregister their studies and indicate in advance the analyses they intend to conduct. Only these analyses deserve the label "confirmatory," and only for these analyses are the common statistical tests valid. Other analyses can be carried out but these should be labeled "exploratory." We illustrate our proposal with a confirmatory replication attempt of a study on extrasensory perception.

Integrity signals

Registry

Crossref · 10.1177/1745691612463078

Cites

49 of 49 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Bayes factors
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Journal of personality and social psychology
Armstrong, J. (1988) · International Journal of Forecasting · doi:10.1016/0169-2070(88)90126-4 · Cited by 10,544
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267
False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Wildlife Society Bulletin
Wildlife Society (2011) · Wildlife Society Bulletin · doi:10.1002/(issn)1938-5463a · Cited by 5,571
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“confirmatory experiments, wonky statistics, ESP, Bayesian hypothesis test Several years ago, Ioannidis (2005) famously argued that “most published research findings are false.””
Journal of the American Statistical Association
Fildes, R. A. (1989) · International Journal of Forecasting · doi:10.1016/0169-2070(89)90106-4 · Cited by 3,956
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1×
“And indeed, recent results from biomedical and cancer research suggest that replication rates are lower than 50%, with some as low as 11% (Begley & Ellis, 2012; Osherovich, 2011; Prinz, Schlange, & Asadullah, 2011).”
Result

Show all 48 references

Research works printed but not linked: 4

Feynman R. P., 1974, Engineering & Science, 37, 10
Goldacre B., 2009, Bad science
Jeffreys H., 1961, Theory of probability
Roediger H. L., 2012, APS Observer, 25, 9

Sorted by citations

Items 601–700 of 998

Addressing researcher fraud: retrospective, real-time, and preventive strategies–including legal points and data management that prevents fraud
Kennedy, J. E. (2024) · Frontiers in Research Metrics and Analytics · doi:10.3389/frma.2024.1397649 · Cited by 7
Attachment insecurity and the biological embedding of reproductive strategies: Investigating the role of cellular aging
Bolhuis, E., Belsky, J., Frankenhuis, W. E., Shalev, I., Hastings, W. J., Tollenaar, M. S., O’Donnell, K. J., McGill, M. G., Pokhvisneva, I., Lin, D. T. S., et al. (2022) · Biological Psychology · doi:10.1016/j.biopsycho.2022.108446 · Cited by 7
Evaluating false positive rates of standard and hierarchical measures of metacognitive accuracy
Rausch, M., & Zehetleitner, M. (2023) · Metacognition and Learning · doi:10.1007/s11409-023-09353-y · Cited by 9
Is N-Hacking Ever OK? The consequences of collecting more data in pursuit of statistical significance
Reinagel, P. (2023) · PLoS Biology · doi:10.1371/journal.pbio.3002345 · Cited by 6
Replication Requires Psychological Rather than Statistical Hypotheses: The Case of Eye Movements Enhancing Word Recollection
Phaf, R. H. (2016) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.02023 · Cited by 6
Towards a multiple motives meta-theory for social psychology
Rubin, M. (2017) · Journal of Theoretical Social Psychology · doi:10.1002/jts5.3 · Cited by 6
Steps toward preregistration of research on research integrity
Sijtsma, K., Emons, W. H. M., Steneck, N. H., & Bouter, L. M. (2021) · Research Integrity and Peer Review · doi:10.1186/s41073-021-00108-4 · Cited by 8
Wider die „Sternchenkunde“!
Büsch, D., & Strauß, B. (2015) · German Journal of Exercise and Sport Research · doi:10.1007/s12662-015-0376-x · Cited by 7
The Influence of Direct and Indirect Speech on Source Memory
Eerland, A., & Zwaan, R. A. (2018) · Collabra Psychology · doi:10.1525/collabra.123 · Cited by 6
Moral Elevation Reduces Prejudice Against Gay MenPreprint
Lai, C. K., Haidt, J., & Nosek, B. A. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2276195 · Cited by 6
Non-dichotomous inference using bootstrapped evidencePreprint
Schwarzkopf, D. S. (2015) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/017327 · Cited by 6
Comment on “Math at home adds up to achievement in school”
Frank, M. C. (2016) · Science · doi:10.1126/science.aad8008 · Cited by 5
Hidden obstacles in education for students from low socioeconomic backgrounds
Muskens (2019) · Research Publications (Maastricht University) · doi:10.26481/dis.20191115mm · Cited by 5
Leveraging the Open Science Framework in Clinical Psychological Assessment ResearchPreprint
Tackett, J. L., Brandes, C. M., & Reardon, K. W. (2018) · doi:10.31234/osf.io/wm5g6 · Cited by 6
Embedding Data Skills in Research Methods Education: Preparing Students for Reproducible ResearchPreprint
McAleer, P., Stack, N., Woods, H. C., DeBruine, L. M., Paterson, H., Nordmann, E., Kuepper-Tetzel, C. E., & Barr, D. J. (2022) · doi:10.31234/osf.io/hq68s · Cited by 6
No Clear Evidence of Reduced Brain Serotonin Release Capacity in Patients With Depression
Hengartner, M. P., & Plöderl, M. (2023) · Biological Psychiatry · doi:10.1016/j.biopsych.2022.11.020 · Cited by 6
Why does preregistration increase the persuasiveness of evidence? A Bayesian rationalizationPreprint
Peikert, A., Ernst, M. S., & Brandmaier, A. M. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/cs8wb · Cited by 10
The Benefits of Preregistration and Registered ReportsPreprint
Lakens, D., Mesquida, C., Rasti, S., & Ditroilo, M. (2024) · doi:10.31234/osf.io/dqap7 · Cited by 6
Are biologically meaningful effect sizes a factor in study design? A systematic review of translational chronic variable stress studies
Jordan, C. Y., Romanò, N., & Menzies, J. R. W. (2025) · Experimental Physiology · doi:10.1113/ep092884 · Cited by 5
On “Confirmatory” Methodological Research in Statistics and Related Fields
Lange, F. J. D., Wilcke, J. C., Hoffmann, S., Herrmann, M., & Boulesteix, A. (2025) · Statistics in Medicine · doi:10.1002/sim.70303 · Cited by 8
Zooming in on what counts as core and auxiliary: A case study on recognition models of visual working memory
Robinson, M. M., Williams, J. R., Wixted, J. T., & Brady, T. F. (2024) · Psychonomic Bulletin & Review · doi:10.3758/s13423-024-02562-9 · Cited by 5
A systematic review of pre-registration in autism research journals
Poole, D., Linden, A. H., Sedgewick, F., Allchin, O., & Hobson, H. (2024) · Autism · doi:10.1177/13623613241308312 · Cited by 7
Modeling the path to digital health intention: the mediating role of system expectation and health beliefs
Pu, B., & Huang, K. (2025) · Frontiers in Public Health · doi:10.3389/fpubh.2025.1697273 · Cited by 8
Multisensory temporal processing in own-body contexts: plausibility of hand ownership does not improve visuo-tactile asynchrony detection
Keys, R. T., Rich, A. N., & Zopf, R. (2018) · Experimental Brain Research · doi:10.1007/s00221-018-5232-4 · Cited by 6
How to Identify and How to Conduct Research that Is Informative and Reproducible
Zickfeld, J., & Schubert, T. W. (2019) · Theory and history in the human and social sciences · doi:10.1007/978-3-030-33099-6_9 · Cited by 5
Open Science and Intervention Research: a Program Developer’s and Researcher’s Perspective on Issues and Concerns
Lochman, J. E. (2021) · Prevention Science · doi:10.1007/s11121-021-01219-6 · Cited by 5
Functional relevance of the extrastriate body area for visual and haptic object recognition: a preregistered fMRI-guided TMS study
Atılgan, H., Koi, J. X. J., Wong, E., Laakso, I., Matilainen, N., Pasqualotto, A., Tanaka, S., Chen, S. A., & Kitada, R. (2023) · Cerebral Cortex Communications · doi:10.1093/texcom/tgad005 · Cited by 6
Is Social Work Research in Crisis?
Dunleavy, D. J., & Lacasse, J. R. (2023) · Research on Social Work Practice · doi:10.1177/10497315231188684 · Cited by 5
Cobblers, Let’s Stick to Our Lasts! A Song of Sorrow (and of Hope) About the State of Personnel and Human Resource Management Science
Götz, M., & O’Boyle, E. H. (2023) · Emerald Group Publishing Limited eBooks · doi:10.1108/s0742-730120230000041004 · Cited by 8
Designing an In Vivo Preclinical Research Study
Moctezuma-Ramirez, A., Dworaczyk, D. A., Whitehorn, J., Li, K., Cardoso, C. D. O., & Elgalad, A. (2023) · Surgeries · doi:10.3390/surgeries4040053 · Cited by 6
DUPLICATE: Recommendations for Good Procedural Practices for Real-World Data Studies of Treatment Effectiveness and/or Comparative Effectiveness Designed to Inform Health Care Decisions: Report of the Joint ISPOR-ISPE Special Task Force on Real-World Evidence in Health Care Decision Making
Berger, M. L., Sox, H. C., Willke, R. J., Brixner, D. L., Eichler, H.-G., Goettsch, W., Madigan, D., Makady, A., Schneeweiß, S., Tarricone, R., et al. (2017) · Value in Health · doi:10.1016/j.jval.2017.07.013 · Cited by 5
Exploring the consistency and value of humour style profiles
Evans, T. R., Johannes, N., Wińska, J., Glinska-Newes, A. J., van Stekelenburg, A., Nilsonne, G., Dean, L. A., Fido, D., Galloway, G., Jones, S. E., et al. (2020) · Comprehensive Results in Social Psychology · doi:10.1080/23743603.2020.1756239 · Cited by 5
An exploratory investigation of online and offline social behaviour among digital natives
Broughton, A., Daly, M., Marx, N.-J., Nieuwoudt, M., Roux, D., & Parry, D. A. (2019) · South African Institute of Computer Scientists and Information Technologists · doi:10.1145/3351108.3351146 · Cited by 5
Reliability of Inference: Analogs of Replication in Qualitative Research
Fairfield, T., & Charman, A. E. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.012 · Cited by 6
Minimal replicability, generalizability, and scientific advances in psychological science.
Cacioppo, J. T., & Cacioppo, S. (2013) · Cited by 5
Introduction
Gerring, J., Mahoney, J., & Elman, C. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.001 · Cited by 6
Dynamic interplay of cognitive functioning and depressive symptoms in patients with Parkinson’s disease.
Schroeders, U., Zimmermann, J., Wicke, T., Schaumburg, M., Lang, E., Trenkwalder, C., & Mollenhauer, B. (2022) · Neuropsychology · doi:10.1037/neu0000795 · Cited by 5
Climate policy support as a tool to control others’ (but not own) environmental behavior?
Kukowski, C. A., Bernecker, K., von der Heyde, L., Boos, M., & Brandstätter, V. (2022) · PLoS ONE · doi:10.1371/journal.pone.0269030 · Cited by 5
Emotional, motivational and attitudinal consequences of autonomous prosocial behaviour
Kelley, N. J., Weinstein, N., Smith, E. E., Davis, W. E., Christy, A. G., Sedikides, C., & Schlegel, R. J. (2022) · European Journal of Social Psychology · doi:10.1002/ejsp.2916 · Cited by 6
An exploratory analysis of revision behavior development of L2 writers on an intensive English for academic purposes program using Bayesian methods
Mazgutova, D., & McCray, G. (2023) · Frontiers in Communication · doi:10.3389/fcomm.2022.934583 · Cited by 5
Children use disagreement to infer what happened
Amemiya, J. L., Heyman, G. D., & Gerstenberg, T. (2023) · Cognition · doi:10.1016/j.cognition.2024.105836 · Cited by 5
Communicating uncertain experimental evidence.
Davis, A. L., & Fischhoff, B. (2013) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0033778 · Cited by 5
Socially Thermoregulated Thinking: How Past Experiences Matter in Thinking About Our Loved OnesPreprint
IJzerman, H., Schrama, M., & Pronk, T. (2016) · SSRN Electronic Journal · doi:10.2139/ssrn.2807943 · Cited by 5
Open Scientific Practices Are the Way Forward for Internet Gaming Disorder Research: Response to Yao et al.
Przybylski, A. K., Weinstein, N., & Murayama, K. (2017) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2017.16121346r · Cited by 5
Doctoral thesis: The human fallibility of scientists - dealing with error and bias in academic researchPreprint
Veldkamp, C. L. S. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/g8cjq · Cited by 6
Hidden Multiplicity in Multiway ANOVA: Prevalence, Consequences, and RemediesPreprint
Cramer, A. O. J., van Ravenzwaaij, D., Matzke, D., Steingroever, H., Wetzels, R., Grasman, R. P. P. P., Waldorp, L., & Wagenmakers, E. (2014) · arXiv (Cornell University) · Cited by 5
Self-citation
Openness and Reproducibility: Insights from a Model-Centric ApproachPreprint
Baumgaertner, B. O., Devezer, B., Buzbas, E. O., & Nardin, L. G. (2018) · arXiv (Cornell University) · doi:10.48550/arxiv.1811.04525 · Cited by 11
Maximizing the Reproducibility of Your ResearchPreprint
Bosco, F. A., Carp, J., Field, J. G., IJzerman, H., Lewis, M., Munafo, M. R., Nosek, B. A., Prenoveau, J. M., Spies, J. R., & Giner‐Sorolla, R. (2016) · doi:10.31234/osf.io/k9mn3 · Cited by 5
Open Science is Liberating and Can Foster CreativityPreprint
Frankenhuis, W. E., & Nettle, D. (2018) · doi:10.31219/osf.io/edhym · Cited by 9
The benefits of preregistration for hypothesis-driven bilingualism researchPreprint
Mertzen, D., Lago, S., & Vasishth, S. (2020) · doi:10.31234/osf.io/nm3eg · Cited by 6
Virtual Reality Check: Statistical Power, Reported Results, and the Validity of Research on the Psychology of Virtual Reality and Immersive EnvironmentsPreprint
Lanier, M., Waddell, T. F., Elson, M., Tamul, D., Ivory, J., & Przybylski, A. K. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/6hk89 · Cited by 6
Flexibility in reaction time analysis: Many roads to a false positive?Preprint
Fernández, L. M., & Vadillo, M. A. (2019) · doi:10.31219/osf.io/d4yqz · Cited by 5
Enhancing Transparency and Replicability in Entrepreneurship Research with Preregistrations, Registered Reports, and Registered Revisions: A Call for Papers
Fellnhofer, K., Wennberg, K. J., Allison, T. H., Arenius, P. M., Lévesque, M., Gish, J. J., & Pollack, J. M. (2026) · Entrepreneurship Theory and Practice · doi:10.1177/10422587251401175 · Cited by 5
Corpus linguistics will benefit from greater adoption of pre-registration: A novice-friendly split-corpus approach to pre-registration
Mak, M. H. (2024) · Applied Corpus Linguistics · doi:10.1016/j.acorp.2024.100111 · Cited by 4
Effects of Visual Prompt on Recycling Behavior of Waste Batteries
Deng, Y., & Zhang, F. (2019) · Psychology · doi:10.4236/psych.2019.1012102 · Cited by 4
Replication for Quantitative Research
Jeremy Freese, A., & Peterson, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.010 · Cited by 4
Hypothesizing After Results Are Known: HARKing
Bridges, A. J. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_8 · Cited by 5
Task-dependent sketch maps
Krukar, J., van Eek, A., & Schwering, A. (2023) · Spatial Cognition and Computation · doi:10.1080/13875868.2023.2170802 · Cited by 7
Coming to Terms With the Psi-Trickster
Kennedy, J. E. (2024) · Journal of Scientific Exploration · doi:10.31275/20242755 · Cited by 4
Intolerance of uncertainty does not significantly predict decisions about delayed, probabilistic rewards: A failure to replicate Luhmann, C. C., Ishida, K., & Hajcak, G. (2011)
Cobos, P. L., Quintero, M. J., López, F. J., Luque, D., Ciria, L. F., & Morís, J. (2024) · PLoS ONE · doi:10.1371/journal.pone.0298503 · Cited by 6
Lower Healthcare Access and Its Association With Individual Factors and Health-Related Quality of Life in Adults With Rare Diseases in Switzerland
Wehrli, S., Dwyer, A. A., Baumgartner, M. R., Lehmann, C. U., & Landolt, M. A. (2024) · International Journal of Public Health · doi:10.3389/ijph.2024.1607548 · Cited by 4
HRI Wasn’t Built In a Day: A Call To Action For Responsible HRI Research
Spitale, M., Stower, R., Parreira, M. T., Yadollahi, E., Leite, I., & Gunes, H. (2024) · 2024 33rd IEEE International Conference on Robot and Human Interactive Communication (ROMAN) · doi:10.1109/ro-man60168.2024.10731210 · Cited by 7
Psychological insights for judging expertise and implications for adversarial legal contexts
Martire, K. A., Neal, T. M. S., Gobet, F. R., Chin, J. M., Berengut, J. F., & Edmond, G. (2025) · Nature Reviews Psychology · doi:10.1038/s44159-025-00430-4 · Cited by 9
Pupil dilation prediction of random events
Tressoldi, P. E., Martinelli, M., & Semenzato, L. (2013) · F1000Research · doi:10.12688/f1000research.2-262.v2 · Cited by 6
Properties of hypothesis testing techniques and (Bayesian) model selection for exploration‐based and theory‐based (order‐restricted) hypotheses
Kuiper, R. M., Nederhoff, T., & Klugkist, I. G. (2014) · British Journal of Mathematical and Statistical Psychology · doi:10.1111/bmsp.12041 · Cited by 4
Registered Reports for Student Research
King, M. B., Dablander, F., Jakob, L., Agan, M. L. F., Huber, F. A., Haslbeck, J. M. B., & Brecht, K. F. (2016) · Journal of European Psychology Students · doi:10.5334/jeps.401 · Cited by 4
Transparency and Reproducibility: Conceptualizing the Problem
Christensen, G., & Miguel, E. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.006 · Cited by 4
Measurement Replication in Qualitative and Quantitative Studies
Reiter, D. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.011 · Cited by 4
Cerebellar Transcranial Direct Current Stimulation in Children with Developmental Coordination Disorder: A Randomized, Double-Blind, Sham-Controlled Pilot Study
Akremi, H., Hamel, R., Dumas, A., Camden, C., Corriveau, H., & Lepage, J. (2021) · Journal of Autism and Developmental Disorders · doi:10.1007/s10803-021-05202-6 · Cited by 8
Are structural equation models theories and does it matter?
Trafimow, D., Hyman, M. R., & Kostyk, A. (2022) · Journal of Global Scholars of Marketing Science · doi:10.1080/21639159.2022.2048960 · Cited by 4
Open Science: Recommendations for Research on School Bullying
Noret, N. F., Hunter, S. C., Pimenta, S. M., Taylor, R., & Johnson, R. (2022) · International Journal of Bullying Prevention · doi:10.1007/s42380-022-00130-0 · Cited by 7
Increased suicide risk among younger women in winter during full moon in northern Europe. An artifact or a novel finding?
Plöderl, M., Westerlund, J., Hökby, S., Hadlaczky, G., & Hengartner, M. P. (2022) · Molecular Psychiatry · doi:10.1038/s41380-022-01823-0 · Cited by 4
Measuring the reliability of binocular rivalry
Acquafredda, M., Sarı, İ. D., Steinwurzel, C., Lunghi, C., & Binda, P. (2023) · Journal of Vision · doi:10.1167/jov.23.10.5 · Cited by 4
Similar event-related potentials to structural violations in music and language
de Leeuw, J. R. (2019) · Meta-Psychology · doi:10.15626/mp.2018.1481 · Cited by 4
Open Science at OBHDP
Moore, D. A., Thau, S., Zhong, C., & Francesca Gino, B. (2021) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2021.104111 · Cited by 4
Neuroscience Needs to Test Both Statistical and Scientific Hypotheses
Alger, B. E. (2022) · Journal of Neuroscience · doi:10.1523/jneurosci.1134-22.2022 · Cited by 5
Planning falsifiable confirmatory research.
Kennedy, J. E. (2024) · Psychological Methods · doi:10.1037/met0000639 · Cited by 9
Alcohol Expectancies Moderate the Association Between School Connectedness and Alcohol Consumption
Cummins, K. M., Diep, S. A., & Brown, S. A. (2019) · Journal of School Health · doi:10.1111/josh.12829 · Cited by 5
Opening Science
Nosek, B. A. (2017) · Ubiquity Press eBooks · doi:10.5334/bbc.g · Cited by 4
Promoting and supporting credibility in neuroscience
Rousselet, G. A., Hazell, G. G. J., Cooke, A., & Dalley, J. W. (2019) · Brain and Neuroscience Advances · doi:10.1177/2398212819844167 · Cited by 5
Persistence and plasticity in the human memory system: An empirical investigation of the overwriting hypothesisPreprint
Hardwicke, T. E. (2017) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/r4c32 · Cited by 4
Reproducibility Project
Zeigler‐Hill, V., & Shackelford, T. K. (2020) · Springer eBooks · doi:10.1007/978-3-319-24612-3_302244 · Cited by 5
Organizational and Individual Safety Factors in Work on Chemical Tanker VesselsPreprint
Hjellvik, L. R., Aga, R. E. H., & Sætrevik, B. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/szr3f · Cited by 5
Evaluating the pedagogical effectiveness of study preregistration in the undergraduate dissertation: A Registered ReportPreprint
Pownall, M., Pennington, C. R., Norris, E., Juanchich, M., Smailes, D., Russell, P. S., Gooch, D., Evans, T. R., Persson, S., Mak, M. H., et al. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/xg2ah · Cited by 3
Replication Study: RAF inhibitors prime wild-type RAF to activate the MAPK pathway and enhance growthPreprint
Pelech, S., Gallagher, C., Sutter, C., Yue, L., Kerwin, J., Bhargava, A., Iorns, E. J., Tsui, R., Denis, A., Perfito, N., et al. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.11.30.470372 · Cited by 4
Registered Reports: A Method to Increase the Credibility of Published ReportsPreprint
Nosek, B. A., & Lakens, D. (2016) · doi:10.31234/osf.io/mgxyg · Cited by 4
The Hypository: Registering Hypotheses for Cumulative SciencePreprint
Moeller, J., Langener, A. M., Lafit, G., Karhulahti, V., Bastiaansen, J. A., & Bergmann, C. (2022) · doi:10.31234/osf.io/5qgj7 · Cited by 4
Using preregistration as a tool for transparent fNIRS study designPreprint
Schroeder, P. A., Artemenko, C., Kosie, J. E., Cockx, H., Stute, K., Pereira, J., Klein, F., & Mehler, D. M. A. (2022) · doi:10.31222/osf.io/zfawx · Cited by 4
Making Preregistration Accessible: An R Package to Make Machine-Readable Preregistrations and Create New Preregistration FormsPreprint
van Eijk, N. L., Jiao, H., & Peters, G.-J. (2023) · doi:10.31234/osf.io/qfjy7 · Cited by 4
Latent class choice models with an error structure: Investigating potential unobserved associations between latent segmentation and behavior generation
Kim, S. H., & Mokhtarian, P. (2024) · Journal of Choice Modeling · doi:10.1016/j.jocm.2024.100519 · Cited by 3
Behavioural and EEG correlates of forward and backward priming—An exploratory study
Wilson, M., Wittmann, M., Kornmeier, J., & Kornmeier, J. (2025) · PLoS ONE · doi:10.1371/journal.pone.0322930 · Cited by 4
The insights from the crowd: Drawing inferences from many approaches to key empirical questions in international business
Delios, A., Hu, T., Yu, S., Zhou, N., Ahsan, F. M., Bahl, M., Bai, T., Basu, M., Bathula, H., Batsakis, G. K., et al. (2025) · Journal of International Business Studies · doi:10.1057/s41267-025-00808-9 · Cited by 3
Super donor assessment tool for oral microbiome transplantation
Nath, S., Mittinty, M., Zilm, P. S., Santiago, P. H. R., Ketagoda, D. H. K., Jamieson, L., & Weyrich, L. S. (2025) · BMC Microbiology · doi:10.1186/s12866-025-04630-z · Cited by 3
The emerging submission crisis in behavioral science
Spitzer, M. (2026) · Trends in Neuroscience and Education · doi:10.1016/j.tine.2026.100276 · Cited by 5
The replication crisis as mere indicator of two fundamental misalignments: Methodological confirmation bias in hypothesis testing and anthropological oversimplification in theory-building
Schnepf, J., & Groeben, N. (2024) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2024.101110 · Cited by 6
Effects of winning and losing streaks on within-session chasing in online gambling: a replication and extension study
Banerjee, N., Noël, X., & Chen, Z. (2025) · International Gambling Studies · doi:10.1080/14459795.2025.2494598 · Cited by 3
Preregister now for an upgrade to Behavioral Ecology 2.0: a comment on Ihle et al.
Forstmeier, W. (2017) · Behavioral Ecology · doi:10.1093/beheco/arx005 · Cited by 3
Understanding the Motives for Terrorism—Does it Have an Effect on Psychological Reactions? A Replication and Extension
Leder, J., Schlegel, R., & Schütz, A. (2021) · Journal of Interpersonal Violence · doi:10.1177/08862605211025045 · Cited by 3
Current issues in medical epistemology and statistics: a view from the frontline of medicine
Park, J. H. (2022) · Synthese · doi:10.1007/s11229-022-03765-0 · Cited by 3
Implementation of a multiverse approach in developmental research: The longitudinal relation between s elf‐esteem and peer victimization
Peetz, H. K., Lansu, T. A. M., van den Berg, Y. H. M., & Cillessen, A. H. N. (2023) · Infant and Child Development · doi:10.1002/icd.2421 · Cited by 3

Authors: Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A.
Affiliations: University of Amsterdam (NL)
ORCID: Wagenmakers, Eric-Jan
Borsboom, Denny
van der Maas, Han L. J.
Kievit, Rogier A.
Venue: Perspectives on Psychological Science
Publisher: SAGE Publications
Published: 2012-11
Volume: 7
Issue: 6
Pages: 632-638
ISSN: 1745-6916 (ISSN-L)
1745-6924
DOI: 10.1177/1745691612463078
OpenAlex: W2123263696
Cited by: 1,042
References: 48
Citations by year: 2026: 57 · 2025: 41 · 2024: 65 · 2023: 85 · 2022: 102 · 2021: 108 · 2020: 114 · 2019: 98 · 2018: 88 · 2017: 86 · 2016: 75 · 2015: 51 · 2014: 43 · 2013: 28 · 2012: 1
FWCI: 44.75
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Perspectives on Psychological Science (publishedVersion)
PubMed (publishedVersion)
UvA-DARE (University of Amsterdam) (publishedVersion)
UvA-DARE (University of Amsterdam) (submittedVersion)
Data Archiving and Networked Services (DANS) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Keywords: preregistration, confirmatory analysis, exploratory analysis, data snooping, statistical validity, research integrity, extrasensory perception, replication, hypothesis testing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

An Agenda for Purely Confirmatory Research

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks