Cited by 1,042Meta-analysis and systematic reviewsPsychology Research and BibliometricsStatistical Methods and Bayesian Inference

The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.

An Agenda for Purely Confirmatory Research

Wagenmakers, Eric-Jan, Wetzels, Ruud, Borsboom, Denny, van der Maas, Han L. J., Kievit, Rogier A.·2012·Perspectives on Psychological Science

DOI 10.1177/1745691612463078

Open this paper in CoChat — free account

Abstract

The veracity of substantive research claims hinges on the way experimental data are collected and analyzed. In this article, we discuss an uncomfortable fact that threatens the core of psychology's academic enterprise: almost without exception, psychologists do not commit themselves to a method of data analysis before they see the actual data. It then becomes tempting to fine tune the analysis to the data in order to obtain a desired result-a procedure that invalidates the interpretation of the common statistical tests. The extent of the fine tuning varies widely across experiments and experimenters but is almost impossible for reviewers and readers to gauge. To remedy the situation, we propose that researchers preregister their studies and indicate in advance the analyses they intend to conduct. Only these analyses deserve the label "confirmatory," and only for these analyses are the common statistical tests valid. Other analyses can be carried out but these should be labeled "exploratory." We illustrate our proposal with a confirmatory replication attempt of a study on extrasensory perception.

Integrity signals

Registry

Crossref · 10.1177/1745691612463078

Cites

49 of 49 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Bayes factors
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Journal of personality and social psychology
Armstrong, J. (1988) · International Journal of Forecasting · doi:10.1016/0169-2070(88)90126-4 · Cited by 10,544
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267
False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Wildlife Society Bulletin
Wildlife Society (2011) · Wildlife Society Bulletin · doi:10.1002/(issn)1938-5463a · Cited by 5,571
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“confirmatory experiments, wonky statistics, ESP, Bayesian hypothesis test Several years ago, Ioannidis (2005) famously argued that “most published research findings are false.””
Journal of the American Statistical Association
Fildes, R. A. (1989) · International Journal of Forecasting · doi:10.1016/0169-2070(89)90106-4 · Cited by 3,956
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1×
“And indeed, recent results from biomedical and cancer research suggest that replication rates are lower than 50%, with some as low as 11% (Begley & Ellis, 2012; Osherovich, 2011; Prinz, Schlange, & Asadullah, 2011).”
Result

Show all 48 references

Research works printed but not linked: 4

Feynman R. P., 1974, Engineering & Science, 37, 10
Goldacre B., 2009, Bad science
Jeffreys H., 1961, Theory of probability
Roediger H. L., 2012, APS Observer, 25, 9

Sorted by citations

Items 901–998 of 998

Introduction
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.002
Assessment: Types of Measures and Their Use
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.012
Experimental Research Using Group Designs
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.006
Ethical Issues and Guidelines for Research
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.017
Communication of Research Findings
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.019
Are Speeded Tests Unfair? Modelling the Impact of Time Limits on the Gender Gap in MathematicsPreprint
Stoevenbelt, A. H., Wicherts, J. M., Flore, P. C., Phillips, L. A. T., Pietschnig, J., Verschuère, B., Voracek, M., & Schwabe, I. (2022) · doi:10.31234/osf.io/stjw2
Peer Review
Liao, T. F. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.004
Comparison of factor analysis models applied to the NCANDA neuropsychological test battery
Cummins, K. M., Pitpitan, E. V., Brumback, T., Moore, T. M., Trim, R. S., Clark, D. B., Brown, S. A., & Tapert, S. F. (2022) · PLoS ONE · doi:10.1371/journal.pone.0263174
Replication crisisPreprint
Quang-Loc, N. (2022) · doi:10.31219/osf.io/4wd5x
Peer Review #2 of "Replicability of sight word training and phonics training in poor readers: a randomised controlled trial (v0.1)"
(2015) · PeerJ · doi:10.7287/peerj.922v0.1/reviews/2
Smart but evil? Student-teachers perception of educational researchers’ epistemic trustworthiness.Preprint
Merk, S., & Rosman, T. (2018) · doi:10.31219/osf.io/cduqe
Index
Elman, C., Gerring, J., & Mahoney, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.019
NSF 19-609 Proposal: Evaluating Rigor and Transparency Culture Change InitiativesPreprint
Nosek, B. A., Errington, T. M., Mellor, D. T., Soderberg, C. K., Krall, T., Grasty, F. L., Brooks, R. E., Greene, A., Buck, S., Rosa, S. L., et al. (2020) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/ecgb5
Peer Review #1 of "Replicability of sight word training and phonics training in poor readers: a randomised controlled trial (v0.1)"
(2015) · PeerJ · doi:10.7287/peerj.922v0.1/reviews/1
Brain-to-Brain (mind-to-mind) interaction at distance: a confirmatory study
Tressoldi, P. E., Pederzoli, L., Bilucaglia, M., Caini, P., Fedele, P., Ferrini, A., Melloni, S., Richeldi, D., Richeldi, F., & Accardo, A. (2014) · F1000Research · doi:10.12688/f1000research.4336.2
Peer Review #2 of "Replicability of sight word training and phonics training in poor readers: a randomised controlled trial (v0.2)"
(2015) · PeerJ · doi:10.7287/peerj.922v0.2/reviews/2
Incidental Haptic Sensations May Not Influence Social Judgments: A Purely Confirmatory Replication Attempt of Study 1 by Ackerman, Nocera, & Bargh (2010)Preprint
Beek, T. F., Matzke, D., Pinto, Y., Rotteveel, M., Gierholz, A., Selker, R., Sasiadek, A., Steingroever, H., Jostmann, N. B., & Wagenmakers, E. (2017) · doi:10.31234/osf.io/2avns
Self-citation
Similar event-related potentials to structural violations in music and language: A replication of Patel, Gibson, Ratner, Besson, & Holcomb (1998).Preprint
de Leeuw, J. R., Andrews, J., Altman, Z., Andrews, R., Appleby, R., Bonanno, J., DeStefano, I. C., Doyle-Samay, E., Faruqui, A., Griesmer, C., et al. (2018) · doi:10.31234/osf.io/e9w3v
Communicating uncertain experimental evidencePreprint
Davis, A., Davis, A. L., & Fischhoff, B. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/7d3g9
Peer Review #3 of "Distributions of p-values smaller than .05 in psychology: what is going on? (v0.1)"
(2016) · PeerJ · doi:10.7287/peerj.1935v0.1/reviews/3
Peer Review #3 of "Replicability of sight word training and phonics training in poor readers: a randomised controlled trial (v0.1)"
(2015) · PeerJ · doi:10.7287/peerj.922v0.1/reviews/3
Center for Open Science: Proposal for NSF 19-537 Mid-Scale Research InfrastructurePreprint
Nosek, B. A., Ofiesh, L., Pfeiffer, N., Bowman, S. D., Litherland, D. M., Booth, A., Elliott, F., Davis, J., Frazier, M., Pattison, D., et al. (2019) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/mn4t2
Exercise practice associates with different brain rhythmic patterns during vigilancePreprint
Luque‐Casado, A., Ciria, L. F., Sanabria, D., & Perakakis, P. (2018) · doi:10.31236/osf.io/qw45u
Improving human interaction research through ecological grounding (in press at Collabra)Preprint
Albert, S., & de Ruiter, J. P. (2018) · doi:10.31219/osf.io/rz9xa
Peer Review #2 of "Teenage sleep and technology engagement across the week (v0.1)"
(2020) · PeerJ · doi:10.7287/peerj.8427v0.1/reviews/2
Peer Review #2 of "Distributions of p-values smaller than .05 in psychology: what is going on? (v0.1)"
(2016) · PeerJ · doi:10.7287/peerj.1935v0.1/reviews/2
Peer Review #1 of "Distributions of p-values smaller than .05 in psychology: what is going on? (v0.1)"
(2016) · PeerJ · doi:10.7287/peerj.1935v0.1/reviews/1
Brain-to-Brain (mind-to-mind) interaction at distance: a confirmatory study
Tressoldi, P. E., Pederzoli, L., Bilucaglia, M., Caini, P., Fedele, P., Ferrini, A., Melloni, S., Richeldi, D., Richeldi, F., & Accardo, A. (2014) · F1000Research · doi:10.12688/f1000research.4336.1
Peer Review #3 of "Replicability of sight word training and phonics training in poor readers: a randomised controlled trial (v0.2)"
(2015) · PeerJ · doi:10.7287/peerj.922v0.2/reviews/3
Peer Review #1 of "Replicability of sight word training and phonics training in poor readers: a randomised controlled trial (v0.2)"
(2015) · PeerJ · doi:10.7287/peerj.922v0.2/reviews/1
Psychological Science Replicates Just Fine, ThanksPreprint
Aarts, A. A. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.4176922
Publishing
Mellenbergh, G. J. (2019) · Springer eBooks · doi:10.1007/978-3-030-12272-0_19
JSE 36:1 Spring 2022 Whole Issue PDF
Erickson, K. E. (2022) · Journal of Scientific Exploration · doi:10.31275/20222613
Psychology and the Paranormal by David F. Marks
Kennedy, J. E. (2022) · Journal of Scientific Exploration · doi:10.31275/20222403
Pre-specifying effects of interest: necessary practice to clarify conclusion credibility in individual researchPreprint
Jin, H. (2022) · doi:10.31234/osf.io/t5hv3 · Cited by 1
Argument-Based Approach to Validity: Developing a Living Document and Incorporating PreregistrationPreprint
Gerasimova, D. (2022) · doi:10.31234/osf.io/t8h5g
Making the Most of Tenure in Two Acts: An Additional Way to Help Change Incentives in Psychological Science?Preprint
Aarts, A. A. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4176916
Decline (Handing Out) Individual Awards: An Additional Way to Help Change Incentives in Psychological Science?Preprint
Aarts, A. A. (2021) · SSRN Electronic Journal · doi:10.2139/ssrn.4176882
Model Specification Searches in Structural Equation Modeling Using Bee Swarm OptimizationPreprint
Schroeders, U., Scharf, F., & Olaru, G. (2022) · doi:10.31234/osf.io/sm5zt
Practice Schedules Affect How Learners Correct Their Errors: Secondary Analysis From a Contextual Interference Study
Taylor, S. E., Fawver, B. J., Thomas, J. L., WILLIAMS, A. M., & Lohse, K. R. (2022) · Journal of Motor Learning and Development · doi:10.1123/jmld.2022-0021
[PhD Dissertation] Good Research PracticesPreprint
Sarafoglou, A. (2022) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/7aj5h
Skalen zur Erfassung der selbstbestimmten Motivation von Grundschulkindern (SESMO)
Lohbeck, A. (2023) · Zeitschrift für Pädagogische Psychologie · doi:10.1024/1010-0652/a000356
Reproducible research practices and transparency across linguisticsPreprint
Bochyńska, A., Keeble, L., Halfacre, C. A. E., Casillas, J. V., Champagne, I.-A., Chen, K., Röthlisberger, M., Buchanan, E. M., & Roettger, T. B. (2023) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/naf8t
Route effects in city-based survey knowledge estimates
Krukar, J., Medrano, S. N., & Schwering, A. (2023) · Cognitive Processing · doi:10.1007/s10339-022-01122-0
Transparency and Open Science Practices in Research on Emerging AdulthoodPreprint
Nguyen, P. L. L., & Syed, M. (2023) · doi:10.31234/osf.io/ckdws
More Useful Junk? Replicating the Effects of Visual Embellishment on Description and Recall of ChartsPreprint
Syeda, U. H., South, L., Raynor, J., Panavas, L., Saffo, D., Morriss, T., Dunne, C., & Borkin, M. A. (2023) · doi:10.31219/osf.io/dferj
Review of Nancy Cartwright’s A Philosopher Looks at Science - Nancy Cartwright, A Philosopher Looks at Science. Cambridge: Cambridge University Press (2022), 210 pp. $12.95 (paperback).
Hicks, D. (2023) · Philosophy of Science · doi:10.1017/psa.2023.63
Pre-registration of study protocols by paper and poster presenters at 7th WCRI World Conference on Research Integrity (WCRI) in Cape Town SA, 2022Preprint
Emons, W. H. M., Sijtsma, K., & Bouter, L. M. (2023) · doi:10.31219/osf.io/ejcak
Veri Toplamaya Hala Gerek Var Mı? Yoksa Ulusal Pazarlama Akademisi HARKING Tehlikesi Altında Mı?
Doğan, V., VATANDAEŞ, T., & MIHOĞLU, B. A. (2023) · Tüketici ve tüketim araştırmaları dergisi · doi:10.15659/ttad.15.1.170
L’importance de la science ouverte en recherche en psychologiePreprint
Thériault, R. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/758dx
Assessing evidence and uncertainty
Pittelkow, M.-M. (2023) · University of Groningen research database (University of Groningen / Centre for Information Technology) · doi:10.33612/diss.762945985
Understanding the Motives for Terrorism : Does it Have an Effect on Psychological Reactions? : A Replication and Extension
Leder, J., Schlegel, R., & Schütz, A. (2021) · doi:10.20378/irb-50038
Two Voices on the Credibility Crisis in Psychology
Białek, A., & Wolski, P. (2023) · Przegląd Psychologiczny · doi:10.31648/przegldpsychologiczny.9679
The Unwholesomeness of the Scientific Ecosystem in the Research Misconduct: A Breach of Duty
Ajaka, L. N., & Saab, J. (2023) · doi:10.60149/rdku3775
Biases in dermatology: A primer
Chakraborty, A. (2024) · Indian Journal of Dermatology Venereology and Leprology · doi:10.25259/ijdvl_126_2023
Questionable Metascience PracticesPreprint
Rubin, M. (2024) · SSRN Electronic Journal · doi:10.2139/ssrn.4706575
Argument‐Based Approach to Validity: Developing a Living Document and Incorporating Preregistration
Gerasimova, D. (2024) · Journal of Educational Measurement · doi:10.1111/jedm.12385
Confronting Consumers’ Complicity: Do Confrontations with Causal Responsibility for Sweatshop Labor Raise Moral Obligation?
Flade, F., Messer, M., & Imhoff, R. (2024) · International Review of Social Psychology · doi:10.5334/irsp.775
Confirmation Bias Without Prior Beliefs: Should We Speak of a ‘See-Something-Versus-Nothing Bias’Preprint
Schnepf, J. (2024) · doi:10.31219/osf.io/mk8nh
Measuring is knowing?
Bokern, P. (2024) · doi:10.26481/dis.20240529pb
Feasibility of a Cochlear Implant Fitting Approach Based on Phoneme Confusions: Lessons Learned from the AuDiET StudyPreprint
Wasmann, J.-W. A., Migliorini, E., Philpott, N., Philips, B., van Dijk, B., & Huinck, W. J. (2024) · doi:10.31219/osf.io/k8f2y
Effects of winning and losing streaks on within-session chasing in online gambling: A replication and extension studyPreprint
Banerjee, N., Noël, X., & Chen, Z. (2024) · doi:10.31234/osf.io/rph6d
Researchers’ Perceptions of the State of Social and Personality PsychologyPreprint
Schiavone, S. R., Vazire, S., & Rhemtulla, M. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ja4u2
La llamada crisis teórica de la psicología y las alternativas propuestas para sortearla
Vizioli, N. A. (2024) · Prometeica - Revista de Filosofía y Ciencias · doi:10.34024/prometeica.2024.30.16057 · Cited by 1
Número completo 30
Prometeica, R. (2024) · Prometeica - Revista de Filosofía y Ciencias · doi:10.34024/prometeica.2024.30.18843
Subjective logic as a complementary tool to meta-analysis to explicitly address second-order uncertainty in research findings: A case from infant studies
Margoni, F., & Walkinshaw, N. (2024) · Infant Behavior and Development · doi:10.1016/j.infbeh.2024.101978 · Cited by 1
From Data Streams to Mental Health Predictions: Improving the use of Passive Measures from Digital Devices
Langener, A. M. (2024) · University of Groningen research database (University of Groningen / Centre for Information Technology) · doi:10.33612/diss.1069770227 · Cited by 1
Assessing Preregistration Deviations: A Comparative Analysis of Psychologists and Open Science Experts
Ting, Y., Huang, P., Kung, L., Huang, Y., & Jeng, W. (2024) · Proceedings of the Association for Information Science and Technology · doi:10.1002/pra2.1076
Data Validation for Data Science Projects
Demchenko, Y., Cuadrado-Gallego, J. J., Chertov, О., & Aleksandrova, M. (2024) · Springer eBooks · doi:10.1007/978-3-031-69366-3_14
Transparency and Open Science Practices in Research on Emerging Adulthood
Nguyen, P., & Syed, M. (2024) · Oxford University Press eBooks · doi:10.1093/oso/9780197677797.003.0002
Strategic Decision Points in Experiments: A Predictive Bayesian Optional Stopping MethodPreprint
Yang, X., Flannagan, C. A. C., & Bärgman, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5163638
Open and Reproducible Special Education Research
Kalandadze, T. (2025) · Springer eBooks · doi:10.1007/978-3-031-40858-8_24-1
Hidden rules of visual perception in the Rorschach test
Matousek, S., Škobrtal, P., & Badošek, R. (2025) · Cognitive Systems Research · doi:10.1016/j.cogsys.2025.101359
How preschoolers react to norm violations is associated with culturePreprint
Gampe, A., & Daum, M. M. (2017) · doi:10.31219/osf.io/cm9ag_v1
Variable Control and Conceptual Change: A Large-Scale Quantitative Study in Elementary SchoolPreprint
Edelsbrunner, P. A., Schalk, L., Schumacher, R., & Stern, E. (2016) · doi:10.31234/osf.io/escqa_v1
Examining the impact of attentional focus and partner gaze on interpersonal coordination
Macpherson, M. C., Brown, A., & Miles, L. K. (2025) · Psychonomic Bulletin & Review · doi:10.3758/s13423-025-02695-5
The Open Empirical Cycle for Hypothesis Evaluation in PsychologyPreprint
Hoijtink, H., Bruin, J. D., Duken, S. B., Flores-Dourojeanni, J. P., Frankenhuis, W. E., & Lissa, C. J. V. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/wsxbh_v3
The Open Empirical Cycle for Hypothesis Evaluation in PsychologyPreprint
Hoijtink, H., Bruin, J. D., Duken, S. B., Flores-Dourojeanni, J. P., Frankenhuis, W. E., & Lissa, C. J. V. (2025) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/wsxbh_v2
Making Null Results Credible: An Overview of Design and Analytical ToolsPreprint
Favero, N., Belardinelli, P., Zhu, L., & Lahey, J. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5397071
Statistics and Persuasion in Medicine
Osimani, B. (2025) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780197625835.013.0013
Between-session chasing via time of return in online eCasino gambling
Banerjee, N., Noël, X., Zhu, J., & Chen, Z. (2026) · Journal of Behavioral Addictions · doi:10.1556/2006.2025.00454
Metascientific replication project with the advanced meta-experimental protocol of the transparent psi project procedures for testing the precognitive effect claimed by Bem
Walleczek, J., von Stillfried, N., Schmidt, S., Wittmann, M., Kirmse, K. A., Moll, J., & Kekecs, Z. (2025) · PLoS ONE · doi:10.1371/journal.pone.0335330 · Cited by 1
Registration of research on research integrity is still not common: Findings from the Hong Kong, Cape Town, and Athens editions of the World Conference on Research Integrity
Emons, W. H. M., Sijtsma, K., & Bouter, L. M. (2025) · Accountability in Research · doi:10.1080/08989621.2025.2575442
A Generalized Discrete Choice Model with Segmentation and Embedding via AI-Learning (DCM-SEAL)Preprint
Baek, K., & Khani, A. (2025) · SSRN Electronic Journal · doi:10.2139/ssrn.5765940
Preregistration in Animal Experimentation – A Qualitative Study on Researchers’ Views in SwitzerlandPreprint
Priboi, C., Lalor, S., Sarra, G., Vergauwe, E., Elger, B. S., & Würbel, H. (2025) · Research Square · doi:10.21203/rs.3.rs-8194213/v1
Additional file 1 of Dissemination and outcome reporting bias in clinical malaria intervention trials: a cross-sectional analysis
Pool, L., Ruiz del Portal Luyten, C., van der Pluijm, R. W., Soentjens, P. H. P., Hänscheid, T., Grobusch, M. P., & Visser, B. J. (2024) · Figshare · doi:10.6084/m9.figshare.27140808
Additional file 2 of Dissemination and outcome reporting bias in clinical malaria intervention trials: a cross-sectional analysis
Pool, L., Ruiz del Portal Luyten, C., van der Pluijm, R. W., Soentjens, P. H. P., Hänscheid, T., Grobusch, M. P., & Visser, B. J. (2024) · Figshare · doi:10.6084/m9.figshare.27140811
Additional file 1 of Informed Bayesian survival analysis
Bartos̆, F., Aust, F., & Haaf, J. M. (2022) · Figshare · doi:10.6084/m9.figshare.21077675
Additional file 2 of Informed Bayesian survival analysis
Bartos̆, F., Aust, F., & Haaf, J. M. (2022) · Figshare · doi:10.6084/m9.figshare.21077678
Researcher Degrees of Freedom in the Psychology of ReligionPreprint
Bartlett, J. E., Uzdavines, A., Coleman, T. J., III, Messick, K. J., & Charles, S. J. (2018) · OSF Preprints (OSF Preprints)
Research practices and statistical reporting quality in 250 economic psychology master’s theses: A meta-research investigationPreprint
Mosen, J., Voracek, M., Kirchler, E., & Olsen, J. (2019) · OSF Preprints (OSF Preprints)
A Simple Introduction to Markov Chain Monte-Carlo SamplingPreprint
Vandekerckhove, J., & van Ravenzwaaij, D. (2018) · OSF Preprints (OSF Preprints)
Research practices and assessment of research misconductPreprint
Wicherts, J. M., & Hartgerink, C. H. J. (2016) · OSF Preprints (OSF Preprints)
Robust tests should be the default, not the backup
Höfler, M. (2026) · Peer Community Journal · doi:10.24072/pcjournal.670 · Cited by 1
Ovarian cancer recurrence prediction: comparing confirmatory to real-world predictors with machine learning
Katsimpokis, D., van Odenhoven, A. E. C., van Erp, M. A. J. M., Wenzel, H. H. B., van der Aa, M. A., van Swieten, M. M. H., Smedts, H. P. M., & Piek, J. M. J. (2026) · ESMO Real World Data and Digital Oncology · doi:10.1016/j.esmorw.2025.100666
Subclinical Variation in Mental Health Shapes the Dynamics of Everyday Behaviour
Brown, A., Macpherson, M. C., & Miles, L. K. (2026) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218261424186
Putting Open Science into practice: Wie Prä-Registrierung die Forschung transparenter macht
Düvel, N. (2024) · doi:10.59350/68t81-cjc33
Putting Open Science into practice: Wie Prä-Registrierung die Forschung transparenter macht
Düvel, N. (2024) · doi:10.65527/p74qq-0c510

Authors: Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A.
Affiliations: University of Amsterdam (NL)
ORCID: Wagenmakers, Eric-Jan
Borsboom, Denny
van der Maas, Han L. J.
Kievit, Rogier A.
Venue: Perspectives on Psychological Science
Publisher: SAGE Publications
Published: 2012-11
Volume: 7
Issue: 6
Pages: 632-638
ISSN: 1745-6916 (ISSN-L)
1745-6924
DOI: 10.1177/1745691612463078
OpenAlex: W2123263696
Cited by: 1,042
References: 48
Citations by year: 2026: 57 · 2025: 41 · 2024: 65 · 2023: 85 · 2022: 102 · 2021: 108 · 2020: 114 · 2019: 98 · 2018: 88 · 2017: 86 · 2016: 75 · 2015: 51 · 2014: 43 · 2013: 28 · 2012: 1
FWCI: 44.75
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Perspectives on Psychological Science (publishedVersion)
PubMed (publishedVersion)
UvA-DARE (University of Amsterdam) (publishedVersion)
UvA-DARE (University of Amsterdam) (submittedVersion)
Data Archiving and Networked Services (DANS) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Keywords: preregistration, confirmatory analysis, exploratory analysis, data snooping, statistical validity, research integrity, extrasensory perception, replication, hypothesis testing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

An Agenda for Purely Confirmatory Research

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks