Cited by 1,042Meta-analysis and systematic reviewsPsychology Research and BibliometricsStatistical Methods and Bayesian Inference

The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.

An Agenda for Purely Confirmatory Research

Wagenmakers, Eric-Jan, Wetzels, Ruud, Borsboom, Denny, van der Maas, Han L. J., Kievit, Rogier A.·2012·Perspectives on Psychological Science

DOI 10.1177/1745691612463078

Open this paper in CoChat — free account

Abstract

The veracity of substantive research claims hinges on the way experimental data are collected and analyzed. In this article, we discuss an uncomfortable fact that threatens the core of psychology's academic enterprise: almost without exception, psychologists do not commit themselves to a method of data analysis before they see the actual data. It then becomes tempting to fine tune the analysis to the data in order to obtain a desired result-a procedure that invalidates the interpretation of the common statistical tests. The extent of the fine tuning varies widely across experiments and experimenters but is almost impossible for reviewers and readers to gauge. To remedy the situation, we propose that researchers preregister their studies and indicate in advance the analyses they intend to conduct. Only these analyses deserve the label "confirmatory," and only for these analyses are the common statistical tests valid. Other analyses can be carried out but these should be labeled "exploratory." We illustrate our proposal with a confirmatory replication attempt of a study on extrasensory perception.

Integrity signals

Registry

Crossref · 10.1177/1745691612463078

Cites

49 of 49 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Bayes factors
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Journal of personality and social psychology
Armstrong, J. (1988) · International Journal of Forecasting · doi:10.1016/0169-2070(88)90126-4 · Cited by 10,544
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267
False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Wildlife Society Bulletin
Wildlife Society (2011) · Wildlife Society Bulletin · doi:10.1002/(issn)1938-5463a · Cited by 5,571
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“confirmatory experiments, wonky statistics, ESP, Bayesian hypothesis test Several years ago, Ioannidis (2005) famously argued that “most published research findings are false.””
Journal of the American Statistical Association
Fildes, R. A. (1989) · International Journal of Forecasting · doi:10.1016/0169-2070(89)90106-4 · Cited by 3,956
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1×
“And indeed, recent results from biomedical and cancer research suggest that replication rates are lower than 50%, with some as low as 11% (Begley & Ellis, 2012; Osherovich, 2011; Prinz, Schlange, & Asadullah, 2011).”
Result

Show all 48 references

Research works printed but not linked: 4

Feynman R. P., 1974, Engineering & Science, 37, 10
Goldacre B., 2009, Bad science
Jeffreys H., 1961, Theory of probability
Roediger H. L., 2012, APS Observer, 25, 9

Sorted by citations

Items 701–800 of 998

Dopamine D1 receptor availability is not associated with delusional ideation measures of psychosis proneness
Matheson, G. J., Plavén‐Sigray, P., Louzolo, A., Borg, J., Farde, L., Petrović, P., & Červenka, S. (2020) · Schizophrenia Research · doi:10.1016/j.schres.2020.06.001 · Cited by 3
Működési zavarok és megújulási törekvések a tudományos pszichológiában, a 21. század elején
Szokolszky, Á. (2018) · Magyar Pszichológiai Szemle · doi:10.1556/0016.2018.73.4.3 · Cited by 3
Cultural Problems Cannot Be Solved with Technical Solutions Alone
Lilburn, S. D., Little, D. R., Osth, A. F., & Smith, P. L. (2019) · Computational Brain & Behavior · doi:10.1007/s42113-019-00036-z · Cited by 3
Simulation of vocational activities: experimental evidence of (no) changes in vocational interests
Martončik, M., Babjáková, J., Čupková, L., Köverová, N., & Kačmárová, M. (2020) · Empirical research in vocational education and training · doi:10.1186/s40461-020-00093-w · Cited by 5
Les pratiques de recherche ouvertes en psychologie
Lantian, A. (2020) · Psychologie Française · doi:10.1016/j.psfr.2020.09.001 · Cited by 6
What do Incoming University Students Believe About Open Science Practices in Psychology?
Beaudry, J. L., Williams, M. N., Philipp, M. C., & Kothe, E. J. (2022) · Teaching of Psychology · doi:10.31234/osf.io/rq3zs · Cited by 11
Avoiding Bias in the Search for Implicit Bias
Cyrus-Lai, W., Tierney, W., du Plessis, C., Nguyen, M., Schaerer, M., Clemente, E. G., & Uhlmann, E. L. (2022) · Psychological Inquiry · doi:10.1080/1047840x.2022.2106762 · Cited by 3
Gaming Disorder: A Contemporary Ampliative Account
Bamijoko-Okungbaye, A., Firdosi, M., & Koukoularis, D. (2020) · BRAIN BROAD RESEARCH IN ARTIFICIAL INTELLIGENCE AND NEUROSCIENCE · doi:10.18662/brain/11.1/11 · Cited by 3
The Emergence of Forensic ObjectivityPreprint
Peterson, D. (2016) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/2ft8x · Cited by 3
Replication in Social SciencePreprint
Jeremy Freese, A., & Peterson, D. (2017) · doi:10.31235/osf.io/5bck9 · Cited by 6
Contributions towards understanding and building sustainable sciencePreprint
Hartgerink, C. H. J. (2019) · Thesis Commons (OSF Preprints) · doi:10.31237/osf.io/4wtpc · Cited by 3
Hoekstra & Vazire (2020), Aspiring to greater intellectual humility in sciencePreprint
Hoekstra, R., & Vazire, S. (2020) · doi:10.31234/osf.io/edh2s · Cited by 3
NSF Science of Science Proposal: Randomized Trial of Registered ReportsPreprint
Nosek, B. A., Mellor, D. T., Errington, T. M., Soderberg, C. K., Krall, T., Grasty, F. L., Brooks, R. E., Davis, R., Kousta, S. T., Swaminathan, S., et al. (2020) · doi:10.31222/osf.io/jvxab · Cited by 3
Open Science in phonetics and phonologyPreprint
Coretta, S. (2020) · doi:10.31219/osf.io/4dz5t · Cited by 3
Ten steps toward a better personality science - how quality may be rewarded more in research evaluationPreprint
Leising, D., Thielmann, I., Glöckner, A., Gärtner, A., & Schönbrodt, F. D. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/5zvmh · Cited by 5
A critical assessment of reconsolidation interference as a tool for therapeutic forgettingPreprint
Schroyens, N., Beckers, T., & Luyten, L. (2021) · doi:10.31219/osf.io/4z7qx · Cited by 3
Can infants learn phonology in the lab? A meta-analytic answerPreprint
Cristià, A. (2016) · doi:10.31219/osf.io/jffa5 · Cited by 3
Do Open Science Badges increase trust in scientists among undergraduates, scientists, and the public?Preprint
Schneider, J. M., Rosman, T., Kelava, A., & Merk, S. (2020) · doi:10.31234/osf.io/43ec2 · Cited by 3
A tutorial on analyzing ecological momentary assessment data in psychological research with Bayesian (generalized) mixed-effects modelsPreprint
Dora, J., McCabe, C. J., Lissa, C. J. V., Witkiewitz, K. A., & King, K. M. (2022) · doi:10.31234/osf.io/jc938 · Cited by 3
A systematic review of Null Hypothesis Significance Testing, sample sizes, and statistical power in research using the Implicit Relational Assessment ProcedurePreprint
Hussey, I. (2023) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/g2x9p · Cited by 3
An Updated Guide to Robust Statistical Methods in NeurosciencePreprint
Wilcox, R. R., & Rousselet, G. A. (2023) · doi:10.31234/osf.io/kcjfe · Cited by 3
Trauma’s distinctive and combined effects on subsequent substance use, mental health, and neurocognitive functioning with the NCANDA sample
Patel, H., Nooner, K. B., Reich, J. C., Woodley, M. M. O., Cummins, K. M., & Brown, S. A. (2024) · Developmental Cognitive Neuroscience · doi:10.1016/j.dcn.2024.101427 · Cited by 2
Dialogues about the practice of science
Shiffrin, R. M., Trueblood, J. S., Kellen, D., & Vandekerckhove, J. (2025) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2423782122 · Cited by 2
What is critical metascience and why is it important?
Rubin, M. (2026) · Frontiers in Psychology · doi:10.3389/fpsyg.2026.1860740 · Cited by 2
Ride-hailing as a safer transport option: Evidence from frequency of use and commuting choices in Brazil
de Sá, A. L. S., Lavieri, P. S., & Pitombo, C. S. (2025) · Latin American Transport Studies · doi:10.1016/j.latran.2025.100042 · Cited by 2
A randomized controlled trial study of a life review art intervention for older adults living alone
Tsai, P., Chou, W.-H., & Liao, S.-Y. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1669119 · Cited by 4
Situated learning and the problem of scientific inference
Affognon, D. A. (2026) · Frontiers in Education · doi:10.3389/feduc.2026.1725228 · Cited by 4
Event‐Related Brain Potential Correlates of Face Processing: A High‐Precision Replication and Individual Differences Study
Ciocan, M., Gandlin, L., Bojdo, M. M., Lidborg, L. H., & Wiese, H. (2026) · Psychophysiology · doi:10.1111/psyp.70242 · Cited by 2
Doing Your Own Patient Activist Research
McKenna, R. (2026) · Social Epistemology · doi:10.1080/02691728.2026.2646178 · Cited by 2
Why Radiomics Rarely Reaches the Clinic: Reproducibility, Validation, and Evidence Gap—A Critical Narrative Review
Pozzi, J., D’Argenzio, J., Carriero, S., Cè, M., D’Arrigo, D., Lanza, C., Biondetti, P., Angileri, S. A., Pavan, M., Catona, R., et al. (2026) · Diagnostics · doi:10.3390/diagnostics16142266 · Cited by 2
Scientism in Contemporary Psychology, and Its Underlying Mythic Order
Cornejo, C., & Rojas, P. (2026) · Springer eBooks · doi:10.1007/978-3-032-01453-5_9 · Cited by 2
Association of Teacher Well-Being With Student Motivation and Achievement: A Systematic Review and Meta-Analysis
Dicke, T., Ferber, K. A., Devine, E. K., Collie, R. J., Granziera, H., Parker, P. D., Guo, J., Marsh, H. W., Teuber, Z., Bradshaw, E. L., et al. (2026) · Educational Psychology Review · doi:10.1007/s10648-026-10216-6 · Cited by 4
Transparency and Reproducibility: Potential Solutions
Christensen, G., & Miguel, E. A. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.007 · Cited by 2
Large number placements on a bounded number line: The importance of explanations
Harkness, S. S., & Brass, A. (2022) · School Science and Mathematics · doi:10.1111/ssm.12513 · Cited by 2
For Post Hoc's Sake: Determining Sample Size for Tukey Multiple Comparisons in 4-Group ANOVA
Brooks, G. P., An, Q., Li, Y., & Johanson, G. A. (2023) · General Linear Model Journal · doi:10.31523/glmj.047001.00 · Cited by 2
Network Approach to Work Addiction: A Cross-Cultural Study
Bereznowski, P., Atroszko, P. A., & Konarski, R. (2024) · SAGE Open · doi:10.1177/21582440241245414 · Cited by 4
Effects of dominance on language switching: a longitudinal study of Turkish–Dutch children with and without developmental language disorder
Snijders, V. E., van Witteloostuijn, M., Boerma, T., Timmermeister, M., & Blom, E. (2024) · Bilingualism Language and Cognition · doi:10.1017/s1366728924000427 · Cited by 2
Preregistration and predictivism
Choi, H. H. (2024) · Synthese · doi:10.1007/s11229-024-04827-1 · Cited by 2
Triadic shared decision making in emergency psychiatry: an explorative study
van Asperen, G. C. R., Ai, W., de Winter, R. F. P., & Mulder, C. L. (2025) · BMC Psychiatry · doi:10.1186/s12888-025-06640-7 · Cited by 2
Evaluating eXtended Reality (XR) and Desktop Modalities for AI Education
Feijoo‐Garcia, M. A., Zhang, Y., Gu, Y., Magana, A. J., Beneš, B., & Popescu, V. S. (2025) · SN Computer Science · doi:10.1007/s42979-025-04495-z · Cited by 2
Impact Metrics
Gerring, J., Karcher, S., & Apfeld, B. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.015 · Cited by 3
The Distinctiveness Effect in the Recognition of Whole Melodies
Rainsford, M., Palmer, M. A., & Sauer, J. D. (2019) · Music Perception An Interdisciplinary Journal · doi:10.1525/mp.2019.36.3.253 · Cited by 2
What’s Wrong with Replicating the Old Boys’ Networks?
Teele, D. L. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.016 · Cited by 2
Masked analysis for small-scale cluster randomized controlled trials
Ferron, J. M., Nguyen, D. T. N., Dedrick, R. F., Suldo, S. M., & Shaunessy‐Dedrick, E. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01708-0 · Cited by 2
Coordinating Reappraisals
Gerring, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.013 · Cited by 2
Research Cycles
Lieberman, E. S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.003 · Cited by 2
Individual differences in relational body image: Within-person variability predicts maladaptive trait body image
Waring, S. V., Sharpinskyi, K., & Kelly, A. C. (2022) · Body Image · doi:10.1016/j.bodyim.2022.08.005 · Cited by 4
Publish without bias or perish without replications
Ventura, R. (2022) · Studies in History and Philosophy of Science Part A · doi:10.1016/j.shpsa.2022.08.010 · Cited by 2
Unequal Valuations of Lives and What to Do About It : The Role of Identifiability, Numbers, and Age in Charitable Giving
Moche, H. (2022) · Linköping studies in behavioural science · doi:10.3384/9789179295226 · Cited by 2
Changes in subjective well-being predict changes in U.S. presidential, Senate, & House of Representatives election outcomes
Chan, E. W., Solomon, A., & Cheung, F. (2022) · Personality Science · doi:10.5964/ps.7253 · Cited by 2
Time, money, and happiness: Does putting a price on time affect our ability to smell the roses?
Connors, S. W., Khamitov, M., Moroz, S., Campbell, L., & Henderson, C. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.08.005 · Cited by 2
Big Data, Exploratory Data Analyses and Questionable Research Practices: Suggestion for a Foundational Principle
Bissonette, J. A. (2021) · Wildlife Society Bulletin · doi:10.1002/wsb.1201 · Cited by 2
Mind-Matter Interaction at Distance. Part 1: Effects on a Random Events Generator (REG)Preprint
Tressoldi, P. E., Pederzoli, L., Caini, P., Ferrini, A., Melloni, S., Richeldi, D., & Richeldi, F. (2014) · SSRN Electronic Journal · doi:10.2139/ssrn.2423702 · Cited by 2
Pitfalls in Parapsychological Research
Hyman, R. (2017) · Wiley eBooks · doi:10.1002/9781119095910.ch14 · Cited by 2
Dissertation R.C.M. van AertPreprint
van Aert, R. C. M. (2018) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/eqhjd · Cited by 3
An exploration of issues relating to the implementation of Active Learning in Saudi Arabian Universities
Alotaibi, F. (2019) · PEARL (University of Plymouth) · doi:10.24382/1180 · Cited by 2
Commentary on Vassar et al. (2020): Cautionary observations on the pre‐registration revolution
Gorman, D. M. (2020) · Addiction · doi:10.1111/add.14945 · Cited by 2
Effects of smartphone cues and online vigilance on well-being and performance
Johannes, N. (2020) · Radboud Repository (Radboud University) · Cited by 2
“So you confirmed, replicated and emptied your file-drawer… now what?” A Structural Realist’s Guide to Theory Evaluation in Psychological SciencePreprint
Hasselman, F., Seevinck, M. P., & Cox, R. F. A. (2019) · doi:10.31234/osf.io/b8csj · Cited by 2
Visual Partitioning for Multivariate Models: An approach for identifying and visualizing complex multivariate datasetPreprint
Fife, D. A. (2021) · doi:10.31234/osf.io/avu2n · Cited by 2
Waldian t tests: Sequential Bayesian t tests with controlled error probabilitiesPreprint
Schnuerch, M., Heck, D. W., & Erdfelder, E. (2021) · doi:10.31234/osf.io/x4ybm · Cited by 2
An Exploratory Study of the Relations Between Women Miners’ Gender-Based Workplace Issues and their Mental Health and Job SatisfactionPreprint
Rubin, M. (2017) · doi:10.31234/osf.io/hnrud · Cited by 2
Moral Elevation Reduces Prejudice Against Gay MenPreprint
Lai, C. K., & Nosek, B. A. (2016) · doi:10.31234/osf.io/49nqy · Cited by 2
Examining Psychological Science through Systematic Meta-Method Analysis: A Call for ResearchPreprint
Elson, M. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/cfbzt · Cited by 2
Improving the Replicability of Psychological Science Through PedagogyPreprint
Frank, M. C. (2016) · doi:10.31234/osf.io/p73he · Cited by 2
Investigating cognitive and therapeutic effects of transcranial electric stimulation (TES): a short guide for reproducible and transparent researchPreprint
Westwood, S. J. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/8qms2 · Cited by 2
Mind-Wandering and Mindfulness as Mediators of the Relation Between Online Vigilance and Well-BeingPreprint
Johannes, N., Veling, H., Dora, J., Meier, A., Reinecke, L., & Buijzen, M. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/2erwy · Cited by 2
From theories to models to predictions: A Bayesian model comparison approachPreprint
Rouder, J. N., Haaf, J. M., & Aust, F. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/jt4th · Cited by 5
The Influence of Direct and Indirect Speech on Source MemoryPreprint
Eerland, A., & Zwaan, R. A. (2017) · doi:10.31234/osf.io/trx36 · Cited by 2
Designing for Preregistration in Practice: Multiple Norms and PurposesPreprint
Pu, X., Zhu, L., Kay, M., & Conrad, F. G. (2019) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/w5ked · Cited by 3
Examining Psychological Science through Systematic Meta-Method Analysis: A Call for ResearchPreprint
Elson, M. (2019) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/cj7xf · Cited by 2
The Creativity-Verification Cycle in Psychological Science: New Methods to Combat Old IdolsPreprint
Wagenmakers, E., Dutilh, G., & Sarafoglou, A. (2018) · doi:10.31234/osf.io/37ntp · Cited by 2
Self-citation
Review of Four Preregistration Registries for Special Education ResearchersPreprint
Fleming, J. I., McLucas, A. S., & Cook, B. G. (2022) · doi:10.35542/osf.io/7ujgs · Cited by 2
Children use disagreement to infer what happenedPreprint
Amemiya, J. L., Heyman, G. D., & Gerstenberg, T. (2023) · doi:10.31234/osf.io/y79sd · Cited by 2
Intolerance of uncertainty does not significantly predict decisions about delayed, probabilistic rewardsPreprint
Cobos, P. L., Quintero, M. J., López, F. J., Luque, D., Ciria, L. F., & Morís, J. (2024) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2024.01.29.577520 · Cited by 2
Generalizability of Choice Architecture InterventionsPreprint
Szászi, B., Goldstein, D. G., Soman, D., & Michie, S. (2024) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/8p4vq · Cited by 2
Exploratory Analysis and the Expected Value of Experimentation
Klein, C. (2023) · Philosophy of Science · doi:10.1017/psa.2023.116 · Cited by 1
Comparative judgement for experimental philosophy: A method for assessing ordinary meaning in vehicles in the park cases
Tanswell, F. S., DAVIES, B. T., Jones, I., & Kinnear, G. (2023) · Philosophical Psychology · doi:10.1080/09515089.2023.2263036 · Cited by 1
Reputation Without Practice? A Dynamic Computational Model of the Unintended Consequences of Open Scientist Reputations
Linde, M., Pittelkow, M.-M., Schwarzback, N., & van Ravenzwaaij, D. (2024) · Journal of Trial and Error · doi:10.36850/mr10 · Cited by 2
Dissemination and outcome reporting bias in clinical malaria intervention trials: a cross-sectional analysis
Pool, L., Luyten, C. R. D. P., van der Pluijm, R. W., Soentjens, P. H. P., Hänscheid, T., Grobusch, M. P., & Visser, B. J. (2024) · Malaria Journal · doi:10.1186/s12936-024-05115-6 · Cited by 2
Meta-analyzing nonpreregistered and preregistered studies.
van Aert, R. C. M. (2025) · Psychological Methods · doi:10.1037/met0000719 · Cited by 3
PoweR Analysis in Review: Leveraging R to Conduct Power Analyses for a Range of Research Designs
Rubin, M. (2025) · International Journal of Psychology · doi:10.1002/ijop.70017 · Cited by 1
Direction of reading, not writing, shapes concepts of time
Crossley, J., & Bylund, E. (2025) · Language and Cognition · doi:10.1017/langcog.2025.10008 · Cited by 2
The State of Replication at IEEE ISMAR and IEEE VR: A Scoping Literature Review (2010 – 2024) and Online Survey
Arefin, M. S., Biener, V., Nijhum, S. M. R. H., Weidner, F., Grubert, J., & Swan, J. E. (2025) · Proceedings - International Symposium on Mixed and Augmented Reality, ISMAR · doi:10.1109/ismar67309.2025.00086 · Cited by 2
Peripheral cyclical expression of GABA-A receptor subunit genes and menstrual cycle affective change: a dimensional, transdiagnostic study
Barone, J., Romano, R., Nagpal, A., Salerno, A., Patterson, A., Wenzel, E., Guzman, G., Alluri, V., Maki, P. M., Pinna, G., et al. (2025) · Translational Psychiatry · doi:10.1038/s41398-025-03767-9 · Cited by 1
Taxonomic Bias Persists in Ecology and Evolution Research Despite Decades of Concern
Pollo, P., & Kasumovic, M. M. (2026) · Ecology and Evolution · doi:10.1002/ece3.74450 · Cited by 1
Drivers of Taxonomic Bias in Ecology and Evolution: Insights From Ethologists and Behavioural Ecologists
Pollo, P., & Kasumovic, M. M. (2026) · Ecology and Evolution · doi:10.1002/ece3.74460 · Cited by 1
Registered Replication Report: Johns et al. (2005)
Stoevenbelt, A. H., Flore, P. C., Adamkovic, M., Baník, G., Bergers, R., Calin-Jageman, R. J., Gómez, L. L., Hüffmeier, J., Imundo, M. N., Martin, S. D., et al. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459261424724 · Cited by 1
Open Science and Clinical Psychology
Linthicum, K. P., Southward, M. W., & Schleider, J. L. (2021) · Elsevier eBooks · doi:10.1016/b978-0-12-818697-8.00165-5 · Cited by 2
Acceptance of anomalous research findings: explaining treatment implausibility reduces belief in far-fetched results
Thompson, W. B., & Radell, M. L. (2021) · PeerJ · doi:10.7717/peerj.12532 · Cited by 1
Internal and External Validity
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.003 · Cited by 1
An experimental test of integrating imagery with approach bias modification for alcohol: A cautionary tale
Fridland, E., Wiers, C. E., Rinck, M., Becker, E. S., & Gladwin, T. E. (2022) · British Journal of Health Psychology · doi:10.1111/bjhp.12630 · Cited by 1
Dwa głosy o kryzysie wiarygodności w psychologii
Białek, A., & Wolski, P. (2023) · Przegląd Psychologiczny · doi:10.31648/przegldpsychologiczny.9455 · Cited by 1
Některé méně známé postupy otevřené vědy v sociologii: Předregistrace a registrované reporty
Urban, J., & Černá, V. A. (2024) · Czech Sociological Review · doi:10.13060/csr.2024.011
Dimensions of predictive success
Syrjänen, P. (2024) · The British Journal for the Philosophy of Science · doi:10.1086/733193 · Cited by 1
Can the lateral mental timeline be automatically activated in language comprehension?
Santiago, J., Beracci, A., Flumini, A., Sanjuan, E., Ouellet, M., & Solana, P. (2025) · Journal of Memory and Language · doi:10.1016/j.jml.2025.104644 · Cited by 1
People Use Norms, Values, Codification, and Enforceability to Determine if a Rule Was Broken
Wylie, J., Bostyn, D. H., & Gantman, A. P. (2025) · Open Mind · doi:10.1162/opmi.a.19
Comparing the performance of functional versus taxonomic metagenomics for detecting ammonia disturbances in the biogas system
Boers, D., Chapleur, O., Andersson, A. F., & Schnürer, A. (2026) · FEMS Microbiology Ecology · doi:10.1093/femsec/fiag029 · Cited by 1
Toward a More Accurate Notion of Exploratory Research (And Why It Matters)
Feest, U., & Devezer, B. (2026) · Springer eBooks · doi:10.1007/978-3-032-01453-5_3 · Cited by 1
Is Banning Significance Testing the Best Way to Improve Applied Social Science Research? – Questions on
Spreckelsen, T. F., & van der Horst, M. (2016) · Sociological Research Online · doi:10.5153/sro.4076 · Cited by 1

Authors: Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A.
Affiliations: University of Amsterdam (NL)
ORCID: Wagenmakers, Eric-Jan
Borsboom, Denny
van der Maas, Han L. J.
Kievit, Rogier A.
Venue: Perspectives on Psychological Science
Publisher: SAGE Publications
Published: 2012-11
Volume: 7
Issue: 6
Pages: 632-638
ISSN: 1745-6916 (ISSN-L)
1745-6924
DOI: 10.1177/1745691612463078
OpenAlex: W2123263696
Cited by: 1,042
References: 48
Citations by year: 2026: 57 · 2025: 41 · 2024: 65 · 2023: 85 · 2022: 102 · 2021: 108 · 2020: 114 · 2019: 98 · 2018: 88 · 2017: 86 · 2016: 75 · 2015: 51 · 2014: 43 · 2013: 28 · 2012: 1
FWCI: 44.75
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Perspectives on Psychological Science (publishedVersion)
PubMed (publishedVersion)
UvA-DARE (University of Amsterdam) (publishedVersion)
UvA-DARE (University of Amsterdam) (submittedVersion)
Data Archiving and Networked Services (DANS) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Keywords: preregistration, confirmatory analysis, exploratory analysis, data snooping, statistical validity, research integrity, extrasensory perception, replication, hypothesis testing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

An Agenda for Purely Confirmatory Research

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks