Cited by 1,042Meta-analysis and systematic reviewsPsychology Research and BibliometricsStatistical Methods and Bayesian Inference

The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.

An Agenda for Purely Confirmatory Research

Wagenmakers, Eric-Jan, Wetzels, Ruud, Borsboom, Denny, van der Maas, Han L. J., Kievit, Rogier A.·2012·Perspectives on Psychological Science

DOI 10.1177/1745691612463078

Open this paper in CoChat — free account

Abstract

The veracity of substantive research claims hinges on the way experimental data are collected and analyzed. In this article, we discuss an uncomfortable fact that threatens the core of psychology's academic enterprise: almost without exception, psychologists do not commit themselves to a method of data analysis before they see the actual data. It then becomes tempting to fine tune the analysis to the data in order to obtain a desired result-a procedure that invalidates the interpretation of the common statistical tests. The extent of the fine tuning varies widely across experiments and experimenters but is almost impossible for reviewers and readers to gauge. To remedy the situation, we propose that researchers preregister their studies and indicate in advance the analyses they intend to conduct. Only these analyses deserve the label "confirmatory," and only for these analyses are the common statistical tests valid. Other analyses can be carried out but these should be labeled "exploratory." We illustrate our proposal with a confirmatory replication attempt of a study on extrasensory perception.

Integrity signals

Registry

Crossref · 10.1177/1745691612463078

Cites

49 of 49 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Bayes factors
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Journal of personality and social psychology
Armstrong, J. (1988) · International Journal of Forecasting · doi:10.1016/0169-2070(88)90126-4 · Cited by 10,544
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267
False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Wildlife Society Bulletin
Wildlife Society (2011) · Wildlife Society Bulletin · doi:10.1002/(issn)1938-5463a · Cited by 5,571
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“confirmatory experiments, wonky statistics, ESP, Bayesian hypothesis test Several years ago, Ioannidis (2005) famously argued that “most published research findings are false.””
Journal of the American Statistical Association
Fildes, R. A. (1989) · International Journal of Forecasting · doi:10.1016/0169-2070(89)90106-4 · Cited by 3,956
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1×
“And indeed, recent results from biomedical and cancer research suggest that replication rates are lower than 50%, with some as low as 11% (Begley & Ellis, 2012; Osherovich, 2011; Prinz, Schlange, & Asadullah, 2011).”
Result

Show all 48 references

Research works printed but not linked: 4

Feynman R. P., 1974, Engineering & Science, 37, 10
Goldacre B., 2009, Bad science
Jeffreys H., 1961, Theory of probability
Roediger H. L., 2012, APS Observer, 25, 9

Sorted by citations

Items 501–600 of 998

Forschungstransparenz als hohes wissenschaftliches Gut stärken
Schönbrodt, F. D., Maier, M., Heene, M., & Bühner, M. (2018) · Psychologische Rundschau · doi:10.1026/0033-3042/a000386 · Cited by 12
Do pride and shame track the evaluative psychology of audiences? Preregistered replications of Sznycer et al . (2016, 2017)
Cohen, A. S., Chun, R., & Sznycer, D. (2020) · Royal Society Open Science · doi:10.1098/rsos.191922 · Cited by 14
High impact nutrition and dietetics journals’ use of publication procedures to increase research transparency
Gorman, D. M., & Ferdinand, A. O. (2020) · Research Integrity and Peer Review · doi:10.1186/s41073-020-00098-9 · Cited by 12
Grammatical performance in children with dyslexia: the contributions of individual differences in phonological memory and statistical learning
van Witteloostuijn, M., Boersma, P., Wijnen, F. N. K., & Rispens, J. (2021) · Applied Psycholinguistics · doi:10.1017/s0142716421000102 · Cited by 12
To what extent do home numeracy practices and parental number talk relate to children's math skills? A pre-registered study in 5-year-old children
Girard, C., Longo, L., Chesnokova, H., Epinat‐Duclos, J., & Prado, J. (2023) · Learning and Individual Differences · doi:10.1016/j.lindif.2023.102328 · Cited by 12
Two Bayesian tests of the GLOMOsys Model.
Field, S. M., Wagenmakers, E., Newell, B. R., Zeelenberg, R., & van Ravenzwaaij, D. (2016) · Journal of Experimental Psychology General · doi:10.1037/xge0000067 · Cited by 11
Self-citation
Personality Traits and Psychopathology Over the Course of Six Months of Outpatient Psychotherapy: A Prospective Observational Study
Hengartner, M. P., von Wyl, A., Haldimann, B. H., & Yamanaka, M. (2020) · Frontiers in Psychology · doi:10.3389/fpsyg.2020.00174 · Cited by 11
Two kinds of theory: What psychology can learn from Einstein
McGann, M., & Speelman, C. P. (2020) · Theory & Psychology · doi:10.1177/0959354320937804 · Cited by 11
Four Internal Inconsistencies in Tversky and Kahneman’s (1992) Cumulative Prospect Theory Article: A Case Study in Ambiguous Theoretical Scope and Ambiguous Parsimony
Regenwetter, M., Robinson, M. M., & Wang, C. (2022) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459221074653 · Cited by 11
The Inner Workings of Registered Reports
Dienes, Z. P. (2024) · Cambridge University Press eBooks · doi:10.1017/9781009000796.015 · Cited by 11
Mind-Matter Interaction at a Distance of 190 km: Effects on a Random Event Generator Using a Cutoff Method
Tressoldi, P. E., Pederzoli, L., Caini, P., Ferrini, A., Melloni, S., Richeldi, D., Richeldi, F., & Duma, G. M. (2014) · NeuroQuantology · doi:10.14704/nq.2014.12.3.767 · Cited by 11
Human values and value instantiations : similarities and differences between countries and their implications
Hanel, P. H. P. (2016) · ORCA Online Research @Cardiff (Cardiff University) · Cited by 11
Outcome Reporting bias in Exercise Oncology trials (OREO): a cross-sectional studyPreprint
Singh, B., Fairman, C. M., Christensen, J. F., Bolam, K. A., Twomey, R., Nunan, D., & Lahart, I. M. (2021) · medRxiv · doi:10.1101/2021.03.12.21253378 · Cited by 13
“Technology and Human Behavior”
Elson, M., Przybylski, A. K., & Krämer, N. C. (2015) · Journal of Media Psychology Theories Methods and Applications · doi:10.1027/1864-1105/a000170 · Cited by 10
Synchrony and mental health: Investigating the negative association between interpersonal coordination and subclinical variation in autism and social anxiety
Macpherson, M. C., & Miles, L. K. (2022) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2022.104439 · Cited by 13
Evaluating the Pedagogical Effectiveness of Study Preregistration in the Undergraduate Dissertation
Pownall, M., Pennington, C. R., Norris, E., Juanchich, M., Smailes, D., Russell, P. S., Gooch, D., Evans, T. R., Persson, S., Mak, M. H., et al. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231202724 · Cited by 16
Nine quick tips for open meta-analyses
Moreau, D., & Wiebels, K. (2024) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1012252 · Cited by 11
Addressing the criticisms and critiques of positive psychology: recommendations for improving the science and practice of the field
Gaffaney, J., & Donaldson, S. I. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1548612 · Cited by 10
A framework for assessing the trustworthiness of scientific research findings
Nosek, B. A., Allison, D. B., Jamieson, K. H., Mcnutt, M. K., Nielsen, A. B., & Wolf, S. M. (2026) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2536736123 · Cited by 16
Paleoecology grand challenge
Biondi, F. (2014) · Frontiers in Ecology and Evolution · doi:10.3389/fevo.2014.00050 · Cited by 10
Power problems: n > 138
Bakker, M. (2015) · Cortex · doi:10.1016/j.cortex.2015.07.006 · Cited by 11
Bayesian mixture modeling of significant p values: A meta-analytic method to estimate the degree of contamination from H₀.
Gronau, Q. F., Duizer, M., Bakker, M., & Wagenmakers, E. (2017) · Journal of Experimental Psychology General · doi:10.1037/xge0000324 · Cited by 13
Self-citation
Exercise practice associates with different brain rhythmic patterns during vigilance
Luque‐Casado, A., Ciria, L. F., Sanabria, D., & Perakakis, P. (2020) · Physiology & Behavior · doi:10.1016/j.physbeh.2020.113033 · Cited by 9
Differences between decisions made using verbal or numerical quantifiers
Liu, D., Juanchich, M., Sirota, M., & Orbell, S. (2020) · Thinking and Reasoning · doi:10.1080/13546783.2020.1720813 · Cited by 12
The Role of Open Science Practices in Scaling Evidence-Based Prevention Programs
Supplee, L. H., Ammerman, R. T., DUGGAN, A. K., List, J. A., & Suskind, D. L. (2021) · Prevention Science · doi:10.1007/s11121-021-01322-8 · Cited by 13
Is the replication crisis a base-rate fallacy?
Autzen, B. (2021) · Metamedicine · doi:10.1007/s11017-022-09561-8 · Cited by 9
Attention Cueing in Rivalry: Insights from Pupillometry
Acquafredda, M., Binda, P., & Lunghi, C. (2022) · eNeuro · doi:10.1523/eneuro.0497-21.2022 · Cited by 11
Research practices and assessment of research misconduct
Hartgerink, C. H. J., & Wicherts, J. M. (2016) · ScienceOpen Research · doi:10.14293/s2199-1006.1.sor-socsci.arysbi.v1 · Cited by 10
Partial awareness can be induced by independent cognitive access to different spatial frequencies
Kim, C., & Chong, S. C. (2021) · Cognition · doi:10.1016/j.cognition.2021.104692 · Cited by 10
A Skeptical Eye on PsiPreprint
Wagenmakers, E., Wetzels, R., Borsboom, D., Kievit, R., & van der Maas, H. L. J. (2020) · doi:10.31234/osf.io/syq2h · Cited by 10
Self-citation
The New Psychology of Expert Witness ProcedurePreprint
Chin, J. M., Roque, M. S., & McFadden, R. (2020) · SSRN Electronic Journal · doi:10.2139/ssrn.3564796 · Cited by 10
Multidimensional signals and analytic flexibility: Estimating degrees of freedom in human speech analysesPreprint
Coretta, S., Casillas, J. V., & Roettger, T. B. (2022) · doi:10.31234/osf.io/q8t2k · Cited by 10
Medical decision making beyond evidence: Correlates of belief in complementary and alternative medicine (CAM) and homeopathy
Aßmann, L., & Betsch, T. (2023) · PLoS ONE · doi:10.1371/journal.pone.0284383 · Cited by 9
Profiles in the Teaching of Experimental Design and Analysis
Smucker, B. J., Stevens, N. T., Asscher, J., & Goos, P. (2023) · Journal of Statistics and Data Science Education · doi:10.1080/26939169.2023.2205907 · Cited by 10
Subtle Scientific Fallacies Undermine the Validity of Neuroendocrinological Research: Do Not Draw Premature Conclusions on the Role of Female Sex Hormones
Hengartner, M. P. (2017) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2017.00003 · Cited by 9
Transparent reporting of hypotheses and analyses in behavioral medicine research: an audit of publications in 2018 and 2008
McVay, M. A., Cooper, K. B., Seoane, M. C., Donahue, M. L., & Scherer, L. D. (2021) · Health Psychology and Behavioral Medicine · doi:10.1080/21642850.2021.1907186 · Cited by 7
A machine learning approach for the factorization of psychometric data with application to the Delis Kaplan Executive Function System
Camilleri, J. A., Eickhoff, S. B., Weis, S., Ji, C., Amunts, J., Sotiras, A., & Genon, S. (2021) · Scientific Reports · doi:10.1038/s41598-021-96342-3 · Cited by 9
Personal relative deprivation and pro-environmental intentions
Skylark, W. J., & Callan, M. J. (2021) · PLoS ONE · doi:10.1371/journal.pone.0259711 · Cited by 11
The trustworthiness of the cumulative knowledge in industrial/organizational psychology: The current state of affairs and a path forward
Keener, S. K., Kepes, S., & Torka, A. (2023) · Acta Psychologica · doi:10.1016/j.actpsy.2023.104005 · Cited by 12
Fairness Hacking: The Malicious Practice of Shrouding Unfairness in Algorithms
Meding, K., & Hagendorff, T. (2024) · Philosophy & Technology · doi:10.1007/s13347-023-00679-8 · Cited by 13
Math items about real-world content lower test-scores of students from families with low socioeconomic status
Muskens, M., Frankenhuis, W. E., & Borghans, L. (2024) · npj Science of Learning · doi:10.1038/s41539-024-00228-8 · Cited by 13
Some Data Indicating That Editors and Reviewers Do Not Check Preregistrations During the Review Process
Syed, M. (2025) · Journal of Trial and Error · doi:10.36850/e5ce-4cc5 · Cited by 20
Enabling Confirmatory Secondary Data Analysis by Logging Data Checkout
Scott, K. M., & Struhl, M. K. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918815849 · Cited by 13
A Plea for Preregistration in Personality Disorders Research: The Case of Psychopathy
Verschuère, B., Yasrebi, F., van Zelm, I., & Lilienfeld, S. O. (2019) · Journal of Personality Disorders · doi:10.1521/pedi_2019_33_426 · Cited by 10
Joy and rigor in behavioral science
Collins, H. K., Whillans, A. V., & John, L. K. (2021) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2021.03.002 · Cited by 9
Shedding light on functional near-infrared spectroscopy and open science practices
Kelsey, C. M., Taylor, J., Pirazzoli, L., Lorenzo, R. D., Sullivan, E., & Nelson, C. A. (2023) · Neurophotonics · doi:10.1117/1.nph.10.2.023520 · Cited by 10
Reforms in Academic Publishing: Should Behavioral Disorders and Special Education Journals Embrace Them?
Cook, B. G. (2016) · Behavioral Disorders · doi:10.17988/0198-7429-41.3.161 · Cited by 9
Die Vertrauenskrise empirischer Forschung in der Psychologie
Schweizer, G., & Furley, P. (2016) · Zeitschrift für Sportpsychologie · doi:10.1026/1612-5010/a000171 · Cited by 9
Coupling between mean blood pressure and EEG in preterm neonates is associated with reduced illness severity scores
Semenova, O., Lightbody, G., O’Toole, J. M., Boylan, G. B., Dempsey, E. M., & Temko, A. (2018) · PLoS ONE · doi:10.1371/journal.pone.0199587 · Cited by 9
Dealing with Distributional Assumptions in Preregistered Research
Williams, M. N., & Albers, C. J. (2019) · Meta-Psychology · doi:10.15626/mp.2018.1592 · Cited by 9
Charting the Constellation of Science Reform
Field, S. M. (2022) · Liberate Science GmbH eBooks · doi:10.53962/meeb-2ktd · Cited by 11
Are Speeded Tests Unfair? Modeling the Impact of Time Limits on the Gender Gap in Mathematics
Stoevenbelt, A. H., Wicherts, J. M., Flore, P. C., Phillips, L. A. T., Pietschnig, J., Verschuère, B., Voracek, M., & Schwabe, I. (2022) · Educational and Psychological Measurement · doi:10.1177/00131644221111076 · Cited by 11
Four Requirements for an Acceptable Research Program
Marsman, M., Ly, A., & Wagenmakers, E. (2016) · Basic and Applied Social Psychology · doi:10.1080/01973533.2016.1221349 · Cited by 8
Self-citation
Silent shapes and shapeless sounds: the robustness of the diminished crossmodal correspondences effect in autism spectrum conditions
Król, M. E., & Ferenc, K. (2019) · Psychological Research · doi:10.1007/s00426-019-01163-9 · Cited by 8
Pengaruh Fungsi Manajemen Koperasi Pondok Pesantren dan Etos Kerja Islami Terhadap Pembentukan Jiwa Wirausaha Santri di Pondok Pesantren Al-Qodiri Jember
Zainuri, Z., Mahardiyanto, A. M., & Rohmah, R. M. (2021) · e-Journal Ekonomi Bisnis dan Akuntansi · doi:10.19184/ejeba.v8i1.23215 · Cited by 8
Retrospective and prospective hindsight bias: Replications and extensions of Fischhoff (1975) and Slovic and Fischhoff (1977)
Chen, J., Kwan, C., Yeung, L. Y., Choi, H. Y., Lo, Y. C., Au, S. Y., Tsang, C. H., Cheng, B., & Feldman, G. (2021) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2021.104154 · Cited by 15
Assessing 36 Years of the Forced Choice Design in Extra Sensory Perception Research: A Meta-Analysis, 1987 to 2022
Storm, L., & Tressoldi, P. E. (2023) · Journal of Scientific Exploration · doi:10.31275/20232967 · Cited by 13
Die New Statistics in der Psychologie
Schäfer, T. (2018) · Zeitschrift für Entwicklungspsychologie und Pädagogische Psychologie · doi:10.1026/0049-8637/a000184 · Cited by 8
An Empirical Study of Downstream Analysis Effects of Model Pre-Processing Choices
Rudd, J., & Ray, H. G. (2020) · Open Journal of Statistics · doi:10.4236/ojs.2020.105046 · Cited by 8
Biasing the input: A yoked-scientist demonstration of the distorting effects of optional stopping on Bayesian inference
Anderson, R. B., Crawford, J. C., & Bailey, M. H. (2021) · Behavior Research Methods · doi:10.3758/s13428-021-01618-1 · Cited by 7
Intolerance of uncertainty and decisions about delayed, probabilistic rewards: A replication and extension of Luhmann, C. C., Ishida, K., & Hajcak, G. (2011)
Ciria, L. F., Quintero, M. J., López, F. J., Luque, D., Cobos, P. L., & Morís, J. (2021) · PLoS ONE · doi:10.1371/journal.pone.0256210 · Cited by 8
Open Science, Replicability, and Transparency in Modelling
Prike, T. (2021) · Methodos series · doi:10.1007/978-3-030-83039-7_10 · Cited by 12
Review of Four Preregistration Registries for Special Education Researchers
Fleming, J. I., McLucas, A. S., & Cook, B. G. (2023) · Remedial and Special Education · doi:10.1177/07419325231160293 · Cited by 12
Registered Report Protocol: Survey on attitudes and experiences regarding preregistration in psychological research
Spitzer, L., & Mueller, S. (2021) · PLoS ONE · doi:10.1371/journal.pone.0253950 · Cited by 7
Reply to Walker and Stickgold: Proposed boundary conditions on memory reconsolidation will require empirical verification
Hardwicke, T. E., & Shanks, D. R. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1608235113 · Cited by 8
Toward Transparent Reporting of Psychological Science
LeBel, E. P., & John, L. K. (2017) · doi:10.1002/9781119095910.ch5 · Cited by 8
Validating a Standardized Approach to the Taylor Aggression ParadigmPreprint
Chester, D. S., & Lasko, E. N. (2018) · doi:10.31234/osf.io/k24h8 · Cited by 13
The multiplicity of analysis strategies jeopardizes replicability: lessons learned across disciplinesPreprint
Hoffmann, S., Schönbrodt, F. D., Elsas, R., Wilson, R., Strasser, U., & Boulesteix, A. (2020) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/afb9p · Cited by 8
Charting the Constellation of Science Reform
Field, S. M. (2022) · University of Groningen research database (University of Groningen / Centre for Information Technology) · doi:10.33612/diss.229114775 · Cited by 23
Impact of redefining statistical significance on P-hacking and false positive rates: An agent-based model
Fitzpatrick, B. G., Gorman, D. M., & Trombatore, C. (2024) · PLoS ONE · doi:10.1371/journal.pone.0303262 · Cited by 7
Generalizability of choice architecture interventions
Szászi, B., Goldstein, D. G., Soman, D., & Michie, S. (2025) · Nature Reviews Psychology · doi:10.1038/s44159-025-00471-9 · Cited by 15
Pain vs. comfort diary: A fully remote app‐based experiment
Gruszka, P., Stammen, C., Bissantz, N., & Jensen, M. P. (2019) · European Journal of Pain · doi:10.1002/ejp.1446 · Cited by 6
Conditional Objectivism: A Strategy for Connecting the Social Sciences and Practical Decision-Making
Reber, R., & Bullot, N. J. (2019) · Theory and History in the Human and Social Sciences · doi:10.1007/978-3-030-33099-6_5 · Cited by 7
Positive Deviance Underlies Successful Science: Normative Methodologies Risk Throwing out the Baby With the Bathwater
Phaf, R. H. (2024) · Review of General Psychology · doi:10.1177/10892680241235120 · Cited by 8
Eye movement differences when recognising and learning moving and static faces
Butcher, N. L., Bennetts, R. J., Sexton, L., Barbanta, A., & Lander, K. (2024) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218241252145 · Cited by 8
Pupillometry indexes ocular dominance plasticity
Acquafredda, M., & Binda, P. (2024) · Vision Research · doi:10.1016/j.visres.2024.108449 · Cited by 7
Meta analytical structural equation modeling: comments on issues with current methods and viable alternatives
Yuan, K. (2016) · Research Synthesis Methods · doi:10.1002/jrsm.1213 · Cited by 7
Does it actually feel right? A replication attempt of the rounded price effect
Harms, C., Genau, H. A., Meschede, C., & Beauducel, A. (2018) · Royal Society Open Science · doi:10.1098/rsos.171127 · Cited by 10
The five factor model and infidelity: Beyond the broad domains
van Zyl, C. J. J. (2020) · Personality and Individual Differences · doi:10.1016/j.paid.2020.110553 · Cited by 11
Hits and misses in the last decade of open science: Researchers from different subfields and career stages offer personal reflections and suggestions
Beer, J. S., Eastwick, P. W., & Goh, J. X. (2023) · Social Psychological Bulletin · doi:10.32872/spb.9681 · Cited by 9
Brain-to-Brain (mind-to-mind) interaction at distance: a confirmatory study
Tressoldi, P. E., Pederzoli, L., Bilucaglia, M., Caini, P., Fedele, P., Ferrini, A., Melloni, S., Richeldi, D., Richeldi, F., & Accardo, A. (2014) · F1000Research · doi:10.12688/f1000research.4336.3 · Cited by 7
Making sense of the noise: Replication difficulties of Correll’s (2008) modulation of 1/f noise in a racial bias task
Madurski, C., & LeBel, E. P. (2014) · Psychonomic Bulletin & Review · doi:10.3758/s13423-014-0757-4 · Cited by 7
Simple and rationale-providing SMS reminders to promote accelerometer use: a within-trial randomised trial comparing persuasive messages
Heino, M. T. J., Knittle, K. P., Haukkala, A., Vasankari, T. J., & Hankonen, N. E. (2018) · BMC Public Health · doi:10.1186/s12889-018-6121-2 · Cited by 5
Educating students and future researchers about academic misconduct and questionable collaboration practices
Gladwin, T. E. (2018) · International Journal for Educational Integrity · doi:10.1007/s40979-018-0034-9 · Cited by 7
Designing for Preregistration
Pu, X., Zhu, L., Kay, M., & Conrad, F. G. (2019) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/3290607.3312862 · Cited by 8
Unburdening the Shoulders of Giants: A Quest for Disconnected Academic Psychology
Krpan, D. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691620904775 · Cited by 8
A Two-Stage Bayesian Sequential Assessment of Exploratory Hypotheses
Stefan, A. M., Lengersdorff, L., & Wagenmakers, E. (2022) · Collabra Psychology · doi:10.1525/collabra.40350 · Cited by 7
Self-citation
Personality, Psychopathology, and Psychotherapy: A Pre-specified Analysis Protocol for Confirmatory Research on Personality–Psychopathology Associations in Psychotherapy Outpatients
Hengartner, M. P., & Yamanaka, M. (2017) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2017.00009 · Cited by 7
Efficiently Exploring Multilevel Data with Recursive Partitioning
Martin, D. P. (2015) · doi:10.18130/v3ps0f · Cited by 7
Data from a pre-publication independent replication initiative examining ten moral judgement effects
Tierney, W., Schweinsberg, M., Jordan, J., Kennedy, D. M., Qureshi, I., Sommer, S. A., Thornley, N., Madan, N., Vianello, M., Awtrey, E. C., et al. (2016) · Scientific Data · doi:10.1038/sdata.2016.82 · Cited by 7
Self-citation
The Garden of Forking Paths in Visualization: A Design Space for Reliable Exploratory Visual AnalyticsPreprint
Pu, X., & Kay, M. (2018) · doi:10.31219/osf.io/4jbh2 · Cited by 7
Searching for replicable associations between cortical thickness and psychometric variables in healthy adults: empirical factsPreprint
Masouleh, S. K., Eickhoff, S. B., & Genon, S. (2020) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2020.01.10.901181 · Cited by 7
Reproducibility and Registration in Sexuality Research
Lorenz, T. K. (2020) · Archives of Sexual Behavior · doi:10.1007/s10508-020-01650-w · Cited by 7
Minimizing Mistakes In Psychological SciencePreprint
Rouder, J. N., Haaf, J. M., & Snyder, H. K. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/gxcy5 · Cited by 10
First impressions count: Therapists’ impression on patients’ motivation and helping alliance predicts psychotherapy dropout
Jankowsky, K., Zimmermann, J., Jaeger, U., Mestel, R., & Schroeders, U. (2024) · Psychotherapy Research · doi:10.1080/10503307.2024.2411985 · Cited by 7
Attitude to ambiguity as a predictor of analytic thinking
van Zyl, C. J. J. (2020) · South African Journal of Psychology · doi:10.1177/0081246320953715 · Cited by 7
Estimating and Testing Causal Mediation Effects in Single-Case Experimental Designs Using State-Space Modeling
Langenberg, B., Wurpts, I. C., Geuke, G. G. M., & Onghena, P. (2022) · Evaluation & the Health Professions · doi:10.1177/01632787211067533 · Cited by 7
Evaluating the effects of counterconditioning, novelty-facilitated, and standard extinction on the spontaneous recovery of threat expectancy and conditioned stimulus valence
Quintero, M. J., Morís, J., & López, F. J. (2023) · Quarterly Journal of Experimental Psychology · doi:10.1177/17470218231165373 · Cited by 8
Bayesian stopping
Douven, I. (2023) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2023.102794 · Cited by 7
Establishing driving simulator validity: drawbacks of null-hypothesis significance testing when compared to equivalence tests and Bayes factors
Himmels, C., Weigl, K., Riener, A., & Venrooij, J. (2023) · Theoretical Issues in Ergonomics Science · doi:10.1080/1463922x.2023.2286478 · Cited by 6

Authors: Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A.
Affiliations: University of Amsterdam (NL)
ORCID: Wagenmakers, Eric-Jan
Borsboom, Denny
van der Maas, Han L. J.
Kievit, Rogier A.
Venue: Perspectives on Psychological Science
Publisher: SAGE Publications
Published: 2012-11
Volume: 7
Issue: 6
Pages: 632-638
ISSN: 1745-6916 (ISSN-L)
1745-6924
DOI: 10.1177/1745691612463078
OpenAlex: W2123263696
Cited by: 1,042
References: 48
Citations by year: 2026: 57 · 2025: 41 · 2024: 65 · 2023: 85 · 2022: 102 · 2021: 108 · 2020: 114 · 2019: 98 · 2018: 88 · 2017: 86 · 2016: 75 · 2015: 51 · 2014: 43 · 2013: 28 · 2012: 1
FWCI: 44.75
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Perspectives on Psychological Science (publishedVersion)
PubMed (publishedVersion)
UvA-DARE (University of Amsterdam) (publishedVersion)
UvA-DARE (University of Amsterdam) (submittedVersion)
Data Archiving and Networked Services (DANS) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Keywords: preregistration, confirmatory analysis, exploratory analysis, data snooping, statistical validity, research integrity, extrasensory perception, replication, hypothesis testing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

An Agenda for Purely Confirmatory Research

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks