Cited by 1,042Meta-analysis and systematic reviewsPsychology Research and BibliometricsStatistical Methods and Bayesian Inference

The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.

An Agenda for Purely Confirmatory Research

Wagenmakers, Eric-Jan, Wetzels, Ruud, Borsboom, Denny, van der Maas, Han L. J., Kievit, Rogier A.·2012·Perspectives on Psychological Science

DOI 10.1177/1745691612463078

Open this paper in CoChat — free account

Abstract

The veracity of substantive research claims hinges on the way experimental data are collected and analyzed. In this article, we discuss an uncomfortable fact that threatens the core of psychology's academic enterprise: almost without exception, psychologists do not commit themselves to a method of data analysis before they see the actual data. It then becomes tempting to fine tune the analysis to the data in order to obtain a desired result-a procedure that invalidates the interpretation of the common statistical tests. The extent of the fine tuning varies widely across experiments and experimenters but is almost impossible for reviewers and readers to gauge. To remedy the situation, we propose that researchers preregister their studies and indicate in advance the analyses they intend to conduct. Only these analyses deserve the label "confirmatory," and only for these analyses are the common statistical tests valid. Other analyses can be carried out but these should be labeled "exploratory." We illustrate our proposal with a confirmatory replication attempt of a study on extrasensory perception.

Integrity signals

Registry

Crossref · 10.1177/1745691612463078

Cites

49 of 49 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Bayes factors
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Journal of personality and social psychology
Armstrong, J. (1988) · International Journal of Forecasting · doi:10.1016/0169-2070(88)90126-4 · Cited by 10,544
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267
False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Wildlife Society Bulletin
Wildlife Society (2011) · Wildlife Society Bulletin · doi:10.1002/(issn)1938-5463a · Cited by 5,571
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“confirmatory experiments, wonky statistics, ESP, Bayesian hypothesis test Several years ago, Ioannidis (2005) famously argued that “most published research findings are false.””
Journal of the American Statistical Association
Fildes, R. A. (1989) · International Journal of Forecasting · doi:10.1016/0169-2070(89)90106-4 · Cited by 3,956
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1×
“And indeed, recent results from biomedical and cancer research suggest that replication rates are lower than 50%, with some as low as 11% (Begley & Ellis, 2012; Osherovich, 2011; Prinz, Schlange, & Asadullah, 2011).”
Result

Show all 48 references

Research works printed but not linked: 4

Feynman R. P., 1974, Engineering & Science, 37, 10
Goldacre B., 2009, Bad science
Jeffreys H., 1961, Theory of probability
Roediger H. L., 2012, APS Observer, 25, 9

Sorted by citations

Items 401–500 of 998

A New Replication Norm for Psychology
LeBel, E. P. (2015) · Collabra · doi:10.1525/collabra.23 · Cited by 27
Implicit short- and long-term memory direct our gaze in visual search
Kruijne, W., & Meeter, M. (2016) · Attention Perception & Psychophysics · doi:10.3758/s13414-015-1021-3 · Cited by 22
Best-Practice Guidelines for Positive Psychological Intervention Research Design
van Zyl, L. E., Efendić, E., Rothmann, S., & Shankland, R. (2019) · Springer eBooks · doi:10.1007/978-3-030-20020-6_1 · Cited by 23
Advancing the Cognitive Science of Religion through Replication and Open Science
Hoogeveen, S., & van Elk, M. (2020) · Journal for the Cognitive Science of Religion · doi:10.1558/jcsr.39039 · Cited by 21
Faces and words are both associated and dissociated as evidenced by visual problems in dyslexia
Sigurdardottir, H. M., Arnardóttir, A., & Halldórsdóttir, E. Þ. (2021) · Scientific Reports · doi:10.1038/s41598-021-02440-7 · Cited by 20
The time it takes to truly know someone: Neurophysiological correlates of face and identity learning during the first two years
Popova, T., & Wiese, H. (2022) · Biological Psychology · doi:10.1016/j.biopsycho.2022.108312 · Cited by 22
Open developmental science: An overview and annotated reading list
Kalandadze, T., & Hart, S. A. (2022) · Infant and Child Development · doi:10.1002/icd.2334 · Cited by 23
Mapping the Universe of Registered ReportsPreprint
Hardwicke, T. E., & Ioannidis, J. P. A. (2018) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/fzpcy · Cited by 31
Registered Reports and Replications in Attention, Perception, & Psychophysics
(2013) · Attention Perception & Psychophysics · doi:10.3758/s13414-013-0502-5 · Cited by 20
Quantifying the Behavioural Relevance of Hippocampal Neurogenesis
Lazic, S. E., Fuß, J., & Gass, P. (2014) · PLoS ONE · doi:10.1371/journal.pone.0113855 · Cited by 20
False-Positive Effect in the Radin Double-Slit Experiment on Observer Consciousness as Determined With the Advanced Meta-Experimental Protocol
Walleczek, J., & von Stillfried, N. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.01891 · Cited by 22
Do p Values Lose Their Meaning in Exploratory Analyses? It Depends How You Define the Familywise Error RatePreprint
Rubin, M. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/gn8aq · Cited by 22
The costs of being consequentialist: Social inference from instrumental harm and impartial beneficencePreprint
Everett, J. A. C., Faber, N. S., Savulescu, J., & Crockett, M. J. (2017) · doi:10.31234/osf.io/a2kx6 · Cited by 20
No evidence for contextual cueing beyond explicit recognition
Meyen, S., Vadillo, M. A., Ulrike Von Luxburg, A., & Franz, V. H. (2023) · Psychonomic Bulletin & Review · doi:10.3758/s13423-023-02358-3 · Cited by 20
Researcher Degrees of Freedom in the Psychology of Religion
Charles, S. J., Bartlett, J. E., Messick, K. J., Coleman, T. J., III, & Uzdavines, A. (2019) · International Journal for the Psychology of Religion · doi:10.1080/10508619.2019.1660573 · Cited by 21
We should have seen this coming
Schwarzkopf, D. S. (2014) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2014.00332 · Cited by 23
Advancing Pharmacotherapy Development from Preclinical Animal Studies
Egli, M. (2018) · Handbook of experimental pharmacology · doi:10.1007/164_2017_85 · Cited by 19
A critique of using the labels confirmatory and exploratory in modern psychological research
Jacobucci, R. (2022) · Frontiers in Psychology · doi:10.3389/fpsyg.2022.1020770 · Cited by 24
The logical structure of experiments lays the foundation for a theory of reproducibility
Buzbas, E. O., Devezer, B., & Baumgaertner, B. O. (2023) · Royal Society Open Science · doi:10.1098/rsos.221042 · Cited by 22
Null Hypothesis Significance Testing Does Not Show Equivalence
Barchard, K. A. (2015) · Analyses of Social Issues and Public Policy · doi:10.1111/asap.12095 · Cited by 18
EJPA Introduces Registered Reports as New Submission Format
Greiff, S., & Allen, M. S. (2018) · European Journal of Psychological Assessment · doi:10.1027/1015-5759/a000492 · Cited by 18
Are Difficult-To-Study Populations too Difficult to Study in a Reliable Way?
Lange, F. (2019) · European Psychologist · doi:10.1027/1016-9040/a000384 · Cited by 19
Exploring Bayesian analyses of a small-sample-size factorial design in human systems integration: the effects of pilot incapacitation
Schmid, D., & Stanton, N. A. (2019) · Human-Intelligent Systems Integration · doi:10.1007/s42454-020-00012-0 · Cited by 19
Big secrets do not necessarily cause hills to appear steeper
LeBel, E. P., & Wilbur, C. J. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0549-2 · Cited by 18
Journal of neuroscience research policy on addressing sex as a biological variable: Comments, clarifications, and elaborations
Rippon, G., Jordan-Young, R. M., Kaiser, A., Joel, D., & Fine, C. (2017) · Journal of Neuroscience Research · doi:10.1002/jnr.24045 · Cited by 18
Back off! The effect of emotion on backward step initiation
Bouman, D., & Stins, J. F. (2017) · Human Movement Science · doi:10.1016/j.humov.2017.09.006 · Cited by 21
Grand Challenges for Personality and Social Psychology: Moving beyond the Replication Crisis
Bardi, A., & Zentner, M. R. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.02068 · Cited by 18
“Seeing What’s Left”: The Effect of Position of Transparent Windows on Product Evaluation
Simmonds, G., Woods, A. T., & Spence, C. (2018) · Foods · doi:10.3390/foods7090151 · Cited by 15
The effectiveness of preregistration in psychology: Assessing preregistration strictness and preregistration-study consistencyPreprint
van den Akker, O. R., Bakker, M., van Assen, M. A. L. M., Pennington, C. R., Verweij, L., Elsherif, M. M., Claesen, A., Gaillard, S. D. M., Yeung, S. K., Frankenberger, J.-L., et al. (2023) · doi:10.31222/osf.io/h8xjw · Cited by 18
Incentives and the replication crisis in social sciences: A critical review of open science practices
Balafoutas, L., Celse, J., Karakostas, A., & Umashev, N. (2024) · Journal of Behavioral and Experimental Economics · doi:10.1016/j.socec.2024.102327 · Cited by 22
Open Science: A Review of Its Effectiveness and Implications for Service Research
Vaerenbergh, Y. V., Hazée, S., & Zwienenberg, T. J. (2025) · Journal of Service Research · doi:10.1177/10946705251338461 · Cited by 21
An exploratory study of the relations between women miners' gender‐based workplace issues and their mental health and job satisfaction
Rubin, M., Subašić, E., Giacomini, A., & Паолини, С. (2017) · Journal of Applied Social Psychology · doi:10.1111/jasp.12448 · Cited by 17
A Bayesian Reanalysis of a Trial of Psilocybin Versus Escitalopram for Depression
Nayak, S. M., Bari, B. A., Yaden, D. B., Spriggs, M. J., Rosas, F. E., Peill, J. M., Giribaldi, B., Erritzøe, D., Nutt, D. J., & Carhart-Harris, R. L. (2022) · Psychedelic Medicine · doi:10.1089/psymed.2022.0002 · Cited by 19
Ten dos and don’ts of Character Strengths Research
Ruch, W., & Stahlmann, A. G. (2024) · International Journal of Applied Positive Psychology · doi:10.1007/s41042-024-00155-4 · Cited by 22
Is anxiety sensitivity a risk factor for, or complication of, alcohol misuse? A meta-analysis
Bartel, S. J., Sherry, S., Smith, M. M., Vidovic, V., & Stewart, S. H. (2018) · Personality and Individual Differences · doi:10.1016/j.paid.2018.07.031 · Cited by 17
Should Psychology Journals Adopt Specialized Statistical Review?
Hardwicke, T. E., Frank, M. C., Vazire, S., & Goodman, S. N. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919858428 · Cited by 20
Research practices and statistical reporting quality in 250 economic psychology master's theses: a meta-research investigation
Olsen, J., Mosen, J., Voracek, M., & Kirchler, E. M. (2019) · Royal Society Open Science · doi:10.1098/rsos.190738 · Cited by 14
Questionable Research Practices
O’Boyle, E. H., & Götz, M. (2022) · Oxford University Press eBooks · doi:10.1093/oso/9780190938550.003.0010 · Cited by 21
The mechanism of filler items in the response time concealed information test
Lukács, G., & Ulrich Ansorge, A. (2021) · Psychological Research · doi:10.1007/s00426-020-01432-y · Cited by 17
Assessing Visual Statistical Learning in Early-School-Aged Children: The Usefulness of an Online Reaction Time Measure
van Witteloostuijn, M., Lammertink, I. L., Boersma, P., Wijnen, F. N. K., & Rispens, J. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.02051 · Cited by 16
Bystander Intervention in Intimate Partner Violence: An Audio Vignette Study of Heterosexual, Gay, and Lesbian Dating Partners
Graham, K., LaChance, A. S., & Wormwood, J. B. (2022) · Journal of Interpersonal Violence · doi:10.1177/08862605221111412 · Cited by 16
Altered sensorimotor processing in irritable bowel syndrome: Evidence for a transdiagnostic pathomechanism in functional somatic disorders
Schröder, L., Regnath, F., Glasauer, S., Hackenberg, A. E. C., Hente, J. M., Weilenmann, S., Pohl, D., von Känel, R., & Lehnen, N. (2022) · Frontiers in Neuroscience · doi:10.3389/fnins.2022.1029126 · Cited by 23
Rich data, poor information? Teachers’ perceptions of mean differences in graphical feedback from statewide tests
Merk, S., Ophoff, J. G., & Kelava, A. (2022) · Learning and Instruction · doi:10.1016/j.learninstruc.2022.101717 · Cited by 20
Comparing Analysis Blinding With Preregistration in the Many-Analysts Religion Project
Sarafoglou, A., Hoogeveen, S., & Wagenmakers, E. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459221128319 · Cited by 16
Self-citation
A systematic review of null hypothesis significance testing, sample sizes, and statistical power in research using the Implicit Relational Assessment Procedure
Hussey, I. (2023) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2023.06.008 · Cited by 21
Examining the replicability of online experiments selected by a decision market
Holzmeister, F., Johannesson, M., Camerer, C. F., Chen, Y., Ho, T., Hoogeveen, S., Huber, J., Imai, N., Imai, T., Jin, L. J., et al. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-02062-9 · Cited by 20
Self-citation
Rewarding high-power replication research
Wagenmakers, E., & Forstmann, B. U. (2013) · Cortex · doi:10.1016/j.cortex.2013.09.010 · Cited by 16
Self-citation
The need for a formalised system of Quality Control for environmental policy-science
Larcombe, P., & Ridd, P. (2017) · Marine Pollution Bulletin · doi:10.1016/j.marpolbul.2017.11.038 · Cited by 16
Rigor and reproducibility for data analysis and design in the behavioral sciences
Hildebrandt, T., & Prenoveau, J. M. (2020) · Behaviour Research and Therapy · doi:10.1016/j.brat.2020.103552 · Cited by 17
Lessons from the first two years of operating a study registry
Watt, C. A., & Kennedy, J. E. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00173 · Cited by 20
Repeated failures to obtain selective directed forgetting in lab and online samples and variations in stimuli
Akan, M., & Sahakyan, L. (2017) · Memory · doi:10.1080/09658211.2017.1327600 · Cited by 16
Socially thermoregulated thinking: How past experiences matter in thinking about our loved ones
IJzerman, H., Neyroud, L., Courset, R., Schrama, M., Post, J., & Pronk, T. (2018) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2018.08.008 · Cited by 16
Maximizing the Reproducibility of Your ResearchPreprint
Bosco, F. A., Carp, J., Field, J. G., IJzerman, H., Lewis, M., Munafo, M. R., Nosek, B. A., Prenoveau, J. M., Spies, J. R., & Giner‐Sorolla, R. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/k9mn3_v1 · Cited by 16
What should a preregistration contain?Preprint
McPhetres, J. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/cj5mh · Cited by 16
A Tutorial on Analyzing Ecological Momentary Assessment Data in Psychological Research With Bayesian (Generalized) Mixed-Effects Models
Dora, J., McCabe, C. J., Lissa, C. J. V., Witkiewitz, K. A., & King, K. M. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459241235875 · Cited by 21
Broken windows, mediocre methods, and substandard statistics
Wicherts, J. M., & Bakker, M. (2013) · Group Processes & Intergroup Relations · doi:10.1177/1368430213502557 · Cited by 17
Hypothesis Testing Reconsidered
Francis, G. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108582995 · Cited by 15
Raiders of the lost HARK: a reproducible inference framework for big data science
Prosperi, M., Bian, J., Buchan, I. E., Koopman, J. S., Sperrin, M., & Wang, M. (2019) · Humanities and Social Sciences Communications · doi:10.1057/s41599-019-0340-8 · Cited by 17
The benefits of preregistration for hypothesis-driven bilingualism research
Mertzen, D., Lago, S., & Vasishth, S. (2021) · Bilingualism Language and Cognition · doi:10.1017/s1366728921000031 · Cited by 17
Eye Movements Enhance Recollection of Re-Imagined Negative Words: A Link between EMDR and Sire?
Phaf, R. H. (2017) · Journal of Experimental Psychopathology · doi:10.5127/jep.059916 · Cited by 15
Empirical facts from search for replicable associations between cortical thickness and psychometric variables in healthy adults
Masouleh, S. K., Eickhoff, S. B., Balajoo, S. M., Nicolaisen‐Sobesky, E., Thirion, B., & Genon, S. (2022) · Scientific Reports · doi:10.1038/s41598-022-17556-7 · Cited by 19
Vigilance performance during acute exercisePreprint
Sanabria, D., Etnier, J. L., González-Férnandez, F. T., & Zabala, M. (2019) · doi:10.31234/osf.io/jw27c · Cited by 15
Development and Validation of the Certainty About Mental States Questionnaire (CAMSQ): A Self-Report Measure of Mentalizing Oneself and OthersPreprint
Müller, S., Wendt, L. P., & Zimmermann, J. (2021) · doi:10.31234/osf.io/jtc3s · Cited by 15
Visual body form and orientation cues do not modulate visuo-tactile temporal integration
Smit, S., Rich, A. N., & Zopf, R. (2019) · PLoS ONE · doi:10.1371/journal.pone.0224174 · Cited by 14
Challenges to both reliability and validity of masculinity-preference measures in menstrual-cycle-effects research
Lewis, M. B. (2020) · Cognition · doi:10.1016/j.cognition.2020.104201 · Cited by 14
Making Research Data Accessible
Kapiszewski, D., & Karcher, S. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.008 · Cited by 15
Registration and primary outcome reporting in behavioral health trials
Taylor, N. J., & Gorman, D. M. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-021-01500-w · Cited by 18
Work Addiction
Atroszko, P. A. (2022) · Studies in neuroscience, psychology and behavioral economics · doi:10.1007/978-3-031-04772-5_9 · Cited by 14
Is Open Science Neoliberal?
Tunç, D. U., Tunç, M. N., & Eper, Z. B. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916221114835 · Cited by 18
Open Peer Commentary
Bakker, M., Cramer, A. O. J., Matzke, D., Kievit, R., van der Maas, H. L. J., Wagenmakers, E., & Borsboom, D. (2013) · European Journal of Personality · doi:10.1002/per.1920 · Cited by 13
Self-citation
Publishing Open, Reproducible Research With Undergraduates
Strand, J. F., & Brown, V. A. (2019) · Frontiers in Psychology · doi:10.3389/fpsyg.2019.00564 · Cited by 16
The Function of Literature in Psychological Science
Flis, I. (2022) · Review of General Psychology · doi:10.1177/10892680211066466 · Cited by 15
Integrating open science practices into recommendations for accepting gambling industry research funding
Louderback, E. R., Wohl, M. J. A., & LaPlante, D. A. (2020) · Addiction Research & Theory · doi:10.1080/16066359.2020.1767774 · Cited by 20
Raising the value of research studies in psychological science by increasing the credibility of research reports: The Transparent Psi Project - PreprintPreprint
Kekecs, Z., Pálfi, B., Szászi, B., Szécsi, P., Zrubka, M., Kovács, M., Bakos, B. E., Cousineau, D., Tressoldi, P. E., Schmidt, K., et al. (2019) · doi:10.31234/osf.io/uwk7y · Cited by 14
Long-term priming of visual search prevails against the passage of time and counteracting instructions.
Kruijne, W., & Meeter, M. (2016) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/xlm0000233 · Cited by 13
Do the effects of nonverbal behaviour on team outcome confidence in team sports depend on the availability of additional performance information?
Seiler, K., Schweizer, G., & Seiler, R. (2017) · Psychology of sport and exercise · doi:10.1016/j.psychsport.2017.12.007 · Cited by 13
Systematic reviews in engineering education: a catalyst for change
Power, J. (2021) · European Journal of Engineering Education · doi:10.1080/03043797.2021.1980770 · Cited by 12
Bayesian Testing of Scientific Expectations under Multivariate Normal Linear Models
Mulder, J., & Gu, X. (2021) · Multivariate Behavioral Research · doi:10.1080/00273171.2021.1904809 · Cited by 16
The structured interview's resistance to gender discrimination under cognitive load
Kith, S., Cassidy, S. A., & Powell, D. M. (2022) · International Journal of Selection and Assessment · doi:10.1111/ijsa.12361 · Cited by 17
Is comfort food really good for the soul? A replication of Troisi and Gabriel's (2011) Study 2
Ong, L. S., IJzerman, H., & Leung, A. K. ‐. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00314 · Cited by 14
On visualizing phonetic data from repeated measures experiments with multiple random effects
Politzer‐Ahles, S., & Piccinini, P. E. (2018) · Journal of Phonetics · doi:10.1016/j.wocn.2018.05.002 · Cited by 14
Computational optimization of associative learning experiments
Melinščak, F., & Bach, D. R. (2020) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1007593 · Cited by 15
Response Time Concealed Information Test on Smartphones
Lukács, G., Kleinberg, B., Kunzi, M., & Ulrich Ansorge, A. (2020) · Collabra Psychology · doi:10.1525/collabra.255 · Cited by 14
Improving evidence quality for organisational change management through open science
Evans, T. R. (2020) · Journal of Organizational Change Management · doi:10.1108/jocm-05-2019-0127 · Cited by 13
How Do We Choose Our Giants? Perceptions of Replicability in Psychological Science
Alister, M., Vickers-Jones, R., Sewell, D. K., & Ballard, T. (2021) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459211018199 · Cited by 15
“I Know Things They Don’t Know!” The Role of Need for Uniqueness in Belief in Conspiracy TheoriesPreprint
Lantian, A., Dominique Muller, B., Nurra, C., & Douglas, K. M. (2017) · doi:10.31234/osf.io/zm9a6 · Cited by 13
Maximizing the Reproducibility of Your Research
Open Science Collaboration (2017) · Wiley eBooks · doi:10.1002/9781119095910.ch1 · Cited by 15
A robust Bayesian test for identifying context effects in multiattribute decision-making
Katsimpokis, D., Fontanesi, L., & Rieskamp, J. (2022) · Psychonomic Bulletin & Review · doi:10.3758/s13423-022-02157-2 · Cited by 14
The use of alternative scenarios in assessing the reliability of victims’ statements
Arbiyah, N., Otgaar, H., Sauerland, M., Rassin, E., Maegherman, E., & Merckelbach, H. L. G. J. (2023) · Psychology Crime and Law · doi:10.1080/1068316x.2023.2236274 · Cited by 12
A dimensional approach to the neuronal correlates of anxiety, depression, and perfectionism: A transdiagnostic dissociation of error-related brain activity
Macedo, I., Pasion, R., Barbosa, F., & Ferreira‐Santos, F. (2021) · Behavioural Brain Research · doi:10.1016/j.bbr.2021.113271 · Cited by 12
Worked-out examples of the adequacy of Bayesian optional stopping
Tendeiro, J. N., Kiers, H. A. L., & van Ravenzwaaij, D. (2021) · Psychonomic Bulletin & Review · doi:10.3758/s13423-021-01962-5 · Cited by 12
Do Owners Know How Impulsive Their Dogs Are?
Stevens, J. R., Mathias, M., Herridge, M., Hughes-Duvall, K., Wolff, L., & Yohe, M. (2022) · Animal Behavior and Cognition · doi:10.26451/abc.09.03.02.2022 · Cited by 12
Model Specification Searches in Structural Equation Modeling Using Bee Swarm Optimization
Schroeders, U., Scharf, F., & Olaru, G. (2023) · Educational and Psychological Measurement · doi:10.1177/00131644231160552 · Cited by 12
Comparing the vibration of effects due to model, data pre-processing and sampling uncertainty on a large data set in personality psychology
Klau, S., Schönbrodt, F. D., Patel, C. J., Ioannidis, J. P. A., Boulesteix, A., & Hoffmann, S. (2023) · Meta-Psychology · doi:10.15626/mp.2020.2556 · Cited by 15
Do visual illusions affect grasping? Considerable progress in a scientific debate. A reply to Whitwell & Goodale, 2016
Kopiske, K. K., Bruno, N., Hesse, C., Schenk, T., & Franz, V. H. (2016) · Cortex · doi:10.1016/j.cortex.2016.10.012 · Cited by 12
Modelling the links between farm characteristics, respiratory health and pig production traits
Gray, H. E., Friel, M., Goold, C. M., Smith, R. P., Williamson, S. M., & Collins, L. (2021) · Scientific Reports · doi:10.1038/s41598-021-93027-9 · Cited by 12
Three Persistent Myths about Open Science
Syed, M. (2024) · Journal of Trial and Error · doi:10.36850/mr11 · Cited by 13
Strategic ambiguity in the social sciencesPreprint
Frankenhuis, W. E., Panchanathan, K., & Smaldino, P. E. (2022) · doi:10.31222/osf.io/kep5b · Cited by 12
Complex Systems and Sustainable Leadership: Enhancing Resilience and Sustainability of Community-Based Social Enterprises in Soweto, South Africa
Koech, R., & Venter, R. (2024) · Sustainability · doi:10.3390/su16198555 · Cited by 11
Addressing Reproducibility: Peer Review, Impact Factors, Checklists, Guidelines, and Reproducibility Initiatives
Williams, M. J., Mullane, K., & Curtis, M. J. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804725-5.00005-7 · Cited by 10

Authors: Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A.
Affiliations: University of Amsterdam (NL)
ORCID: Wagenmakers, Eric-Jan
Borsboom, Denny
van der Maas, Han L. J.
Kievit, Rogier A.
Venue: Perspectives on Psychological Science
Publisher: SAGE Publications
Published: 2012-11
Volume: 7
Issue: 6
Pages: 632-638
ISSN: 1745-6916 (ISSN-L)
1745-6924
DOI: 10.1177/1745691612463078
OpenAlex: W2123263696
Cited by: 1,042
References: 48
Citations by year: 2026: 57 · 2025: 41 · 2024: 65 · 2023: 85 · 2022: 102 · 2021: 108 · 2020: 114 · 2019: 98 · 2018: 88 · 2017: 86 · 2016: 75 · 2015: 51 · 2014: 43 · 2013: 28 · 2012: 1
FWCI: 44.75
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Perspectives on Psychological Science (publishedVersion)
PubMed (publishedVersion)
UvA-DARE (University of Amsterdam) (publishedVersion)
UvA-DARE (University of Amsterdam) (submittedVersion)
Data Archiving and Networked Services (DANS) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Keywords: preregistration, confirmatory analysis, exploratory analysis, data snooping, statistical validity, research integrity, extrasensory perception, replication, hypothesis testing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

An Agenda for Purely Confirmatory Research

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks