Cited by 1,042Meta-analysis and systematic reviewsPsychology Research and BibliometricsStatistical Methods and Bayesian Inference

The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.

An Agenda for Purely Confirmatory Research

Wagenmakers, Eric-Jan, Wetzels, Ruud, Borsboom, Denny, van der Maas, Han L. J., Kievit, Rogier A.·2012·Perspectives on Psychological Science

DOI 10.1177/1745691612463078

Open this paper in CoChat — free account

Abstract

The veracity of substantive research claims hinges on the way experimental data are collected and analyzed. In this article, we discuss an uncomfortable fact that threatens the core of psychology's academic enterprise: almost without exception, psychologists do not commit themselves to a method of data analysis before they see the actual data. It then becomes tempting to fine tune the analysis to the data in order to obtain a desired result-a procedure that invalidates the interpretation of the common statistical tests. The extent of the fine tuning varies widely across experiments and experimenters but is almost impossible for reviewers and readers to gauge. To remedy the situation, we propose that researchers preregister their studies and indicate in advance the analyses they intend to conduct. Only these analyses deserve the label "confirmatory," and only for these analyses are the common statistical tests valid. Other analyses can be carried out but these should be labeled "exploratory." We illustrate our proposal with a confirmatory replication attempt of a study on extrasensory perception.

Integrity signals

Registry

Crossref · 10.1177/1745691612463078

Cites

49 of 49 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Bayes factors
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Journal of personality and social psychology
Armstrong, J. (1988) · International Journal of Forecasting · doi:10.1016/0169-2070(88)90126-4 · Cited by 10,544
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267
False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Wildlife Society Bulletin
Wildlife Society (2011) · Wildlife Society Bulletin · doi:10.1002/(issn)1938-5463a · Cited by 5,571
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“confirmatory experiments, wonky statistics, ESP, Bayesian hypothesis test Several years ago, Ioannidis (2005) famously argued that “most published research findings are false.””
Journal of the American Statistical Association
Fildes, R. A. (1989) · International Journal of Forecasting · doi:10.1016/0169-2070(89)90106-4 · Cited by 3,956
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1×
“And indeed, recent results from biomedical and cancer research suggest that replication rates are lower than 50%, with some as low as 11% (Begley & Ellis, 2012; Osherovich, 2011; Prinz, Schlange, & Asadullah, 2011).”
Result

Show all 48 references

Research works printed but not linked: 4

Feynman R. P., 1974, Engineering & Science, 37, 10
Goldacre B., 2009, Bad science
Jeffreys H., 1961, Theory of probability
Roediger H. L., 2012, APS Observer, 25, 9

Sorted by citations

Items 301–400 of 998

Can the use of minipublics backfire? Examining how policy adoption shapes the effect of minipublics on political support among the general public
van Dijk, L., & Lefevere, J. (2022) · European Journal of Political Research · doi:10.1111/1475-6765.12523 · Cited by 37
How many participants do I need to test an interaction? Conducting an appropriate power analysis and achieving sufficient power to detect an interaction
Sommet, N., Weissman, D. L., Cheutin, N., & Elliot, A. (2022) · doi:10.31219/osf.io/xhe3u · Cited by 36
Over‐optimism in benchmark studies and the multiplicity of design and analysis options when interpreting their results
Niessl, C., Herrmann, M., Wiedemann, C., Casalicchio, G., & Boulesteix, A.-L. (2021) · WIREs Data Mining Knowl. Discov. · doi:10.1002/widm.1441 · Cited by 47
Data-dredging bias
Erasmus, A., Holman, B., & Ioannidis, J. P. A. (2021) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2020-111584 · Cited by 38
An Evaluation of Four Solutions to the Forking Paths Problem: Adjusted Alpha, Preregistration, Sensitivity Analyses, and Abandoning the Neyman-Pearson Approach
Rubin, M. (2017) · Review of General Psychology · doi:10.1037/gpr0000135 · Cited by 32
(When and how) does basic research in clinical psychology lead to more effective psychological treatment for mental disorders?
Ehring, T. W., Limburg, K., Kunze, A. E., Wittekind, C. E., Werner, G. G., Wolkenstein, L., Guzey, M., & Cludius, B. (2022) · Clinical Psychology Review · doi:10.1016/j.cpr.2022.102163 · Cited by 43
The affective, behavioural and cognitive outcomes of agile project management: A preliminary meta‐analysis
Koch, J., Drazic, I., & Schermuly, C. C. (2023) · Journal of Occupational and Organizational Psychology · doi:10.1111/joop.12429 · Cited by 46
How can preregistration contribute to research in our field?
Jonas, K. J., & Cesario, J. (2015) · Comprehensive Results in Social Psychology · doi:10.1080/23743603.2015.1070611 · Cited by 38
A practical guide for transparency in psychological sciencePreprint
Klein, O., Hardwicke, T. E., Aust, F., Breuer, J., Danielsson, H., Mohr, A. H., IJzerman, H., Nilsonne, G., Vanpaemel, W., & Frank, M. C. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/rtygm · Cited by 46
From theories to models to predictions: A Bayesian model comparison approach
Rouder, J. N., Haaf, J. M., & Aust, F. (2017) · Communication Monographs · doi:10.1080/03637751.2017.1394581 · Cited by 35
Replicability of sight word training and phonics training in poor readers: a randomised controlled trial
McArthur, G. M., Kohnen, S., Jones, K., Eve, P., Banales, E., Larsen, L., & Castles, A. E. (2015) · PeerJ · doi:10.7717/peerj.922 · Cited by 35
Robust Standards in Cognitive Science
Crüwell, S., Stefan, A. M., & Evans, N. J. (2019) · Computational Brain & Behavior · doi:10.1007/s42113-019-00049-8 · Cited by 35
The contribution of individual differences in statistical learning to reading and spelling performance in children with and without dyslexia
van Witteloostuijn, M., Boersma, P., Wijnen, F. N. K., & Rispens, J. (2021) · Dyslexia · doi:10.1002/dys.1678 · Cited by 35
Transparent, Open, and Reproducible Prevention Science
Grant, S., Wendt, K. E., Leadbeater, B. J. R., Supplee, L. H., Mayo‐Wilson, E., Gardner, F. E. M., & Bradshaw, C. P. (2022) · Prevention Science · doi:10.1007/s11121-022-01336-w · Cited by 42
Practical tools and strategies for researchers to increase replicability
Nuijten, M. B. (2018) · Developmental Medicine & Child Neurology · doi:10.1111/dmcn.14054 · Cited by 39
Does the conclusion follow from the evidence? Recommendations for improving research
Hales, A. H. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.09.011 · Cited by 54
Raising the value of research studies in psychological science by increasing the credibility of research reports: the transparent Psi project
Kekecs, Z., Pálfi, B., Szászi, B., Szécsi, P., Zrubka, M., Kovács, M., Bakos, B. E., Cousineau, D., Tressoldi, P. E., Schmidt, K., et al. (2023) · Royal Society Open Science · doi:10.1098/rsos.191375 · Cited by 63
Recommendations in pre-registrations and internal review board proposals promote formal power analyses but do not increase sample size
Bakker, M., Veldkamp, C. L. S., van den Akker, O. R., van Assen, M. A. L. M., Crompvoets, E. A. V., Ong, H. H., & Wicherts, J. M. (2020) · PLoS ONE · doi:10.1371/journal.pone.0236079 · Cited by 39
Subpopulations of Addictive Behaviors in Different Sample Types and Their Relationships with Gender, Personality, and Well-Being: Latent Profile vs. Latent Class Analysis
Atroszko, P. A., Atroszko, B., & Charzyńska, E. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18168590 · Cited by 36
Selective Hypothesis Reporting in Psychology: Comparing Preregistrations and Corresponding Publications
van den Akker, O. R., van Assen, M. A. L. M., Enting, M., de Jonge, M., Ong, H. H., Rüffer, F. F., Schoenmakers, M., Stoevenbelt, A. H., Wicherts, J. M., & Bakker, M. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231187988 · Cited by 45
Big Little Lies: A Compendium and Simulation of p-Hacking StrategiesPreprint
Stefan, A. M., & Schönbrodt, F. D. (2022) · doi:10.31234/osf.io/xy2dk · Cited by 35
Options for Prospective Meta-Analysis and Introduction of Registration-Based Prospective Meta-Analysis
Watt, C. A., & Kennedy, J. E. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2016.02030 · Cited by 38
Negative affect is unrelated to fluctuations in hormone levels across the menstrual cycle: Evidence from a multisite observational study across two successive cycles
Hengartner, M. P., Krüger, T. H. C., Geraedts, K., Tronci, E., Mancini, T., Ille, F., Egli, M., Röblitz, S., Ehrig, R. M., Saleh, L., et al. (2017) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2017.05.018 · Cited by 36
Towards Bayesian Model-Based Demography
Bijak, J. (2021) · Methodos series · doi:10.1007/978-3-030-83039-7 · Cited by 35
Regulate me! Self-control dissatisfaction in meat reduction success relates to stronger support for behavior-regulating policy
Kukowski, C. A., Bernecker, K., Nielsen, K. S., Hofmann, W., & Brandstätter, V. (2022) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2022.101922 · Cited by 33
Using preregistration as a tool for transparent fNIRS study design
Schroeder, P. A., Artemenko, C., Kosie, J. E., Cockx, H., Stute, K., Pereira, J., Klein, F., & Mehler, D. M. A. (2023) · Neurophotonics · doi:10.1117/1.nph.10.2.023515 · Cited by 36
Registered report: Survey on attitudes and experiences regarding preregistration in psychological research
Spitzer, L., & Mueller, S. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281086 · Cited by 43
Vegetarians’ and omnivores’ affective and physiological responses to images of food
Anderson, E., Wormwood, J. B., Barrett, L. F., & Quigley, K. S. (2018) · Food Quality and Preference · doi:10.1016/j.foodqual.2018.06.008 · Cited by 36
Why Too Many Political Science Findings Cannot Be Trusted and What We Can Do About It: A Review of Meta-Scientific Research and a Call for Academic Reform
Wuttke, A. (2018) · Politische Vierteljahresschrift · doi:10.1007/s11615-018-0131-7 · Cited by 37
Sample size estimation revisited
Abt, G., Boreham, C. A., Davison, G. W., Jackson, R. C., Jobson, S., Wallace, E. S., & Williams, M. R. F. (2025) · Journal of Sports Sciences · doi:10.1080/02640414.2025.2499403 · Cited by 42
Flexibility in reaction time analysis: many roads to a false positive?
Fernández, L. M., & Vadillo, M. A. (2020) · Royal Society Open Science · doi:10.1098/rsos.190831 · Cited by 38
A Hierarchical Watershed Model of Fluid Intelligence in Childhood and Adolescence
Fuhrmann, D., Simpson-Kent, I. L., Bathelt, J., The CALM Team, Kievit, R., Holmes, J., Gathercole, S. E., Astle, D. E., Manly, T., & Kievit, R. (2019) · Cerebral Cortex · doi:10.1093/cercor/bhz091 · Cited by 37
Self-citation
When and how assessment matters: An update on the Treatment Utility of Clinical Assessment (TUCA).
Kamphuis, J. H., Noordhof, A., & Hopwood, C. J. (2020) · Psychological Assessment · doi:10.1037/pas0000966 · Cited by 34
Five Common Mistakes for Using Partial Least Squares Path Modeling (PLS-PM) in Management Research
Afthanorhan, A., Awang, Z., & Aimran, N. (2020) · Contemporary Management Research · doi:10.7903/cmr.20247 · Cited by 38
The long and the short of priming in visual search
Kruijne, W., & Meeter, M. (2015) · Attention Perception & Psychophysics · doi:10.3758/s13414-015-0860-2 · Cited by 33
Writing Empirical Articles: Transparency, Reproducibility, Clarity, and Memorability
Gernsbacher, M. A. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918754485 · Cited by 39
Auditory statistical learning in children: Novel insights from an online measure
Lammertink, I. L., van Witteloostuijn, M., Boersma, P., Wijnen, F. N. K., & Rispens, J. (2018) · Applied Psycholinguistics · doi:10.1017/s0142716418000577 · Cited by 31
Minimizing Mistakes in Psychological Science
Rouder, J. N., Haaf, J. M., & Snyder, H. K. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918801915 · Cited by 32
Multidimensional Signals and Analytic Flexibility: Estimating Degrees of Freedom in Human-Speech Analyses
Coretta, S., Casillas, J. V., Roessig, S., Franke, M., Ahn, B., Al‐Hoorie, A. H., Al‐Tamimi, J., Alotaibi, N. E., AlShakhori, M. K., Altmiller, R. M., et al. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231162567 · Cited by 52
Iterating on a single model is a viable alternative to multimodel inference
Hoef, J. M. V., & Boveng, P. L. (2015) · Journal of Wildlife Management · doi:10.1002/jwmg.891 · Cited by 31
It’s All About Timing: Exploring Different Temporal Resolutions for Analyzing Digital-Phenotyping Data
Langener, A. M., Stulp, G., Jacobson, N. C., Costanzo, A., Jagesar, R. R., Kas, M. J., & Bringmann, L. F. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231202677 · Cited by 38
Psychology’s Replication Crisis as Scientific Opportunity: A Précis for Policymakers
Rodgers, J. L., & Shrout, P. E. (2017) · Policy Insights from the Behavioral and Brain Sciences · doi:10.1177/2372732217749254 · Cited by 35
Disappearing dissociations in experimental psychology: Using state-trace analysis to test for multiple processes
Stephens, R. G., Matzke, D., & Hayes, B. K. (2018) · Journal of Mathematical Psychology · doi:10.1016/j.jmp.2018.11.003 · Cited by 31
The Garden of Forking Paths in Visualization: A Design Space for Reliable Exploratory Visual Analytics : Position Paper
Pu, X., & Kay, M. (2018) · IEEE Evaluation and Beyond - Methodological Approaches for Visualization (BELIV) · doi:10.1109/beliv.2018.8634103 · Cited by 31
Reading Your Emotions in My Physiology? Reliable Emotion Interpretations in Absence of a Robust Physiological Resonance
Folz, J., Fiacchino, D., Nikolić, M., van Steenbergen, H., & Kret, M. E. (2022) · Affective Science · doi:10.1007/s42761-021-00083-5 · Cited by 31
How the Complexity of Psychological Processes Reframes the Issue of Reproducibility in Psychological Science
Gernigon, C., Hartigh, R. J. R. D., Vallacher, R. R., & van Geert, P. L. C. (2023) · Perspectives on Psychological Science · doi:10.1177/17456916231187324 · Cited by 35
Oscillatory brain activity during acute exercise: Tonic and transient neural response to an oddball task
Ciria, L. F., Luque‐Casado, A., Sanabria, D., Holgado, D., Ivanov, P. C., & Perakakis, P. (2019) · Psychophysiology · doi:10.1111/psyp.13326 · Cited by 32
Evaluating Registered Reports: A Naturalistic Comparative Study of Article Impact
Hopun, L. T., Singleton Thorn, F., Nosek, B. A., & Errington, T. M. (2017) · doi:10.31219/osf.io/5y8w7 · Cited by 29
Pursuing quality learning experiences for young children through learning in play: how do children perceive play?
Keung, C. P. C., & Fung, C. K. H. (2019) · Early Child Development and Care · doi:10.1080/03004430.2019.1633313 · Cited by 39
Preregistration in infant research—A primer
Havron, N., Bergmann, C., & Tsuji, S. (2020) · Infancy · doi:10.1111/infa.12353 · Cited by 28
Do Open-Science Badges Increase Trust in Scientists Among Undergraduates, Scientists, and the Public?
Schneider, J. M., Rosman, T., Kelava, A., & Merk, S. (2022) · Psychological Science · doi:10.1177/09567976221097499 · Cited by 46
From Discovery to Justification: Outline of an Ideal Research Program in Empirical Psychology
Witte, E. H., & Zenker, F. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01847 · Cited by 31
Zur Methodologie von Replikationsstudien
Erdfelder, E., & Ulrich, R. (2018) · Psychologische Rundschau · doi:10.1026/0033-3042/a000387 · Cited by 33
Teaching Good Research Practices: Protocol of a Research Master Course
Sarafoglou, A., Hoogeveen, S., Matzke, D., & Wagenmakers, E. (2019) · Psychology Learning & Teaching · doi:10.1177/1475725719858807 · Cited by 35
Self-citation
Pre-registration and Results-Free Review in Observational and Qualitative Research
Jacobs, A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.009 · Cited by 30
The Ethics of Security Research: An Ethics Framework for Contemporary Security Studies
Baele, S. J., Lewis, D. G., Hoeffler, A., Sterck, O. C., & Slingeneyer, T. (2017) · International Studies Perspectives · doi:10.1093/isp/ekx003 · Cited by 28
‘Grandpa, Do you like Roller Coasters?’: Identifying Age–Appropriate Personality Indicators
Olaru, G., Schroeders, U., Wilhelm, O., & Ostendorf, F. (2019) · European Journal of Personality · doi:10.1002/per.2185 · Cited by 28
Questionable Metascience Practices
Rubin, M. (2023) · Journal of Trial and Error · doi:10.36850/mr4 · Cited by 40
The Epistemic Importance of Establishing the Absence of an Effect
Fidler, F. M., Thorn, F. S., Barnett, A., Kambouris, S., & Kruger, A. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918770407 · Cited by 32
The Science of Technology and Human Behavior
Elson, M., & Przybylski, A. K. (2017) · Journal of Media Psychology Theories Methods and Applications · doi:10.1027/1864-1105/a000212 · Cited by 27
Smart but Evil? Student-Teachers’ Perception of Educational Researchers’ Epistemic Trustworthiness
Merk, S., & Rosman, T. (2019) · AERA Open · doi:10.1177/2332858419868158 · Cited by 28
Evaluation of inequality constrained hypotheses using a generalization of the AIC.
Altinisik, Y., Lissa, C. J. V., Hoijtink, H., Oldehinkel, A. J., & Kuiper, R. M. (2021) · Psychological Methods · doi:10.1037/met0000406 · Cited by 28
The Influence of Direct and Indirect Speech on Mental Representations
Eerland, A., Engelen, J. A. A., & Zwaan, R. A. (2013) · PLoS ONE · doi:10.1371/journal.pone.0065480 · Cited by 31
The daily association between affect and alcohol use: A meta-analysis of individual participant dataPreprint
Dora, J., Piccirillo, M., Foster, K. T., Arbeau, K. J., Armeli, S., Auriacombe, M., Bartholow, B., Beltz, A., Blumenstock, S. M., Bold, K., et al. (2022) · Psychological bulletin · doi:10.31234/osf.io/xevct · Cited by 117
The process of replication target selection in psychology: what to consider?
Pittelkow, M.-M., Field, S. M., Isager, P. M., Veer, A. V. '., Anderson, T., Cole, S. N., Dominik, T., Giner‐Sorolla, R., Gök, S., Heyman, T., et al. (2023) · Royal Society Open Science · doi:10.1098/rsos.210586 · Cited by 33
Are Associations Between “Sexist” Video Games and Decreased Empathy Toward Women Robust? A Reanalysis of Gabbiadini et al. 2016
Ferguson, C. J., & Donnellan, M. B. (2017) · Journal of Youth and Adolescence · doi:10.1007/s10964-017-0700-x · Cited by 27
Keep Degrowth or go Rebirth? Regulatory focus theory and the support for a sustainable downscaling of production and consumption
Krpan, D., & Bassó, F. (2021) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2021.101586 · Cited by 30
Preregistration in diverse contexts: a preregistration template for the application of cognitive models
Crüwell, S., & Evans, N. J. (2021) · Royal Society Open Science · doi:10.1098/rsos.210155 · Cited by 28
Assessing and Improving Robustness of Psychological Research Findings in Four Steps
Nuijten, M. B. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_17 · Cited by 26
Information leakage in the Response Time‐Based Concealed Information Test
Lukács, G., & Ulrich Ansorge, A. (2019) · Applied Cognitive Psychology · doi:10.1002/acp.3565 · Cited by 26
Open Science
Spellman, B. A., Gilbert, E. A., & Corker, K. S. (2018) · Wiley eBooks · doi:10.1002/9781119170174.epcn519 · Cited by 88
Exploratory analyses in aetiologic research and considerations for assessment of credibility: mini-review of literature
Luijken, K., Dekkers, O. M., Rosendaal, F. R., & Groenwold, R. H. H. (2022) · BMJ · doi:10.1136/bmj-2021-070113 · Cited by 28
Appraising reconsolidation theory and its empirical validation
Schroyens, N., Beckers, T., & Luyten, L. (2022) · Psychonomic Bulletin & Review · doi:10.3758/s13423-022-02173-2 · Cited by 36
Means to valuable exploration: I. The blending of confirmation and exploration and how to resolve it
Höfler, M., Scherbaum, S., Kanske, P., McDonald, B., & Miller, R. (2022) · Meta-Psychology · doi:10.15626/mp.2021.2837 · Cited by 32
The influence of professional development in gifted education on the frequency of instructional practices
Peters, S. J., & Jolly, J. L. (2018) · The Australian Educational Researcher · doi:10.1007/s13384-018-0260-4 · Cited by 25
Pre-Registration in Social Psychology—a Discussion and Suggested TemplatePreprint
Veer, A. V. '., & Giner‐Sorolla, R. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/4frms · Cited by 31
Examining Psychological Science Through Systematic Meta-Method Analysis: A Call for Research
Elson, M. (2019) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245919863296 · Cited by 25
Sorting the File Drawer: A Typology for Describing Unpublished Studies
Lishner, D. A. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620979831 · Cited by 24
Informed Bayesian survival analysis
Bartos̆, F., Aust, F., & Haaf, J. M. (2022) · BMC Medical Research Methodology · doi:10.1186/s12874-022-01676-9 · Cited by 30
Type I Error Rates are Not Usually Inflated
Rubin, M. (2024) · Journal of Trial and Error · doi:10.36850/4d35-44bd · Cited by 30
Using Bayes Factors to Test Hypotheses in Developmental Research
Williams, M. N., Bååth, R. A., & Philipp, M. C. (2017) · Research in Human Development · doi:10.1080/15427609.2017.1370964 · Cited by 23
In Search Of True Things Worth Knowing: Considerations For A New Article Prototype
Tullett, A. M. (2015) · Social and Personality Psychology Compass · doi:10.1111/spc3.12166 · Cited by 24
Replication Study: Biomechanical remodeling of the microenvironment by stromal caveolin-1 favors tumor invasion and metastasis
Sheen, M. R., Fields, J. L., Northan, B., Lacoste, J., Ang, L., Fiering, S., Reproducibility Project: Cancer Biology, Iorns, E. J., Tsui, R., Denis, A., et al. (2019) · eLife · doi:10.7554/elife.45120 · Cited by 24
The relationship between daily positive future thinking and past-week suicidal ideation in youth: An experience sampling study
Kirtley, O. J., Lafit, G., Vaessen, T., Decoster, J., Derom, C. A., Gülöksüz, S., Binder, M. D., Jacobs, N., Menne‐Lothmann, C., Rutten, B. P. F., et al. (2022) · Frontiers in Psychiatry · doi:10.3389/fpsyt.2022.915007 · Cited by 25
How preschoolers react to norm violations is associated with culture
Gampe, A., & Daum, M. M. (2017) · Journal of Experimental Child Psychology · doi:10.1016/j.jecp.2017.06.009 · Cited by 24
Analítica del aprendizaje y educación basada en datos: Un campo en expansión
Figaredo, D. D., Reich, J., & Ruipérez‐Valiente, J. A. (2020) · RIED Revista Iberoamericana de Educación a Distancia · doi:10.5944/ried.23.2.27105 · Cited by 23
Changing the logic of replication: A case from infant studies
Margoni, F., & Shepperd, M. (2020) · Infant Behavior and Development · doi:10.1016/j.infbeh.2020.101483 · Cited by 22
Degrees of freedom in planning, running, analyzing, and reporting psychological studies A checklist to avoid p-hackingPreprint
Wicherts, J. M., Veldkamp, C. L. S., Augusteijn, H. E. M., Bakker, M., van Aert, R. C. M., & van Assen, M. A. L. M. (2016) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/umq8d · Cited by 32
Practices and attitudes toward replication in empirical translation and interpreting studies
Olalla-Soler, C. (2019) · Target International Journal of Translation Studies · doi:10.1075/target.18159.ola · Cited by 24
Opening the Door to Registered Reports: Census of Journals Publishing Registered Reports (2013–2020)
Montoya, A. K., Krenzer, W. L. D., & Fossum, J. L. (2021) · Collabra Psychology · doi:10.1525/collabra.24404 · Cited by 25
Unknown Vocabulary Density and Reading Comprehension: Replicating Hu and Nation (2000)
Kremmel, B., Indrarathne, B., Kormos, J., & Suzuki, S. (2023) · Language Learning · doi:10.1111/lang.12622 · Cited by 39
Use of publication procedures to improve research integrity by addiction journals
Gorman, D. M. (2019) · Addiction · doi:10.1111/add.14604 · Cited by 23
Open exploration
Thompson, W. H., Wright, J., & Bissett, P. G. (2020) · eLife · doi:10.7554/elife.52157 · Cited by 22
Resilience-based interventions in the public sector workplace: a systematic review
Hollaar, M. H. L., Kemmere, B., Kocken, P., & Denktaş, S. (2025) · BMC Public Health · doi:10.1186/s12889-024-21177-2 · Cited by 49
Behavioral Priming 2.0: Enter a Dynamical Systems Perspective
Krpan, D. (2017) · Frontiers in Psychology · doi:10.3389/fpsyg.2017.01204 · Cited by 23
Improving Human Interaction Research through Ecological Grounding
Albert, S., & de Ruiter, J. P. (2018) · Collabra Psychology · doi:10.1525/collabra.132 · Cited by 23
The effect of alcohol hangover on choice response time
Grange, J. A., Stephens, R., Jones, K., & Owen, L. (2016) · Journal of Psychopharmacology · doi:10.1177/0269881116645299 · Cited by 21
Is There a General Factor of Spiritual Intelligence? Factorial Validity of the Polish Adaptation of Spiritual Intelligence Self-Report Inventory
Atroszko, P. A., Skrzypińska, K., & Balcerowska, J. M. (2021) · Journal of Religion and Health · doi:10.1007/s10943-021-01350-2 · Cited by 21
Predicting Lifetime Suicide Attempts in a Community Sample of Adolescents Using Machine Learning Algorithms
Jankowsky, K., Steger, D., & Schroeders, U. (2023) · Assessment · doi:10.1177/10731911231167490 · Cited by 28
Determinantes do voto no primeiro turno das eleições presidenciais brasileiras de 2010: uma análise exploratória
Nicolau, J. M. (2014) · Opinião Pública · doi:10.1590/1807-01912014203311 · Cited by 21

Authors: Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A.
Affiliations: University of Amsterdam (NL)
ORCID: Wagenmakers, Eric-Jan
Borsboom, Denny
van der Maas, Han L. J.
Kievit, Rogier A.
Venue: Perspectives on Psychological Science
Publisher: SAGE Publications
Published: 2012-11
Volume: 7
Issue: 6
Pages: 632-638
ISSN: 1745-6916 (ISSN-L)
1745-6924
DOI: 10.1177/1745691612463078
OpenAlex: W2123263696
Cited by: 1,042
References: 48
Citations by year: 2026: 57 · 2025: 41 · 2024: 65 · 2023: 85 · 2022: 102 · 2021: 108 · 2020: 114 · 2019: 98 · 2018: 88 · 2017: 86 · 2016: 75 · 2015: 51 · 2014: 43 · 2013: 28 · 2012: 1
FWCI: 44.75
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Perspectives on Psychological Science (publishedVersion)
PubMed (publishedVersion)
UvA-DARE (University of Amsterdam) (publishedVersion)
UvA-DARE (University of Amsterdam) (submittedVersion)
Data Archiving and Networked Services (DANS) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Keywords: preregistration, confirmatory analysis, exploratory analysis, data snooping, statistical validity, research integrity, extrasensory perception, replication, hypothesis testing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

An Agenda for Purely Confirmatory Research

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks