Cited by 1,042Meta-analysis and systematic reviewsPsychology Research and BibliometricsStatistical Methods and Bayesian Inference

The DOI matches its Crossref record; 49 of the 49 references it cites were found in a registry or an index.

An Agenda for Purely Confirmatory Research

Wagenmakers, Eric-Jan, Wetzels, Ruud, Borsboom, Denny, van der Maas, Han L. J., Kievit, Rogier A.·2012·Perspectives on Psychological Science

DOI 10.1177/1745691612463078

Open this paper in CoChat — free account

Abstract

The veracity of substantive research claims hinges on the way experimental data are collected and analyzed. In this article, we discuss an uncomfortable fact that threatens the core of psychology's academic enterprise: almost without exception, psychologists do not commit themselves to a method of data analysis before they see the actual data. It then becomes tempting to fine tune the analysis to the data in order to obtain a desired result-a procedure that invalidates the interpretation of the common statistical tests. The extent of the fine tuning varies widely across experiments and experimenters but is almost impossible for reviewers and readers to gauge. To remedy the situation, we propose that researchers preregister their studies and indicate in advance the analyses they intend to conduct. Only these analyses deserve the label "confirmatory," and only for these analyses are the common statistical tests valid. Other analyses can be carried out but these should be labeled "exploratory." We illustrate our proposal with a confirmatory replication attempt of a study on extrasensory perception.

Integrity signals

Registry

Crossref · 10.1177/1745691612463078

Cites

49 of 49 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Bayes factors
Kass, R. E., & Raftery, A. E. (1995) · Journal of the American Statistical Association · doi:10.1080/01621459.1995.10476572 · Cited by 12,558
Journal of personality and social psychology
Armstrong, J. (1988) · International Journal of Forecasting · doi:10.1016/0169-2070(88)90126-4 · Cited by 10,544
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Confirmation Bias: A Ubiquitous Phenomenon in Many Guises
Nickerson, R. S. (1998) · Review of General Psychology · doi:10.1037/1089-2680.2.2.175 · Cited by 7,267
False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Wildlife Society Bulletin
Wildlife Society (2011) · Wildlife Society Bulletin · doi:10.1002/(issn)1938-5463a · Cited by 5,571
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 1×
“confirmatory experiments, wonky statistics, ESP, Bayesian hypothesis test Several years ago, Ioannidis (2005) famously argued that “most published research findings are false.””
Journal of the American Statistical Association
Fildes, R. A. (1989) · International Journal of Forecasting · doi:10.1016/0169-2070(89)90106-4 · Cited by 3,956
Bayesian t tests for accepting and rejecting the null hypothesis
Rouder, J. N., Speckman, P. L., Sun, D., Morey, R. D., & Iverson, G. (2009) · Psychonomic Bulletin & Review · doi:10.3758/pbr.16.2.225 · Cited by 3,688
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1×
“And indeed, recent results from biomedical and cancer research suggest that replication rates are lower than 50%, with some as low as 11% (Begley & Ellis, 2012; Osherovich, 2011; Prinz, Schlange, & Asadullah, 2011).”
Result

Show all 48 references

Research works printed but not linked: 4

Feynman R. P., 1974, Engineering & Science, 37, 10
Goldacre B., 2009, Bad science
Jeffreys H., 1961, Theory of probability
Roediger H. L., 2012, APS Observer, 25, 9

Sorted by citations

Items 201–300 of 998

The Role of p -Values in Judging the Strength of Evidence and Realistic Replication Expectations
Gibson, E. W. (2020) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2020.1724560 · Cited by 68
Does preregistration improve the credibility of research findings?
Rubin, M. (2020) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.16.4.p376 · Cited by 61
Preregistration in practice: A comparison of preregistered and non-preregistered studies in psychology
van den Akker, O. R., van Assen, M. A. L. M., Bakker, M., Elsherif, M. M., Wong, T. K., & Wicherts, J. M. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02277-0 · Cited by 84
The compatibility of theoretical frameworks with machine learning analyses in psychological research
Elhai, J. D., & Montag, C. (2020) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2020.05.002 · Cited by 70
Benefits of Open and High-Powered Research Outweigh Costs
LeBel, E. P., Campbell, L., & Loving, T. J. (2016) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000049 · Cited by 67
Conducting Linguistic Experiments Online With OpenSesame and OSWeb
Mathôt, S., & March, J. (2022) · Language Learning · doi:10.1111/lang.12509 · Cited by 61
Improving Psychological Science through Transparency and Openness: An Overview
Hales, A. H., Wesselmann, E. D., & Hilgard, J. (2018) · Perspectives on Behavior Science · doi:10.1007/s40614-018-00186-8 · Cited by 67
Transparency and Openness Promotion (TOP) GuidelinesPreprint
Nosek, B. A., Alter, G. C., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S., Buck, S., Chambers, C., Chin, G. J., Christensen, G., et al. (2016) · doi:10.31219/osf.io/vj54c · Cited by 60
Self-citation
Teenage sleep and technology engagement across the week
Orben, A. C., & Przybylski, A. K. (2020) · PeerJ · doi:10.7717/peerj.8427 · Cited by 61
If Mathematical Psychology Did Not Exist We Might Need to Invent It: A Comment on Theory Building in Psychology
Navarro, D. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620974769 · Cited by 58
Individual Differences in Intertemporal Choice
Keidel, K., Rramani, Q., Weber, B., Murawski, C., & Ettinger, U. (2021) · Frontiers in Psychology · doi:10.3389/fpsyg.2021.643670 · Cited by 66
Making Sense of Conflicting Science Information
Novin, A., & Meyers, E. (2017) · Conference on Human Information Interaction and Retrieval · doi:10.1145/3020165.3020185 · Cited by 58
Multitasking behavior and its related constructs: Executive functions, working memory capacity, relational integration, and divided attention
Himi, S. A., Bühner, M., Schwaighofer, M., Klapetek, A., & Hilbert, S. (2019) · Cognition · doi:10.1016/j.cognition.2019.04.010 · Cited by 66
A systematic review of the strength of evidence for the most commonly recommended happiness strategies in mainstream media
Folk, D. P., & Dunn, E. W. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01651-4 · Cited by 74
Analyzing data from single-case alternating treatments designs.
Manolov, R., & Onghena, P. (2017) · Psychological Methods · doi:10.1037/met0000133 · Cited by 57
The multiplicity of analysis strategies jeopardizes replicability: lessons learned across disciplines
Hoffmann, S., Schönbrodt, F. D., Elsas, R., Wilson, R., Strasser, U., & Boulesteix, A. (2021) · Royal Society Open Science · doi:10.1098/rsos.201925 · Cited by 71
Towards a Research Agenda for Promoting Responsible Research Practices
Tijdink, J. K., Horbach, S. P. J. M., Nuijten, M. B., & O’Neill, G. (2021) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/15562646211018916 · Cited by 60
The Psychometric Modeling of Scientific Reasoning: a Review and Recommendations for Future Avenues
Edelsbrunner, P. A., & Dablander, F. (2018) · Educational Psychology Review · doi:10.1007/s10648-018-9455-5 · Cited by 64
The Interplay between Subjectivity, Statistical Practice, and Psychological Science
Rouder, J. N., Morey, R. D., & Wagenmakers, E. (2016) · Collabra · doi:10.1525/collabra.28 · Cited by 57
Self-citation
An overview of issues in infant and developmental research for the creation of robust and replicable science
Davis-Kean, P. E., & Ellis, A. (2019) · Infant Behavior and Development · doi:10.1016/j.infbeh.2019.101339 · Cited by 57
Ten steps toward a better personality science – how quality may be rewarded more in research evaluation
Leising, D., Thielmann, I., Glöckner, A., Gärtner, A., & Schönbrodt, F. D. (2022) · Personality Science · doi:10.5964/ps.6029 · Cited by 75
Mind-Wandering and Mindfulness as Mediators of the Relationship Between Online Vigilance and Well-Being
Johannes, N., Veling, H., Dora, J., Meier, A., Reinecke, L., & Buijzen, M. (2018) · Cyberpsychology Behavior and Social Networking · doi:10.1089/cyber.2018.0373 · Cited by 66
Experimental Psychology
Stahl, C. (2015) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000289 · Cited by 54
Improving the rigor of psychophysiology research
Baldwin, S. A. (2016) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2016.04.006 · Cited by 54
Beyond Statistical Ritual: Theory in Psychological Science
Proulx, T., & Morey, R. D. (2021) · Perspectives on Psychological Science · doi:10.1177/17456916211017098 · Cited by 64
RETRACTED ARTICLE: High replicability of newly discovered social-behavioural findings is achievable
Protzko, J., Krosnick, J. A., Nelson, L. D., Nosek, B. A., Axt, J. R., Berent, M., Buttrick, N. R., DeBell, M., Ebersole, C. R., Lundmark, S., et al. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01749-9 · Cited by 97
Retracted
A solution for factorial validity testing of three-item scales: An example of tau-equivalent strict measurement invariance of three-item loneliness scale
Czerwiński, S. K., & Atroszko, P. A. (2021) · Current Psychology · doi:10.1007/s12144-021-01554-5 · Cited by 61
Open science, the replication crisis, and environmental public health
Hicks, D. (2021) · Accountability in Research · doi:10.1080/08989621.2021.1962713 · Cited by 56
It’s new, but is it good? How generalization and uncertainty guide the exploration of novel options.
Stojić, H., Schulz, E., Analytis, P. P., & Speekenbrink, M. (2020) · Journal of Experimental Psychology General · doi:10.1037/xge0000749 · Cited by 57
Feeling the future: A meta-analysis of 90 experiments on the anomalous anticipation of random future events
Bem, D., Tressoldi, P. E., Rabeyron, T., & Duggan, M. (2015) · F1000Research · doi:10.12688/f1000research.7177.1 · Cited by 52
Opportunistic biases: Their origins, effects, and an integrated solution.
DeCoster, J., Sparks, E., Sparks, J. C., Sparks, G. G., & Sparks, C. W. (2015) · American Psychologist · doi:10.1037/a0039191 · Cited by 49
The Human Penguin Project: Climate, Social Integration, and Core Body Temperature
IJzerman, H., Lindenberg, S. M., Dalḡar, İ., Weißgerber, S. C., Vergara, R. C., Cairo, A. H., Čolić, M. V., Dursun, P., Frankowska, N., Hadi, R., et al. (2018) · Collabra Psychology · doi:10.1525/collabra.165 · Cited by 53
A creative destruction approach to replication: Implicit work and sex morality across cultures
Tierney, W., Hardy, J. H., Ebersole, C. R., Viganola, D., Clemente, E. G., Gordon, M., Hoogeveen, S., Haaf, J. M., Dreber, A., Johannesson, M., et al. (2020) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2020.104060 · Cited by 54
Best practices to promote rigor and reproducibility in the era of sex-inclusive research
Rich-Edwards, J. W., & Maney, D. L. (2023) · eLife · doi:10.7554/elife.90623 · Cited by 50
How similarity between choice options affects decisions from experience: The accentuation-of-differences model.
Spektor, M. S., Gluth, S., Fontanesi, L., & Rieskamp, J. (2019) · Psychological Review · doi:10.1037/rev0000122 · Cited by 63
A weak scientific basis for gaming disorder: Let us err on the side of cautionPreprint
van Rooij, A. J., Ferguson, C. J., Carras, M. C., Kardefelt‐Winther, D., Shi, J. C., & Przybylski, A. K. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/kc7r9 · Cited by 53
Random effects structure for confirmatory hypothesis testing: Keep it maximalPreprint
Barr, D. J., Lévy, R., Scheepers, C., & Tily, H. J. (2018) · doi:10.31234/osf.io/39mhs · Cited by 51
A Bayesian bird's eye view of ‘Replications of important results in social psychology’
Marsman, M., Schönbrodt, F. D., Morey, R. D., Yao, Y., Gelman, A., & Wagenmakers, E. (2017) · Royal Society Open Science · doi:10.1098/rsos.160426 · Cited by 52
Self-citation
Is research in social psychology politically biased? Systematic empirical tests and a forecasting survey to address the controversy
Eitan, O., Viganola, D., Inbar, Y., Dreber, A., Johannesson, M., Pfeiffer, T., Thau, S., & Uhlmann, E. L. (2018) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2018.06.004 · Cited by 55
Gender Stereotypes in a Children's Television Program: Effects on Girls' and Boys' Stereotype Endorsement, Math Performance, Motivational Dispositions, and Attitudes
Wille, E., Gaspard, H., Trautwein, U., Oschatz, K., Scheiter, K., & Nagengast, B. (2018) · Frontiers in Psychology · doi:10.3389/fpsyg.2018.02435 · Cited by 69
Elusiveness of menstrual cycle effects on mate preferences: Comment on Gildersleeve, Haselton, and Fales (2014).
Wood, W., & Carden, L. (2014) · Psychological Bulletin · doi:10.1037/a0036722 · Cited by 50
Leveraging the Open Science Framework in clinical psychological assessment research.
Tackett, J. L., Brandes, C. M., & Reardon, K. W. (2019) · Psychological Assessment · doi:10.1037/pas0000583 · Cited by 49
Preregistration of Analyses of Preexisting Data
Mertens, G., & Krypotos, A. (2019) · Psychologica Belgica · doi:10.5334/pb.493 · Cited by 49
The Eight Steps of Data Analysis: A Graphical Framework to Promote Sound Statistical Analysis
Fife, D. A. (2020) · Perspectives on Psychological Science · doi:10.1177/1745691620917333 · Cited by 49
Open Science: What, Why, and HowPreprint
Spellman, B., Gilbert, E. A., & Corker, K. S. (2017) · doi:10.31234/osf.io/ak6jr · Cited by 50
Religious Unbelief in Three Western European Countries: Identifying and Characterizing Unbeliever Types Using Latent Class Analysis
Lindeman, M., van Elk, M., Lipsanen, J. O., Marin, P., & Schjoedt, U. (2019) · International Journal for the Psychology of Religion · doi:10.1080/10508619.2019.1591140 · Cited by 50
Open science in psychophysiology: An overview of challenges and emerging solutions
Garrett-Ruffin, S., Hindash, A. C., Kaczkurkin, A. N., Mears, R. P., Morales, S., Paul, K., Pavlov, Y. G., & Keil, A. (2021) · International Journal of Psychophysiology · doi:10.1016/j.ijpsycho.2021.02.005 · Cited by 48
Using large, publicly available data sets to study adolescent development: opportunities and challenges
Kievit, R., McCormick, E. M., Fuhrmann, D., Deserno, M. K., & Orben, A. C. (2021) · Current Opinion in Psychology · doi:10.1016/j.copsyc.2021.10.003 · Cited by 49
Self-citation
High Replicability of Newly-Discovered Social-behavioral Findings is AchievablePreprint
Protzko, J., Krosnick, J. A., Nelson, L. D., Nosek, B. A., Axt, J. R., Berent, M. K., Buttrick, N., DeBell, M., Ebersole, C. R., Lundmark, S., et al. (2020) · doi:10.31234/osf.io/n2a9x · Cited by 48
Are questionable research practices facilitating new discoveries in sport and exercise medicine? The proportion of supported hypotheses is implausibly high
Büttner, F., Toomey, E. C., McClean, S., Roe, M., & Delahunt, E. (2020) · British Journal of Sports Medicine · doi:10.1136/bjsports-2019-101863 · Cited by 56
Adapting implementation science for higher education research: the systematic study of implementing evidence-based practices in college classrooms
Soicher, R. N., Becker‐Blease, K. A., & Bostwick, K. C. P. (2020) · Cognitive Research Principles and Implications · doi:10.1186/s41235-020-00255-0 · Cited by 52
Registered reports: an early example and analysis
Wiseman, R. J., Watt, C. A., & Kornbrot, D. E. (2019) · PeerJ · doi:10.7717/peerj.6232 · Cited by 48
Designing for Interactive Exploratory Data Analysis Requires Theories of Graphical Inference
Hullman, J. R., & Gelman, A. (2021) · Harvard Data Science Review · doi:10.1162/99608f92.3ab8a587 · Cited by 62
Semantics guide infants’ vowel learning: Computational and experimental evidence
ter Schure, S., Junge, C., & Boersma, P. (2016) · Infant Behavior and Development · doi:10.1016/j.infbeh.2016.01.002 · Cited by 46
Benefits and Pitfalls of Debunking Interventions to Counter mRNA Vaccination Misinformation During the COVID-19 Pandemic
Schmid, P., & Betsch, C. (2022) · Science Communication · doi:10.1177/10755470221129608 · Cited by 44
The Creativity-Verification Cycle in Psychological Science: New Methods to Combat Old Idols
Wagenmakers, E., Dutilh, G., & Sarafoglou, A. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691618771357 · Cited by 49
Self-citation
Preregistration in experimental linguistics: applications, challenges, and limitations
Roettger, T. B. (2021) · Linguistics · doi:10.1515/ling-2019-0048 · Cited by 51
An Updated Guide to Robust Statistical Methods in Neuroscience
Wilcox, R. R., & Rousselet, G. A. (2023) · Current Protocols · doi:10.1002/cpz1.719 · Cited by 54
Who Believes in the Storybook Image of the Scientist?
Veldkamp, C. L. S., Hartgerink, C. H. J., van Assen, M. A. L. M., & Wicherts, J. M. (2016) · Accountability in Research · doi:10.1080/08989621.2016.1268922 · Cited by 45
Too Good to be False: Nonsignificant Results Revisited
Hartgerink, C. H. J., Wicherts, J. M., & van Assen, M. A. L. M. (2017) · Collabra Psychology · doi:10.1525/collabra.71 · Cited by 45
Improving the Replicability of Psychological Science Through Pedagogy
Hawkins, R. X. D., Smith, E. N., Au, C., Arias, J. M., Catapano, R., Hermann, E., Keil, M., Lampinen, A. K., Raposo, S., Reynolds, J., et al. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245917740427 · Cited by 46
Flexible yet fair: blinding analyses in experimental psychology
Dutilh, G., Sarafoglou, A., & Wagenmakers, E. (2019) · Synthese · doi:10.1007/s11229-019-02456-7 · Cited by 52
Self-citation
Experimental Psychology
Stahl, C. (2014) · Experimental Psychology (formerly Zeitschrift für Experimentelle Psychologie) · doi:10.1027/1618-3169/a000257 · Cited by 45
Combining Animal Welfare With Experimental Rigor to Improve Reproducibility in Behavioral Neuroscience.
Loss, C. M., Melleu, F. F., Domingues, K., Lino-de-Oliveira, C., & Viola, G. G. (2021) · Frontiers in Behavioral Neuroscience · doi:10.3389/fnbeh.2021.763428 · Cited by 44
What Does It Mean? A Review of the Neuroscientific Evidence for Embodied Lexical Semantics
Hauk, O. (2015) · Elsevier eBooks · doi:10.1016/b978-0-12-407794-2.00062-6 · Cited by 44
Reproducible research practices and transparency across linguistics
Bochyńska, A., Keeble, L., Halfacre, C. A. E., Casillas, J. V., Champagne, I.-A., Chen, K., Röthlisberger, M., Buchanan, E. M., & Roettger, T. B. (2023) · Glossa Psycholinguistics · doi:10.5070/g6011239 · Cited by 53
Elastic analysis procedures: An incurable (but preventable) problem in the fertility effect literature. Comment on Gildersleeve, Haselton, and Fales (2014).
Harris, C. R., Pashler, H., & Mickes, L. (2014) · Psychological Bulletin · doi:10.1037/a0036478 · Cited by 44
A Case Concerning Children's False Memories of Abuse: Recommendations Regarding Expert Witness Work
Otgaar, H., de Ruiter, C., Howe, M. L., Hoetmer, L., & van Reekum, P. (2016) · Psychiatry Psychology and Law · doi:10.1080/13218719.2016.1230924 · Cited by 53
Paths Explored, Paths Omitted, Paths Obscured: Decision Points & Selective Reporting in End-to-End Data Analysis
Liu, Y., Althoff, T., & Heer, J. (2020) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3313831.3376533 · Cited by 54
Increasing the Credibility of Political Science Research: A Proposal for Journal Reforms
Nyhan, B. J. (2015) · PS Political Science & Politics · doi:10.1017/s1049096515000463 · Cited by 57
Publication standards in infancy research: Three ways to make Violation-of-Expectation studies more reliable
Rubio‐Fernández, P. (2018) · Infant Behavior and Development · doi:10.1016/j.infbeh.2018.09.009 · Cited by 46
Statistical learning abilities of children with dyslexia across three experimental paradigms
van Witteloostuijn, M., Boersma, P., Wijnen, F. N. K., & Rispens, J. (2019) · PLoS ONE · doi:10.1371/journal.pone.0220041 · Cited by 42
A preregistered replication of “Inoculating the public against misinformation about climate change”
Williams, M. N., & Bond, C. (2020) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2020.101456 · Cited by 48
Why optional stopping can be a problem for Bayesians
de Heide, R., & Grünwald, P. (2020) · Psychonomic Bulletin & Review · doi:10.3758/s13423-020-01803-x · Cited by 63
Effect Sizes, Power, and Biases in Intelligence Research: A Meta-Meta-Analysis
Nuijten, M. B., van Assen, M. A. L. M., Augusteijn, H. E. M., Crompvoets, E. A. V., & Wicherts, J. M. (2020) · Journal of Intelligence · doi:10.3390/jintelligence8040036 · Cited by 42
The relation between the control-of-variables strategy and content knowledge in physics in secondary school
Schwichow, M., Osterhaus, C., & Edelsbrunner, P. A. (2020) · Contemporary Educational Psychology · doi:10.1016/j.cedpsych.2020.101923 · Cited by 42
Teachers’ Innovative Work Behavior Scale: Psychometric Properties of the Greek Version and Measurement Invariance across Genders
Gkontelos, A., Vaiopoulou, J., & Stamovlasis, D. (2022) · Social Sciences · doi:10.3390/socsci11070306 · Cited by 42
Strategic ambiguity in the social sciences
Frankenhuis, W. E., Panchanathan, K., & Smaldino, P. E. (2023) · Social Psychological Bulletin · doi:10.32872/spb.9923 · Cited by 63
Turning the hands of time again: a purely confirmatory replication study and a Bayesian analysis
Wagenmakers, E., Beek, T. F., Rotteveel, M., Gierholz, A., Matzke, D., Steingroever, H., Ly, A., Verhagen, J., Selker, R., Sasiadek, A., et al. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00494 · Cited by 44
Self-citation
Enhancing transparency of the research process to increase accuracy of findings: A guide for relationship researchers
Campbell, L., Loving, T. J., & LeBel, E. P. (2014) · Personal Relationships · doi:10.1111/pere.12053 · Cited by 40
Window to Hope: A Randomized Controlled Trial of a Psychological Intervention for the Treatment of Hopelessness Among Veterans With Moderate to Severe Traumatic Brain Injury
Brenner, L. A., Forster, J. E., Hoffberg, A. S., Matarazzo, B. B., Hostetter, T. A., Signoracci, G. M., & Simpson, G. K. (2017) · Journal of Head Trauma Rehabilitation · doi:10.1097/htr.0000000000000351 · Cited by 44
From Outcome to Process Focus: Fostering a More Robust Psychological Science Through Registered Reports and Results-Blind Reviewing
Grand, J. A., Rogelberg, S. G., Banks, G. C., Landis, R. S., & Tonidandel, S. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691618767883 · Cited by 45
A step-by-step guide on preregistration and effective data sharing for psychopathology research.
Krypotos, A., Klugkist, I. G., Mertens, G., & Engelhard, I. M. (2019) · Journal of Abnormal Psychology · doi:10.1037/abn0000424 · Cited by 43
Single-Case Research Methods: History and Suitability for a Psychological Science in Need of Alternatives
Hurtado‐Parrado, C., & López‐López, W. (2015) · Integrative Psychological and Behavioral Science · doi:10.1007/s12124-014-9290-2 · Cited by 41
Investigating the replicability of the social and behavioural sciences
Tyner, A. H., Abatayo, A. L., Daley, M., Field, S., Fox, N. W., Haber, N., Hahn, K. M., Struhl, M. K., Mawhinney, B., Miske, O., et al. (2026) · Nature · doi:10.1038/s41586-025-10078-y · Cited by 54
Heightened Sensitivity to Temperature Cues in Individuals With High Anxious Attachment
LeBel, E. P., & Campbell, L. (2013) · Psychological Science · doi:10.1177/0956797613486983 · Cited by 40
Big Data approaches in social and behavioral science: four key trade-offs and a call for integration
Mahmoodi, J., Leckelt, M., van Zalk, M. H. W., Geukes, K., & Back, M. D. (2017) · Current Opinion in Behavioral Sciences · doi:10.1016/j.cobeha.2017.07.001 · Cited by 42
Putting Popper to work
Derksen, M. (2019) · Theory & Psychology · doi:10.1177/0959354319838343 · Cited by 45
Relationship between the Implicit Association Test and intergroup behavior: A meta-analysisPreprint
Kurdi, B., Seitchik, A. E., Axt, J. R., Carroll, T. J., Karapetyan, A., Kaushik, N., Tomezsko, D., Greenwald, A. G., & Banaji, M. R. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/582gh · Cited by 53
Single-case experimental research designs.
Kazdin, A. E. (2015) · Methodological issues and strategies in clinical research (4th ed.). · doi:10.1037/14805-029 · Cited by 39
Judgment and decision-making in clinical dentistry
Feller, L., Lemmer, J., Nemutandani, S. M., Ballyram, R., & Khammissa, R. A. G. (2020) · Journal of International Medical Research · doi:10.1177/0300060520972877 · Cited by 42
A 20-Year Review of Outcome Reporting Bias in Moderated Multiple Regression
O’Boyle, E. H., Banks, G. C., Carter, K., Walter, S. L., & Yuan, Z. (2018) · Journal of Business and Psychology · doi:10.1007/s10869-018-9539-8 · Cited by 42
贝叶斯因子及其在JASP中的实现
Chuan-Peng, H., Kong, X., Er, I.-J., Al, E., & Peng, K. (2018) · Advances in Psychological Science · doi:10.3724/sp.j.1042.2018.00951 · Cited by 44
Perception of action-outcomes is shaped by life-long and contextual expectations
Dogge, M., Custers, R., Gayet, S., Hoijtink, H., & Aarts, H. (2019) · Scientific Reports · doi:10.1038/s41598-019-41090-8 · Cited by 40
Publish less, read more
Phaf, R. H. (2020) · Theory & Psychology · doi:10.1177/0959354319898250 · Cited by 41
A Multidimensional Framework for Examining the Effects of Social Class on Organizational Behavior
Côté, S. (2022) · Journal of Management · doi:10.1177/01492063221126490 · Cited by 42
Feminism and Evolutionary Psychology: Moving Forward
Eagly, A. H., & Wood, W. (2013) · Sex Roles · doi:10.1007/s11199-013-0315-y · Cited by 40
Frequentist and Bayesian inference: A conceptual primer
van Zyl, C. J. J. (2018) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2018.06.004 · Cited by 43
Conducting Web-Based Experiments for Numerical Cognition Research
Kochari, A. R. (2019) · Journal of Cognition · doi:10.5334/joc.85 · Cited by 40
On the automatic link between affect and tendencies to approach and avoid: Chen and Bargh (1999) revisited
Rotteveel, M., Gierholz, A., Koch, G., van Aalst, C., Pinto, Y., Matzke, D., Steingroever, H., Verhagen, J., Beek, T. F., Selker, R., et al. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00335 · Cited by 41
Self-citation

Authors: Wagenmakers, E.-J., Wetzels, R., Borsboom, D., van der Maas, H. L. J., & Kievit, R. A.
Affiliations: University of Amsterdam (NL)
ORCID: Wagenmakers, Eric-Jan
Borsboom, Denny
van der Maas, Han L. J.
Kievit, Rogier A.
Venue: Perspectives on Psychological Science
Publisher: SAGE Publications
Published: 2012-11
Volume: 7
Issue: 6
Pages: 632-638
ISSN: 1745-6916 (ISSN-L)
1745-6924
DOI: 10.1177/1745691612463078
OpenAlex: W2123263696
Cited by: 1,042
References: 48
Citations by year: 2026: 57 · 2025: 41 · 2024: 65 · 2023: 85 · 2022: 102 · 2021: 108 · 2020: 114 · 2019: 98 · 2018: 88 · 2017: 86 · 2016: 75 · 2015: 51 · 2014: 43 · 2013: 28 · 2012: 1
FWCI: 44.75
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Perspectives on Psychological Science (publishedVersion)
PubMed (publishedVersion)
UvA-DARE (University of Amsterdam) (publishedVersion)
UvA-DARE (University of Amsterdam) (submittedVersion)
Data Archiving and Networked Services (DANS) (submittedVersion)
Topics: Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods and Bayesian Inference
Keywords: preregistration, confirmatory analysis, exploratory analysis, data snooping, statistical validity, research integrity, extrasensory perception, replication, hypothesis testing

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

An Agenda for Purely Confirmatory Research

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks