The DOI matches its Crossref record; 75 of the 75 references it cites were found in a registry or an index.
The Rules of the Game Called Psychological Science
Open accessAbstract
If science were a game, a dominant rule would probably be to collect results that are statistically significant. Several reviews of the psychological literature have shown that around 96% of papers involving the use of null hypothesis significance testing report significant outcomes for their main results but that the typical studies are insufficiently powerful for such a track record. We explain this paradox by showing that the use of several small underpowered samples often represents a more efficient research strategy (in terms of finding p < .05) than does the use of one larger (more powerful) sample. Publication bias and the most efficient strategy lead to inflated effects and high rates of false positives, especially when researchers also resorted to questionable research practices, such as adding participants after intermediate testing. We provide simulations that highlight the severity of such biases in meta-analyses. We consider 13 meta-analyses covering 281 primary studies in various fields of psychology and find indications of biases and/or an excess of significant results in seven. These results highlight the need for sufficiently powerful replications and changes in journal policies.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Also, the publication culture promotes novel, and often surprising, findings and this will motivate researchers to postulate improbable hypotheses (20).”
From Statistical and Methodological Considerations for the Interpretation of Intranasal Oxytocin Studies (2016) · cites this paper as [20]
In the citing paper
“From a statistical point of view this problem might not be any more serious for this field than other domains of psychology (20, 21, 31) or neuroscience in general (14).”
From Statistical and Methodological Considerations for the Interpretation of Intranasal Oxytocin Studies (2016) · cites this paper as [20]
In the citing paper
“However, one pervasive problem in the social sciences, including psychology, that threatens the accuracy of meta-analytic estimates is publication bias (Bakker et al., 2012; Franco et al., 2014, 2016)”
From Do Salient Social Norms Moderate Mortality Salience Effects? A (Challenging) Meta-Analysis of Terror Management Studies (2023) · cites this paper as Bakker et al., 2012
In the citing paper
“Given that publication bias and researcher degrees of freedom are understood to be pervasive problems in psychological science (Bakker et al., 2012; Franco et al., 2014, 2016; Hesse, 2018; John et al., 2012), unadjusted effect sizes are likely to be overestimated (Kvarven et al., 2020).”
From Do Salient Social Norms Moderate Mortality Salience Effects? A (Challenging) Meta-Analysis of Terror Management Studies (2023) · cites this paper as Bakker et al., 2012
Citations
Cites
Two new Later Stone Age sites from the Final Pleistocene in the Falémé Valley, eastern Senegal
Ndiaye, M., Lespez, L., Tribolo, C., Rassé, M., Hadjas, I., Davidoux, S., Huysecom, É., & Douze, K. (2024) · Monash University Research Portal (Monash University) · doi:10.3929/ethz-b-000667478 · Cited by 24,214
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
The file drawer problem and tolerance for null results.
Rosenthal, R. (1979) · Psychological Bulletin · doi:10.1037/0033-2909.86.3.638 · Cited by 9,068
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Journal of The American Statistical Association
Fienberg, S. E. (2004) · Encyclopedia of Statistical Sciences · doi:10.1002/0471667196.ess1317 · Cited by 6,289
Understanding and using the Implicit Association Test: I. An improved scoring algorithm.
Greenwald, A. G., Nosek, B. A., & Banaji, M. R. (2003) · Journal of Personality and Social Psychology · doi:10.1037/0022-3514.85.2.197 · Cited by 5,815
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 3×
“Such practices lead to inflated ESs and increased false positive rates (Ioannidis, 2005, 2008b; Simmons et al., 2011).”
BackgroundResultCohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
Understanding and using the Implicit Association Test: III. Meta-analysis of predictive validity.
Greenwald, A. G., Poehlman, T. A., Uhlmann, E. L., & Banaji, M. R. (2009) · Journal of Personality and Social Psychology · doi:10.1037/a0015575 · Cited by 3,257
Belief in the law of small numbers.
Tversky, A., & Kahneman, D. (1971) · Psychological Bulletin · doi:10.1037/h0031322 · Cited by 3,246
Research works printed but not linked: 1
- 10.1037/0003-066X.56.2.128 · DOI · Paper page
Cited by
Sorted by citations
Items 301–400 of 799
The pros and cons of funnel plots as an aid to risk communication and patient decision making
Rakow, T., Wright, R. J., Spiegelhalter, D. J., & Bull, C. (2014) · British Journal of Psychology · doi:10.1111/bjop.12081 · Cited by 28
van Aert, R. C. M., & van Assen, M. A. L. M. (2017) · Behavior Research Methods · doi:10.3758/s13428-017-0967-6 · Cited by 33
The Epistemic Importance of Establishing the Absence of an Effect
Fidler, F. M., Thorn, F. S., Barnett, A., Kambouris, S., & Kruger, A. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918770407 · Cited by 32
Behavioral interventions for waste reduction: a systematic review of experimental studies
Wilson, B. M., Delmas, M. A., & Rajagopal, D. (2025) · Frontiers in Psychology · doi:10.3389/fpsyg.2025.1561467 · Cited by 31
Feng, C., Gu, R., Li, T., Wang, L., Zhang, Z., Luo, W., & Eickhoff, S. B. (2021) · Neuroscience & Biobehavioral Reviews · doi:10.1016/j.neubiorev.2021.09.041 · Cited by 34
Vankelecom, L., Loeys, T., & Moerkerke, B. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231212128 · Cited by 30
Forsberg, E., Nilsson, A., & Jørgensen, Ø. (2018) · Social Psychological and Personality Science · doi:10.1177/1948550618817347 · Cited by 35
Published estimates of group differences in multisensory integration are inflated
Magnotti, J., & Beauchamp, M. (2018) · bioRxiv · doi:10.1371/journal.pone.0202908 · Cited by 26
The Research Reproducibility Crisis and Economics of Science
Maniadis, Z., & Tufano, F. (2017) · The Economic Journal · doi:10.1111/ecoj.12526 · Cited by 28
Assessing and Improving Robustness of Psychological Research Findings in Four Steps
Nuijten, M. B. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_17 · Cited by 26
Collins, B., Breithaupt, L. E., McDowell, J. E., Miller, L. S., Thompson, J., & Fischer, S. F. (2017) · Journal of Abnormal Psychology · doi:10.1037/abn0000242 · Cited by 26
Sample size estimation for heterogeneous growth curve models with attrition
Vallejo, G., Ato, M., Fernández, P., & Livacic-Rojas, P. E. (2018) · Behavior Research Methods · doi:10.3758/s13428-018-1059-y · Cited by 26
Empirically Derived Guidelines for Effect Size Interpretation in Social PsychologyPreprint
Lovakov, A. V., & Рафиковна, А. Е. (2017) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/2epc4 · Cited by 37
Evoked and event-related potentials in disorders of consciousness: A quantitative review
Kotchoubey, B. (2017) · Consciousness and Cognition · doi:10.1016/j.concog.2017.05.002 · Cited by 25
The pervasive avoidance of prospective statistical power: major consequences and practical solutions
Tressoldi, P. E., & Giofrè, D. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00726 · Cited by 25
Scientific Disintegrity as a Public Bad
Engel, C. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615577865 · Cited by 25
Relating individual differences in bilingual language experiences to executive attention
Yamasaki, B. L., Stocco, A., & Prat, C. S. (2018) · Language Cognition and Neuroscience · doi:10.1080/23273798.2018.1448092 · Cited by 25
Statistical reporting inconsistencies in experimental philosophy
Colombo, M., Duev, G., Nuijten, M. B., & Sprenger, J. (2018) · PLoS ONE · doi:10.1371/journal.pone.0194360 · Cited by 25
Mapping brain asymmetry in health and disease through the ENIGMA consortiumPreprint
Kong, X., Postema, M. C., Guadalupe, T. M., de Kovel, C. G. F., Boedhoe, P. S. W., Hoogman, M., Mathias, S. R., van Rooij, D., Schijven, D., Glahn, D. C., et al. (2019) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/ufwhp · Cited by 25
Konijn, E. A., van de Schoot, R., Winter, S. D., & Ferguson, C. J. (2015) · Communication Methods and Measures · doi:10.1080/19312458.2015.1096332 · Cited by 28
Replikationskrise, p-hacking und Open Science
Brachem, J., Frank, M., Kvetnaya, T., Schramm, L. F. F., & Volz, L. (2022) · Psychologische Rundschau · doi:10.1026/0033-3042/a000562 · Cited by 29
Examining the predictive validity of NIH peer review scores
Lindner, M. D., & Nakamura, R. K. (2015) · PLOS ONE · doi:10.1371/journal.pone.0126938 · Cited by 24
In Search Of True Things Worth Knowing: Considerations For A New Article Prototype
Tullett, A. M. (2015) · Social and Personality Psychology Compass · doi:10.1111/spc3.12166 · Cited by 24
How often does random assignment fail? Estimates and recommendations
Goldberg, M. H. (2019) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2019.101351 · Cited by 23
Bodner, K. E., Williams, D. L., Engelhardt, C. R., & Minshew, N. J. (2014) · Research in Autism · doi:10.1016/j.rasd.2014.07.015 · Cited by 25
Visual Task Demands and the Auditory Mismatch Negativity: An Empirical Study and a Meta-Analysis
Wiens, S., Szychowska, M., & Nilsson, M. E. (2016) · PLoS ONE · doi:10.1371/journal.pone.0146567 · Cited by 23
Diversity in gender stereotypes? A comparison of heterosexual, gay and lesbian perspectives
Clarke, H. M., & Arnold, K. A. (2017) · Canadian Journal of Administrative Sciences / Revue Canadienne des Sciences de l Administration · doi:10.1002/cjas.1437 · Cited by 23
Belastbare und effiziente Wissenschaft
Glöckner, A., Fiedler, S., & Renkewitz, F. (2018) · Psychologische Rundschau · doi:10.1026/0033-3042/a000384 · Cited by 26
“1-in-X” bias: “1-in-X” format causes overestimation of health-related risks.
Sirota, M., Juanchich, M., & Bonnefon, J. (2018) · Journal of Experimental Psychology Applied · doi:10.1037/xap0000190 · Cited by 23
Changing the logic of replication: A case from infant studies
Margoni, F., & Shepperd, M. (2020) · Infant Behavior and Development · doi:10.1016/j.infbeh.2020.101483 · Cited by 22
Wicherts, J. M., Veldkamp, C. L. S., Augusteijn, H. E. M., Bakker, M., van Aert, R. C. M., & van Assen, M. A. L. M. (2016) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/umq8d · Cited by 32
Sotola, L. K., & Credé, M. (2022) · European Journal of Social Psychology · doi:10.1002/ejsp.2858 · Cited by 28
Neff, M. B., & Martin, A. (2022) · Infancy · doi:10.1111/infa.12507 · Cited by 23
Brooker, R., & Allum, N. (2024) · Research Integrity and Peer Review · doi:10.1186/s41073-024-00151-x · Cited by 28
The need for reporting negative results – a 90 year update
Earp, B. D. (2017) · Journal of Clinical and Translational Research · doi:10.18053/jctres.03.2017s2.001 · Cited by 21
Fact or fiction: reducing the proportion and impact of false positives
Stahl, D. R., & Pickles, A. R. (2017) · Psychological Medicine · doi:10.1017/s003329171700294x · Cited by 23
7 Deadly Sins in Educational Research
Picho, K., & Artino, A. R. (2016) · Journal of Graduate Medical Education · doi:10.4300/jgme-d-16-00332.1 · Cited by 22
Excess success for three related papers on racial bias
Francis, G. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00512 · Cited by 21
Akanni, A. A., Kareem, D. B., & Oduaran, C. A. (2020) · Cogent Psychology · doi:10.1080/23311908.2020.1869376 · Cited by 21
Fraley, R. C., Chong, J. Y., Baacke, K. A., Greco, A. J., Guan, H., & Vazire, S. (2022) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459221120217 · Cited by 24
A New Replication Norm for Psychology
LeBel, E. P. (2015) · Collabra · doi:10.1525/collabra.23 · Cited by 27
Lindner, M. D., Vancea, A., Chen, M., & Chacko, G. W. (2015) · American Journal of Evaluation · doi:10.1177/1098214015582049 · Cited by 22
Random responses inflate statistical estimates in heavily skewed addictions data
King, K. M., Kim, D. S., & McCabe, C. J. (2017) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2017.10.033 · Cited by 24
Steinfath, M., Vogl, S., Violet, N., Schwarz, F., Mielke, H., Selhorst, T., Greiner, M., & Schönfelder, G. (2018) · PLoS ONE · doi:10.1371/journal.pone.0202762 · Cited by 26
Redefine or justify? Comments on the alpha debate
de Ruiter, J. (2018) · Psychonomic Bulletin & Review · doi:10.3758/s13423-018-1523-9 · Cited by 23
Best-Practice Guidelines for Positive Psychological Intervention Research Design
van Zyl, L. E., Efendić, E., Rothmann, S., & Shankland, R. (2019) · Springer eBooks · doi:10.1007/978-3-030-20020-6_1 · Cited by 23
The need for open science practices and well-conducted replications in the field of gambling studies
Wohl, M. J. A., Tabri, N., & Zelenski, J. M. (2019) · International Gambling Studies · doi:10.1080/14459795.2019.1672769 · Cited by 20
Doing better leadership science via replications and registered reports
Carsten, M. K., Clapp‐Smith, R., Haslam, S. A., Bastardoz, N., Gooty, J., Connelly, S., & Spain, S. M. (2023) · The Leadership Quarterly · doi:10.1016/j.leaqua.2023.101712 · Cited by 23
Failure to Replicate: Sound the Alarm.
Ioannidis, J. P. A. (2015) · PubMed Central · Cited by 20
Don't Just Judge the Spelling! The Influence of Spelling on Assessing Second-Language Student Essays
Jansen, T., Vögelin, C., Machts, N., Keller, S. D., & Møller, J. (2021) · Frontline Learning Research · doi:10.14786/flr.v9i1.541 · Cited by 20
Yang, Z., Freling, T. H., Sun, S., & Richardson-Greenfield, P. (2022) · Journal of Business Research · doi:10.1016/j.jbusres.2022.05.022 · Cited by 26
Assessing the Evidential Value of Mental Fatigue and Exercise Research
Holgado, D., Mesquida, C., & Román-Caballero, R. (2023) · Sports Medicine · doi:10.1007/s40279-023-01926-w · Cited by 31
Improving the Conduct and Reporting of Statistical Analysis in Psychology
Sijtsma, K., Veldkamp, C. L. S., & Wicherts, J. M. (2015) · Psychometrika · doi:10.1007/s11336-015-9444-2 · Cited by 20
Addressing Publication Bias in Meta-Analysis
Tsuji, S., Cristià, A., Frank, M. C., & Bergmann, C. (2020) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000393 · Cited by 21
Psychologists’ psychologies of psychologists in a time of crisis.
Morawski, J. G. (2020) · History of Psychology · doi:10.1037/hop0000140 · Cited by 22
Foreign Language does not Affect Gambling-Related Judgments
Muda, R., Walker, A. C., Pieńkosz, D., Fugelsang, J. A., & Białek, M. (2020) · Journal of Gambling Studies · doi:10.1007/s10899-020-09933-6 · Cited by 20
Alessandroni, N., & Rodríguez, C. (2020) · Psicologia Reflexão e Crítica · doi:10.1186/s41155-020-00154-9 · Cited by 20
Optimization of Cellular ELISA for Assay of Surface Antigens on Human Synoviocytes
Smith, D. D., Cohick, C. B., & Lindsley, H. B. (1997) · BioTechniques · doi:10.2144/97225rr03 · Cited by 21
What can expert witnesses reliably say about memory in the courtroom?
Otgaar, H., Howe, M. L., & Dodier, O. (2022) · Forensic Science International Mind and Law · doi:10.1016/j.fsiml.2022.100106 · Cited by 19
Olsson, T. M., & Sundell, K. (2023) · PLoS ONE · doi:10.1371/journal.pone.0281110 · Cited by 23
Gandhi, L., Manning, B. S., & Duckworth, A. L. (2024) · Current Directions in Psychological Science · doi:10.1177/09637214241268222 · Cited by 20
The Contagion of Interstate Violence
Li, M., Leidner, B., Euh, H., & Choi, H. (2016) · Personality and Social Psychology Bulletin · doi:10.1177/0146167216649609 · Cited by 19
Innovation and Integrity: Desiderata and Future Directions for Prevention and Intervention Science
Beelmann, A., Malti, T., Noam, G., & Sommer, S. (2018) · Prevention Science · doi:10.1007/s11121-018-0869-6 · Cited by 22
Belief in a Loving Versus Punitive God and Behavior
Shepperd, J. A., Pogge, G. C., Lipsey, N. P., Miller, W. A., & Webster, G. D. (2019) · Journal of Research on Adolescence · doi:10.1111/jora.12437 · Cited by 22
Researcher Degrees of Freedom in the Psychology of Religion
Charles, S. J., Bartlett, J. E., Messick, K. J., Coleman, T. J., III, & Uzdavines, A. (2019) · International Journal for the Psychology of Religion · doi:10.1080/10508619.2019.1660573 · Cited by 21
Watanabe, S., & Laurent, S. M. (2020) · Journal for the Cognitive Science of Religion · doi:10.1558/jcsr.38411 · Cited by 19
Lucas, R. E., & Donnellan, M. B. (2013) · Journal of Research in Personality · doi:10.1016/j.jrp.2013.05.002 · Cited by 19
Not Published Is Not Perished: Addressing Publication Bias in Meta-Analytic Studies in Communication
Sun, Y., & Pan, Z. (2020) · Human Communication Research · doi:10.1093/hcr/hqz015 · Cited by 18
Yip, J. A., & Schweitzer, M. E. (2022) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2021.104109 · Cited by 18
Reckoning With Our Crisis: An Agenda for the Field of Social and Personality Psychology
Schiavone, S. R., & Vazire, S. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916221101060 · Cited by 23
Understanding node-link and matrix visualizations of networks: A large-scale online experiment
Ren, D., Marusich, L. R., O’Donovan, J., Bakdash, J. Z., Schaffer, J., Cassenti, D. N., Kase, S. E., Roy, H., Lin, W.-Y., & Höllerer, T. (2019) · Network Science · doi:10.1017/nws.2019.6 · Cited by 18
Big secrets do not necessarily cause hills to appear steeper
LeBel, E. P., & Wilbur, C. J. (2013) · Psychonomic Bulletin & Review · doi:10.3758/s13423-013-0549-2 · Cited by 18
DerLex: An eye-movement database of derived word reading in English
Schmidtke, D., Dyke, J. A. V., & Kuperman, V. (2024) · Behavior Research Methods · doi:10.3758/s13428-024-02565-3 · Cited by 17
Selvanathan, H., & Lickel, B. (2019) · Journal of Social and Political Psychology · doi:10.5964/jspp.v7i1.1063 · Cited by 14
Olsen, J., Mosen, J., Voracek, M., & Kirchler, E. M. (2019) · Royal Society Open Science · doi:10.1098/rsos.190738 · Cited by 14
Do Incidental Environmental Anchors Bias Consumers’ Price Estimations?
Shanks, D. R., Barbieri-Hermitte, P., & Vadillo, M. A. (2020) · Collabra Psychology · doi:10.1525/collabra.310 · Cited by 24
Attentional fluctuations and the temporal organization of memory
Jayakumar, M., Balusu, C., & Aly, M. (2022) · Cognition · doi:10.1016/j.cognition.2023.105408 · Cited by 17
Integration of Basic Controversies in Cross-cultural Psychology
Poortinga, Y. H. (2016) · Psychology and Developing Societies · doi:10.1177/0971333616657169 · Cited by 15
Das Experten-Novizen-Paradigma und die Vertrauenskrise in der Psychologie
Furley, P., Schul, K., & Memmert, D. (2016) · Zeitschrift für Sportpsychologie · doi:10.1026/1612-5010/a000174 · Cited by 17
Antoniou, K. (2023) · Psychonomic Bulletin & Review · doi:10.3758/s13423-023-02245-x · Cited by 20
Hussey, I. (2023) · Journal of Contextual Behavioral Science · doi:10.1016/j.jcbs.2023.06.008 · Cited by 21
Stereotype Threat and Its Problems: Theory Misspecification in Research, Consequences, and Remedies
Picho, K., Turnbull, A., & Rodriguez-Leahy, A. (2021) · Journal of Advanced Academics · doi:10.1177/1932202x20986161 · Cited by 25
Optimizing Research Output: How Can Psychological Research Methods Be Improved?
Miller, J. O., & Ulrich, R. (2021) · Annual Review of Psychology · doi:10.1146/annurev-psych-020821-094927 · Cited by 20
Bailey, J. A., Samek, D. R., Keyes, M. A., Hemphill, S. A., Hicks, B. M., McGue, M., Iacono, W. G., Epstein, M., Catalano, R. F., Haggerty, K. P., et al. (2014) · Drug and Alcohol Dependence · doi:10.1016/j.drugalcdep.2014.02.023 · Cited by 16
The Meta-Science of Adult Statistical Word Segmentation: Part 1
Hartshorne, J. K., Skorb, L., Dietz, S. L., Garcia, C., Iozzo, G., Lamirato, K., Ledoux, J. R., Mu, J., Murdock, K., Ravid, J., et al. (2019) · Collabra Psychology · doi:10.1525/collabra.181 · Cited by 22
Understanding of researcher behavior is required to improve data reliability
Wass, M. N., Ray, L., & Michaelis, M. (2019) · GigaScience · doi:10.1093/gigascience/giz017 · Cited by 19
Challenges of Big Data Analyses and Applications in Psychology
Cheung, M. W. ‐., & Jak, S. (2018) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000348 · Cited by 16
Beyond p values: utilizing multiple methods to evaluate evidence
Valentine, K. D., Buchanan, E. M., Scofield, J. E., & Beauchamp, M. T. (2019) · Behaviormetrika · doi:10.1007/s41237-019-00078-4 · Cited by 17
How the Probabilistic Structure of Grammatical Context Shapes Speech
Linke, M., & Ramscar, M. (2020) · Entropy · doi:10.3390/e22010090 · Cited by 16
Maximizing the Reproducibility of Your ResearchPreprint
Bosco, F. A., Carp, J., Field, J. G., IJzerman, H., Lewis, M., Munafo, M. R., Nosek, B. A., Prenoveau, J. M., Spies, J. R., & Giner‐Sorolla, R. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/k9mn3_v1 · Cited by 16
Context Dependency as a Predictor of Replicability
Gollwitzer, M., & Schwabe, J. (2021) · Review of General Psychology · doi:10.1177/10892680211015635 · Cited by 17
A toolbox to evaluate the trustworthiness of published findings
Adler, S. J., Röseler, L., & Schöniger, M. K. (2023) · Journal of Business Research · doi:10.1016/j.jbusres.2023.114189 · Cited by 21
Evaluating the Replicability of Social Priming Studies
Giolla, E. M., Karlsson, S., Neequaye, D. A., & Bergquist, M. (2024) · Meta-Psychology · doi:10.15626/mp.2022.3308 · Cited by 23
Broken windows, mediocre methods, and substandard statistics
Wicherts, J. M., & Bakker, M. (2013) · Group Processes & Intergroup Relations · doi:10.1177/1368430213502557 · Cited by 17
Romanovska, L., Janssen, R., & Bonte, M. (2021) · NeuroImage: Clinical · doi:10.1016/j.nicl.2021.102588 · Cited by 25
The Technological Future of Love
Nyholm, S., Danaher, J., & Earp, B. D. (2021) · Routledge eBooks · doi:10.4324/9781003014331-18 · Cited by 15
Brandone, A. C., & Stout, W. A. (2022) · Journal of Cognition and Development · doi:10.1080/15248372.2022.2146117 · Cited by 16
ROCZNIKI PSYCHOLOGICZNE / ANNALS OF PSYCHOLOGY
Soroko, E., & Psychologii, I. (2013) · Cited by 14
An Analysis of Nonsignificant Results in Audiology Using Bayes Factors
Brydges, C. R., & Gaeta, L. (2019) · Journal of Speech Language and Hearing Research · doi:10.1044/2019_jslhr-h-19-0182 · Cited by 14
Tunç, D. U., Tunç, M. N., & Eper, Z. B. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916221114835 · Cited by 18
Metadata
- Authors
- Bakker, M., van Dijk, A., & Wicherts, J. M.
- Affiliations
- University of Amsterdam (NL)
- University of Amsterdam, The Netherlands
- Tilburg University (NL)
- Venue
- Perspectives on Psychological Science
- Publisher
- SAGE Publications
- Published
- 2012-11
- Volume
- 7
- Issue
- 6
- Pages
- 543-554
- ISSN
- 1745-6916 (ISSN-L)
- 1745-6924
- OpenAlex
- W2157668596
- Cited by
- 800
- References
- 75
- Citations by year
- 2026: 14 · 2025: 32 · 2024: 39 · 2023: 50 · 2022: 52 · 2021: 100 · 2020: 63 · 2019: 82 · 2018: 87 · 2017: 88 · 2016: 56 · 2015: 59 · 2014: 52 · 2013: 19 · 2012: 5
- FWCI
- 49.25
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Perspectives on Psychological Science (publishedVersion)
- Research portal (Tilburg University) (publishedVersion)
- PubMed (publishedVersion)
- Data Archiving and Networked Services (DANS) (submittedVersion)
- UvA-DARE (University of Amsterdam) (submittedVersion)
- Funders
- Nederlandse Organisatie voor Wetenschappelijk Onderzoek (016-125-385)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Education › Academic integrity and plagiarism
- Keywords
- null hypothesis significance testing, statistical power, publication bias, questionable research practices, false positives, meta-analysis, replication, sample size, p-values, research integrity, editorial policy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
