Cited by 274Psychology Research and BibliometricsAcademic Publishing and Open AccessMeta-analysis and systematic reviews

The DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.

Science or Art? How Aesthetic Standards Grease the Way Through the Publication Bottleneck but Undermine Science

Giner-Sorolla, Roger·2012·Perspectives on Psychological Science

DOI 10.1177/1745691612457576

Open this paper in CoChat — free account

Abstract

The current crisis in psychological research involves issues of fraud, replication, publication bias, and false positive results. I argue that this crisis follows the failure of widely adopted solutions to psychology’s similar crisis of the 1970s. The untouched root cause is an information-economic one: Too many studies divided by too few publication outlets equals a bottleneck. Articles cannot pass through just by showing theoretical meaning and methodological rigor; their results must appear to support the hypothesis perfectly. Consequently, psychologists must master the art of presenting perfect-looking results just to survive in the profession. This favors aesthetic criteria of presentation in a way that harms science’s search for truth. Shallow standards of statistical perfection distort analyses and undermine the accuracy of cumulative data; narrative expectations encourage dishonesty about the relationship between results and hypotheses; criteria of novelty suppress replication attempts. Concerns about truth in research are emerging in other sciences and may eventually descend on our heads in the form of difficult and insensitive regulations. I suggest a more palatable solution: to open the bottleneck, putting structures in place to reward broader forms of information sharing beyond the exquisite art of present-day journal publication.

Integrity signals

Registry

Crossref · 10.1177/1745691612457576

Cites

70 of 70 references verified0 citation errors · 0 not checkable

Statistics

Recomputing p-values needs the paper’s full text.

Claims the paper makes

This paper’s full text isn’t openly available, so its claims and self-check weren’t run. The registry and citation checks still apply.

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
The Elaboration Likelihood Model of Persuasion
Petty, R. E., & Cacioppo, J. T. (1986) · Advances in Experimental Social Psychology · doi:10.1016/s0065-2601(08)60214-2 · Cited by 8,822
False-Positive Psychology: Undisclosed Flexibility in Data Collection and Analysis Allows Presenting Anything as Significant
Simmons, J. P., Nelson, L. D., & Simonsohn, U. (2011) · Psychological Science · doi:10.1177/0956797611417632 · Cited by 6,567
Heuristic versus systematic information processing and the use of source versus message cues in persuasion.
Chaiken, S. (1980) · Journal of Personality and Social Psychology · doi:10.1037//0022-3514.39.5.752 · Cited by 5,516
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · CHANCE · doi:10.1080/09332480.2005.10722754 · Cited by 4,702 · cited 3×
“It was in that field that Ioannidis (2005) declared that “most published research findings are false” because of incentives to publish only positive results.”
Background
The earth is round (p < .05).
Cohen, J. (1994) · American Psychologist · doi:10.1037/0003-066x.49.12.997 · Cited by 4,003
The Handbook of Research Synthesis.
Howel, D., Cooper, H., & Hedges, L. V. (1995) · Biometrics · doi:10.2307/2533295 · Cited by 3,657
Processing Fluency and Aesthetic Pleasure: Is Beauty in the Perceiver's Processing Experience?
Reber, R., Schwarz, N., & Winkielman, P. (2004) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0804_3 · Cited by 3,149
Raise standards for preclinical cancer research
Begley, C. G., & Ellis, L. M. (2012) · Nature · doi:10.1038/483531a · Cited by 2,979 · cited 1×
“Confidence in the applied usefulness of the publication process has taken a hit, as clinical trials have demonstrated unusually low success rates when trying to reproduce academic results (Begley & Ellis, 2012; Prinz, Schlange, & Asadullah, 2011; Turner, Matthews, et al., 2008).”
Result
Statistical methods in psychology journals: Guidelines and explanations.
Wilkinson, L., & Task Force on Statistical Inference (1999) · American Psychologist · doi:10.1037/0003-066x.54.8.594 · Cited by 2,791

Show all 70 references

Research works printed but not linked: 10

Carpenter D., 2007, Northwestern University Law Review, 101, 687
10.1037/0022-3514.39.5.752 · DOI · Paper page
Chamberlin J., 2000, APA Monitor, 31, 36
Eco U., 1985, Daedalus, 114, 161
Gillie O., 1977, The Phi Delta Kappan, 58, 469
ISI Web of Knowledge. (2012). Journal citation reports. Retrieved from http://admin-apps.webofknowledge.com/JCR/JCR?PointOfEntry=Home&SID=R2H17OMe9G5oN@26iil
Kaiser C. R., 2012, Dialogue, 26, 8
Pennington N., 1991, Cardozo Law Review, 13, 519
Ritchie S. J., 2012, The Psychologist, 25, 346
Voss J. F., 1999, Narrative comprehension, causality, and coherence: Essays in honor of Tom Trabasso, 235

Sorted by citations

The preregistration revolution
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708274114 · Cited by 1,998
Editors’ Introduction to the Special Section on Replicability in Psychological Science: A Crisis of Confidence?
Pashler, H., & Wagenmakers, E. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612465253 · Cited by 1,321
Untitled work
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
Replicability, Robustness, and Reproducibility in Psychological Science
Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Dreber, A., Fidler, F., Hilgard, J., Kline Struhl, M., Nuijten, M. B., et al. (2022) · Annual Review of Psychology · doi:10.1146/annurev-psych-020821-114157 · Cited by 770
Registered Reports: A Method to Increase the Credibility of Published Results
Nosek, B. A., & Lakens, D. (2014) · Social Psychology · doi:10.1027/1864-9335/a000192 · Cited by 716
“This creates incentives to avoid or ignore replications and negative results, even at the expense of accuracy (Giner-Sorolla, 2012; Nosek, Spies, & Motyl, 2012).”
Background
The Value of Direct Replication
Simons, D. J. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691613514755 · Cited by 630
Why Science Is Not Necessarily Self-Correcting
Ioannidis, J. P. A. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612464056 · Cited by 563
The prevalence of statistical reporting errors in psychology (1985–2013)
Nuijten, M. B., Hartgerink, C. H. J., van Assen, M. A. L. M., Epskamp, S., & Wicherts, J. M. (2016) · Behavior Research Methods · doi:10.3758/s13428-015-0664-2 · Cited by 510
“Whatever the cause of this over-representation might be, there seems to be too much focus on getting B perfect, ^ significant results (see also Giner-Sorolla, 2012).”
Replication, falsification, and the crisis of confidence in social psychology
Earp, B. D., & Trafimow, D. (2015) · Frontiers in Psychology · doi:10.3389/fpsyg.2015.00621 · Cited by 472
Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention
Ioannidis, J. P. A., Munafò, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.02.010 · Cited by 471
Deep impact: unintended consequences of journal rank
Brembs, B., Button, K., & Munafò, M. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00291 · Cited by 441
Prevention is better than cure: addressing anti-vaccine conspiracy theories
Jolley, D., & Douglas, K. M. (2017) · Journal of Applied Social Psychology · doi:10.1111/jasp.12453 · Cited by 446
Pre-registration in social psychology—A discussion and suggested template
Veer, A. V. '., & Giner‐Sorolla, R. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2016.03.004 · Cited by 464
Self-citation
Exploratory Research
Swedberg, R. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.002 · Cited by 471
Implications of the Credibility Revolution for Productivity, Creativity, and Progress
Vazire, S. (2018) · Perspectives on Psychological Science · doi:10.1177/1745691617751884 · Cited by 398
Fair Statistical Communication in HCI
Dragicevic, P. (2016) · Human-computer interaction series · doi:10.1007/978-3-319-26633-6_13 · Cited by 365
Implementing Reproducible Research
Stodden, V. (2014) · doi:10.1201/b16868 · Cited by 314
Challenges for assessing replicability in preclinical cancer biology
Errington, T. M., Denis, A., Perfito, N., Iorns, E., & Nosek, B. A. (2021) · eLife · doi:10.7554/elife.67995 · Cited by 345
Continuously Cumulating Meta-Analysis and Replicability
Braver, S. L., Thoemmes, F. J., & Rosenthal, R. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614529796 · Cited by 308
Initial evidence of research quality of registered reports compared with the standard publishing model
Soderberg, C. K., Errington, T. M., Schiavone, S. R., Bottesini, J., Thorn, F. S., Vazire, S., Esterling, K. M., & Nosek, B. A. (2021) · Nature Human Behaviour · doi:10.1038/s41562-021-01142-4 · Cited by 295
A Short (Personal) Future History of Revolution 2.0
Spellman, B. A. (2015) · Perspectives on Psychological Science · doi:10.1177/1745691615609918 · Cited by 213
How Many Participants Do I Need to Test an Interaction? Conducting an Appropriate Power Analysis and Achieving Sufficient Power to Detect an Interaction
Sommet, N., Weissman, D. L., Cheutin, N., & Elliot, A. J. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231178728 · Cited by 313
An Agenda for Open Science in Communication
Dienlin, T., Johannes, N., Bowman, N. D., Masur, P. K., Engesser, S., Kümpel, A. S., Lukito, J., Bier, L. M., Zhang, R., Johnson, B. K., et al. (2020) · Journal of Communication · doi:10.1093/joc/jqz052 · Cited by 252
When Does HARKing Hurt? Identifying When Different Types of Undisclosed Post Hoc Hypothesizing Harm Scientific Progress
Rubin, M. (2017) · Review of General Psychology · doi:10.1037/gpr0000128 · Cited by 209
Reducing bias, increasing transparency and calibrating confidence with preregistration
Hardwicke, T. E., & Wagenmakers, E. (2023) · Nature Human Behaviour · doi:10.1038/s41562-022-01497-2 · Cited by 205
“Rarely safe to assume”: Evaluating the use and interpretation of manipulation checks in experimental social psychology
Ejelöv, E., & Luke, T. J. (2019) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2019.103937 · Cited by 175
Crowdsourcing hypothesis tests: Making transparent how design choices shape research results.
Landy, J. F., Jia, M. (., Ding, I. L., Viganola, D., Tierney, W., Dreber, A., Johannesson, M., Pfeiffer, T., Ebersole, C. R., Gronau, Q. F., et al. (2020) · Psychological Bulletin · doi:10.1037/bul0000220 · Cited by 168
The Preregistration RevolutionPreprint
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/2dxu5 · Cited by 220
Reconceptualizing replication as a sequence of different studies: A replication typology
Hüffmeier, J., Mazei, J., & Schultze, T. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.09.009 · Cited by 177
Lessons From Pinocchio: Cues to Deception May Be Highly Exaggerated
Luke, T. J. (2019) · Perspectives on Psychological Science · doi:10.1177/1745691619838258 · Cited by 174
Let’s Put Our Money Where Our Mouth Is
Maner, J. K. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691614528215 · Cited by 151
The Production of Knowledge
(2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519 · Cited by 154
Promoting Open Science to Increase the Trustworthiness of Evidence in Special Education
Adelson, J. L., Barton, E., Bradshaw, C., Nosek, B. A., Bryant, D., Cook, B. G., Coyne, M., DeBettencourt, L., DeHaven, A. C., Dymond, S., et al. (2018) · Exceptional Children · doi:10.1177/0014402918793138 · Cited by 136
Reporting standards for literature searches and report inclusion criteria: making research syntheses more transparent and easy to replicate
Atkinson, K. M., Koenka, A. C., Sanchez, C. E., Moshontz, H., & Cooper, H. M. (2014) · Research Synthesis Methods · doi:10.1002/jrsm.1127 · Cited by 144
How Trustworthy Is the Scientific Literature in Industrial and Organizational Psychology?
Kepes, S., & McDaniel, M. A. (2013) · Industrial and Organizational Psychology · doi:10.1111/iops.12045 · Cited by 136
Increasing the Transparency of Research Papers with Explorable Multiverse Analyses
Dragicevic, P., Jansen, Y., Sarma, A., Kay, M., & Chevalier, F. (2019) · CHI Conference on Human Factors in Computing Systems · doi:10.1145/3290605.3300295 · Cited by 144
Understanding the Replication Crisis as a Base Rate Fallacy
Bird, A. (2018) · The British Journal for the Philosophy of Science · doi:10.1093/bjps/axy051 · Cited by 126
P-hacking and publication bias interact to distort meta-analytic effect size estimates
Friese, M., & Frankenbach, J. (2020) · Psychological Methods · doi:10.1037/met0000246 · Cited by 122
Replication Research and Special Education
Travers, J. C., Cook, B. G., Therrien, W. J., & Coyne, M. D. (2016) · Remedial and Special Education · doi:10.1177/0741932516648462 · Cited by 121
Replicability Crisis in Social Psychology: Looking at the Past to Find New Pathways for the Future
Świątkowski, W., & Dompnier, B. (2017) · International Review of Social Psychology · doi:10.5334/irsp.66 · Cited by 132
On the Other Side of the Mirror: Priming in Cognitive and Social Psychology
Doyen, S., Klein, O., Simons, D. J., & Axel Cleeremans, B. (2014) · Social Cognition · doi:10.1521/soco.2014.32.supp.12 · Cited by 119
Quantifying Support for the Null Hypothesis in Psychology: An Empirical Investigation
Aczél, B., Pálfi, B., Szollosi, A., Kovács, M., Szászi, B., Szécsi, P., Zrubka, M., Gronau, Q. F., van den Bergh, D., & Wagenmakers, E. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918773742 · Cited by 122
Some Whys and Hows of Experiments in Human—Computer Interaction
Hornbæk, K. (2013) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000043 · Cited by 109
Why Publishing Everything Is More Effective than Selective Publishing of Statistically Significant Results
van Assen, M. A. L. M., van Aert, R. C. M., Nuijten, M. B., & Wicherts, J. M. (2014) · PLoS ONE · doi:10.1371/journal.pone.0084896 · Cited by 113
Quality Uncertainty Erodes Trust in Science
Vazire, S. (2017) · Collabra: Psychology · doi:10.1525/collabra.74 · Cited by 106
Prospects of functional magnetic resonance imaging as lie detector
Rusconi, E., & Mitchener-Nissen, T. (2013) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2013.00594 · Cited by 106
Calibrating the Scientific Ecosystem Through Meta-Research
Hardwicke, T. E., Serghiou, S., Janiaud, P., Danchev, V., Crüwell, S., Goodman, S. N., & Ioannidis, J. P. A. (2020) · Annual Review of Statistics and Its Application · doi:10.1146/annurev-statistics-031219-041104 · Cited by 98
PsychDisclosure.org
LeBel, E. P., Borsboom, D., Giner‐Sorolla, R., Hasselman, F., Peters, K. R., Ratliff, K. A., & Smith, C. T. (2013) · Perspectives on Psychological Science · doi:10.1177/1745691613491437 · Cited by 106
Self-citation
I feel good, therefore I am real: Testing the causal influence of mood on state authenticity
Lenton, A. P., Slabu, L., Sedikides, C., & Power, K. (2013) · Cognition & Emotion · doi:10.1080/02699931.2013.778818 · Cited by 121
A Call for Examining Replication and Bias in Special Education Research
Cook, B. G. (2014) · Remedial and Special Education · doi:10.1177/0741932514528995 · Cited by 100
The Replication Paradox: Combining Studies can Decrease Accuracy of Effect Size Estimates
Nuijten, M. B., van Assen, M. A. L. M., Veldkamp, C. L. S., & Wicherts, J. M. (2015) · Review of General Psychology · doi:10.1037/gpr0000034 · Cited by 73
Why Selective Publication of Statistically Significant Results Can Be Effective
de Winter, J., & Happee, R. (2013) · PLoS ONE · doi:10.1371/journal.pone.0066463 · Cited by 69
Scientists’ Reputations Are Based on Getting It Right, Not Being Right
Ebersole, C. R., Axt, J. R., & Nosek, B. A. (2016) · PLoS Biology · doi:10.1371/journal.pbio.1002460 · Cited by 67
Laypeople Can Predict Which Social-Science Studies Will Be Replicated Successfully
Hoogeveen, S., Sarafoglou, A., & Wagenmakers, E. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920919667 · Cited by 62
Selfishly benevolent or benevolently selfish: When self-interest undermines versus promotes prosocial behavior
Zlatev, J. J., & Miller, D. T. (2016) · Organizational Behavior and Human Decision Processes · doi:10.1016/j.obhdp.2016.08.004 · Cited by 64
Does preregistration improve the credibility of research findings?
Rubin, M. (2020) · The Quantitative Methods for Psychology · doi:10.20982/tqmp.16.4.p376 · Cited by 61
“…(Simmons, Nelson, & Simonsohn, 2012), (b) providing logical and principled justifications for nonstandard data exclusions and analytical approaches (Giner-Sorolla, 2012, p. 568), (c) providing public access to their standard data analysis procedures (e.g., Lin & Green, 2016), (d) providing public…”
Method
Preregistration in practice: A comparison of preregistered and non-preregistered studies in psychology
van den Akker, O. R., van Assen, M. A. L. M., Bakker, M., Elsherif, M. M., Wong, T. K., & Wicherts, J. M. (2023) · Behavior Research Methods · doi:10.3758/s13428-023-02277-0 · Cited by 84
Into the wild: Field research can increase both replicability and real-world impact
Maner, J. K. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.09.018 · Cited by 71
Improving Psychological Science through Transparency and Openness: An Overview
Hales, A. H., Wesselmann, E. D., & Hilgard, J. (2018) · Perspectives on Behavior Science · doi:10.1007/s40614-018-00186-8 · Cited by 67
Self-Determination Theory and HCI Games Research: Unfulfilled Promises and Unquestioned Paradigms
Tyack, A., & Mekler, E. D. (2024) · ACM Transactions on Computer-Human Interaction · doi:10.1145/3673230 · Cited by 57
Solutions to the problems of incremental validity testing in relationship science
Wang, Y. A., & Eastwick, P. W. (2020) · Personal Relationships · doi:10.1111/pere.12309 · Cited by 61
Open Science Promotes Diverse, Just, and Sustainable Research and Educational Outcomes
Grahe, J. E., Cuccolo, K., Leighton, D. C., & Alvarez, L. D. C. (2019) · Psychology Learning & Teaching · doi:10.1177/1475725719869164 · Cited by 63
From Sex Objects to Human Beings
Bernard, P., Gervais, S. J., Allen, J. M., Delmée, A., & Klein, O. (2015) · Psychology of Women Quarterly · doi:10.1177/0361684315580125 · Cited by 55
Sleep spindles and general cognitive ability – A meta-analysis
Ujma, P. P. (2018) · Sleep Spindles & Cortical Up States · doi:10.1556/2053.2.2018.01 · Cited by 49
Triple P-Positive Parenting programs: the folly of basing social policy on underpowered flawed studies
Coyne, J. C., & Kwakkenbos, L. (2013) · BMC Medicine · doi:10.1186/1741-7015-11-11 · Cited by 51
Displaced revenge: Can revenge taste “sweet” if it aims at a different target?
Sjöström, A., & Gollwitzer, M. (2014) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2014.09.016 · Cited by 50
Frightened by an Old Scarecrow: The Remarkable Resilience of Demand Characteristics
Sharpe, D., & Whelton, W. J. (2016) · Review of General Psychology · doi:10.1037/gpr0000087 · Cited by 53
From crisis of evidence to a “crisis” of relevance? Incentive-based answers for social psychology’s perennial relevance worries
Giner‐Sorolla, R. (2018) · European Review of Social Psychology · doi:10.1080/10463283.2018.1542902 · Cited by 52
Self-citation
Open Science: What, Why, and HowPreprint
Spellman, B., Gilbert, E. A., & Corker, K. S. (2017) · doi:10.31234/osf.io/ak6jr · Cited by 50
A Concise Set of Core Recommendations to Improve the Dependability of Psychological Research
Lishner, D. A. (2015) · Review of General Psychology · doi:10.1037/gpr0000028 · Cited by 49
Psychology, replication & beyond
Laws, K. R. (2016) · BMC Psychology · doi:10.1186/s40359-016-0135-2 · Cited by 52
Questionable research practices in student final theses – Prevalence, attitudes, and the role of the supervisor’s perceived attitudes
Krishna, A., & Peter, S. M. (2018) · PLoS ONE · doi:10.1371/journal.pone.0203470 · Cited by 46
Too Good to be False: Nonsignificant Results Revisited
Hartgerink, C. H. J., Wicherts, J. M., & van Assen, M. A. L. M. (2017) · Collabra Psychology · doi:10.1525/collabra.71 · Cited by 45
Replication crisis or an opportunity to improve scientific production?
Navarro, M. D. F., Pascual‐Llobell, J., Pascual‐Soler, M., Perezgonzalez, J. D., & Berríos-Riquelme, J. (2020) · European Journal of Education · doi:10.1111/ejed.12417 · Cited by 55
Negativland - a home for all findings in psychology
Laws, K. R. (2013) · BMC Psychology · doi:10.1186/2050-7283-1-2 · Cited by 45
Enhancing transparency of the research process to increase accuracy of findings: A guide for relationship researchers
Campbell, L., Loving, T. J., & LeBel, E. P. (2014) · Personal Relationships · doi:10.1111/pere.12053 · Cited by 40
Investigating the replicability of the social and behavioural sciences
Tyner, A. H., Abatayo, A. L., Daley, M., Field, S., Fox, N. W., Haber, N., Hahn, K. M., Struhl, M. K., Mawhinney, B., Miske, O., et al. (2026) · Nature · doi:10.1038/s41586-025-10078-y · Cited by 54
Perceiving happiness in an intergroup context: The role of race and attention to the eyes in differentiating between true and false smiles.
Friesen, J. P., Kawakami, K., Vingilis‐Jaremko, L., Caprara, R., Sidhu, D. M., Williams, A., Hugenberg, K., Rodríguez‐Bailón, R., Cañadas, E., & Niedenthal, P. M. (2019) · Journal of Personality and Social Psychology · doi:10.1037/pspa0000139 · Cited by 49
Open Science and Radical Solutions for Diversity, Equity and Quality in Research: A Literature Review of Different Research Schools, Philosophies and Frameworks and Their Potential Impact on Science and Education
Stracke, C. M. (2020) · Lecture notes in educational technology · doi:10.1007/978-981-15-4276-3_2 · Cited by 49
Frequentist and Bayesian inference: A conceptual primer
van Zyl, C. J. J. (2018) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2018.06.004 · Cited by 43
How many participants do I need to test an interaction? Conducting an appropriate power analysis and achieving sufficient power to detect an interaction
Sommet, N., Weissman, D. L., Cheutin, N., & Elliot, A. (2022) · doi:10.31219/osf.io/xhe3u · Cited by 36
How can preregistration contribute to research in our field?
Jonas, K. J., & Cesario, J. (2015) · Comprehensive Results in Social Psychology · doi:10.1080/23743603.2015.1070611 · Cited by 38
Psychological science’s replicability crisis and what it means for science in the courtroom.
Chin, J. M. (2014) · Psychology Public Policy and Law · doi:10.1037/law0000012 · Cited by 39
Radical Solutions and Open Science
Burgos, D. (2020) · Lecture notes in educational technology · doi:10.1007/978-981-15-4276-3 · Cited by 49
Does the conclusion follow from the evidence? Recommendations for improving research
Hales, A. H. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.09.011 · Cited by 54
Practicing What We Preach (and Sometimes Study): Methodological Issues in Experimental Laboratory Research
Nichols, A., & Edlund, J. E. (2015) · Review of General Psychology · doi:10.1037/gpr0000027 · Cited by 34
Selective Hypothesis Reporting in Psychology: Comparing Preregistrations and Corresponding Publications
van den Akker, O. R., van Assen, M. A. L. M., Enting, M., de Jonge, M., Ong, H. H., Rüffer, F. F., Schoenmakers, M., Stoevenbelt, A. H., Wicherts, J. M., & Bakker, M. (2023) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231187988 · Cited by 45
Arguing, Obeying and Defying
Gibson, S. (2019) · Cambridge University Press eBooks · doi:10.1017/9781108367943 · Cited by 67
The empirical march: Making science better at self-correction.
Makel, M. C. (2014) · Psychology of Aesthetics Creativity and the Arts · doi:10.1037/a0035803 · Cited by 35
An Introduction to Replication Research in Gifted Education
Makel, M. C., & Plucker, J. A. (2015) · Gifted Child Quarterly · doi:10.1177/0016986215578747 · Cited by 31
An Initial Test of the Cosmetics Dehumanization Hypothesis: Heavy Makeup Diminishes Attributions of Humanness-Related Traits to Women
Bernard, P., Content, J., Servais, L., Wollast, R., & Gervais, S. J. (2020) · Sex Roles · doi:10.1007/s11199-019-01115-y · Cited by 33
Special Interest Group on Transparent Statistics in HCI
Kay, M., Haroz, S., Guha, S., & Dragicevic, P. (2016) · CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA) · doi:10.1145/2851581.2886442 · Cited by 31
Is something rotten in the state of Denmark? Cross-national evidence for widespread involvement but not systematic use of questionable research practices across all fields of research
Schneider, J. W., Allum, N., Andersen, J. P., Petersen, M. B., Madsen, E. B., Mejlgaard, N., & Zachariae, R. H. (2024) · PLoS ONE · doi:10.1371/journal.pone.0304342 · Cited by 34
Evaluating Registered Reports: A Naturalistic Comparative Study of Article Impact
Hopun, L. T., Singleton Thorn, F., Nosek, B. A., & Errington, T. M. (2017) · doi:10.31219/osf.io/5y8w7 · Cited by 29
Pre-registration and Results-Free Review in Observational and Qualitative Research
Jacobs, A. M. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.009 · Cited by 30
Who is open to a narcissistic romantic partner? The roles of sensation seeking, trait anxiety, and similarity
Grosz, M. P., Dufner, M., Back, M. D., & Denissen, J. J. A. (2015) · Journal of Research in Personality · doi:10.1016/j.jrp.2015.05.007 · Cited by 32
Addressing replicability concerns via adversarial collaboration: Discovering hidden moderators of the minimal intergroup discrimination effect
Kerr, N. L., Ao, X., Hogg, M. A., & Zhang, J. (2018) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2018.05.001 · Cited by 28
Open Science
Spellman, B. A., Gilbert, E. A., & Corker, K. S. (2018) · Wiley eBooks · doi:10.1002/9781119170174.epcn519 · Cited by 88
Psychology Exceptionalism and the Multiple Discovery of the Replication Crisis
Nelson, N. C., Chung, J., Ichikawa, K., & Malik, M. M. (2021) · Review of General Psychology · doi:10.1177/10892680211046508 · Cited by 27
Pre-Registration in Social Psychology—a Discussion and Suggested TemplatePreprint
Veer, A. V. '., & Giner‐Sorolla, R. (2016) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/4frms · Cited by 31
Self-citation

Authors: Giner-Sorolla, R.
Affiliations: University of Kent, United Kingdom
Venue: Perspectives on Psychological Science
Publisher: SAGE Publications
Published: 2012-11
Volume: 7
Issue: 6
Pages: 562-571
ISSN: 1745-6916 (ISSN-L)
1745-6924
DOI: 10.1177/1745691612457576
OpenAlex: W2125515636
Cited by: 274
References: 70
Citations by year: 2026: 5 · 2025: 9 · 2024: 8 · 2023: 21 · 2022: 17 · 2021: 17 · 2020: 40 · 2019: 40 · 2018: 19 · 2017: 19 · 2016: 22 · 2015: 14 · 2014: 19 · 2013: 18 · 2012: 5
FWCI: 23.99
Type: journal article
Language: en
Open access: closed
Licence: journals.sagepub.com/page/policies/text-and-data-mining-license (tdm)
Locations: Perspectives on Psychological Science (publishedVersion)
PubMed (publishedVersion)
Kent Academic Repository (University of Kent) (submittedVersion)
Topics: Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
Keywords: publication bias, replication, scientific fraud, false positives, statistical significance thresholds, information economics, open science, research integrity

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

Science or Art? How Aesthetic Standards Grease the Way Through the Publication Bottleneck but Undermine Science

Abstract

Overview

Integrity signals

Verification

Claims the paper makes

Claims other papers make about this one

Citations

Cites

Cited by

Related

Metadata

Record

About these checks