The DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
What is replication?
Open accessPublished version of a preprint
Abstract
Credibility of scientific claims is established with evidence for their replicability using new data. According to common understanding, replication is repeating a study's procedure and observing whether the prior finding recurs. This definition is intuitive, easy to apply, and incorrect. We propose that replication is a study for which any outcome would be considered diagnostic evidence about a claim from prior research. This definition reduces emphasis on operational characteristics of the study and increases emphasis on the interpretation of possible outcomes. The purpose of replication is to advance theory by confronting existing understanding with new evidence. Ironically, the value of replication may be strongest when existing understanding is weakest. Successful replication provides evidence of generalizability across the conditions that inevitably differ from the original study; Unsuccessful replication indicates that the reliability of the finding may be more constrained than recognized previously. Defining replication as a confrontation of current theoretical expectations clarifies its important, exciting, and generative role in scientific progress.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Small adjustments to the overall study do not diminish the replicatory nature and value of the new scholarship.
“Furthermore, they argued that small adjustments to the overall study do not diminish the replicatory nature and value of the new scholarship.”
From Examining Counselor Trainees’ Clinical Impressions of Pornography Use: Implications for Couple and Family Counselors (2026) · cites this paper as Nosek and Errington (2020)
In “Replication redux,” the authors define replication by whether its outcomes test a prior claim, rather than by exact repetition of procedures. This supports the idea that adjustments need not disqualify a study as a replication. But “Replication resolved” explains that a seemingly small difference can matter: seasonal differences in frogs meant some attempted replications were not studying the same thing. The claim is too categorical in saying small adjustments do not diminish replicatory status. (LLM, conf=0.85)
Experimental — accuracy not yet measured
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
(2002) · Cited by 13,211
Falsification and the Methodology of Scientific Research Programmes
Lakatos, I. (1976) · Can Theories be Refuted? · doi:10.1007/978-94-010-1863-0_14 · Cited by 3,915
A manifesto for reproducible science
Munafò, M. R., Nosek, B. A., Bishop, D. V. M., Button, K. S., Chambers, C. D., Percie du Sert, N., Simonsohn, U., Wagenmakers, E.-J., Ware, J. J., & Ioannidis, J. P. A. (2017) · Nature Human Behaviour · doi:10.1038/s41562-016-0021 · Cited by 3,397
Self-citationPromoting an open research culture
Nosek, B. A., Alter, G., Banks, G. C., Borsboom, D., Bowman, S. D., Breckler, S. J., Buck, S., Chambers, C. D., Chin, G., Christensen, G., et al. (2015) · Science · doi:10.1126/science.aab2374 · Cited by 2,708
Self-citationThe preregistration revolution
Nosek, B. A., Ebersole, C. R., DeHaven, A. C., & Mellor, D. T. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1708274114 · Cited by 1,998
Self-citationCamerer, C. F., Dreber, A., Holzmeister, F., Ho, T.-H., Huber, J., Johannesson, M., Kirchler, M., Nave, G., Nosek, B. A., Pfeiffer, T., et al. (2018) · Nature Human Behaviour · doi:10.1038/s41562-018-0399-z · Cited by 1,521
Self-citationNosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
Self-citationShall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences
Schmidt, S. (2009) · Review of General Psychology · doi:10.1037/a0015108 · Cited by 1,125
Muthukrishna, M., & Henrich, J. (2019) · Nature Human Behaviour · doi:10.1038/s41562-018-0522-1 · Cited by 741
Border, R., Johnson, E. C., Evans, L. M., Smolen, A., Berley, N., Sullivan, P. F., & Keller, M. C. (2019) · American Journal of Psychiatry · doi:10.1176/appi.ajp.2018.18070881 · Cited by 629
The alleged crisis and the illusion of exact replication
Stroebe, W., & Strack, F. (2014) · Perspectives on Psychological Science · doi:10.1177/1745691613514450 · Cited by 597
On the scientific superiority of conceptual replications for scientific progress
Crandall, C., & Sherman, J. (2016) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2015.10.002 · Cited by 313
Bartholomew, D. J., & Jeffreys, H. (1976) · Journal of the Royal Statistical Society Series D (The Statistician) · doi:10.2307/2988142 · Cited by 38
Bain, W. A. (1932) · Quarterly journal of experimental physiology · doi:10.1113/expphysiol.1932.sp000574 · Cited by 14
Flagged first, then by citations
Research works printed but not linked: 2
- H Jeffreys, 1973, Scientific Inference
- I Lakatos, 1976, Can Theories be Refuted? Synthese Library (Monographs on Epistemology, Logic, Methodology, Philosophy of Science, Sociology of Science and of Knowledge, and on the Mathematical Methods of Social and Behavioral Sciences), 205
Cited by
Sorted by citations
Replicability, Robustness, and Reproducibility in Psychological Science
Nosek, B. A., Hardwicke, T. E., Moshontz, H., Allard, A., Corker, K. S., Dreber, A., Fidler, F., Hilgard, J., Kline Struhl, M., Nuijten, M. B., et al. (2022) · Annual Review of Psychology · doi:10.1146/annurev-psych-020821-114157 · Cited by 770
Self-citationInvestigating the replicability of preclinical cancer biology
Errington, T. M., Mathur, M., Soderberg, C. K., Denis, A., Perfito, N., Iorns, E., & Nosek, B. A. (2021) · eLife · doi:10.7554/elife.71601 · Cited by 462
Self-citationChallenges for assessing replicability in preclinical cancer biology
Errington, T. M., Denis, A., Perfito, N., Iorns, E., & Nosek, B. A. (2021) · eLife · doi:10.7554/elife.67995 · Cited by 351
Self-citationAuditing Algorithms: Understanding Algorithmic Systems from the Outside In
Metaxa, D., Park, J.-S., Robertson, R. E., Karahalios, K. G., Wilson, C., Hancock, J. T., & Sandvig, C. (2021) · Foundations and Trends® in Human–Computer Interaction · doi:10.1561/1100000083 · Cited by 200
Validation of cluster analysis results on validation data: A systematic framework
Ullmann, T., Hennig, C. M., & Boulesteix, A. (2021) · Wiley Interdisciplinary Reviews Data Mining and Knowledge Discovery · doi:10.1002/widm.1444 · Cited by 156
Replication is important for educational psychology: Recent developments and key issues
Plucker, J. A., & Makel, M. C. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1895796 · Cited by 137
Low availability of code in ecology: A call for urgent action
Čulina, A., van den Berg, I., Evans, S. R., & Sánchez‐Tójar, A. (2020) · PLoS Biology · doi:10.1371/journal.pbio.3000763 · Cited by 122
Mesquida, C., Murphy, J., Lakens, D., & Warne, J. P. (2022) · Royal Society Open Science · doi:10.1098/rsos.220946 · Cited by 107
Many Labs 5: Testing Pre-Data-Collection Peer Review as an Intervention to Increase Replicability
Ebersole, C. R., Mathur, M. B., Baranski, E., Bart-Plange, D.-J., Buttrick, N. R., Chartier, C. R., Corker, K. S., Corley, M., Hartshorne, J. K., IJzerman, H., et al. (2020) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245920958687 · Cited by 105
Klein, R. A., Cook, C. L., Ebersole, C. R., Vitiello, C., Nosek, B. A., Hilgard, J., Ahn, P. H., Brady, A. J., Chartier, C. R., Christopherson, C. D., et al. (2022) · Collabra Psychology · doi:10.1525/collabra.35271 · Cited by 193
Self-citationKinds of Replication: Examining the Meanings of “Conceptual Replication” and “Direct Replication”
Derksen, M., & Morawski, J. G. (2022) · Perspectives on Psychological Science · doi:10.1177/17456916211041116 · Cited by 104
RETRACTED ARTICLE: High replicability of newly discovered social-behavioural findings is achievable
Protzko, J., Krosnick, J. A., Nelson, L. D., Nosek, B. A., Axt, J. R., Berent, M., Buttrick, N. R., DeBell, M., Ebersole, C. R., Lundmark, S., et al. (2023) · Nature Human Behaviour · doi:10.1038/s41562-023-01749-9 · Cited by 96
Self-citationRetractedIsager, P. M., van Aert, R. C. M., Bahník, Š., Brandt, M. J., DeSoto, K. A., Giner‐Sorolla, R., Krueger, J. I., Perugini, M., Ropovik, I., Veer, A. V. '., et al. (2021) · Psychological Methods · doi:10.1037/met0000438 · Cited by 94
Dated phylogeny suggests early Neolithic origin of Sino-Tibetan languages
Zhang, H., Ji, T., Pagel, M. D., & Mace, R. H. (2020) · Scientific Reports · doi:10.1038/s41598-020-77404-4 · Cited by 87
Open Science in Education Sciences
van Dijk, W., Schatschneider, C. W., & Hart, S. A. (2020) · Journal of Learning Disabilities · doi:10.1177/0022219420945267 · Cited by 84
Introduction to the EQIPD quality system
Bespalov, A., Bernard, R., Gilis, A., Gerlach, B., Guillén, J., Castagné, V., Lefevre, I. A., Ducrey, F., Monk, L., Bongiovanni, S., et al. (2021) · eLife · doi:10.7554/elife.63294 · Cited by 76
Biomedical researchers’ perspectives on the reproducibility of research
Cobey, K. D., Ebrahimzadeh, S., Page, M. J., Thibault, R. T., Nguyen, P., Abu-Dalfa, F., & Moher, D. (2024) · PLoS Biology · doi:10.1371/journal.pbio.3002870 · Cited by 75
Systematizing Confidence in Open Research and Evidence (SCORE)Preprint
Alipourfard, N., Arendt, B., Benjamin, D. M., Benkler, N., Bishop, M. M., Burstein, M. H., Bush, M., Caverlee, J., Chen, Y., Clark, C., et al. (2021) · SocArXiv (OSF Preprints) · doi:10.31235/osf.io/46mnb · Cited by 75
Self-citationSiegel, J. A., Huellemann, K. L., Hillier, C. C., & Campbell, L. (2019) · Body Image · doi:10.1016/j.bodyim.2019.12.003 · Cited by 70
Suicide capability within the ideation-to-action framework: A systematic scoping review
Bayliss, L. T., Christensen, S. A., Lamont‐Mills, A., & du Plessis, C. (2022) · PLoS ONE · doi:10.1371/journal.pone.0276070 · Cited by 66
Intolerance of uncertainty and threat generalization: A replication and extension
Bauer, E., MacNamara, A., Sandre, A., Lonsdorf, T. B., Weinberg, A., Morriss, J., & van Reekum, C. M. (2020) · Psychophysiology · doi:10.1111/psyp.13546 · Cited by 64
John, M. T. (2021) · Journal of Evidence Based Dental Practice · doi:10.1016/j.jebdp.2021.101645 · Cited by 59
Page, M. J., Moher, D., Fidler, F. M., Higgins, J. P. T., Brennan, S., Haddaway, N., Hamilton, D. G., Kanukula, R., Karunananthan, S., Maxwell, L. J., et al. (2021) · Systematic Reviews · doi:10.1186/s13643-021-01670-0 · Cited by 58
Using Big Data and Machine Learning in Personality Measurement: Opportunities and Challenges
Alexander, L., Mulfinger, E., & Oswald, F. L. (2020) · European Journal of Personality · doi:10.1002/per.2305 · Cited by 57
Improving preclinical studies through replications
Drude, N., Martinez‐Gamboa, L., Danziger, M., Dirnagl, U., & Toelch, U. (2021) · eLife · doi:10.7554/elife.62101 · Cited by 56
Remapping the Sport Brandscape: A Structured Review and Future Direction for Sport Brand Research
Baker, B. J., Kunkel, T., Doyle, J. P., Su, Y., Bredikhina, N., & Biscaia, R. (2022) · Journal of Sport Management · doi:10.1123/jsm.2021-0231 · Cited by 55
Replication and trustworthiness
Peels, R., & Bouter, L. M. (2021) · Accountability in Research · doi:10.1080/08989621.2021.1963708 · Cited by 54
Farrar, B. G., Voudouris, K., & Clayton, N. S. (2021) · Animal Behavior and Cognition · doi:10.26451/abc.08.02.14.2021 · Cited by 53
Ocean acidification drives global reshuffling of ecological communities
Nagelkerken, I., & Connell, S. D. (2022) · Global Change Biology · doi:10.1111/gcb.16410 · Cited by 52
Accessibility and generalizability: Are social media effects moderated by age or digital literacy?
Munger, K., Gopal, I., Nagler, J., & Tucker, J. A. (2021) · Research & Politics · doi:10.1177/20531680211016968 · Cited by 52
Field Experiments on Social Media
Mosleh, M., Pennycook, G., & Rand, D. G. (2021) · Current Directions in Psychological Science · doi:10.1177/09637214211054761 · Cited by 51
Investigating the replicability of the social and behavioural sciences
Tyner, A. H., Abatayo, A. L., Daley, M., Field, S., Fox, N. W., Haber, N., Hahn, K. M., Struhl, M. K., Mawhinney, B., Miske, O., et al. (2026) · Nature · doi:10.1038/s41586-025-10078-y · Cited by 51
Practical Methodological Reform Needs Good Theory
Gervais, W. M. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620977471 · Cited by 50
Mapping the discursive dimensions of the reproducibility crisis: A mixed methods analysis
Nelson, N. C., Ichikawa, K., Chung, J., & Malik, M. M. (2021) · PLoS ONE · doi:10.1371/journal.pone.0254090 · Cited by 49
Forty years in the making: A systematic review of the megatrends literature
Naughtin, C. K., Schleiger, E., Bratanova, A., Terhorst, A., & Hajkowicz, S. A. (2024) · Futures · doi:10.1016/j.futures.2024.103329 · Cited by 49
A framework for evaluating reproducibility and replicability in economics
Dreber, A., & Johannesson, M. (2024) · Economic Inquiry · doi:10.1111/ecin.13244 · Cited by 49
Estimating the Replicability of Sports and Exercise Science Research
Murphy, J., Caldwell, A. R., Mesquida, C., Ladell, A. J. M., Martínez, A. E., Tual, A., Denys, A. T., Cameron, B., Hooren, B. V., Parr, B., et al. (2025) · Sports Medicine · doi:10.1007/s40279-025-02201-w · Cited by 49
The best time to argue about what a replication means? Before you do it
Nosek, B. A., & Errington, T. M. (2020) · Nature · doi:10.1038/d41586-020-02142-6 · Cited by 47
Self-citationGordon, M., Viganola, D., Bishop, M., Chen, Y., Dreber, A., Goldfedder, B., Holzmeister, F., Johannesson, M., Liu, Y., Twardy, C. R., et al. (2020) · Royal Society Open Science · doi:10.1098/rsos.200566 · Cited by 47
Temporal validity as meta-science
Munger, K. (2023) · Research & Politics · doi:10.1177/20531680231187271 · Cited by 46
Single case studies are a powerful tool for developing, testing and extending theories
Nickels, L., Fischer‐Baum, S., & Best, W. (2022) · Nature Reviews Psychology · doi:10.1038/s44159-022-00127-y · Cited by 45
The role of replication in psychological science
Fletcher, S. C. (2021) · European Journal for Philosophy of Science · doi:10.1007/s13194-020-00329-2 · Cited by 45
Proposal of a Selection Protocol for Replication of Studies in Sports and Exercise Science
Murphy, J., Mesquida, C., Caldwell, A. R., Earp, B. D., & Warne, J. P. (2022) · Sports Medicine · doi:10.1007/s40279-022-01749-1 · Cited by 44
Estimating the reproducibility of social learning research published between 1955 and 2018
Minocher, R., Atmaca, S., Bavero, C., McElreath, R. L., & Beheim, B. (2021) · Royal Society Open Science · doi:10.1098/rsos.210450 · Cited by 43
Arefin, M. S., Phillips, N., Plopski, A., Gabbard, J. L., & Swan, J. E. (2022) · IEEE Transactions on Visualization and Computer Graphics · doi:10.1109/tvcg.2022.3150503 · Cited by 42
Defending one's worldview under mortality salience: Testing the validity of an established idea
Schindler, S., Reinhardt, N., & Reinhard, M.-A. (2021) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2020.104087 · Cited by 40
Ng, J. Y., Wieland, L. S., Lee, M. S., Liu, J., Witt, C. M., Moher, D., & Cramer, H. (2024) · Integrative Medicine Research · doi:10.1016/j.imr.2024.101047 · Cited by 40
Improving norms in research culture to incentivize transparency and rigor
Mellor, D. T. (2021) · Educational Psychologist · doi:10.1080/00461520.2021.1902329 · Cited by 40
Twomey, R., Harlley, S., Medina, C. R., Murphy, J., Atkins, W. C., McCrum, C. L., Schneider, C., Warne, J. P., Yingling, V. R., & Caldwell, A. R. (2021) · Communications in Kinesiology · doi:10.51224/cik.v1i3.43 · Cited by 40
From replication to substantiation: A complexity theory perspective
Al‐Hoorie, A. H., Hiver, P. V., Larsen‐Freeman, D., & Lowie, W. M. (2021) · Language Teaching · doi:10.1017/s0261444821000409 · Cited by 39
A Multilab Replication of the Induced-Compliance Paradigm of Cognitive Dissonance
Vaidis, D. C., Sleegers, W. W. A., van Leeuwen, F., DeMarree, K. G., Sætrevik, B., Ross, R. M., Schmidt, K., Protzko, J., Morvinski, C., Ghasemi, O., et al. (2024) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459231213375 · Cited by 38
Understanding Replication in a Way That Is True to Science
Haig, B. D. (2021) · Review of General Psychology · doi:10.1177/10892680211046514 · Cited by 36
Replication and Open Science in Applied Linguistics ResearchPreprint
McManus, K. (2021) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/bqr9w · Cited by 36
Mortality salience effects fail to replicate in traditional and novel measures
Sætrevik, B., & Sjåstad, H. (2022) · Meta-Psychology · doi:10.15626/mp.2020.2628 · Cited by 35
The Top 10 Soft Skills in Business Today Compared to 2012
Fletcher, S., & Thornton, K. R. V. (2023) · Business and Professional Communication Quarterly · doi:10.1177/23294906221148453 · Cited by 35
De Cassai, A., Geraldini, F., De Pinto, S., Carbonari, I., Cascella, M., Boscolo, A., Sella, N., Monteleone, F., Cavaliere, F., Munari, M., et al. (2022) · Anesthesiology · doi:10.1097/aln.0000000000004302 · Cited by 34
Ricardo, G. F., Harper, C. E., Negri, A. P., Luter, H. M., Wahab, M. A. A., & Jones, R. J. (2021) · The Science of The Total Environment · doi:10.1016/j.scitotenv.2021.146079 · Cited by 34
McManus, K. (2024) · Studies in Second Language Acquisition · doi:10.1017/s0272263124000652 · Cited by 32
The necessity of construct and external validity for deductive causal inference
Esterling, K., Brady, D., & Schwitzgebel, E. (2025) · Journal of Causal Inference · doi:10.1515/jci-2024-0002 · Cited by 32
Evaluating replicability in microbiome data
Clausen, D. S., & Willis, A. D. (2021) · Biostatistics · doi:10.1093/biostatistics/kxab048 · Cited by 32
Ahmad, P., Hussain, A., & Siqueira, W. L. (2022) · Mass Spectrometry Reviews · doi:10.1002/mas.21822 · Cited by 32
Predicting and reasoning about replicability using structured groups
Wintle, B. C., Smith, E. T., Bush, M., Mody, F., Wilkinson, D. P., Hanea, A. M., Marcoci, A., Fraser, H. S., Hemming, V., Thorn, F. S., et al. (2023) · Royal Society Open Science · doi:10.1098/rsos.221553 · Cited by 31
Center for Open Science: Strategic PlanPreprint
Nosek, B. A., Shaw, L. C., Errington, T. M., Pfeiffer, N., & Zaringhalam, M. (2017) · OSF Preprints (OSF Preprints) · doi:10.31219/osf.io/x2w9h · Cited by 30
Self-citationGerdle, B. U. C., & Ghafouri, B. (2020) · Expert Review of Proteomics · doi:10.1080/14789450.2020.1797499 · Cited by 29
Replikationskrise, p-hacking und Open Science
Brachem, J., Frank, M., Kvetnaya, T., Schramm, L. F. F., & Volz, L. (2022) · Psychologische Rundschau · doi:10.1026/0033-3042/a000562 · Cited by 28
Tracing the Adoption and Effects of Open Science in Communication Research*
Markowitz, D. M., Song, H., & Taylor, S. H. (2021) · Journal of Communication · doi:10.1093/joc/jqab030 · Cited by 28
How to Improve the Reproducibility, Replicability, and Extensibility of Remote Sensing Research
Kedron, P., & Frazier, A. E. (2022) · Remote Sensing · doi:10.3390/rs14215471 · Cited by 26
Volatility shocks and investment behavior
Huber, C., Huber, J., & Kirchler, M. (2021) · Journal of Economic Behavior & Organization · doi:10.1016/j.jebo.2021.12.007 · Cited by 26
Cobey, K. D., Fehlmann, C. A., Franco, M. C., Ayala, A. P., Sikora, L., Rice, D. B., Xu, C., Ioannidis, J. P. A., Lalu, M. M., Ménard, A., et al. (2023) · eLife · doi:10.7554/elife.78518 · Cited by 26
Liu, M. (2023) · Language Teaching · doi:10.1017/s0261444823000307 · Cited by 26
A guide for social science journal editors on easing into open science
Silverstein, P., Elman, C., Montoya, A. K., McGillivray, B. C., Pennington, C. R., Harrison, C. H., Steltenpohl, C. N., Röer, J. P., Corker, K. S., Charron, L., et al. (2024) · Research Integrity and Peer Review · doi:10.1186/s41073-023-00141-5 · Cited by 26
A Framework for Evaluating Reproducibility and Replicability in EconomicsPreprint
Dreber, A., & Johannesson, M. (2023) · SSRN Electronic Journal · doi:10.2139/ssrn.4458153 · Cited by 26
Rubin, M. (2019) · Synthese · doi:10.1007/s11229-019-02433-0 · Cited by 25
Tkemaladze, J. (2026) · Longevity Horizon · doi:10.65649/3hm9b025 · Cited by 24
Effects of selective attention on the C1 ERP component: A systematic review and meta‐analysis
Qin, N., Wiens, S., Rauss, K. S., & Pourtois, G. (2022) · Psychophysiology · doi:10.1111/psyp.14123 · Cited by 24
It's time! Ten reasons to start replicating simulation studies
Lohmann, A., Astivia, O. L. O., Morris, T. P., & Groenwold, R. H. H. (2022) · Frontiers in Epidemiology · doi:10.3389/fepid.2022.973470 · Cited by 24
Drude, N., Martinez‐Gamboa, L., Danziger, M., Collazo, A., Kniffert, S., Wiebach, J., Nilsonne, G., Konietschke, F., Piper, S. K., Pawel, S., et al. (2022) · Translational Medicine Communications · doi:10.1186/s41231-022-00130-8 · Cited by 24
Gharemahmudli, S., Sadeghi, S. H., Najafinejad, A., Darki, B. Z., Kheirfam, H., & Behbahani, A. M. (2023) · Environmental Monitoring and Assessment · doi:10.1007/s10661-023-11446-9 · Cited by 24
The near-miss effect in online slot machine gambling: A series of conceptual replications.
Palmer, L., Ferrari, M. A., & Clark, L. (2024) · Psychology of Addictive Behaviors · doi:10.1037/adb0000999 · Cited by 24
Open developmental science: An overview and annotated reading list
Kalandadze, T., & Hart, S. A. (2022) · Infant and Child Development · doi:10.1002/icd.2334 · Cited by 24
Capuchins (Sapajus apella) and their Aversion to Inequity
Schweinfurth, M. K., & Call, J. (2021) · Springer eBooks · doi:10.1007/978-981-16-2028-7_11 · Cited by 23
Evaluating the Replicability of Social Priming Studies
Giolla, E. M., Karlsson, S., Neequaye, D. A., & Bergquist, M. (2024) · Meta-Psychology · doi:10.15626/mp.2022.3308 · Cited by 23
“Repeated sampling from the same population?” A critique of Neyman and Pearson’s responses to Fisher
Rubin, M. (2020) · European Journal for Philosophy of Science · doi:10.1007/s13194-020-00309-6 · Cited by 22
Open Science Practices in Gambling Research Publications (2016–2019): A Scoping Review
Louderback, E. R., Gainsbury, S., Heirene, R. M., Amichia, K., Grossman, A., Bernhard, B. J., & LaPlante, D. A. (2022) · Journal of Gambling Studies · doi:10.1007/s10899-022-10120-y · Cited by 22
Past is future for the era of COVID-19 research in the social sciences
Conley, D., & Johnson, T. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.2104155118 · Cited by 22
Replicating and extending the effects of auditory religious cues on dishonest behavior
Nichols, A. D., Lang, M., Kavanagh, C. M., Kundt, R., Yamada, J., Dan Ariely, C., & Mitkidis, P. (2020) · PLoS ONE · doi:10.1371/journal.pone.0237007 · Cited by 21
Advancing the Cognitive Science of Religion through Replication and Open Science
Hoogeveen, S., & van Elk, M. (2020) · Journal for the Cognitive Science of Religion · doi:10.1558/jcsr.39039 · Cited by 21
Palmer, L., Brooks, G. A., & Clark, L. (2025) · BMC Psychology · doi:10.1186/s40359-025-02766-1 · Cited by 20
Replication, Uncertainty and Progress in Comparative Cognition
Boyle, A. (2021) · Animal Behavior and Cognition · doi:10.26451/abc.08.02.15.2021 · Cited by 20
Krüppel, J., Yoon, D., & Mokros, A. (2022) · Personality and Individual Differences · doi:10.1016/j.paid.2022.111966 · Cited by 20
Building reproducible bridges to cross the “valley of death”
Errington, T. M. (2024) · Journal of Clinical Investigation · doi:10.1172/jci177383 · Cited by 20
Self-citationWhiteside, D. M., Basso, M. R., Shen, C., Fry, L., Naini, S. M., Waldron, E. J., Holker, E. G., Porter, J., Eskridge, C. L. M., Logemann, A., et al. (2024) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/13803395.2024.2312625 · Cited by 20
Williamson, P. C., Pörtner, H., Widdicombe, S., & Gattuso, J. (2021) · Biogeosciences · doi:10.5194/bg-18-1787-2021 · Cited by 20
Farrar, B. G., Ostojić, L., & Clayton, N. S. (2021) · PLoS ONE · doi:10.1371/journal.pone.0256607 · Cited by 20
The future of replication in applied linguistics: Toward a standard for replication studies
McManus, K. (2024) · Annual Review of Applied Linguistics · doi:10.1017/s0267190524000011 · Cited by 19
Exploring risk factors and determinants: A scoping review of factors associated with nomophobia
Rajguru, A. J., Mishra, A. K., Bhargava, R., Sarkar, S., & Balhara, Y. P. S. (2024) · Indian Journal of Psychiatry · doi:10.4103/indianjpsychiatry.indianjpsychiatry_244_24 · Cited by 19
Over-optimism in unsupervised microbiome analysis: Insights from network learning and clustering
Ullmann, T., Peschel, S., Finger, P., Müller, C. L., & Boulesteix, A. (2023) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1010820 · Cited by 18
Ng, J. Y., Lee, M. S., Liu, J., Steel, A., Wieland, L. S., Witt, C. M., Moher, D., & Cramer, H. (2024) · Integrative Medicine Research · doi:10.1016/j.imr.2024.101068 · Cited by 18
How failure to falsify in high-volume science contributes to the replication crisis
Rajtmajer, S. M., Errington, T. M., & Hillary, F. G. (2022) · eLife · doi:10.7554/elife.78830 · Cited by 18
Self-citationReply to: Methods matter in repeating ocean acidification studies
Clark, T. D., Raby, G. D., Roche, D. G., Binning, S. A., Speers‐Roesch, B., Jutfelt, F., & Sundin, J. (2020) · Nature · doi:10.1038/s41586-020-2804-9 · Cited by 18
Metadata
- Authors
- Nosek, B. A., & Errington, T. M.
- Affiliations
- Center for Open Science (US)
- Corresponding author
- Nosek, Brian A.
- Venue
- PLOS Biology
- Publisher
- Public Library of Science (PLoS)
- Published
- 2020-03-27
- Volume
- 18
- Issue
- 3
- Pages
- e3000691
- ISSN
- 1544-9173 (ISSN-L)
- 1545-7885
- PMC
- PMC7100931
- OpenAlex
- W3013926312
- Cited by
- 444
- References
- 14
- Citations by year
- 2026: 59 · 2025: 78 · 2024: 77 · 2023: 65 · 2022: 61 · 2021: 71 · 2020: 29
- FWCI
- 20.64
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- PLoS Biology (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- OSF Preprints (OSF Preprints) (submittedVersion, public-domain)
- MetArXiv (OSF Preprints) (submittedVersion)
- OSF Preprints (OSF Preprints) (submittedVersion)
- MetArXiv (OSF Preprints) (submittedVersion, public-domain)
- Funders
- John Templeton Foundation
- Arnold Ventures
- Templeton World Charity Foundation
- Templeton Religion Trust
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Arts and Humanities › History and Philosophy of Science › Philosophy of Biology and Scientific Explanation
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- replication, diagnostic findings, generalizability, scientific progress, theory testing
- MeSH terms
- Data Interpretation, Statistical, Humans, Research Design, Statistics as Topic, Reproducibility of Results
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
