Publication prejudices: An experimental study of confirmatory bias in the peer review system
The DOI matches its Crossref record; 28 of the 29 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“journal peer reviewers are more likely to recommend publication of reports with statistically positive results.”
From Reporting research results: a moral obligation for all researchers. (2007) · cites this paper as [7]
Experimental — accuracy not yet measuredIn the citing paper
“The bias against negative results appears to be a consequence of both editors and reviewers finding them less compelling for publication and from authors themselves not trying to publish them 8-12”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [10]
In the citing paper
“Positive results -- finding that a treatment is effective or that there is a relationship between two variables -- are more likely to be published than negative results 6-12 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [10]
Citations
Cites
Social Theory and Social Structure
Ross, E. J., & Merton, R. K. (1958) · The American Catholic Sociological Review · doi:10.2307/3709394 · Cited by 10,315
The American Psychological Association
Langfeld, H. S. (1919) · Science · doi:10.1126/science.49.1254.51 · Cited by 7,475
(1975) · Medical Entomology and Zoology · Cited by 7,245
Social Theory and Social Structure.
Bock, K. E., & Merton, R. K. (1969) · American Sociological Review · doi:10.2307/2091967 · Cited by 6,660
Effects of externally mediated rewards on intrinsic motivation.
Deci, E. L. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030644 · Cited by 4,170
Lehman, H. (1972) · Philosophy of Science · doi:10.1086/288419 · Cited by 2,998
Cognitive Therapy and the Emotional Disorders
Ince, L. P. (1977) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1977.31.4.633 · Cited by 2,892
Lepper, M. R., Greene, D., & Nisbett, R. E. (1973) · Journal of Personality and Social Psychology · doi:10.1037/h0035519 · Cited by 2,559
Lambert, N. M., Ketzenberger, K. E., & Kemp, C. A. (2014) · Encyclopedia of Special Education · doi:10.1002/9781118660584.ese0122 · Cited by 2,220
Social Stratification in Science
Cole, J. R., Cole, S., & deB. Beaver, D. (1974) · American Journal of Physics · doi:10.1119/1.1987897 · Cited by 1,135
Research works printed but not linked: 10
- Adams, J. A.Human memory. New York: McGraw-Hill, 1967.
- American Psychological Association.Standards for educational and psychological tests and manuals. Washington, D.C.: American Psychological Association, 1966.
- Bacon, F.Novum organum. New York: Bobbs-Merrill, 1960. (Originally published, 1621.)
- Dixon, B.What is science for? New York: Harper & Row, 1973.
- Lakatos, I., & Musgrave, A. (Eds.),Criticism and the growth of knowledge. London: Cambridge University Press, 1970.
- Mahoney, M. J., & DeMonbreun, B. G. Confirmatory bias in scientists and non-scientists.Cognitive Therapy and Research, 1977 (in press).
- Mahoney, M. J., & Kimper, T. P. From ethics to logic: A survey of scientists. In M. J. Mahoney,Scientist as subject. Cambridge, Massachusetts: Ballinger, 1976. Pp. 187?193.
- Neisser, V.Cognitive psychology. New York: Appleton-Century-Crofts, 1967.
- Popper, K. R.Objective knowledge: An evaluative approach. London: Oxford University Press, 1972.
- Weimer, W. B.Psychology and the conceptual foundations of science. Hillsdale, New Jersey; Lawrence Erlbaum Associates, 1977.
Cited by
Items 601–700 of 1,000
Bias, incompetence, or bad management?
Ziman, J. M. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011742 · Cited by 9
Peer review and theCurrent Anthropologyexperience
Belshaw, C. S. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011237 · Cited by 9
Extrinsic rewards, reward-associated messages, and intrinsic motivation
Dollinger, S. J. (1979) · Cognitive Therapy and Research · doi:10.1007/bf01184451 · Cited by 11
When we practice to deceive: The ethics of a metascientific inquiry
Mindick, B. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011511 · Cited by 8
Rankings GamesPreprint
Frey, B. S., & Osterloh, M. (2011) · SSRN Electronic Journal · doi:10.2139/ssrn.1957162 · Cited by 8
“Fourth, reviewers find methodological shortcomings in 71% percent of papers that contradict mainstream thinking compared to only 25% that support the mainstream (Mahoney, 1977).”
Mesquida, C., Murphy, J., Warne, J. P., & Lakens, D. (2025) · doi:10.51224/srxiv.534 · Cited by 8
Peer review – issues, limitations, and future development
Velterop, J. (2015) · ScienceOpen Research · doi:10.14293/s2199-1006.1.sor-edu.ayxips.v1 · Cited by 7
“More recently, though still 40 years ago, in 1977, Michael Mahoney commented, in an article [13] in the journal Cognitive Therapy and Research:”
Schnorr, S. M., & Pietrocola, M. (2022) · Revista Brasileira de Pesquisa em Educação em Ciências · doi:10.28976/1984-2686rbpec2022u713742 · Cited by 7
Distinguishing between research and monitoring programs in environmental science and management
Arciszewski, T. J., Roberts, D. R., Mahaffey, A., & Hazewinkel, R. R. O. (2023) · Journal of Environmental Studies and Sciences · doi:10.1007/s13412-023-00859-0 · Cited by 7
“…studies are responsible for reporting all results, including null responses, whereas peer-reviewed literature has a widely acknowledged tendency (some call it a bias) to publish and promote positive results (Hanson et al. 2018; Button et al. 2016; Rosenthal 1979; Mahoney 1977; Lima and Wrona 2019).”
BackgroundJakub, K., & Saulicz, E. (2025) · Journal of Bodywork and Movement Therapies · doi:10.1016/j.jbmt.2025.06.035 · Cited by 7
How Cognitive Biases Can Undermine Program Scale-Up Decisions
Mayer, S. E., Shah, R., & Kalil, A. (2021) · Routledge eBooks · doi:10.4324/9780367822972-4 · Cited by 8
Confirmation Bias as a Mechanism to Focus Attention Enhances Signal Detection
Vogrin, M., Wood, G. M. D. O., & Schmickl, T. (2023) · Journal of Artificial Societies and Social Simulation · doi:10.18564/jasss.4954 · Cited by 8
“Such behaviors are manifestations of a phenomenon called “Confirmation Bias”, which comes in many different forms (Nickerson 1998) and by many different names such as “confirmatory bias” (Mahoney 1977) or “myside bias” (Mercier 2016b).”
Occupational Therapists’ Views of Nussbaum’s Life Capability: An Exploratory Study
Mousavi, T., Dharamsi, S., Forwell, S. J., & Dean, E. (2015) · OTJR Occupational Therapy Journal of Research · doi:10.1177/1539449215601010 · Cited by 7
Why is the reliability of peer review so low?
Laming, D. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065882 · Cited by 8
Evaluation of Research(ers) and its Threat to Epistemic Pluralisms
Viola, M. (2018) · European journal of analytic philosophy · doi:10.31820/ejap.13.2.4 · Cited by 7
“Mahoney (1977) asked 75 (unaware) referees in experimental psychology to review a given manuscript, whose results he slighlty modified, along with their interpretation.”
BackgroundRevealing Reviewers’ Identities as Part of Open Peer Review and Analysis of the Review Reports
Bolek, C., Marolov, D., Bolek, M., & Shopovski, J. (2020) · LIBER Quarterly The Journal of the Association of European Research Libraries · doi:10.18352/lq.10347 · Cited by 9
Marketing Science and the Ivory Tower
Simon, H. (1994) · London Business School Review · doi:10.1111/j.1467-8616.1994.tb00068.x · Cited by 7
Why Academic Journals are Unreadable: The Referees' Crucial Role
Remus, W. (1980) · INFORMS Journal on Applied Analytics · doi:10.1287/inte.10.2.87 · Cited by 7
Schönemann, P. H. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065973 · Cited by 7
Explaining an unsurprising demonstration: High rejection rates and scarcity of space
Beyer, J. M. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011250 · Cited by 7
Science as a justification for psychology as a social institution
John, I. D. (1984) · Australian Psychologist · doi:10.1080/00050068408255415 · Cited by 7
Intermediate assessment in higher education
Day, I. N. Z. (2018) · Leiden Repository (Leiden University) · Cited by 7
Historical research, academic politics and editorial activism *
Tadajewski, M. (2023) · Journal of Marketing Management · doi:10.1080/0267257x.2023.2242374 · Cited by 7
“, 1998), issues of confirmatory bias (Mahoney, 1977) and general acceptance/rejection dynamics (cf.”
BackgroundScientific integrity and the market for lemons
Cottrell, R. C. (2014) · Research Ethics · doi:10.1177/1747016113494651 · Cited by 6
“The reliability of current quality control mechanisms has been brought under scrutiny, with numerous authors questioning the historical reliance on peer review as the only guarantee of the quality or honesty of reported research activity (Chubin and Hackett, 1990; Mahony, 1977; Smith, 1997; Young and Carr, 2011).”
BackgroundCognitive Biases in LLM-Assisted Software Development
Zhou, X., Saghi, Z., Sabouri, S., Pandita, R., McGuire, M., & Chattopadhyay, S. (2026) · ACM/IEEE International Conference on Software Engineering: Companion Proceedings (ICSE-Companion) · doi:10.1145/3744916.3773104 · Cited by 8
Schnepf, J., & Groeben, N. (2024) · New Ideas in Psychology · doi:10.1016/j.newideapsych.2024.101110 · Cited by 9
Beyond conflict: recovering the sociology of social progress
Iceland, J. (2025) · Theory and Society · doi:10.1007/s11186-025-09653-z · Cited by 6
“Studies have shown that peer review - ers provide more positive reviews of articles that support their beliefs, theoretical orientations, and political views, and harsher reviews when they do not (Abramowitz et al., 1975; Clark et al., 2023 ; Eitan et al., 2018; Koehler, 1993; Mahoney, 1977).”
5. Improving the Reliability of Judgements
Wintle, B. C., Mukherjee, N., Hemming, V., Canessa, S., & McBride, M. F. (2022) · Open Book Publishers · doi:10.11647/obp.0321.05 · Cited by 6
Each Reader Decides if a Replication Counts
Simonsohn, U. (2016) · Psychological Science · doi:10.1177/0956797616665220 · Cited by 6
“This allows our motivated minds to find excuses not to update beliefs we do not wish to update (Lord, Ross, & Lepper, 1979; Mahoney, 1977).”
Partisan Selective Exposure to Fake News Content
Ardi, R. (2019) · Makara Human Behavior Studies in Asia · doi:10.7454/hubs.asia.1160219 · Cited by 8
Testing for reviewer anchoring in peer review: A randomized controlled trial
Liu, R., Jecmen, S., Conitzer, V., Fang, F., & Shah, N. B. (2024) · PLoS ONE · doi:10.1371/journal.pone.0301111 · Cited by 10
“These include studies on confirmation bias (Mahoney, 1977), commensuration bias (Lee, 2015), the effects of revealing author identities to reviewers (Blank, 1991; Huber et al., 2022; Manzoor and Shah, 2021; Tomkins et al., 2017), reviewer herding (Stelmakh et al., 2020), resubmission bias (Stelmakh…”
Neue Evaluationsregime? Von der Inquisition zur Evaluation
Hornbostel, S. (2008) · VS Verlag für Sozialwissenschaften eBooks · doi:10.1007/978-3-531-90863-2_5 · Cited by 6
How Do We Know What Works? The Quality of Published Reviews of Evidence-Based Practices
Littell, J. H. (2008) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780195304961.003.0004 · Cited by 7
Ditto, P. H., Wojcik, S. P., Chen, E. E., Grady, R. H., & Ringel, M. M. (2015) · Behavioral and Brain Sciences · doi:10.1017/s0140525x14001186 · Cited by 8
Fine, C. (2020) · Archives of Scientific Psychology · doi:10.1037/arc0000070 · Cited by 6
Reviewing Natural Language Processing Research
Cohen, K. B., Fort, K., Mieskes, M., & Névéol, A. (2020) · Proceedings of the 58th Annual Meeting of the Association for Computational Linguistics: Tutorial Abstracts · doi:10.18653/v1/2020.acl-tutorials.4 · Cited by 7
From Laboratory to Scientific Literature
Dirk, L. (1996) · Science Communication · doi:10.1177/1075547096018001001 · Cited by 6
Improving research on and policies for peer-review practices
Perloff, R. M., & Perloff, R. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011584 · Cited by 6
Meta-Analysis: Methodology, Utility, and Limitations
Mancano, M. A., & Bullano, M. F. (1998) · Journal of Pharmacy Practice · doi:10.1177/089719009801100403 · Cited by 6
Input Control and Random Choice: Improving the Selection Process for Journal Articles
Osterloh, M., & Frey, B. S. (2011) · Econstor (Econstor) · doi:10.5167/uzh-51529 · Cited by 8
Deception in the study of the peer-review process
Fleiss, J. L. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011341 · Cited by 6
Do pilot studies have any value in research?
Nyatanga, B. (2005) · International Journal of Palliative Nursing · doi:10.12968/ijpn.2005.11.7.18482 · Cited by 6
Beetles: Biased Promotions and Persistence of False Belief
Akerlof, G. A., & Michaillat, P. (2017) · National Bureau of Economic Research · doi:10.3386/w23523 · Cited by 13
Makara Human Behavior Studies in Asia
(2021) · Makara Human Behavior Studies in Asia · doi:10.7454/hubs.asia · Cited by 6
Impact of institutional affiliation bias in the peer review process
Horchani, R. (2025) · Insights the UKSG journal · doi:10.1629/uksg.681 · Cited by 5
Kang, Y., Zhang, C., Sun, Z., & Li, Y. (2025) · Journal of Informetrics · doi:10.1016/j.joi.2025.101709 · Cited by 5
How Credible Is the Credibility Revolution?
Lang, K. (2024) · Journal of Labor Economics · doi:10.1086/732772 · Cited by 10
Gender and Knowledge Gatekeepers in Geography
Sultana, S., Dixon, B., Li, W., & Mossa, J. (2025) · The Professional Geographer · doi:10.1080/00330124.2025.2506195 · Cited by 6
“In conclusion, gender and other marginalized identities from all levels of institutions add complexity to academic gatekeeping (Mahoney 1977; Horrobin 1990; Siler, Lee, and Bero 2015).”
Ryan, J. C. (2003) · Springer eBooks · doi:10.1007/978-94-010-0275-2_10 · Cited by 5
Contra el consenso: Hallazgos que amenazan fundamentos del eco-alarmismo
Grau, H. R. (2021) · Ecología Austral · doi:10.25260/ea.22.32.1.0.1782 · Cited by 5
“Esta característica psicológica (Mahoney 1977; Nickerson 1998) se puede reforzar a nivel grupal: la persistencia y la resistencia al cambio fueron descriptas como una característica del funcionamiento de las comunidades científicas alrededor de los paradigmas dominantes en una disciplina (Kuhn…”
BackgroundCOVID-19 and the eye: alternative facts The 2022 Bowman Club, David L. Easty lecture
Ung, L., & Chodosh, J. (2022) · BMJ Open Ophthalmology · doi:10.1136/bmjophth-2022-001042 · Cited by 5
1. Introduction: The Evidence Crisis and the Evidence Revolution
Sutherland, W. J. (2022) · Open Book Publishers · doi:10.11647/obp.0321.01 · Cited by 6
Additional Comments on the Use of Contingent Electric Skin Shock
Fisher, W. W., Greer, B. D., & Mitteer, D. R. (2023) · Perspectives on Behavior Science · doi:10.1007/s40614-023-00382-1 · Cited by 5
“Small, single-case studies may be prone to publication bias (Mahoney, 1977; Shadish et al., 2016; Sham & Smith, 2014).”
BackgroundRidge, R. D., Hawk, C. E., Hartvigsen, L. D., & McCombs, L. D. (2024) · The Journal of Social Psychology · doi:10.1080/00224545.2024.2316619 · Cited by 6
Was ist ein Interessenkonflikt und wie stellt man ihn fest?
Klemperer, D. (2011) · Springer eBooks · doi:10.1007/978-3-642-19842-7_2 · Cited by 5
Experiences of Ethnobotanists with Publication: A First Approach
Albuquerque, U. P., Ramos, M. A., & Medeiros, M. F. T. (2011) · BioScience · doi:10.1525/bio.2011.61.9.9 · Cited by 5
“For example, Mahoney (1977) showed that reviewers were strongly biased against manuscripts that defended a theoretical perspective different from their own.”
Improving what is published: Toward an evidence-based framework for manuscript review.
Bornstein, R. F. (2021) · Archives of Scientific Psychology · doi:10.1037/arc0000076 · Cited by 5
Comment lire une méta-analyse ?
Moulis, G., & Sommet, A. (2013) · La Revue de Médecine Interne · doi:10.1016/j.revmed.2013.07.011 · Cited by 5
Clarification, Refinement, and Extension of the Attributional Approach to Creativity
Kasof, J. (1995) · Creativity Research Journal · doi:10.1207/s15326934crj0804_13 · Cited by 5
Quality control versus innovation in research on marketing
Armstrong, J. S. (1995) · Journal of Marketing Management · doi:10.1080/0267257x.1995.9964377 · Cited by 5
Peer review: An unflattering picture
Adams, K. M. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065687 · Cited by 5
Rejecting published work: It couldn't happen in physics! (or could it?)
Moravcsik, M. J. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011535 · Cited by 5
Communicating uncertain experimental evidence.
Davis, A. L., & Fischhoff, B. (2013) · Journal of Experimental Psychology Learning Memory and Cognition · doi:10.1037/a0033778 · Cited by 5
Peer review to ensure quality in forensic mental health publication.
Felthous, A. R., & Wettstein, R. M. (2014) · PubMed · Cited by 7
O’Brien, P. C. (1993) · Mayo Clinic Proceedings · doi:10.1016/s0025-6196(12)60027-5 · Cited by 5
Reviewer reliability: Confusing random error with systematic error or bias
Presser, S. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011602 · Cited by 5
Authorship and manuscript reviewing: The risk of bias
DeBakey, L. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011328 · Cited by 6
Journal availability and the quality of published research
Fletcher, J. M. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065808 · Cited by 5
Robergs, R. A. (2003) · QUT ePrints (Queensland University of Technology) · Cited by 5
Smaldino, P. E., Turner, M. A., & Kallens, P. C. (2019) · Royal Society Open Science · doi:10.1098/rsos.191249 · Cited by 6
Müller, U. K. (2019) · Integrative and Comparative Biology · doi:10.1093/icb/icz148 · Cited by 5
Herrera-Bennett, A., Heene, M., Lakens, D., & Ufer, S. (2020) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/zt3g9 · Cited by 7
Sala, S. D., & Zhao, B. (2024) · Physics of Life Reviews · doi:10.1016/j.plrev.2024.03.008 · Cited by 5
Gee, C. M., & Todd, K. R. (2025) · Spinal Cord · doi:10.1038/s41393-025-01101-0 · Cited by 4
“It is suggested this may be due to (a) researchers preferring to ‘ fi le-drawer ’ studies with negative fi ndings [7] and/or (b) editors/reviewers looking on positive fi ndings favorably and therefore being more likely to accept these papers for publication [8].”
Bound by Tradition? Peer Review and New Scholarship: An Institutional Case Study.
White, B. J., Cruz, L. E., Ellern, J., Ford, G., & Moss, H. K. (2012) · Research in higher education journal · Cited by 4
Peer-Review and Academic Archaeology: Quality, Epistemology and Science Policies
Salazar, D., Ramírez, H., Yrarrázaval, S., Saball, A., Troncoso, A., Rogan, J. A., & Correa, C. (2019) · Archaeologies · doi:10.1007/s11759-019-09367-6 · Cited by 4
“The contrast is the more striking if we consider the vast production in other academic disciplines about peer-review systems and its numerous criticisms due to its biases, limitations and weaknesses (Bornmann 2008; Campanario 1998a, b; Lee et al. 2013, Mahoney 1977; Jukola 2017; among many others).”
BackgroundInfluential11. Creating a Culture of Evidence Use
Frick, W. F., Cooke, S. J., Dickson, I., Jackson, H. A., Keller, K. E., la Luz, A. D., Parks, D., McPherson, T., Simkins, A. T., Tanshi, I., et al. (2022) · Open Book Publishers · doi:10.11647/obp.0321.11 · Cited by 4
10. How Conservation Practice Can Generate Evidence
Ockendon, N., Cadotte, M. W., Eklund, J., Ferraro, P. J., Fisher, M., Hancock, M. H., & Worthington, T. A. (2022) · Open Book Publishers · doi:10.11647/obp.0321.10 · Cited by 4
The Lighter Side of Deception Research in the Social Sciences: Social Work as Comedy
EPSTEIN, W. M. (2006) · Journal of Information Ethics · doi:10.3172/jie.15.1.11 · Cited by 4
How to find, grow and retain good reviewers: An experience from Pakistan
Jawaid, S. A. (2016) · DOAJ (DOAJ: Directory of Open Access Journals) · Cited by 4
Kenworthy, A. L., & Hrivnak, G. A. (2016) · Organizational Behavior Teaching Review · doi:10.1177/1052562916652644 · Cited by 6
What’s it to me? Self-interest and evaluations of financial conflicts of interest
Bruton, S. V., & Sacco, D. F. (2017) · Research Ethics · doi:10.1177/1747016117739940 · Cited by 4
“, 2012), particularly when reported findings are contrary to the reviewer’s theoretical perspective (Mahoney, 1977).”
Confirmation Bias as a Factor in Pharmacy Student Assessment of Research Study Quality
Miller, D. R., & Jangula, S. J. (2018) · American Journal of Pharmaceutical Education · doi:10.5688/ajpe6754 · Cited by 4
How to select the best: Selection procedures of innovation agencies
Biegelbauer, P. S., Palfinger, T., & Mayer, S. (2020) · Research Evaluation · doi:10.1093/reseval/rvaa011 · Cited by 4
Fraud, specialization, and efficiency in peer review
García, J. A., Sánchez, R. M. R., & Fdez-Valdivia, J. (2021) · Research Evaluation · doi:10.1093/reseval/rvab021 · Cited by 5
Bonaccorsi, A. J., Ferrara, A., & Malgarini, M. (2018) · Springer eBooks · doi:10.1007/978-3-319-68554-0_11 · Cited by 4
7. Framing the Problem and Identifying Potential Solutions
Esmail, N., Green, R. E., Petrovan, S. O., Salafsky, N., Taylor, N. G., & Wilson, J. D. (2022) · Open Book Publishers · doi:10.11647/obp.0321.07 · Cited by 6
2. Gathering and Assessing Pieces of Evidence
White, T., Amano, T., Boersch‐Supan, P. H., Christie, A. P., Freckleton, R. P., Quinzin, M. C., Rezaie, A. M., Sutherland, W. J., & Yamashita, H. (2022) · Open Book Publishers · doi:10.11647/obp.0321.02 · Cited by 5
Steel, A., Foley, H., Bugarc̀ić, A., Wardle, J., Boyd, H., Breakspear, I., Carlton, A.-L., Cope, G., Dua, K., Greenway, P., et al. (2023) · Journal of Integrative and Complementary Medicine · doi:10.1089/jicm.2022.0683 · Cited by 4
“…peer-review process is positioned as the foundation of the scientific critical process, it is still criticized as an imperfect method for appraisal, 33 and in response the sci-entific community has developed reporting guidelines, critical appraisal tools, and journal editorial guidelines to…”
Augusteijn, H. E. M., Wicherts, J. M., Sijtsma, K., & van Assen, M. A. L. M. (2026) · PLoS ONE · doi:10.1371/journal.pone.0355938 · Cited by 4
“Furthermore, reviewers suffer from the same biases as researchers, such as confirmation bias and hind-sight bias [43,44].”
The reliability of peer review in anthrozoology
Herzog, H. A., Podberscek, A. L., & Docherty, A. (2005) · Anthrozoös · doi:10.2752/089279305785594180 · Cited by 5
“While the peer review system is an important gatekeeper in science, its legitimacy has often been questioned (e.g., Bowen, Perloff and Jacoby 1972; Mahoney 1977; Daniel 1993).”
BackgroundAntinonrobustness: A case study in the sociology of science
Bradley, J. V. (1984) · Bulletin of the Psychonomic Society · doi:10.3758/bf03333878 · Cited by 4
Review bias: Positive or negative, good or bad?
Geen, R. G. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011353 · Cited by 4
The place of evolved cognition in scientific thinking
Mercier, H., & Heintz, C. (2013) · Religion Brain & Behavior · doi:10.1080/2153599x.2013.767036 · Cited by 4
“Rather unsurprisingly, scientists also exhibit a confirmation bias (Mahoney, 1977) and their reasoning is also at its best when they discuss with their peers*whether it is in lab meetings or in the pages of academic journals (see Dunbar, 1995).”
Meta‐Analyses and Systematic Reviews of the Literature
Sindhu, F. (1998) · Wiley eBooks · doi:10.1002/9780470699270.ch6 · Cited by 4
Reflections on "Confirmational Response Bias Among Social Work Journals"
Hopps, J. G. (1990) · Science Technology & Human Values · doi:10.1177/016224399001500103 · Cited by 4
Research on peer-review practices: Problems of interpretation, application, and propriety
Wilson, W. A. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011705 · Cited by 4
Responsibility in reviewing and research
Tax, S., & Rubinstein, R. A. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011663 · Cited by 4
Editorial: Journal peer review in integrative medicine discipline
Hojat, M., & Rosenzweig, S. (2004) · Seminars in Integrative Medicine · doi:10.1016/j.sigm.2004.05.005 · Cited by 4
Making the plausible implausible: A favorable review of Peters and Ceci's target article
Millman, J. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0001150x · Cited by 4
Metadata
- Authors
- Mahoney, M. J.
- Affiliations
- Pennsylvania State University (US)
- Corresponding author
- Mahoney, Michael J.
- ORCID
- Mahoney, Michael J.
- Venue
- Cognitive Therapy and Research
- Published
- 1977-06
- Volume
- 1
- Issue
- 2
- Pages
- 161-175
- ISSN
- 0147-5916 (ISSN-L)
- 1573-2819
- OpenAlex
- W2164136002
- Semantic Scholar
- d8cf5c798397b6a0be1b41f18f979f0988f1ece7
- Cited by
- 1,013
- References
- 29
- Citations by year
- 2026: 22 · 2025: 18 · 2024: 25 · 2023: 28 · 2022: 52 · 2021: 45 · 2020: 52 · 2019: 40 · 2018: 31 · 2017: 51 · 2016: 38 · 2015: 43 · 2014: 41 · 2013: 51 · 2012: 23
- FWCI
- 5.62
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Cognitive Therapy and Research (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Keywords
- confirmation bias, peer review, publication bias, scientific journals, manuscript review, interobserver agreement, negative results, epistemology of science
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.