Publication prejudices: An experimental study of confirmatory bias in the peer review system
The DOI matches its Crossref record; 28 of the 29 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“journal peer reviewers are more likely to recommend publication of reports with statistically positive results.”
From Reporting research results: a moral obligation for all researchers. (2007) · cites this paper as [7]
Experimental — accuracy not yet measuredIn the citing paper
“The bias against negative results appears to be a consequence of both editors and reviewers finding them less compelling for publication and from authors themselves not trying to publish them 8-12”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [10]
In the citing paper
“Positive results -- finding that a treatment is effective or that there is a relationship between two variables -- are more likely to be published than negative results 6-12 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [10]
Citations
Cites
Social Theory and Social Structure
Ross, E. J., & Merton, R. K. (1958) · The American Catholic Sociological Review · doi:10.2307/3709394 · Cited by 10,315
The American Psychological Association
Langfeld, H. S. (1919) · Science · doi:10.1126/science.49.1254.51 · Cited by 7,475
(1975) · Medical Entomology and Zoology · Cited by 7,245
Social Theory and Social Structure.
Bock, K. E., & Merton, R. K. (1969) · American Sociological Review · doi:10.2307/2091967 · Cited by 6,660
Effects of externally mediated rewards on intrinsic motivation.
Deci, E. L. (1971) · Journal of Personality and Social Psychology · doi:10.1037/h0030644 · Cited by 4,170
Lehman, H. (1972) · Philosophy of Science · doi:10.1086/288419 · Cited by 2,998
Cognitive Therapy and the Emotional Disorders
Ince, L. P. (1977) · American Journal of Psychotherapy · doi:10.1176/appi.psychotherapy.1977.31.4.633 · Cited by 2,892
Lepper, M. R., Greene, D., & Nisbett, R. E. (1973) · Journal of Personality and Social Psychology · doi:10.1037/h0035519 · Cited by 2,559
Lambert, N. M., Ketzenberger, K. E., & Kemp, C. A. (2014) · Encyclopedia of Special Education · doi:10.1002/9781118660584.ese0122 · Cited by 2,220
Social Stratification in Science
Cole, J. R., Cole, S., & deB. Beaver, D. (1974) · American Journal of Physics · doi:10.1119/1.1987897 · Cited by 1,135
Research works printed but not linked: 10
- Adams, J. A.Human memory. New York: McGraw-Hill, 1967.
- American Psychological Association.Standards for educational and psychological tests and manuals. Washington, D.C.: American Psychological Association, 1966.
- Bacon, F.Novum organum. New York: Bobbs-Merrill, 1960. (Originally published, 1621.)
- Dixon, B.What is science for? New York: Harper & Row, 1973.
- Lakatos, I., & Musgrave, A. (Eds.),Criticism and the growth of knowledge. London: Cambridge University Press, 1970.
- Mahoney, M. J., & DeMonbreun, B. G. Confirmatory bias in scientists and non-scientists.Cognitive Therapy and Research, 1977 (in press).
- Mahoney, M. J., & Kimper, T. P. From ethics to logic: A survey of scientists. In M. J. Mahoney,Scientist as subject. Cambridge, Massachusetts: Ballinger, 1976. Pp. 187?193.
- Neisser, V.Cognitive psychology. New York: Appleton-Century-Crofts, 1967.
- Popper, K. R.Objective knowledge: An evaluative approach. London: Oxford University Press, 1972.
- Weimer, W. B.Psychology and the conceptual foundations of science. Hillsdale, New Jersey; Lawrence Erlbaum Associates, 1977.
Cited by
Items 501–600 of 1,000
Replicability and the Psychology of Science
Clark, C. J., Honeycutt, N., & Jussim, L. J. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_3 · Cited by 14
Motivating and Maintaining Ethics, Equity, Effectiveness, Efficiency, and Expertise in Peer Review
Brain Health Alliance, Craig, A., Lee, C., Bala, N., & Taswell, C. (2022) · Brainiacs Journal of Brain Imaging And Computing Sciences · doi:10.48085/i5b147d9d · Cited by 13
“In a previous study by (Mahoney, 1977), the investigators asked 75 reviewers to referee manuscripts that described identical experimental procedures but reported positive, unfavorable, mixed, or no results, and found bias associated with different schools of thought.”
BackgroundOnitilo, A. A., Engel, J. M., Salzman-Scott, S. A., Stankowski, R. V., & Doi, S. A. R. (2013) · Accountability in Research · doi:10.1080/08989621.2013.804345 · Cited by 13
“There are several reasons why such disagreement would occur, and one of these is probably reviewers’ emphasis and beliefs regarding experiences supporting their own personally-held views, which may allow them to ignore or question those that do not (Mahoney, 1977).”
BackgroundIntroducing Prospective Manuscript Review to Address Publication Bias
Mell, L. K., & Zietman, A. L. (2014) · International Journal of Radiation Oncology*Biology*Physics · doi:10.1016/j.ijrobp.2014.07.052 · Cited by 14
“Multiple subsequent studies have documented the following: (1) Positive studies are more likely to be published in journals with higher impact factors, and to be rated as more important by other investigators (7); (2) Trials supporting the use of a novel therapy are more likely to be published (8); (3) Published trial…”
BackgroundThe Computer-Assisted Literature Review
Brent, E. E. (1984) · Social Science Micro Review · doi:10.1177/089443938600200303 · Cited by 13
Academic rankings between the “republic of science” and “new public management”
Osterloh, M., & Frey, B. S. (2014) · Cambridge University Press eBooks · doi:10.1017/cbo9781139059145.005 · Cited by 18
“Reviewers find methodological shortcomings in 71 percent of papers contradicting the mainstream, compared to only 25 percent of papers supporting the mainstream (Mahoney, 1977).”
BackgroundDifficult Decisions in the Intensive Care Unit: An Illustrative Case
Freshwater-Turner, D., Boots, R. J., Bowman, R. N., Healy, H. G., & Klestov, A. (2007) · Anaesthesia and Intensive Care · doi:10.1177/0310057x0703500515 · Cited by 15
Gate-keepers or judges: peer reviews in construction management
Runeson, G., & Loosemore, M. (1999) · Construction Management and Economics · doi:10.1080/014461999371448 · Cited by 13
Using a dialectical scientific brief in peer review
Stamps, A. E. (1997) · Science and Engineering Ethics · doi:10.1007/s11948-997-0018-2 · Cited by 13
Social Work Research: Priorities and Obstacles
Gambrill, E. D. (1994) · Research on Social Work Practice · doi:10.1177/104973159400400307 · Cited by 13
Alam, M. (2015) · Dermatologic Surgery · doi:10.1097/dss.0000000000000421 · Cited by 14
“Do not be excessively critical of new ideas, even if they make you uncomfortable because part of your job is to allow innovation to flourish.(12,13) There is no standard time allotment, but an average review should take about 1 to 3 hours from beginning to end.”
BackgroundGuidelines for Science: Evidence and ChecklistsPreprint
Armstrong, J. S., & Green, K. C. (2017) · SSRN Electronic Journal · doi:10.2139/ssrn.3055874 · Cited by 15
“Mahoney (1977) sent Journal of Applied Behavior Analysis reviewers a paper that was, unknown to them, fictitious.”
P-hacking in Top-tier Management Journals
Baum, J. A. C., & Bromiley, P. (2019) · Academy of Management Proceedings · doi:10.5465/ambpp.2019.10810abstract · Cited by 13
PROTOCOL: Assessment of outcome reporting bias in studies included in Campbell systematic reviews
Littell, J. H., Gorman, D. M., Valentine, J. C., & Pigott, T. (2023) · Campbell Systematic Reviews · doi:10.1002/cl2.1332 · Cited by 16
“Systematic Reviews, 11(1), 145. https://doi.org/10.1186/s13643-022-01998-1 Mahoney, 1977 Mahoney, M. J. (1977).”
BackgroundInfluentialRegistered report adoption in academic journals: assessing rates in different research domains
Lin, T., Cheng, H., Cheng, L.-F., & Hung, T. (2024) · Scientometrics · doi:10.1007/s11192-023-04896-y · Cited by 14
“First, because of the publication incentive of authors and the bias of journals toward novel and positive results (Mahoney, 1977, pp. 167–169), studies published via the traditional publishing model are undermined by questionable research practices such as cherry-picking, hypothesizing after the…”
Osterloh, M. (2012) · VS Verlag für Sozialwissenschaften eBooks · doi:10.1007/978-3-531-18770-9_12 · Cited by 22
Weakening the ideological immune system: can debiasing techniques reduce confirmation bias?
Whitt, C. M., Tullett, A. M., Bowes, S. M., McDiarmid, A., Lilienfeld, S. O., & Hart, W. (2023) · Comprehensive Results in Social Psychology · doi:10.1080/23743603.2023.2196755 · Cited by 12
Criteria for the Design and Evaluation of Cognitive Architectures
Varma, S. (2011) · Cognitive Science · doi:10.1111/j.1551-6709.2011.01190.x · Cited by 15
Body Piercing and Self-Mutilation: A Multifaceted Relationship
Wessel, A. (2014) · American Journal of Applied Psychology · doi:10.11648/j.ajap.20140304.14 · Cited by 12
“This is consistent with findings in cognitive bias research which indicate that individuals tend to weight evidence consistent with decisions they have made more heavily and assign less value to data which are contrary to the position they have taken in order to avoid cognitive dissonance [16].”
ResultConstantine, N. A. (2013) · Springer eBooks · doi:10.1007/978-1-4614-6633-8_20 · Cited by 15
“The in fl uence of a reviewer’s personal biases on the results and recommendations of their peer reviews has been widely demonstrated (Altman, 2002 ; Ioannidis, Tatsioni, & Karassa, 2010 ; Mahoney, 1977 ; Shatz, 2001 ; Young, Ioannidis, & Al-Ubaydi, 2009 ) .”
BackgroundThe Game Between a Biased Reviewer and His Editor
García, J. A., Sánchez, R. M. R., & Fdez-Valdivia, J. (2017) · Science and Engineering Ethics · doi:10.1007/s11948-017-9998-8 · Cited by 13
Weak evidence of country- and institution-related status bias in the peer review of abstracts
Nielsen, M. W., Baker, C. F., Brady, E., Petersen, M. B., & Andersen, J. P. (2021) · eLife · doi:10.7554/elife.64561 · Cited by 20
“…the empirical data presented in the abstract, the clarity of the statistical reporting, the reporting of positive vs. negative and mixed results ( Mahoney, 1977 ), the reporting of intuitive vs. counter-intuitive findings ( Mahoney, 1977 ; Hergovich et al., 2010 ), and the reporting of journal…”
ResultFrachtenberg, E., & McConville, K. S. (2022) · PLoS ONE · doi:10.1371/journal.pone.0264131 · Cited by 33
A Causal Role for Negative Affect: Misattribution in Biased Evaluations of Scientific Information
Munro, G. D., Stansbury, J. A., & Tsai, J. (2010) · Self and Identity · doi:10.1080/15298868.2010.499707 · Cited by 12
“Subsequent research has revealed consistent support for the biased assimilation of both scientific (Cohen, Aronson, & Steele, 2000; Koehler, 1993; Mahoney, 1977; Munro & Ditto, 1997; Munro, Leary, & Lasane, 2004) and nonscientific information (Edwards & Smith, 1996; Hastorf & Cantril, 1954;…”
BackgroundAn Example of Psychological Science's Failure to Self-Correct
Kelley, L. P., & Blashfield, R. K. (2009) · Review of General Psychology · doi:10.1037/a0015287 · Cited by 12
“Mahoney (1977) was one of the first psychologists to provide evidence for this effect.”
BackgroundThe Future of Academic Publishing: Application of the Long-Tail Theory
Gould, T. H. P. (2009) · Publishing Research Quarterly · doi:10.1007/s12109-009-9134-y · Cited by 12
“Other researchers have found similar weaknesses within the peer system, a system that is intended to ensure that only the best research is published (Dalton 2001, Jefferson 2005, Mahone 1977, Neff and Olden 2006, Peters 1995, Shulenburger 2001).”
Peer Review, Citation Ratings and Other Fetishes
Foley, J. A. (2013) · Springer Science Reviews · doi:10.1007/s40362-013-0003-x · Cited by 12
“Several studies have found that authors tend to cite papers that have a greater number of authors [18, 42], are longer in length [41], are in a journal issue that contains a high-impact article [25], are reviews [3] and report positive findings [31].”
BackgroundPeer Review Practices of Mass Communication Scholarly Journals
Leslie, L. Z. (1990) · Evaluation Review · doi:10.1177/0193841x9001400203 · Cited by 12
Identifying Unethical Practices in Journal Publishing
Serebnick, J. (1991) · Illinois Digital Environment for Access to Learning and Scholarship (University of Illinois at Urbana-Champaign) · Cited by 12
On the failure to detect previously published research
Beaver, D. D. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011225 · Cited by 12
Hargens, L. L. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065857 · Cited by 12
Gambrill, E. D. (2000) · Journal of Social Work Education · doi:10.1080/10437797.2000.10779017 · Cited by 12
Intellectual Humility and Humbling Environments
Bland, S. (2024) · Review of Philosophy and Psychology · doi:10.1007/s13164-024-00732-1 · Cited by 11
“Scientists are no less fallible, biased, and overconfident than the rest of us (Mahoney 1977 ; Mahoney & DeMonbreum 1977; Dunbar 1995 ).”
Thinking Critically about Critical Thinking Approaches: Comment on Yancher, Slife, and Warne (2008)
Bensley, D. A. (2009) · Review of General Psychology · doi:10.1037/a0015654 · Cited by 11
Verified, Shared, Modular, and Provenance Based Research Communication with the Dat Protocol
Hartgerink, C. H. J. (2019) · Publications · doi:10.3390/publications7020040 · Cited by 11
“results than when they result in statistically nonsignificant results; [7]), leading to the “natural selection of bad science” [8].”
Street, C., & Ward, K. (2019) · ACM SIGMIS Database the DATABASE for Advances in Information Systems · doi:10.1145/3371041.3371046 · Cited by 16
Magnetization reversal in Pac-Man shaped Fe nanostructures with varying aperture
Bachar, F.-Z., Schröder, C., & Ehrmann, A. (2021) · Journal of Magnetism and Magnetic Materials · doi:10.1016/j.jmmm.2021.168205 · Cited by 11
To maximize or randomize? An experimental study of probability matching in financial decision making
Lo, A. W., Marlowe, K. P., & Zhang, R. (2021) · PLoS ONE · doi:10.1371/journal.pone.0252540 · Cited by 11
The Performance of Peer Review and a Beauty Contest of Referee Processes of Economics Journals
Seidl, C., Schmidt, U., & Grösche, P. (2005) · Studies of Applied Economics · Cited by 14
Scientific Paper Peer-Reviewing System With Blockchain, IPFS, and Smart Contract
Rahut, S. K., Tanvir, R. A., Rahman, S., & Akhter, S. (2019) · Advances in systems analysis, software engineering, and high performance computing book series · doi:10.4018/978-1-5225-9257-0.ch010 · Cited by 11
From External Evaluation, to School Self-evaluation, to Peer Review
Godfrey, D. (2020) · Accountability and educational improvement · doi:10.1007/978-3-030-48130-8_1 · Cited by 11
“Furthermore, peer review have long been criticised for the tendency toward confirmatory bias, meaning that reviewers judge the standards of scholarly work more according to established knowledge and reject work that falls outside this (e.g. Mahoney, 1977).”
BackgroundA survey of accepted authors in computer systems conferences
Frachtenberg, E., & Koster, N. (2020) · PeerJ Computer Science · doi:10.7717/peerj-cs.299 · Cited by 13
“However, understanding and improving this process is challenging because it can be hard to experiment with peer review ( Beverly & Allman, 2013 ; Ernst & Resch, 1994 ; Mahoney, 1977 ; McNutt et al., 1990 ).”
Reforming peer review: From recycling to reflexivity
Chubin, D. E. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011274 · Cited by 12
Do we really want more “reliable” reviewers?
KRAEMER, H. C. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065870 · Cited by 14
Disagreement among journal reviewers: No cause for undue alarm
Stricker, L. J. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065985 · Cited by 12
Epilogue: Trade-Offs among Editorial Goals in Complex Publishing Environments
Starbuck, W. H., Aguinis, H., Konrad, A. M., & Baruch, Y. (2008) · Palgrave Macmillan UK eBooks · doi:10.1057/9780230582590_25 · Cited by 11
Advancing Knowledge in Sport Psychology: Strategies for Expanding Our Conceptual Frameworks
Feltz, D. L. (1987) · Quest · doi:10.1080/00336297.1987.10483878 · Cited by 11
Navigating the Peer-Review Process: Reviewers’ Suggestions for a Manuscript
Robson, K., PITT, L. F., & West, D. (2015) · Journal of Advertising Research · doi:10.2501/jar-55-1-009-017 · Cited by 10
Williams, M. J., Mullane, K., & Curtis, M. J. (2017) · Elsevier eBooks · doi:10.1016/b978-0-12-804725-5.00005-7 · Cited by 13
de Nebrija, U. A., & Rubio-Arostegui, J. A. (2017) · Annual Review Debats Revista de Cultura Poder i Societat · doi:10.28939/iam.debats-en.2017-11 · Cited by 10
The Cultural Evolution of Science
Wu, J., O’Connor, C., & Smaldino, P. E. (2023) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780198869252.013.78 · Cited by 14
Open Peer Review: Fast Forward for a New Science
Hachani, S. (2015) · Emerald Group Publishing Limited eBooks · doi:10.1108/s0065-283020150000039012 · Cited by 12
“Mahoney (1977) speaks of confirmatory bias “which is ... a tendency for humans to seek out, attend to, and sometimes embellish experiences which support or ‘confirm’ their beliefs” (p. 1). Gilbert, Williams, and Lundberg (1994) investigated the influence of gender on the outcome of publication and acceptance.”
BackgroundResultInfluentialMicropublishing During and After the COVID-19 Era
Yamada, Y. (2020) · Collabra Psychology · doi:10.1525/collabra.370 · Cited by 10
Our Pigheaded Core: How We Became Smarter to Be Influenced by Other People
Mercier, H. (2013) · The MIT Press eBooks · doi:10.7551/mitpress/9033.003.0022 · Cited by 11
Jennings, M. M., Pany, K. J., & Reckers, P. M. J. (2008) · Advances in Accounting · doi:10.1016/j.adiac.2008.08.006 · Cited by 10
Why and where do academics publish?
Starbuck, W. H. (2013) · M n gement · doi:10.3917/mana.165.0707 · Cited by 10
Objectivity and Plausibility in the Study of Organizations
Bosch, R. (2010) · Journal of Management Inquiry · doi:10.1177/1056492610369936 · Cited by 10
“Reputation, institutional affiliation, rhetorical abilities, network ties, and consistency with traditions and positions taken in the past may well be more important than the amount and plausibility of the empirical evidence (Astley, 1985; Lounsbury, 2003; Mahoney, 1977; Zuckerman & Merton, 1971).”
BackgroundThe identity prescription of “the psychologist”
John, I. D. (1985) · Australian Psychologist · doi:10.1080/00050068508256159 · Cited by 10
What should be done improve reviewing?
Crandall, R. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065766 · Cited by 11
Importance of factors in the review of grant proposals.
Norman, K. L. (1986) · Journal of Applied Psychology · doi:10.1037//0021-9010.71.1.156 · Cited by 10
Reproducibility failure in biomedical research: problems and solutions
Haven, T. L., & Ioannidis, J. P. A. (2026) · Annual Review of Medicine · doi:10.1146/annurev-med-050124-050859 · Cited by 9
Peer reviewers’ conflicts of interest in biomedical research: scoping review
Korfitsen, C. B., Nejstgaard, C. H., Hróbjartsson, A., Boutron, I., Bero, L. A., & Lundh, A. (2025) · BMJ Evidence-Based Medicine · doi:10.1136/bmjebm-2024-112967 · Cited by 10
“108 Others have argued, that in contrast to financial interests, researchers cannot separate themselves from their intellectual positions and personal beliefs and such interests cannot be managed in the same way as financial interests.”
A difficult test for hard propaganda: Evidence from a choice experiment in Venezuela
Lutscher, P., & Donnay, K. (2024) · Journal of Peace Research · doi:10.1177/00223433231220269 · Cited by 14
“Evidence from political psychology suggests that humans tend to accept confirming, but question disconfirming, evidence about their prior held beliefs (Koehler, 1993; Kunda, 1987; Lord, Ross and Lepper, 1979; Mahoney, 1977; Taber and Lodge, 2006).”
Gardegaront, M., Sas, A., Brizard, D., Levillain, A., Bermond, F., Confavreux, C. B., Pialat, J., van Lenthe, H., Follet, H., & Mitton, D. (2024) · Journal of the mechanical behavior of biomedical materials/Journal of mechanical behavior of biomedical materials · doi:10.1016/j.jmbbm.2024.106676 · Cited by 9
Science, Pseudoscience, and Not Science: How Do They Differ?
Baran, G. R., Kiani, M. F., & Samuel, S. P. (2013) · Springer eBooks · doi:10.1007/978-1-4614-8541-4_2 · Cited by 16
Management Science: What Does it Have to do with Management or Science?
Armstrong, J. S. (1998) · Scholarly Commons (University of Pennsylvania) · Cited by 9
Cognitive Bias in Peer Review : a New Approach
Sandström, U. (2009) · Cited by 9
Frontloading selectivity: A third way in scientific publishing?
Chambers, C. (2020) · PLoS Biology · doi:10.1371/journal.pbio.3000693 · Cited by 9
False Memories and Free Speech: Is Scientific Debate Being Suppressed?
Andrews, B., & Brewin, C. R. (2016) · Applied Cognitive Psychology · doi:10.1002/acp.3285 · Cited by 9
“The clearest indication that there has been an attempt to suppress our data is contained in the final section of the commentary by Nash et al. (2016), in which they all but state that our article should not have been published because it did not go through a conventional peer review process with Applied Cognitive Psyc…”
BackgroundClimate Control: Gender and Racial Bias in Engineering?
Li, S., Rincon, R., & Williams, J. C. (2018) · ASEE Annual Conference & Exposition · doi:10.18260/1-2--28038 · Cited by 14
“The Prove-It-Again phenomenon also reflects stereotype expectancy (Hamilton & Rose, 1980), aka confirmation bias (Mahoney, 1977): we see what we expect to see.”
BackgroundCharacteristics of Peer Review Reports: Editor-Suggested Versus Author-Suggested Reviewers
Shopovski, J., Bolek, C., & Bolek, M. (2019) · Science and Engineering Ethics · doi:10.1007/s11948-019-00118-y · Cited by 9
Scientific Paper Peer-Reviewing System With Blockchain, IPFS, and Smart Contract
Rahut, S. K., Tanvir, R. A., Rahman, S., & Akhter, S. (2020) · IGI Global eBooks · doi:10.4018/978-1-7998-5351-0.ch057 · Cited by 9
Ethical Considerations When Conducting Research with Students with Learning Disabilities
Vaughn, S. R., & Lyon, G. R. (1994) · Springer eBooks · doi:10.1007/978-1-4613-8345-1_15 · Cited by 9
A Study of Outcome Reporting Bias Using Gender Differences in Risk Attitudes
Crosetto, P., Filippin, A., & Heider, J. (2014) · CESifo Economic Studies · doi:10.1093/cesifo/ifu029 · Cited by 8
“It has also been tested experimentally, for instance by creating fake papers differing only in the significance of results and sending them to journals (Mahoney, 1977).”
BackgroundMethodPuck in the Laboratory: The Construction and Deconstruction of Hoaxlike Deception in Science
Schnabel, J. (1994) · Science Technology & Human Values · doi:10.1177/016224399401900403 · Cited by 9
Oral presentation bias: a retrospective cohort study
Decullier, E., & Chapuis, F. (2007) · Journal of Epidemiology and Community Health · doi:10.1136/jech.2006.048603 · Cited by 9
Variety Is the Spice of Life: Irrational Behavior as Adaptation to Stochastic Environments
Brennan, T. J., Lo, A. W., & Zhang, R. (2018) · Quarterly Journal of Finance · doi:10.1142/s201013921850009x · Cited by 9
“…when choosing between two potential gains), uncertainty effect (Gneezy, List, and Wu, 2006) (a risky prospect is valued less than its worst possible outcome), and confirmation bias (Mahoney, 1977) (the tendency to search for or interpret information in a way that confirms one’s preconceptions).”
BackgroundThe journal article review process as a game of chance
Glenn, N. D. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011365 · Cited by 10
Journalology--or what editors do.
Smith, J. (1990) · BMJ · doi:10.1136/bmj.301.6754.756 · Cited by 9
Toward a cognitive psychology of science
Gholson, B., & Houts, A. (1989) · Social Epistemology · doi:10.1080/02691728908578522 · Cited by 9
Rejecting published work: Similar fate for fiction
Ross, C. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011626 · Cited by 9
Four editorial proposals to improve social sciences research and publication
Joseph, J., & Baldwin, S. (2000) · International Journal of Risk & Safety in Medicine · doi:10.3233/jrs-2000-218 · Cited by 10
Contributions of Psychology to an Integrative Science Studies: The Shape of Things to Come
Shadish, W. R., & Neimeyer, R. A. (1989) · Sociology of the sciences/Sociology of the sciences yearbook · doi:10.1007/978-94-015-7825-7_2 · Cited by 11
(2014) · Choice Reviews Online · doi:10.5860/choice.52-0385 · Cited by 9
Peer review in the physical sciences: An editor's view
Honig, W. M. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011432 · Cited by 9
Academic Journals, Incentives, and the Quality of Peer Review: A Model
Zollman, K., García, J., & Handfield, T. (2023) · Philosophy of Science · doi:10.1017/psa.2023.81 · Cited by 10
The Church and Peer Review: Was 'Peer' Review Fairer, More Honest Then Than Now?
Gould, T. H. P. (2012) · Journal of Scholarly Publishing · doi:10.1353/scp.2012.0029 · Cited by 8
The mind-brain problem: Ethical and clinical implications for psychiatry
Costa, M. D. A., & Moreira‐Almeida, A. (2025) · International Review of Psychiatry · doi:10.1080/09540261.2025.2474965 · Cited by 8
“However, many criteria used in science for decision-making, such as quality, interest, and novelty, involve subjective data, and studies indicate that peer reviewers tend to evaluate studies more positively when they align with their worldview (Mahoney, 1977).”
We need more research on causes and consequences, as well as on solutions
Fanelli, D. (2014) · Addiction · doi:10.1111/add.12772 · Cited by 8
Apophenia and anesthesia: how we sometimes change our practice prematurely
Hanson, N. A., Lavallee, M. B., & Thiele, R. H. (2021) · Canadian Journal of Anesthesia/Journal canadien d anesthésie · doi:10.1007/s12630-021-02005-2 · Cited by 8
Development, implementation and impact of a new preprint solicitation process atProceedings B
Neiman, M., Bagley, R. K., Paczesniak, D., & Singh-Shepherd, S. (2021) · Proceedings of the Royal Society B Biological Sciences · doi:10.1098/rspb.2021.1248 · Cited by 8
Conflicting Incentives Risk Analysis: A Case Study of the Normative Peer Review Process
Wangen, G. (2015) · Administrative Sciences · doi:10.3390/admsci5030125 · Cited by 8
“Mahoney [20] has researched this phenomenon in science and found that scientists too look for evidence to support their perceptions while quickly dismissing contrary evidence.”
BackgroundImperfect referees: Reducing the impact of multiple biases in peer review
Yun, Z., Chi, C., & van den Heuvel, W. (2015) · Journal of the Association for Information Science and Technology · doi:10.1002/asi.23317 · Cited by 9
“Some cognitive biases have significant impacts, for example, confirmatory bias, the negative result bias (the file drawer problem), the Matthew effect, and the Doctor Fox effect (Hojat et al., 2003; Mahoney, 1977), etc.”
BackgroundBest practices: A moral imperative.
Osborne, J. W. (2017) · Canadian Journal of Behavioural Science/Revue canadienne des sciences du comportement · doi:10.1037/cbs0000078 · Cited by 8
Skin in the Game: Personal Accountability and Journal Peer Review
Sacco, D. F., Bruton, S. V., Brown, M., & Medlin, M. M. (2020) · Journal of Empirical Research on Human Research Ethics · doi:10.1177/1556264620922651 · Cited by 9
Is unreliability in peer review harmful?
Roediger, H. L., III (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065936 · Cited by 9
Research and Publications Output: A Survey of the Psychology Department at UNISA
van Staden, F., Boon, C., & Dennill, I. (2001) · South African Journal of Psychology · doi:10.1177/008124630103100307 · Cited by 8
Is Review By Peers As Fair As It Appears
Armstrong, J. S. (1982) · Scholarly Commons (University of Pennsylvania) · Cited by 8
The quandary of manuscript reviewing
Whitehurst, G. J. “. (1982) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00011699 · Cited by 8
Metadata
- Authors
- Mahoney, M. J.
- Affiliations
- Pennsylvania State University (US)
- Corresponding author
- Mahoney, Michael J.
- ORCID
- Mahoney, Michael J.
- Venue
- Cognitive Therapy and Research
- Published
- 1977-06
- Volume
- 1
- Issue
- 2
- Pages
- 161-175
- ISSN
- 0147-5916 (ISSN-L)
- 1573-2819
- OpenAlex
- W2164136002
- Semantic Scholar
- d8cf5c798397b6a0be1b41f18f979f0988f1ece7
- Cited by
- 1,013
- References
- 29
- Citations by year
- 2026: 22 · 2025: 18 · 2024: 25 · 2023: 28 · 2022: 52 · 2021: 45 · 2020: 52 · 2019: 40 · 2018: 31 · 2017: 51 · 2016: 38 · 2015: 43 · 2014: 41 · 2013: 51 · 2012: 23
- FWCI
- 5.62
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Cognitive Therapy and Research (publishedVersion)
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Publishing and Scholarly Communication
- Keywords
- confirmation bias, peer review, publication bias, scientific journals, manuscript review, interobserver agreement, negative results, epistemology of science
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.