The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Consequences of prejudice against the null hypothesis.
Abstract
The consequences of prejudice against accepting the null hypothesis were examined through (a) a mathematical model intended to stimulate the research-publication process and (b) case studies of apparent erroneous rejec-tions of the null hypothesis in published psychological research. The input parameters for the model characterize investigators ' probabilities of selecting a problem for which the null hypothesis is true, of reporting, following up on, or abandoning research when data do or do not reject the null hypothesis, and they characterize editors ' probabilities of publishing manuscripts concluding in favor of or against the null hypothesis. With estimates of the input parameters based on a questionnaire survey of a sample of social psychologists, the model output indicates a dysfunctional research-publication system. Particularly, the model indicates that there may be relatively few publications on problems for which the null hypothesis is (at least to a reasonable approximation) true, and of these, a high proportion will erroneously reject the null hypothesis. The case studies provide additional support for this conclusion. Accordingly, it is
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The bias against negative results appears to be a consequence of both editors and reviewers finding them less compelling for publication and from authors themselves not trying to publish them 8-12”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [11]
In the citing paper
“Positive results -- finding that a treatment is effective or that there is a relationship between two variables -- are more likely to be published than negative results 6-12 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [11]
In the citing paper
“Theoretical analyses point to a system of incentives that prioritizes innovation over verification, leading to infrequent efforts to replicate findings and to behaviors that could reduce the replicability of published findings such as selective reporting, presenting exploratory findings as confirmatory tests, and failures of documentation, transparency, and sharing”
From Investigating the replicability of preclinical cancer biology (2021) · cites this paper as Greenwald, 1975
In the citing paper
“Research that produces novel results, statistically significant results (that is, typically p < 0.05) and seemingly 'clean' results is more likely to be published 2,3 .”
From Power failure: why small sample size undermines the reliability of neuroscience (2013) · cites this paper as [3]
In the citing paper
“An important qualification about this result is the possibility that the original studies have inflated effect sizes due to publication, selection, reporting, or other biases ( 9, 1223 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [16]
In the citing paper
“Potentially problematic practices include selective reporting, selective analysis, and insufficient specification of the conditions necessary or sufficient to obtain the results ( 1223 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [16]
In the citing paper
“There is good evidence that low power of research designs combined with publication bias favoring positive results over negative results produces a literature with upwardly biased effect sizes ( 14, 16, 30, 31 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [16]
In the citing paper
“Concerns about reproducibility are widespread across disciplines ( 921 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [16]
Citations
Cites
Nonparametric Statistics for the Behavioral Sciences
Guitton, H., & Siegel, S. (1958) · Revue économique · doi:10.2307/3498751 · Cited by 35,279
The Influence of Source Credibility on Communication Effectiveness
Hovland, C. I., & Weiss, W. (1951) · Public Opinion Quarterly · doi:10.1086/266350 · Cited by 3,543
Boneau, C. A., & Hays, W. L. (1966) · The American Journal of Psychology · doi:10.2307/1420739 · Cited by 1,887
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
Experimental and quasi-experimental designs for research on teaching
Campbell, D. T. (1963) · Medical Entomology and Zoology · Cited by 1,541
Statistical significance in psychological research.
Lykken, D. T. (1968) · Psychological bulletin · doi:10.1037/h0026141 · Cited by 1,363
Artifact in behavioral research
Rosenthal, R., & Rosnow, R. L. (1969) · Medical Entomology and Zoology · Cited by 1,186
Sterling, T. D. (1959) · Journal of the American Statistical Association · doi:10.1080/01621459.1959.10501497 · Cited by 964
The test of significance in psychological research.
Bakan, D. (1966) · Psychological Bulletin · doi:10.1037/h0020412 · Cited by 957
Flagged first, then by citations
Cited by
Sorted by citations
Items 901–1,000 of 1,001
Models and Theories: Their Influence on Research in Learning Disabilities
Kavale, K. A., & Forness, S. R. (1994) · Springer eBooks · doi:10.1007/978-1-4613-8345-1_3 · Cited by 1
Understanding the Sampling Distribution and the Central Limit Theorem.
Lewis, C. P. (1999) · Cited by 1
metaselection: Meta-Analytic Selection Models for Dependent Effect Sizes
Pustejovsky, J. E., Joshi, M., & Citkowicz, M. (2026) · doi:10.32614/cran.package.metaselection · Cited by 1
Readman, J. (2014) · University of Brighton Repository (University of Brighton)
Kmetz, J. L. (2003) · SSRN Electronic Journal · doi:10.2139/ssrn.334180
Is the Japanese Distribution System Becoming More Accessible to Foreign FirmsPreprint
Bebenroth, R., Kshetri, N., & Hünerberg, R. (2009) · RePEc: Research Papers in Economics
Myrtek, M. (1993) · Springer eBooks · doi:10.1007/978-3-662-08215-7_22
The Role of Statistical And Formal Techniques in Experimental Psychology
Lories, G. (2002) · Springer eBooks · doi:10.1007/978-1-4020-4676-6_3
Emotional Intelligence & Team Performance: Does Training Matter?
Murray, J. P., Jordan, P. J., & Ashkanasy, N. M. (2006)
Micceri, T., Parasher, P., Waugh, G. W., & Herreid, C. (2009)
Lateralization of language in the child: Some recent evidence revisited
Satz, P. (1983) · Journal of Clinical and Experimental Neuropsychology · doi:10.1080/01688638308401175
Roles for Inferential Statistics in Educational Research
Maguire, T. O., & ROWLEY, G. L. (1992) · Educational Philosophy and Theory · doi:10.1111/j.1469-5812.1992.tb00225.x
Hazleton, V., & Riley, P. (1982) · Communication Quarterly · doi:10.1080/01463378209369423
The Role of Perceived Control in Alcohol Prevention Campaigns
Krieger, J. L. R., Parrott, R. L., & Afifi, W. A. (2006) · Communication Research Reports · doi:10.1080/08824090600962359
“Although accepting a result of no effects is reasonable in some circumstances (Cortina & Folger, 1998; Frick, 1995; Greenwald, 1993), it must be done with an extra degree of caution.”
BackgroundMatthews, L. J., & Miller, P. (1981) · Psychological Reports · doi:10.2466/pr0.1981.48.3.1007
Bundling and Simultaneity Effects on Variety Seeking for Consumable and Digital Goods
Bockstedt, J. C., Curley, S. P., & Adomavičius, G. (2009)
Size; Research Methodology; *Sample Size; *Statistical Significance; *Testing
Andrew, L. L. H. (1995)
Assessing the Public Participation Process for Brownfield Revitalization Projects
Vellis, S. D. (2013) · UWSpace (University of Waterloo)
Döring, N., & Bortz, J. (2016) · Springer-Lehrbuch · doi:10.1007/978-3-642-41089-5_15
Does group discussion contribute reliability of complex judgments?
Cohen, P. R. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065729
Now that we know how low the reliability is, what shall we do?
Salzinger, K. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065961
La méta-analyse: évaluation qualitative et quantitative de l’information scientifique en médecine
Delahaye, F., Landrivon, G., & Écochard, R. (1994) · Andrologie · doi:10.1007/bf03034624
Is there an alternative to peer review?
Greene, R. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065845
Replication, reliability and peer review: A case study
Gorman, M. E. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065833
Different rates of agreement on acceptance and rejection: A statistical artifact?
Demorest, M. E. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x0006578x
Human resource management research output in Ireland between 1950 and 2010: A retrospective
Carbery, R., Gunnigle, P., & MORLEY, M. J. (2015) · The Irish Journal of Management · doi:10.1515/ijm-2015-0005
Zimmermann, G., Pomini, V., & Mouline, Q. (2013)
Communication of Research Findings
Uys, H. H. (2016) · Routledge eBooks · doi:10.4324/9781315428376-14
Group Research in Special Education
Miller, P. M., & Drew, C. J. (1983) · Exceptional Education Quarterly · doi:10.1177/074193258300400309
Weisser, C. E. (1983) · The Mathematics Enthusiast
A Journey into Hope—Discovering Partial Solutions
Starbuck, W. H. (2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199288533.003.0004
Creating Better Social Science
Starbuck, W. H. (2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199288533.003.0001
Forecasting Literature To 1978: Annotations and Ratings
Armstrong, J. S. (1978)
A Journey into Disillusionment—Discovering Problems
Starbuck, W. H. (2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199288533.003.0002
Starbuck, W. H. (2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199288533.003.0003
The impact of information processing goals and capacity restrictions on attitude-memory
Norris, M. E. (2007) · QSpace (Queen's University Library)
Imperfectly Known or Socially Constructed? What is Truth Again?
Campanario, S. C., & Yost, P. R. (2017)
Influencing consumer resistance through priming: the role of mindsets and motivational orientation
Harman, B. (2016) · Arrow@dit (Dublin Institute of Technology)
Cashen, L. H. (2005) · doi:10.31390/gradschool_dissertations.2915
“Non-significant findings could be due to insufficient statistical power or the true absence of the phenomenon (Cohen, 1977; Cortina & Folger, 1998; Greenwald, 1993).”
BackgroundScientific Utopia: I. Opening scientific communicationPreprint
Nosek, B. A., & Bar‐Anan, Y. (2012) · arXiv (Cornell University) · doi:10.48550/arxiv.1205.1055
“, nonsignificant) results are much more likely to end up in the file drawer (Greenwald, 1975).”
BackgroundScientific Utopia: II. Restructuring incentives and practices to promote truth over publishabilityPreprint
Nosek, B. A., Spies, J. R., & Motyl, M. S. (2016) · doi:10.31219/osf.io/k4bgq_v1
Beyond Rationality: Antifoundationalism, and the Logic of Identity in Policy-Making
Bullard, A. R. (2018) · White Rose eTheses Online (University of Leeds, The University of Sheffield, University of York)
Bustos, C., Canihuante, N. Z., Salcedo, P., & Mújica, A. D. (2020) · Psykhe (Santiago) · doi:10.7764/psykhe.29.2.1498 · Cited by 4
The Solution to Science's Replication CrisisPreprint
Knuteson, B. (2016) · RePEc: Research Papers in Economics · doi:10.48550/arxiv.1609.03223
Bausell, R. B. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197536537.003.0007
Preregistration, Data Sharing, and Other Salutary Behaviors
Bausell, R. B. (2021) · Oxford University Press eBooks · doi:10.1093/oso/9780197536537.003.0011
Statistical Inference in Psychological and Medical Research
Acree, M. C. (2021) · Springer eBooks · doi:10.1007/978-3-030-73257-8_9
Synopsis, by Way of Autobiography
Acree, M. C. (2021) · Springer eBooks · doi:10.1007/978-3-030-73257-8_1
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.001
Construct and Data-Evaluation Validity
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.004
Single-Case Experimental Research Designs
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.009
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.007
Cautions, Negative Effects, and Replication
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.016
Selecting Measures for Research
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.011
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.021
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.013
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.022
Ideas that Begin the Research Process
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.005
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.020
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.025
Presenting and Analyzing the Data
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.015
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.024
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.018
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.002
Assessment: Types of Measures and Their Use
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.012
Experimental Research Using Group Designs
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.006
Ethical Issues and Guidelines for Research
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.017
Communication of Research Findings
Kazdin, A. E. (2021) · Cambridge University Press eBooks · doi:10.1017/9781108993647.019
An Innovative TRIZ Insight on the Pilot Test Run Issue in NPI Through Intelligent System
Ng, W. C., Teh, S. Y., Jun, T. C., & Teoh, P. C. (2022) · Lecture notes in electrical engineering · doi:10.1007/978-981-16-8129-5_31
Myrtek, M. (1997) · Springer eBooks · doi:10.1007/978-3-642-60363-1_22
(2009) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420079340.bmatt
Liao, T. F. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.004
(2006) · Chapman & Hall/CRC eBooks · doi:10.1201/9781420010657.bmatt
Der, G., & Everitt, B. S. (2012) · Chapman & Hall/CRC eBooks · doi:10.1201/b12738-20
Replication crisisPreprint
Quang-Loc, N. (2022) · doi:10.31219/osf.io/4wd5x
Bausell, R. B. (2021) · doi:10.1093/oso/9780197536537.003.0001
Elman, C., Gerring, J., & Mahoney, J. (2020) · Cambridge University Press eBooks · doi:10.1017/9781108762519.019
NSF 19-609 Proposal: Evaluating Rigor and Transparency Culture Change InitiativesPreprint
Nosek, B. A., Errington, T. M., Mellor, D. T., Soderberg, C. K., Krall, T., Grasty, F. L., Brooks, R. E., Greene, A., Buck, S., Rosa, S. L., et al. (2020) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/ecgb5
Leenaars, A. A. (2004) · doi:10.1002/9780470713419.refs
(1976) · Elsevier eBooks · doi:10.1016/b978-0-08-020934-0.50017-x
Communicating uncertain experimental evidencePreprint
Davis, A., Davis, A. L., & Fischhoff, B. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/7d3g9
(1980) · Elsevier eBooks · doi:10.1016/b978-0-12-287050-7.50018-7
What drives car use? Modelling psychological determinants of travel mode choicePreprint
Gardner, B. (2018) · doi:10.31237/osf.io/u4nyj
A Meta-Analysis of Sex Differences in Formal Operational Thought
Meehan, A. M. (1984) · Child Development · doi:10.1111/j.1467-8624.1984.tb03850.x
Center for Open Science: Proposal for NSF 19-537 Mid-Scale Research InfrastructurePreprint
Nosek, B. A., Ofiesh, L., Pfeiffer, N., Bowman, S. D., Litherland, D. M., Booth, A., Elliott, F., Davis, J., Frazier, M., Pattison, D., et al. (2019) · MetArXiv (OSF Preprints) · doi:10.31222/osf.io/mn4t2
Buttliere, B., & Wicherts, J. M. (2018) · PsyArXiv (OSF Preprints) · doi:10.31234/osf.io/972eu
Mellenbergh, G. J. (2019) · Springer eBooks · doi:10.1007/978-3-030-12272-0_19
(2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199288533.002.0003
(2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199288533.002.0006
(2006) · Oxford University Press eBooks · doi:10.1093/acprof:oso/9780199288533.002.0005
Connecting Statistical Precision with Practical ImportancePreprint
Oswald, F. L. (2023) · doi:10.31234/osf.io/gdthp
Döring, N. M. (2023) · Springer eBooks · doi:10.1007/978-3-662-64762-2_15
Transparency and Reproducibility in the Journal of Contextual Behavioral Science (preprint)Preprint
Lear, M. K., Spata, A., Tittler, M. V., Fishbein, J. N., Arch, J. J., & Luoma, J. B. (2023) · doi:10.31219/osf.io/ugcwd
Røge, K. M. (2022) · Journal of Pragmatic Constructivism · doi:10.7146/jopracon.v12i1.135312
Metadata
- Authors
- Greenwald, A. G.
- Affiliations
- The Ohio State University (US)
- Corresponding author
- Greenwald, Anthony G.
- Venue
- Psychological Bulletin
- Published
- 1975-01
- Volume
- 82
- Issue
- 1
- Pages
- 1-20
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2116618538
- Cited by
- 1,022
- References
- 47
- Citations by year
- 2026: 12 · 2025: 17 · 2024: 18 · 2023: 19 · 2022: 22 · 2021: 54 · 2020: 49 · 2019: 28 · 2018: 43 · 2017: 39 · 2016: 39 · 2015: 28 · 2014: 28 · 2013: 35 · 2012: 32
- FWCI
- 20.20
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- Funders
- National Science Foundation
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- null hypothesis, publication bias, editorial decision-making, social psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
