The DOI matches its Crossref record; 47 of the 47 references it cites were found in a registry or an index.
Consequences of prejudice against the null hypothesis.
Abstract
The consequences of prejudice against accepting the null hypothesis were examined through (a) a mathematical model intended to stimulate the research-publication process and (b) case studies of apparent erroneous rejec-tions of the null hypothesis in published psychological research. The input parameters for the model characterize investigators ' probabilities of selecting a problem for which the null hypothesis is true, of reporting, following up on, or abandoning research when data do or do not reject the null hypothesis, and they characterize editors ' probabilities of publishing manuscripts concluding in favor of or against the null hypothesis. With estimates of the input parameters based on a questionnaire survey of a sample of social psychologists, the model output indicates a dysfunctional research-publication system. Particularly, the model indicates that there may be relatively few publications on problems for which the null hypothesis is (at least to a reasonable approximation) true, and of these, a high proportion will erroneously reject the null hypothesis. The case studies provide additional support for this conclusion. Accordingly, it is
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“The bias against negative results appears to be a consequence of both editors and reviewers finding them less compelling for publication and from authors themselves not trying to publish them 8-12”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [11]
In the citing paper
“Positive results -- finding that a treatment is effective or that there is a relationship between two variables -- are more likely to be published than negative results 6-12 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [11]
In the citing paper
“Theoretical analyses point to a system of incentives that prioritizes innovation over verification, leading to infrequent efforts to replicate findings and to behaviors that could reduce the replicability of published findings such as selective reporting, presenting exploratory findings as confirmatory tests, and failures of documentation, transparency, and sharing”
From Investigating the replicability of preclinical cancer biology (2021) · cites this paper as Greenwald, 1975
In the citing paper
“Research that produces novel results, statistically significant results (that is, typically p < 0.05) and seemingly 'clean' results is more likely to be published 2,3 .”
From Power failure: why small sample size undermines the reliability of neuroscience (2013) · cites this paper as [3]
In the citing paper
“An important qualification about this result is the possibility that the original studies have inflated effect sizes due to publication, selection, reporting, or other biases ( 9, 1223 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [16]
In the citing paper
“Potentially problematic practices include selective reporting, selective analysis, and insufficient specification of the conditions necessary or sufficient to obtain the results ( 1223 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [16]
In the citing paper
“There is good evidence that low power of research designs combined with publication bias favoring positive results over negative results produces a literature with upwardly biased effect sizes ( 14, 16, 30, 31 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [16]
In the citing paper
“Concerns about reproducibility are widespread across disciplines ( 921 ).”
From Estimating the reproducibility of psychological science (2015) · cites this paper as [16]
Citations
Cites
Nonparametric Statistics for the Behavioral Sciences
Guitton, H., & Siegel, S. (1958) · Revue économique · doi:10.2307/3498751 · Cited by 35,279
The Influence of Source Credibility on Communication Effectiveness
Hovland, C. I., & Weiss, W. (1951) · Public Opinion Quarterly · doi:10.1086/266350 · Cited by 3,543
Boneau, C. A., & Hays, W. L. (1966) · The American Journal of Psychology · doi:10.2307/1420739 · Cited by 1,887
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
Experimental and quasi-experimental designs for research on teaching
Campbell, D. T. (1963) · Medical Entomology and Zoology · Cited by 1,541
Statistical significance in psychological research.
Lykken, D. T. (1968) · Psychological bulletin · doi:10.1037/h0026141 · Cited by 1,363
Artifact in behavioral research
Rosenthal, R., & Rosnow, R. L. (1969) · Medical Entomology and Zoology · Cited by 1,186
Sterling, T. D. (1959) · Journal of the American Statistical Association · doi:10.1080/01621459.1959.10501497 · Cited by 964
The test of significance in psychological research.
Bakan, D. (1966) · Psychological Bulletin · doi:10.1037/h0020412 · Cited by 957
Flagged first, then by citations
Cited by
Sorted by citations
Items 501–600 of 1,001
Open Science CollaborationPreprint
Nosek, B. A., Spies, J. R., Cohn, M., Bartmess, E. N., Lakens, D., Holman, D., Cohoon, J., Lewis, M., Gordon-McKeon, S., & IJzerman, H. (2012) · OSF Preprints (OSF Preprints) · Cited by 29
Damaging Real Lives through Obstinacy: Re-Emphasising Why Significance Testing is Wrong
Gorard, S. (2016) · Sociological Research Online · doi:10.5153/sro.3857 · Cited by 26
“The intention behind the proposed ban (above) would be to force researchers to consider and report a much wider range of issues – such as the possible importance and methodological soundness of any findings (Greenwald 1975, Kline 2004).”
BackgroundExposure to an environmental toxin, quality of life and psychological distress
Santiago‐Rivera, A. L., Morse, G. S., Haase, R. F., McCaffrey, R. J., & Tarbell, A. M. (2007) · Journal of Environmental Psychology · doi:10.1016/j.jenvp.2006.12.004 · Cited by 28
Third-party prejudice accommodation increases gender discrimination.
Vial, A. C., Brescoll, V. L., & Dovidio, J. F. (2018) · Journal of Personality and Social Psychology · doi:10.1037/pspi0000164 · Cited by 29
“Although null effects need to be interpreted with caution (Greenwald, 1975), the findings across Studies 6 and 7 suggest that it may not be necessary for gatekeepers to internalize third-party bias in order to accommodate it in their selections, and that the influence of third-party prejudice may…”
BackgroundAnalysis of No-Difference Findings in Evaluation Research
Julnes, G., & Mohr, L. B. (1989) · Evaluation Review · doi:10.1177/0193841x8901300604 · Cited by 28
Publication bias and the evaluation of psychotherapy efficacy in reviews of the research literature
Sohn, D. A. (1996) · Clinical Psychology Review · doi:10.1016/0272-7358(96)00005-0 · Cited by 28
Social Psychophysiology: A New Look
Cacioppo, J. T., Petty, R. E., & Tassinary, L. G. (1989) · Advances in experimental social psychology · doi:10.1016/s0065-2601(08)60305-6 · Cited by 28
Kerr, N. L., Ao, X., Hogg, M. A., & Zhang, J. (2018) · Journal of Experimental Social Psychology · doi:10.1016/j.jesp.2018.05.001 · Cited by 28
Indyk, D., & Rier, D. A. (1993) · Science Communication · doi:10.1177/107554709301500101 · Cited by 27
“17 Combined with problems such as the bias against the null hypothesis (Bracken 1985; Dickersin et al. 1987; Easterbrook et al. 1991; Greenwald 1975; Hetherington et al. 1989; Rier 1990; Rosenthal 1978; Vandenbroucke 1988), this situation suggests that journal publication may not always be the appropriate &dquo;gold s…”
BackgroundThe Specification of Aggregate Market Models
Saunders, J. (1987) · European Journal of Marketing · doi:10.1108/eum0000000004681 · Cited by 27
Information retrieval in systematic reviews: a case study of the crime prevention literature
Tompson, L., & Belur, J. (2015) · Journal of Experimental Criminology · doi:10.1007/s11292-015-9243-x · Cited by 26
“In evidence synthesis nomenclature this is known as publication bias, and has been acknowledged in the academic literature for four decades (Greenwald 1975).”
BackgroundAssessing and Improving Robustness of Psychological Research Findings in Four Steps
Nuijten, M. B. (2022) · Springer eBooks · doi:10.1007/978-3-031-04968-2_17 · Cited by 26
Fail-Safe Ns for One- Versus Two-Tailed Tests Lead to Different Conclusions About Publication Bias
Hsu, L. (2002) · Understanding Statistics · doi:10.1207/s15328031us0102_02 · Cited by 24
Power and reproducibility in the external validation of brain-phenotype predictions
Rosenblatt, M., Tejavibulya, L., Sun, H., Camp, C., Khaitova, M., Adkinson, B. D., Jiang, R., Westwater, M. L., Noble, S., & Scheinost, D. (2024) · Nature Human Behaviour · doi:10.1038/s41562-024-01931-7 · Cited by 26
“47–51).”
(2015) · Psychology Press eBooks · doi:10.4324/9781315717104-10 · Cited by 25
Liars, Damned Liars, and Zealots
Mueller, A. B., & Skitka, L. J. (2017) · Social Psychological and Personality Science · doi:10.1177/1948550617720272 · Cited by 25
“…to detect effects if they were present.4 We therefore argue that our results shift the burden of proof to those who believe that the interaction of moral conviction and attitude agreement is norm dependent (see Greenwald, 1975, on the power of null hypothesis results to shift burdens of proof).”
ResultThe Impact of Case Characteristics and Prior Jury Experience on Jury Verdicts1
Werner, C. M., Strube, M., Cole, A. M., & Kagehiro, D. K. (1985) · Journal of Applied Social Psychology · doi:10.1111/j.1559-1816.1985.tb02262.x · Cited by 25
On the analysis of repeated measures over time in medical, pharmacological, and behavioral research
Shaffer, J. W. (1979) · Journal of Behavioral Medicine · doi:10.1007/bf00844920 · Cited by 25
Richardson, M. A., McCabe, R., & Priebe, S. (2012) · Social Psychiatry and Psychiatric Epidemiology · doi:10.1007/s00127-012-0570-1 · Cited by 25
“Publication of statistically significant results is more probable [24] which increases the likelihood of type 1 errors (and an over estimation of the mean effect size) in meta analysis.”
BackgroundLocal and global processing biases fail to influence face, object, and word recognition
Lawson, R. (2007) · Visual Cognition · doi:10.1080/13506280601112519 · Cited by 25
“Given that null results are less likely to be published than significant effects (Greenwald, 1975; Rosenthal, 1979), the extant literature may overestimate the size of the processing bias effect.”
BackgroundThe real and the unreal: A reply to Jensen and Vernon
Longstreth, L. E. (1986) · Intelligence · doi:10.1016/0160-2896(86)90013-9 · Cited by 25
Black and White Cultural Styles in Pluralistic Perspective
Kochman, T. (1989) · Springer eBooks · doi:10.1007/978-94-009-2500-7_12 · Cited by 25
Wellcome Open ResearchPreprint
Jones, I. M. (2018) · doi:10.17605/osf.io/9crn2 · Cited by 25
Sorting the File Drawer: A Typology for Describing Unpublished Studies
Lishner, D. A. (2021) · Perspectives on Psychological Science · doi:10.1177/1745691620979831 · Cited by 24
“Second, Greenwald (1975) identified a number of “cultural truisms” regarding the null hypothesis that lead psychologists to (sometimes erroneously) perceive a failure to reject the null hypothesis as a less convincing statistical outcome than a rejection of the null hypothesis.”
BackgroundPetrosino, A. J. (1995) · Journal of Crime and Justice · doi:10.1080/0735648x.1995.9721049 · Cited by 24
Doll, B. J., Brehm, K., Zucker, S., Deaver-Langevin, J., Griffin, J., & Hickman, A. (2000) · Psychology in the Schools · doi:10.1002/1520-6807(200009)37:5 · Cited by 3
Race of Examiner Effects and the Validity of Intelligence Tests
Graziano, W. G., Varca, P. E., & Levy, J. C. (1982) · Review of Educational Research · doi:10.2307/1170263 · Cited by 24
Use of Theory-Driven Research in Counseling
Karr, C. A., & Larson, L. M. (2005) · The Counseling Psychologist · doi:10.1177/0011000004272257 · Cited by 24
“…changing conditions and procedures until the desired result is obtained is considered theory confirming (Greenwald et al., 1986) or prejudice against the null hypothesis (Greenwald, 1975), which strays from the ideal empirical methods of hypothesis testing and resulting theory disconfirmation.”
BackgroundRace Comparisons on Need for Achievement: A Meta-Analytic Alternative to Graham’s Narrative Review
Cooper, H., & Dorr, N. (1995) · Review of Educational Research · doi:10.3102/00346543065004483 · Cited by 24
“Regardless of quality, researchers are less likely to submit nonsignificant results, and editors are less likely to publish them (Coursol & Wagner, 1986; Greenwald, 1975).”
BackgroundThe predictive validity of peer review: A neglected issue
Bornstein, R. F. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065717 · Cited by 24
Reducing Implicit PrejudicePreprint
Lai, C., Hoffman, K., & Nosek, B. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2089158 · Cited by 201
“Achieving a positive result – i.e., demonstrating that a manipulation changes implicit evaluation – is a de facto requirement for publication (Fanelli, 2010, 2012; Greenwald, 1975; Meehl, 1978; Nosek, Spies, & Motyl, 2012; Sterling, Rosenbaum, & Weinkam, 1995).”
BackgroundIn Search Of True Things Worth Knowing: Considerations For A New Article Prototype
Tullett, A. M. (2015) · Social and Personality Psychology Compass · doi:10.1111/spc3.12166 · Cited by 24
“Surveying the range of p-values present in published articles quickly makes it clear that within the current publication system, there is an expectation for p-values under .05 (Fanelli 2010, 2012; Greenwald, 1975; Rosenthal, 1979; Sterling, 1959; Sterling, Rosenbaum, &Weinkam, 1995).”
BackgroundInfluentialEthical considerations in synthesising research ‐ Whose representations?
Suri, H. (2008) · Qualitative Research Journal · doi:10.3316/qrj0801062 · Cited by 23
THE EFFECTS OF UNREPRESENTED STUDIES ON THE ROBUSTNESS OF VALIDITY GENERALIZATION RESULTS
Ashworth, S. D., Osburn, H. G., Callender, J. C., & Boyle, K. A. (1992) · Personnel Psychology · doi:10.1111/j.1744-6570.1992.tb00853.x · Cited by 23
Children’s understanding of the mind’s involvement in pretense: do words bend the truth?
Sobel, D. M., & Lillard, A. S. (2002) · Developmental Science · doi:10.1111/1467-7687.00214 · Cited by 23
“It might be that the linguistic tag improves children’s performance in understanding pretense and other domains of reasoning (much in the way fantasy does, see for example Dias & Harris, 1988, 1990). This seems unlikely for several reasons. First, the linguistic condition had no effect on performance in the first expe…”
BackgroundConceptual Issues in Research Synthesis
Pillemer, D. B. (1984) · The Journal of Special Education · doi:10.1177/002246698401800105 · Cited by 23
Miller, M. J., PRIOR, D., & Springer, T. P. (1987) · Counselor Education and Supervision · doi:10.1002/j.1556-6978.1987.tb00741.x · Cited by 23
Insights about Attitudes: Meta-Analytic Perspectives
Johnson, B. T. (1991) · Personality and Social Psychology Bulletin · doi:10.1177/0146167291173009 · Cited by 23
The File Drawer Effect and Publication Rates in Menstrual Cycle Research
Sommer, B. A. (1987) · Psychology of Women Quarterly · doi:10.1111/j.1471-6402.1987.tb00786.x · Cited by 24
P ‐hacking in meta‐analyses: A formalization and new meta‐analytic methods
Mathur, M. B. (2024) · Research Synthesis Methods · doi:10.1002/jrsm.1701 · Cited by 25
Pharmacotherapy of impulsive aggression: A quality comparison of controlled studies
Felthous, A. R., Lake, S. L., Rundle, B. K., & Stanford, M. S. (2013) · International Journal of Law and Psychiatry · doi:10.1016/j.ijlp.2013.04.017 · Cited by 22
On the Conceptual Disconfirmation of Theories
Greenwald, A. G., & Ronis, D. L. (1981) · Personality and Social Psychology Bulletin · doi:10.1177/014616728171020 · Cited by 22
Self-citationWill the ASA's Efforts to Improve Statistical Practice be Successful? Some Evidence to the Contrary
Hubbard, R. (2019) · The American Statistician · doi:10.1080/00031305.2018.1497540 · Cited by 22
“Later that decade, Greenwald (1975), Carver (1978), and Meehl (1978) expressed concerns over the damaging effects of NHST.”
BackgroundWhat's Wrong with Research Literatures? And how to Make Them Right
Howard, G. S., Hill, T. L., Maxwell, S. E., Baptista, T. M., Farias, M., Coelho, C., Coulter-Kern, M., & Coulter-Kern, R. (2009) · Review of General Psychology · doi:10.1037/a0015319 · Cited by 23
“313) Gigerenzer’s (1993) summary reflects an enormous literature (e.g., Atkinson, Furlong, & Wampold, 1982; Chase & Chase, 1976; Greenwald, 1975; Kerr, Tolliver, & Petree, 1977; Mahoney, 1977; Sterling, 1959) that demonstrates editors’ and reviewers’ preference for significant results (and their bias against nonsignif…”
Oral Cholinesterase Inhibitor Add-on Therapy for Cognitive Enhancement in Schizophrenia
Chouinard, S., Sepehry, A. A., & Stip, É. (2007) · Clinical Neuropharmacology · doi:10.1097/wnf.0b013e31802fa61a · Cited by 22
La socialisation par l'organisation : entre tactiques et pratiques
Perrot, S., & Roussel, P. (2009) · Revue de gestion des ressources humaines · doi:10.3917/grhu.073.0002 · Cited by 22
Kelley, K., & Maxwell, S. E. (2012) · SAGE Publications Ltd eBooks · doi:10.4135/9781446212165.n11 · Cited by 22
Teaching the Concept of Precycling : A Campaign and Evaluation
Gillilan, S., Werner, C. M., Olson, L. E., & Adams, D. (1996) · The Journal of Environmental Education · doi:10.1080/00958964.1996.9942810 · Cited by 22
Understanding and using Meta-Analysis
Preiss, R. W., & Allen, M. R. (1995) · Evaluation & the Health Professions · doi:10.1177/016327879501800306 · Cited by 21
Common Methodology Mistakes in Dissertations: Improving Dissertation Quality.
Thompson, B. (1988) · Cited by 22
Lai, L., Gu, W., Hu, M., Wang, W., Wang, S., Huai, Y., Mei, J., & Wang, C. (2021) · Aging · doi:10.18632/aging.203100 · Cited by 23
Searching for effects in big data: Why p-values are not advised and what to use instead
Hofmann, M. A. (2015) · Winter Simulation Conference · doi:10.1109/wsc.2015.7408210 · Cited by 21
“…discredited, both logically and conceptually, from numerous top statisticians – continuously for almost 100 years (Boring 1919, Berkson 1938, Fisher 1955, Bakan 1966, Greenwald 1975, Carver 1978, Rosnow and Rosenthal 1989, Tukey 1991, Cohen 1994, Sedlmeier 1996, Schmidt and Hunter 1997, Falk 1998).”
BackgroundWhen nonreliability of reviews indicates solid science
Eckberg, D. L. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065791 · Cited by 21
Comparison of suicide notes and parasuicide notes
Leenaars, A. A., Lester, D., Wenckstern, S., McMullin, C., Rudzinski, D., & Brevard, A. (1992) · Death Studies · doi:10.1080/07481189208252581 · Cited by 21
Meta-analysis as a means of discovery.
Sohn, D. A. (1995) · American Psychologist · doi:10.1037//0003-066x.50.2.108 · Cited by 21
Sigelman, L. (1999) · Political Analysis · doi:10.1093/oxfordjournals.pan.a029813 · Cited by 21
“, “normal science” in Kuhn’s (1962) sense, should be expected to yield more significant results than other research.”
ResultThe rhetoric of science and the science of rhetoric
Simons, H. W. (1978) · Western Journal of Speech Communication · doi:10.1080/10570317809373920 · Cited by 21
Evaluating and Interpreting Research Syntheses in Adult Learning and Literacy
Cooper, H. (2007) · PsycEXTRA Dataset · doi:10.1037/e549792010-001 · Cited by 20
“In particular, research that fails to achieve standard levels of statistical significance is frequently left in researchers’ file drawers, a problem known as “bias against the null hypothesis” (Greenwald, 1975).”
BackgroundResultThe Philosophy of Outliers: Reintegrating Rare Events Into Biological Science
Cook, C. N., Freeman, A. R., Liao, J. C., & Mangiamele, L. A. (2021) · Integrative and Comparative Biology · doi:10.1093/icb/icab166 · Cited by 20
Haworth, M., Hoshika, Y., & Killi, D. (2016) · Frontiers in Plant Science · doi:10.3389/fpls.2016.01153 · Cited by 21
“Frontiers in Plant Science | www.frontiersin.org 2 August 2016 | Volume 7 | Article 1153 effect are 94% more likely to be submitted (Greenwald, 1975) and then published (Coursol and Wagner, 1986) in leading journals.”
BackgroundUnexpected Gains: Being Overweight Buffers Asian Americans From Prejudice Against Foreigners
Handron, C., Kirby, T. A., Wang, J., Matskewich, H. E., & Cheryan, S. (2017) · Psychological Science · doi:10.1177/0956797617720912 · Cited by 24
“, Cumming, 2014; Simonsohn, Nelson, & Simmons, 2014), we report every study we conducted to test our hypotheses, including both significant and null findings, to avoid a file-drawer bias (Greenwald, 1975).”
BackgroundEffect Size Estimation Fromt-Statistics in the Presence of Publication Bias
Ulrich, R., Miller, J. O., & Erdfelder, E. (2018) · Zeitschrift für Psychologie · doi:10.1027/2151-2604/a000319 · Cited by 20
“Th is a rti cl e is in te nd ed so le ly fo r t he p er so na l u se o f t he in di vi du al u se r a nd published because they fail to support the proposed hypothesis (Fanelli, 2010b; Greenwald, 1975).”
BackgroundCategory Boundaries Can Be Accentuated Without Increasing Intergroup Bias
Deffenbacher, D. M., Park, B., Judd, C. M., & Correll, J. (2009) · Group Processes & Intergroup Relations · doi:10.1177/1368430208101055 · Cited by 20
“In his paper on prejudice against the null hypothesis, Greenwald (1975) argues that demonstrating the null hypothesis is often informative and important, and arguably furthers scientifi c endeavors to the same degree as tests of the alternate hypothesis.”
BackgroundNonparametric classes of weight functions to model publication bias
Silliman, N. (1997) · Biometrika · doi:10.1093/biomet/84.4.909 · Cited by 20
“As large studies with signi cant results are moreeasily published than small studies with non-signi cant results (Rosenthal, 1979; Greenwald, 1975;Chase and Chase, 1976), this \publication bias" inherent in meta-analyses can give misleadingresults unless accounted for.”
BackgroundResultResearch Methodology in Communication: Review and Commentary
Cappella, J. N. (1977) · Annals of the International Communication Association · doi:10.1080/23808985.1977.11923669 · Cited by 20
Selective outcome reporting: telling and detecting true lies. The state of the science
Macura, A., Abraha, I., Kirkham, J., Gensini, G. F., Moja, L., & Iorio, A. (2010) · Internal and Emergency Medicine · doi:10.1007/s11739-010-0371-z · Cited by 19
“Publication bias originates in a prejudiced peerreview attitude: many reviewers are predisposed against recommending the publication of studies reporting nonsignificant findings [4].”
BackgroundStatistical Conclusion Validity for Organizational Science Researchers: A Review
Austin, J. T., Boyle, K. A., & Lualhati, J. (1998) · Organizational Research Methods · doi:10.1177/109442819812002 · Cited by 26
Sladekova, M., Webb, L. E. A., & Field, A. P. (2022) · Psychological Methods · doi:10.1037/met0000470 · Cited by 18
“On the journal level, a study may be rejected by the editors or the reviewers because non-significant results are deemed uninteresting or difficult to interpret (Greenwald, 1975; Sterling et al., 1995).”
BackgroundA methodological and empirical critique of psychotherapy outcome meta-analysis.
Searles, J. S. (1985) · Behaviour Research and Therapy · doi:10.1016/0005-7967(85)90173-1 · Cited by 17
I Have the Answer, Now What's the Question?: Why Metaanalyses Do Not Provide Definitive Solutions
Streiner, D. L. (2005) · The Canadian Journal of Psychiatry · doi:10.1177/070674370505001304 · Cited by 19
How Much Does Effortful Thinking Underlie Observers’ Reactions to Victimization?
Harvey, A. J., Callan, M. J., & Matthews, W. J. (2014) · Social Justice Research · doi:10.1007/s11211-014-0209-3 · Cited by 20
“Criticisms of this aspect of null hypothesis significance testing have a long history (e.g., Edwards, Lindman, & Savage, 1963; Gallistel, 2009; Greenwald, 1975; Wagenmakers, 2007) and the situation is elegantly summarized by Bakan (1966): “Even the strict repetition of an experiment and not getting…”
BackgroundResultOn the significance of statistically insignificant results in consumer behavior experiments
Peterson, R. A., & Umesh, U. N. (2017) · Journal of the Academy of Marketing Science · doi:10.1007/s11747-017-0528-7 · Cited by 18
“Ignoring the third outcome reflects what Greenwald (1975) addressed in his article BConsequences of Prejudice against the Null Hypothesis.”
BackgroundConsideraciones generales en torno a los estudios de potencia
Bono, R., & Gras, J. A. (1995) · Digitum: Institutional Repository of the University of Murcia (University of Murcia) · Cited by 18
Meta-analysis in Clinical Psychology Research
Field, A. P. (2013) · Oxford University Press eBooks · doi:10.1093/oxfordhb/9780199793549.013.0017 · Cited by 18
Confirmation bias in structural equation modeling
Robles, J. R. (1996) · Structural Equation Modeling A Multidisciplinary Journal · doi:10.1080/10705519609540031 · Cited by 18
Apparatus criticus: Methods used to evaluate growth modification in Class II malocclusion
Tuncay, O. C., & Tulloch, J. F. C. (1992) · American Journal of Orthodontics and Dentofacial Orthopedics · doi:10.1016/0889-5406(92)70070-q · Cited by 18
Reflections on the peer review process
Marsh, H. W., & Ball, S. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065912 · Cited by 18
Simonsohn, U., Simmons, J. P., & Nelson, L. D. (2013) · SSRN Electronic Journal · doi:10.2139/ssrn.2351926 · Cited by 18
Theobald, D. L. (2011) · Biology Direct · doi:10.1186/1745-6150-6-60 · Cited by 16
“Frequentist hypothesis tests (of both Fisher and Neyman-Pearson flavors) have been highly criticized and disparaged for many decades by professional statisticians [44-71].”
BackgroundEnding publication bias: A values-based approach to surface null and negative results
Curry, S., Mercado-Lara, E., Arechavala‐Gomeza, V., Begley, C. G., Bernard, C., Bernard, R., Bertuzzi, S., Bhalla, N., Bowers, D., Brod, S., et al. (2025) · PLoS Biology · doi:10.1371/journal.pbio.3003368 · Cited by 26
“This bias persists despite decades of warnings against its consequences [3–8].”
Bridging the Gap Between Academia and Practice in Accounting
Clor-Proell, S. M., Even-Tov, O., Lee, C. M. C., & Rajgopal, S. (2024) · Accounting Horizons · doi:10.2308/horizons-2024-071 · Cited by 17
Méta-analyse et efficacité des psychothérapies : faits et fictions
Zimmermann, G., & Pomini, V. (2013) · Psychologie Française · doi:10.1016/j.psfr.2012.12.002 · Cited by 19
Everything Wrong with P-Values Under One Roof
Briggs, W. M. (2018) · Studies in computational intelligence · doi:10.1007/978-3-030-04200-4_2 · Cited by 18
Bushman, B. J., & Wang, M. C. (1996) · Psychological Methods · doi:10.1037/1082-989x.1.1.66 · Cited by 17
Publication of Nonsignificant Results: A Survey of Psychologists' Opinions
Reysen, S. (2006) · Psychological Reports · doi:10.2466/pr0.98.1.169-175 · Cited by 17
Statistical Power and Research in Occupational Therapy
Ottenbacher, K. J. (1982) · The Occupational Therapy Journal of Research · doi:10.1177/153944928200200102 · Cited by 17
“As a result, researchers in the social and behavioral scienceshave been much more concerned with Type I errors (rejecting a true null hypothesis) than with Type II errors (accepting a false null hypothesis) (Greenwald, 1975; Higbee & Wells, 1972; Nunnally, 1960).”
BackgroundAdvantages of Computer Programs over Power Charts for the Estimation of Power
Gatti, G., & Harwell, M. R. (1998) · Journal of Statistics Education · doi:10.1080/10691898.1998.11910620 · Cited by 17
When Do Interaction/Moderation Effects Stabilize in Linear Regression?
Castillo, A. J., Miller, J. D., Vize, C. E., Baranger, D. A. A., & Lynam, D. R. (2026) · Advances in Methods and Practices in Psychological Science · doi:10.1177/25152459251407860 · Cited by 16
“If the main effects in a study are not found to be significant, researchers may turn to testing interactions until a significant (and thus, publishable; Greenwald, 1975) result is found.”
Mishra, A. N., Raj, A., & Pani, A. K. (2020) · American Business Review · doi:10.37625/abr.23.1.106-135 · Cited by 16
“Another aspect could be the non-reporting of the non-accepted hypothesis (Greenwald, 1975).”
BackgroundPublication bias in psychology: A closer look at the correlation between sample size and effect size
Linden, A. H., Pollet, T. V., & Hönekopp, J. (2024) · PLoS ONE · doi:10.1371/journal.pone.0297075 · Cited by 20
Girardi, P., Vesely, A., Lakens, D., Altoè, G., Pastore, M., Calcagnì, A., & Finos, L. (2024) · Psychometrika · doi:10.1007/s11336-024-09973-6 · Cited by 20
“When researchers select and report the results of a subset of all possible analyses that produce significant results (Sterling, 1959; Greenwald, 1975; Simmons et al., 2011; Brodeur et al., 2016) , they dramatically increase the actual false-positive rates despite their nominal endorsement of a low…”
Revisiting Some “Established Facts” in the Field of Management *
Aguinis, H. (2014) · BRQ Business Research Quarterly · doi:10.1016/j.cede.2013.11.001 · Cited by 15
“In spite of its widespread use and influence, metanalyses are often viewed with suspicion due to the so-called ‘file drawer problem’’ (Greenwald, 1975; Rosenthal, 1979). here seems to be an ‘‘established fact’’ that statistially non-significant results are less likely to be published nd, hence,…”
BackgroundAbout some misconceptions and the discontent with statistical tests in psychology
Hager, W. (2000) · doi:10.23668/psycharchives.12746 · Cited by 16
Do induced moods really influence health perceptions?
Barger, S. D., Burke, S. M., & Limbert, M. J. (2007) · Health Psychology · doi:10.1037/0278-6133.26.1.85 · Cited by 16
Mitchell, O., & MacKenzie, D. L. (2004) · Cited by 16
Presidential Address -- 1981:N Toward a Science of Consumer Behavior
Olson, J. C. (1982) · ACR North American Advances · Cited by 16
Null Findings, Replications and Preregistered Studies in Business Ethics Research
Roloff, J., & Zyphur, M. J. (2018) · Journal of Business Ethics · doi:10.1007/s10551-018-3864-8 · Cited by 19
“1 3 focal hypothesis was rejected due to a high p value has a smaller likelihood of being published (Greenwald 1975; Hopewell et al. 2009).”
BackgroundSohn, D. (1996) · Theory & Psychology · doi:10.1177/0959354396062002 · Cited by 32
Is Social Psychology Really Different?
Manis, M. (1976) · Personality and Social Psychology Bulletin · doi:10.1177/014616727600200417 · Cited by 16
“In discussing some of these cases, Greenwald (1975) implies that the initial research reports may have reflected Type I errors in which the null hypothesis was erroneously rejected.”
BackgroundMethodological Quality as a Component of Meta-Analysis
McGuire, J., Bates, G. W., Dretzke, B. J., McGivern, J. E., Rembold, K. L., Seabold, D. R., Turpin, B. A. M., & Levin, J. R. (1985) · Educational Psychologist · doi:10.1207/s15326985ep2001_1 · Cited by 16
Metadata
- Authors
- Greenwald, A. G.
- Affiliations
- The Ohio State University (US)
- Corresponding author
- Greenwald, Anthony G.
- Venue
- Psychological Bulletin
- Published
- 1975-01
- Volume
- 82
- Issue
- 1
- Pages
- 1-20
- ISSN
- 0033-2909 (ISSN-L)
- 1939-1455
- OpenAlex
- W2116618538
- Cited by
- 1,022
- References
- 47
- Citations by year
- 2026: 12 · 2025: 17 · 2024: 18 · 2023: 19 · 2022: 22 · 2021: 54 · 2020: 49 · 2019: 28 · 2018: 43 · 2017: 39 · 2016: 39 · 2015: 28 · 2014: 28 · 2013: 35 · 2012: 32
- FWCI
- 20.20
- Type
- journal article
- Language
- en
- Open access
- closed
- Locations
- Psychological Bulletin (publishedVersion)
- Funders
- National Science Foundation
- Topics
- Social Sciences › Psychology › Experimental and Cognitive Psychology › Psychology Research and Bibliometrics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Keywords
- null hypothesis, publication bias, editorial decision-making, social psychology
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
