The DOI matches its Crossref record.
Publication Decisions and Their Possible Effects on Inferences Drawn from Tests of Significance--Or Vice Versa
Abstract
Theodore D. Sterling, Publication Decisions and Their Possible Effects on Inferences Drawn from Tests of Significance--Or Vice Versa, Journal of the American Statistical Association, Vol. 54, No. 285 (Mar., 1959), pp. 30-34
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cited by
Estimating the reproducibility of psychological science
Open Science Collaboration (2015) · Science · doi:10.1126/science.aac4716 · Cited by 8,515
A Note on the Theme of Too Many Instruments*
Roodman, D. (2009) · Oxford Bulletin of Economics and Statistics · doi:10.1111/j.1468-0084.2008.00542.x · Cited by 5,084
The Extent and Consequences of P-Hacking in Science
Head, M. L., Holman, L., Lanfear, R., Kahn, A. T., & Jennions, M. D. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002106 · Cited by 1,388
meta-analysis bias in location and selection of studies
Egger, M., & Smith, G. D. (1998) · BMJ · doi:10.1136/bmj.316.7124.61 · Cited by 1,374
Egger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181
Field, A. P., & Gillett, R. (2010) · British Journal of Mathematical and Statistical Psychology · doi:10.1348/000711010x502733 · Cited by 1,162
Dissemination and publication of research findings: an updated review of related biases
Song, F., Parekh, Hooper, L., Loke, Y., Ryder, J., Sutton, A., Hing, C., Kwok, C., Pang, C., & Harvey, I. (2010) · Health Technology Assessment · doi:10.3310/hta14080 · Cited by 1,039
Consequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022
Virtual reality exposure therapy for anxiety disorders: A meta-analysis
Powers, M. B., & Emmelkamp, P. M. G. (2008) · Journal of Anxiety Disorders · doi:10.1016/j.janxdis.2007.04.006 · Cited by 904
Cheung, A. C. K., & Slavin, R. E. (2013) · Educational Research Review · doi:10.1016/j.edurev.2013.01.001 · Cited by 792
Publication bias and clinical trials
Dickersin, K., Chan, S., Chalmersx, T. C., Sacks, H. S., & Smith, H. (1987) · Controlled Clinical Trials · doi:10.1016/0197-2456(87)90155-3 · Cited by 715
Exercise Interventions for Mental Health: A Quantitative and Qualitative Review.
Stathopoulou, G., Powers, M. B., Berry, A. C., Smits, J. A. J., & Otto, M. W. (2006) · Clinical Psychology: Science and Practice · doi:10.1111/j.1468-2850.2006.00021.x · Cited by 663
Olatunji, B. O., Davis, M. L., Powers, M. B., & Smits, J. A. J. (2013) · Journal of Psychiatric Research · doi:10.1016/j.jpsychires.2012.08.020 · Cited by 659
The Power of Bias in Economics Research
Ioannidis, J. P. A., Stanley, T. D., & Doucouliagos, H. (2017) · The Economic Journal · doi:10.1111/ecoj.12461 · Cited by 634
From tools to theories: A heuristic of discovery in cognitive psychology.
Gigerenzer, G. (1991) · Psychological Review · doi:10.1037//0033-295x.98.2.254 · Cited by 634
Facts Are More Important Than Novelty: Replication in the Education Sciences
Makel, M. C., & Plucker, J. A. (2014) · Educational Researcher · doi:10.3102/0013189x14545513 · Cited by 609
A Meta-Analytic Review of Prospective Memory and Aging.
Henry, J. D., MacLeod, M. S., Phillips, L. H., & Crawford, J. R. (2004) · Psychology and Aging · doi:10.1037/0882-7974.19.1.27 · Cited by 611
Stanley, T. D. (2008) · Oxford Bulletin of Economics and Statistics · doi:10.1111/j.1468-0084.2007.00487.x · Cited by 605
Meta‐analysis of transmitter effects on avian behaviour and ecology
Barron, D. G., Brawn, J. D., & Weatherhead, P. J. (2010) · Methods in Ecology and Evolution · doi:10.1111/j.2041-210x.2010.00013.x · Cited by 598
Cicchetti, D. V. (1991) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00065675 · Cited by 496
Publication Bias in Research Synthesis: Sensitivity Analysis Using A Priori Weight Functions.
Vevea, J. L., & Woods, C. M. (2005) · Psychological Methods · doi:10.1037/1082-989x.10.4.428 · Cited by 461
Publication and other reporting biases in cognitive sciences: detection, prevalence, and prevention
Ioannidis, J. P. A., Munafò, M. R., Fusar-Poli, P., Nosek, B. A., & David, S. P. (2014) · Trends in Cognitive Sciences · doi:10.1016/j.tics.2014.02.010 · Cited by 471
The ironic effect of significant results on the credibility of multiple-study articles.
Schimmack, U. (2012) · Psychological Methods · doi:10.1037/a0029487 · Cited by 455
Reporting bias in medical research - a narrative review
McGauran, N., Wieseler, B., Kreis, J., Schüler, Y.-B., Kölsch, H., & Kaiser, T. (2010) · Trials · doi:10.1186/1745-6215-11-37 · Cited by 452
Publication Bias: The Problem That Won't Go Away
DICKERSIN, K., & MIN, Y. (1993) · Annals of the New York Academy of Sciences · doi:10.1111/j.1749-6632.1993.tb26343.x · Cited by 427
Publication and related biases.
Song, Eastwood, Gilbody, Duley, & Sutton (2000) · Health Technology Assessment · doi:10.3310/hta4100 · Cited by 427
Meta-Analyses of the Effects of Media Images on Men's Body-image Concerns
Barlett, C. P., Vowels, C. L., & Saucier, D. A. (2008) · Journal of Social and Clinical Psychology · doi:10.1521/jscp.2008.27.3.279 · Cited by 420
Replications and extensions in marketing: Rarely published but quite contrary
Hubbard, R., & Armstrong, J. S. (1994) · International Journal of Research in Marketing · doi:10.1016/0167-8116(94)90003-5 · Cited by 416
Does stereotype threat influence performance of girls in stereotyped domains? A meta-analysis
Flore, P. C., & Wicherts, J. M. (2015) · Journal of School Psychology · doi:10.1016/j.jsp.2014.10.002 · Cited by 410
Misinformation in and about science
West, J. D., & Bergstrom, C. T. (2021) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1912444117 · Cited by 391
Tryon, W. W. (2001) · Psychological Methods · doi:10.1037/1082-989x.6.4.371 · Cited by 391
Questionable research practices in ecology and evolution
Fraser, H., Parker, T., Nakagawa, S., Barnett, A., & Fidler, F. (2018) · PLOS ONE · doi:10.1371/journal.pone.0200303 · Cited by 346
A systematic review of educational digital storytelling
Wu, J., & Chen, D.-T. V. (2020) · Computers & Education · doi:10.1016/j.compedu.2019.103786 · Cited by 341
A Bayesian Perspective on the Reproducibility Project: Psychology
Etz, A., & Vandekerckhove, J. (2016) · PLOS ONE · doi:10.1371/journal.pone.0149794 · Cited by 295
Diabetes mellitus and risk of prostate cancer: a meta-analysis
Bonovas, S., Filioussi, K., & Tsantes, A. (2004) · Diabetologia · doi:10.1007/s00125-004-1415-6 · Cited by 327
Meta-Analysis of Theory of Mind and Peer Popularity in the Preschool and Early School Years
Slaughter, V., Imuta, K., Peterson, C. C., & Henry, J. D. (2015) · Child Development · doi:10.1111/cdev.12372 · Cited by 324
A reevaluation of the absenteeism-job satisfaction relationship
Hackett, R. D., & Guion, R. M. (1985) · Organizational Behavior and Human Decision Processes · doi:10.1016/0749-5978(85)90028-7 · Cited by 315
Implementing Reproducible Research
Stodden, V. (2014) · doi:10.1201/b16868 · Cited by 314
An open investigation of the reproducibility of cancer biology research
Errington, T. M., Iorns, E., Gunn, W., Tan, F. E., Lomax, J., & Nosek, B. A. (2014) · eLife · doi:10.7554/elife.04333 · Cited by 312
The earth is flat ( p > 0.05): significance thresholds and the crisis of unreplicable research
Amrhein, V., Korner-Nievergelt, F., & Roth, T. (2017) · PeerJ · doi:10.7717/peerj.3544 · Cited by 308
Behavioral couples therapy (BCT) for alcohol and drug use disorders: A meta-analysis
Powers, M. B., Vedel, E., & Emmelkamp, P. M. G. (2008) · Clinical Psychology Review · doi:10.1016/j.cpr.2008.02.002 · Cited by 300
The Analysis and Presentation of Graphic Data
PARSONSON, B. S., & BAER, D. M. (1978) · Single Subject Research · doi:10.1016/b978-0-12-425850-1.50009-0 · Cited by 301
Humphreys, M., Sanchez de la Sierra, R., & van der Windt, P. (2013) · Political Analysis · doi:10.1093/pan/mps021 · Cited by 298
Swedberg, R. (2020) · The Production of Knowledge · doi:10.1017/9781108762519.002 · Cited by 293
When Null Hypothesis Significance Testing Is Unsuitable for Research: A Reassessment
Szucs, D., & Ioannidis, J. P. A. (2017) · Frontiers in Human Neuroscience · doi:10.3389/fnhum.2017.00390 · Cited by 298
Publication bias and the canonization of false facts
Nissen, S. B., Magidson, T., Gross, K., & Bergstrom, C. T. (2016) · eLife · doi:10.7554/elife.21451 · Cited by 266
Lying takes time: A meta-analysis on reaction time measures of deception.
Suchotzki, K., Verschuere, B., Van Bockstaele, B., Ben-Shakhar, G., & Crombez, G. (2017) · Psychological Bulletin · doi:10.1037/bul0000087 · Cited by 279
Publication bias: what is it? How do we measure it? How do we avoid it?
Song, F., Hooper, & Loke, Y. (2013) · Open Access Journal of Clinical Trials · doi:10.2147/oajct.s34419 · Cited by 275
Osborne, J., Simon, S., Christodoulou, A., Howell‐Richardson, C., & Richardson, K. (2013) · Journal of Research in Science Teaching · doi:10.1002/tea.21073 · Cited by 268
Statistics in medical journals: Developments in the 1980s
Altman, D. G. (1991) · Statistics in Medicine · doi:10.1002/sim.4780101206 · Cited by 268
Statistical Rituals: The Replication Delusion and How We Got There
Gigerenzer, G. (2018) · Advances in Methods and Practices in Psychological Science · doi:10.1177/2515245918771329 · Cited by 263
A Large Scale Test of the Effect of Social Class on Prosocial Behavior
Korndörfer, M., Egloff, B., & Schmukle, S. C. (2015) · PLOS ONE · doi:10.1371/journal.pone.0133193 · Cited by 255
Smits, J. A. J., Berry, A. C., Tart, C. D., & Powers, M. B. (2008) · Behaviour Research and Therapy · doi:10.1016/j.brat.2008.06.010 · Cited by 241
Tsai, A. C., & Burns, B. F. O. (2015) · Social Science & Medicine · doi:10.1016/j.socscimed.2015.06.024 · Cited by 227
A meta-analysis of sex differences in human navigation skills
Nazareth, A., Huang, X., Voyer, D., & Newcombe, N. (2019) · Psychonomic Bulletin & Review · doi:10.3758/s13423-019-01633-6 · Cited by 201
Song, F., Parekh-Bhurke, S., Hooper, L., Loke, Y. K., Ryder, J. J., Sutton, A. J., Hing, C. B., & Harvey, I. (2009) · BMC Medical Research Methodology · doi:10.1186/1471-2288-9-79 · Cited by 175
Could It Be Better to Discard 90% of the Data? A Statistical Paradox
Stanley, T. D., Jarrell, S. B., & Doucouliagos, H. (2010) · The American Statistician · doi:10.1198/tast.2009.08205 · Cited by 170
A historical review of publication bias
Marks‐Anglin, A., & Chen, Y. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1452 · Cited by 165
Detecting and adjusting for small‐study effects in meta‐analysis
Rücker, G., Carpenter, J. R., & Schwarzer, G. (2011) · Biometrical Journal · doi:10.1002/bimj.201000151 · Cited by 132
A kinked meta‐regression model for publication bias correction
Bom, P. R. D., & Rachinger, H. (2019) · Research Synthesis Methods · doi:10.1002/jrsm.1352 · Cited by 133
Finding the power to reduce publication bias
Stanley, T. D., Doucouliagos, H., & Ioannidis, J. P. A. (2017) · Statistics in Medicine · doi:10.1002/sim.7228 · Cited by 131
Using Dissertations to Examine Potential Bias in Child and Adolescent Clinical Trials.
McLeod, B. D., & Weisz, J. R. (2004) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.72.2.235 · Cited by 125
P-hacking and publication bias interact to distort meta-analytic effect size estimates
Friese, M., & Frankenbach, J. (2020) · Psychological Methods · doi:10.1037/met0000246 · Cited by 122
Journal Data Sharing Policies and Statistical Reporting Inconsistencies in Psychology
Nuijten, M. B., Borghuis, J., Veldkamp, C. L. S., Dominguez-Alvarez, L., van Assen, M. A. L. M., & Wicherts, J. M. (2017) · Collabra: Psychology · doi:10.1525/collabra.102 · Cited by 79
Nuijten, M. B., & Polanin, J. R. (2020) · Research Synthesis Methods · doi:10.1002/jrsm.1408 · Cited by 56
Meta-analysis, can it ever fail?
Kotiaho, J. S., & Tomkins, J. L. (2002) · Oikos · doi:10.1034/j.1600-0706.2002.960316.x · Cited by 52
Evaluating Registered Reports: A Naturalistic Comparative Study of Article Impact
Hopun, L. T., Singleton Thorn, F., Nosek, B. A., & Errington, T. M. (2017) · doi:10.31219/osf.io/5y8w7 · Cited by 29
Sotola, L. K., & Credé, M. (2022) · European Journal of Social Psychology · doi:10.1002/ejsp.2858 · Cited by 28
Neglect of Multiplicity When Testing Families of Related Hypotheses*
Holland, B., fang, S. W., & Basu, S. (2009) · doi:10.2139/ssrn.1466343 · Cited by 13
Parapsychology is science, but its findings are inconclusive
Akers, C. (1987) · Behavioral and Brain Sciences · doi:10.1017/s0140525x00054480 · Cited by 11
Metadata
- Authors
- Sterling, T. D.
- Venue
- Journal of the American Statistical Association
- Publisher
- JSTOR
- Published
- 1959-03
- Volume
- 54
- Issue
- 285
- Pages
- 30
- ISSN
- 0162-1459 (ISSN-L)
- OpenAlex
- W4237895524
- Cited by
- 524
- References
- 0
- FWCI
- 1.84
- Type
- journal article
- Language
- en
- Open access
- closed
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.