Negativland - a home for all findings in psychology
Open accessThe DOI matches its Crossref record; 30 of the 30 references it cites were found in a registry or an index.
Abstract
Psychology has been historically plagued by the under-reporting of both replications and null findings. The avoidance of these core ingredients of scientific practice means that the psychology literature is unquestionably distorted. The bias in psychology is pervasive and systemic, afflicting researchers, reviewers, editors and journals, all of whom are wed to pursuing the novel and the curious at the expense of the reliable. Psychology therefore operates in a manner that is askew of other sciences, with the links between replicability and believability seemingly much weaker. Additional problems follow from the distorted way that psychology currently operates - including spinning findings, publication bias, and sadly, outright fraud. Such problems represent a serious challenge for psychologists to get their house-in-order - and one step is to make sure that replications and null findings find a home in psychology rather than remain our dirty little secrets that further eat away at the credibility of our science.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Measuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Lipsey, M. W., & Wilson, D. B. (1993) · American Psychologist · doi:10.1037/0003-066x.48.12.1181 · Cited by 2,033
HARKing: Hypothesizing after the results are known
Kerr, N. L. (1998) · Personality and Social Psychology Review · doi:10.1207/s15327957pspr0203_4 · Cited by 1,989
Fanelli, D. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005738 · Cited by 1,911 · cited 1×
“Fanelli [33] found that 1.”
The statistical power of abnormal-social psychological research: A review.
Cohen, J. (1962) · The Journal of Abnormal and Social Psychology · doi:10.1037/h0045186 · Cited by 1,824
Bayesian statistical inference for psychological research.
Edwards, W., Lindman, H., & Savage, L. J. (1963) · Psychological Review · doi:10.1037/h0044139 · Cited by 1,734
Contradicted and Initially Stronger Effects in Highly Cited Clinical Research
Ioannidis, J. P. A. (2005) · JAMA · doi:10.1001/jama.294.2.218 · Cited by 1,465
Pashler, H., & Wagenmakers, E. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612465253 · Cited by 1,321
Negative results are disappearing from most disciplines and countries
Fanelli, D. (2012) · Scientometrics · doi:10.1007/s11192-011-0494-7 · Cited by 1,248 · cited 1×
“Fanelli [29] examined the actual outcome (rather than the abstract) in over 4600 publications from different countries and disciplines and found strong evidence for a steady and significant increase in publication bias across time.”
BackgroundEgger, M., Jüni, P., Bartlett, C., Holenstein, F., & Sterne, J. (2003) · Health Technology Assessment · doi:10.3310/hta7010 · Cited by 1,181
Cumulative Meta-Analysis of Therapeutic Trials for Myocardial Infarction
Lau, J., Antman, E. M., Jimenez-Silva, J., Kupelnick, B., Mosteller, F., & Chalmers, T. C. (1992) · New England Journal of Medicine · doi:10.1056/nejm199207233270406 · Cited by 1,140 · cited 1×
“[49]) or even all negative (null) findings in a meta-analysis may produce an overall significant effect size.”
BackgroundConsequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022 · cited 3×
“Remarkably, Greenwald found that researchers were eight times more likely to submit a manuscript for publication if the results were positive rather than negative.”
BackgroundInfluentialBem, D. J. (2011) · Journal of Personality and Social Psychology · doi:10.1037/a0021524 · Cited by 893 · cited 8×
“Francis highlights the Bem [19] study as an example of one where the paper contains multiple replications of a phenomenon and yet we don’t believe it, while other phenomena do not so readily replicate (e.g. bystander apathy) but we do believe in them!”
BackgroundInfluentialReplications in Psychology Research: How Often Do They Really Occur?
Makel, M. C., Plucker, J. A., & Hegarty, B. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612460688 · Cited by 750
Do studies of statistical power have an effect on the power of studies?
Sedlmeier, P., & Gigerenzer, G. (1989) · Psychological Bulletin · doi:10.1037/0033-2909.105.2.309 · Cited by 748
Publication bias and clinical trials
Dickersin, K., Chan, S., Chalmersx, T. C., Sacks, H. S., & Smith, H. (1987) · Controlled Clinical Trials · doi:10.1016/0197-2456(87)90155-3 · Cited by 715 · cited 1×
“[37] reported that the grey literature may be more a result of failure to write up results rather than”
BackgroundIs the Replicability Crisis Overblown? Three Arguments Examined
Pashler, H., & Harris, C. R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612463401 · Cited by 697
Ioannidis, J. P. A. (1998) · JAMA · doi:10.1001/jama.279.4.281 · Cited by 632
Ferguson, C. J., & Heene, M. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612459059 · Cited by 603 · cited 5×
“Publication bias in psychological science: Comment on Ferguson and Brannick (2012).”
BackgroundInfluentialGrey literature in meta-analyses of randomized trials of health care interventions
Hopewell, S., McDonald, S., Clarke, M. J., & Egger, M. (2007) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.mr000010.pub3 · Cited by 598 · cited 1×
“[25]).”
Lysergic acid diethylamide (LSD) for alcoholism: meta-analysis of randomized controlled trials
Krebs, T. S., & Johansen, P.-Ø. (2012) · Journal of Psychopharmacology · doi:10.1177/0269881112439253 · Cited by 583 · cited 2×
“Krebs, TS, & Johansen, P.Ø. (2012).”
MethodSterling, T. D., Rosenbaum, W. L., & Weinkam, J. J. (1995) · The American Statistician · doi:10.1080/00031305.1995.10476125 · Cited by 453
Statistical power of psychological research: What have we gained in 20 years?
Rossi, J. S. (1990) · Journal of Consulting and Clinical Psychology · doi:10.1037/0022-006x.58.5.646 · Cited by 323 · cited 5×
“Rossi, JS (1997).”
MethodInfluentialYavchitz, A., Boutron, I., Bafeta, A., Marroun, I., Charles, P., Mantz, J., & Ravaud, P. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001308 · Cited by 293 · cited 1×
“[32] examined spin in scientific papers and press releases.”
BackgroundGiner-Sorolla, R. (2012) · Perspectives on Psychological Science · doi:10.1177/1745691612457576 · Cited by 274 · cited 1×
“pendent labs and multiple contexts” (Giner-Sorolla [54], p 564, my italics).”
BackgroundShould Unpublished Data Be Included in Meta-analyses?: Current Convictions and Controversies
Cook, D. J. (1993) · JAMA · doi:10.1001/jama.1993.03500210049030 · Cited by 259
Effect of reporting bias on meta-analyses of drug trials: reanalysis of meta-analyses
Hart, B., Lundh, A., & Bero, L. (2012) · BMJ · doi:10.1136/bmj.d7202 · Cited by 255
Significance tests as sorcery: Science is empirical—significance tests are not
Lambdin, C. (2012) · Theory & Psychology · doi:10.1177/0959354311429854 · Cited by 143
Worsening file-drawer problem in the abstracts of natural, medical and social science databases
Pautasso, M. (2010) · Scientometrics · doi:10.1007/s11192-010-0233-5 · Cited by 136
Bias in genetic association studies and impact factor
Munafò, M. R., Stothart, G., & Flint, J. (2009) · Molecular Psychiatry · doi:10.1038/mp.2008.77 · Cited by 60 · cited 1×
“, [17]).”
Cited by
Karr, J. E., Areshenkoff, C. N., & Garcia-Barrera, M. A. (2014) · Neuropsychology · doi:10.1037/neu0000037 · Cited by 385
Brown, A. W., Bohan Brown, M. M., & Allison, D. B. (2013) · The American Journal of Clinical Nutrition · doi:10.3945/ajcn.113.064410 · Cited by 155
de Winter, J. C., & Dodou, D. (2015) · PeerJ · doi:10.7717/peerj.733 · Cited by 78
Sheeran, P., Listrom, O., & Gollwitzer, P. M. (2025) · European Review of Social Psychology · doi:10.1080/10463283.2024.2334563 · Cited by 48
“…suggests that the benefits of implementation intentions are robust, considerable work remains to be done by authors, reviewers, and editors to ensure that negative and null results are available for future meta-analyses of implementation intentions (Laws, 2013, Nosek, Spies, & Motyl, 2012).”
Metadata
- Authors
- Laws, K. R.
- Venue
- BMC Psychology
- Published
- 2013-02-27
- Volume
- 1
- Issue
- 1
- Pages
- 2-2
- ISSN
- 2050-7283 (ISSN-L)
- OpenAlex
- W1992506330
- Cited by
- 42
- References
- 30
- FWCI
- 7.87
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.