Negative results are disappearing from most disciplines and countries
The DOI matches its Crossref record; 64 of the 64 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Previous research found a decrease in negative results (Fanelli, 2012) and an increase in reporting inconsistencies (Leggett, Thomas, Loetscher, & Nicholls, 2013), suggesting that QRPs are on the rise.”
From The prevalence of statistical reporting errors in psychology (1985–2013) (2016) · cites this paper as Fanelli, 2012
In the citing paper
“Overall, it seems that, contrary to the evidence suggesting that the use of QRPs could be on the rise (Fanelli, 2012; Leggett et al., 2013), neither the inconsistencies nor the gross inconsistencies have shown an increase over time.”
From The prevalence of statistical reporting errors in psychology (1985–2013) (2016) · cites this paper as Fanelli, 2012
In the citing paper
“Positive results are much more likely to be published than negative results 5-7”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [6]
In the citing paper
“Positive results -- finding that a treatment is effective or that there is a relationship between two variables -- are more likely to be published than negative results 6-12 .”
From Initial evidence of research quality of registered reports compared with the standard publishing model (2021) · cites this paper as [6]
In the citing paper
“Publication bias [20, 21], lack of replicability and replication [22], implication of a causal relationship even after stating that the evidence is insufficient to reach causal conclusions [23–25], and related phenomena may also introduce error into bodies of published literature.”
From Causal language and strength of inference in academic and media articles shared in social media (CLAIMS): A systematic review (2018) · cites this paper as [20]
6 more claims about this paper
Create a free account to see every claim other papers make about this one.
Citations
Cites
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Replication validity of genetic association studies
Ioannidis, J. P. A., Ntzani, E. E., Trikalinos, T. A., & Contopoulos-Ioannidis, D. G. (2001) · Nature Genetics · doi:10.1038/ng749 · Cited by 1,832 · cited 1×
“This does indeed seem to be the case at least in some biomedical fields, where the first paper to report a finding often shows extreme effects that subsequent replications reduce or contradict entirely (Ioannidis et al. 2001; Ioannidis and Trikalinos 2005).”
BackgroundSystematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546
Why Most Discovered True Associations Are Inflated
Ioannidis, J. P. A. (2008) · Epidemiology · doi:10.1097/ede.0b013e31818131e7 · Cited by 1,495
The scientific impact of nations
King, D. A. (2004) · Nature · doi:10.1038/430311a · Cited by 1,245
Shall we Really do it Again? The Powerful Concept of Replication is Neglected in the Social Sciences
Schmidt, S. (2009) · Review of General Psychology · doi:10.1037/a0015108 · Cited by 1,125 · cited 2×
“…and had increased more rapidly in the social and many biological sciences [where theories and methods tend to be less codified and replication is rare (Fanelli 2010b; Schmidt 2009; Evanschitzky et al. 2007; Tsang and Kwan 1999; Kelly 2006; Palmer 2000; Jones et al. 2010; Hubbard and Vetter 1996)].”
BackgroundDissemination and publication of research findings: an updated review of related biases
Song, F., Parekh, Hooper, L., Loke, Y., Ryder, J., Sutton, A., Hing, C., Kwok, C., Pang, C., & Harvey, I. (2010) · Health Technology Assessment · doi:10.3310/hta14080 · Cited by 1,039 · cited 5×
“…or non-US countries have been observed in past meta-analyses, and were usually attributed to editorial and peer-review biases, which might tend to reject papers from certain countries unless they present particularly strong or appealing results (Song et al. 2010; Yousefi-Nooraie et al. 2006).”
BackgroundInfluentialLarsen, P. O., & von Ins, M. (2010) · Scientometrics · doi:10.1007/s11192-010-0202-z · Cited by 964
Replication and Theory Development in Organizational Science: A Critical Realist Perspective
Tsang, E. W. K., & Kwan, K.-M. (1999) · The Academy of Management Review · doi:10.2307/259353 · Cited by 821 · cited 2×
“…and had increased more rapidly in the social and many biological sciences [where theories and methods tend to be less codified and replication is rare (Fanelli 2010b; Schmidt 2009; Evanschitzky et al. 2007; Tsang and Kwan 1999; Kelly 2006; Palmer 2000; Jones et al. 2010; Hubbard and Vetter 1996)].”
BackgroundDo Pressures to Publish Increase Scientists' Bias? An Empirical Support from US States Data
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010271 · Cited by 805
Self-citation
Research works printed but not linked: 1
- Shelton, R. D., Foland, P., & Gorelskyy, R. (2007). Do new SCI journals have a different national bias? Proceedings of ISSI 2007: 11th international conference of the international society for scientometrics and informetrics, Vols I and II (pp. 708–717).
Cited by
Power failure: why small sample size undermines the reliability of neuroscience
Button, K. S., Ioannidis, J. P. A., Mokrysz, C., Nosek, B. A., Flint, J., Robinson, E. S. J., & Munafò, M. R. (2013) · Nature Reviews Neuroscience · doi:10.1038/nrn3475 · Cited by 7,641
P-curve: A key to the file-drawer.
Simonsohn, U., Nelson, L. D., & Simmons, J. P. (2014) · Journal of Experimental Psychology: General · doi:10.1037/a0033242 · Cited by 1,500
“The funnel plot’s fill-and-trim procedure does, but it is only valid if publication bias is affected only by effect size, not by statistical significance (Duval & Tweedie, 2000), even though in many disciplines, including psychology, publication bias operates primarily through statistical significance rather than effe…”
Power Analysis and Effect Size in Mixed Effects Models: A Tutorial
Brysbaert, M., & Stevens, M. (2018) · Journal of Cognition · doi:10.5334/joc.10 · Cited by 1,420
“Second, there is a file drawer problem (Fanelli, 2011; Franco, Malhotra, & Simonovits, 2014).”
BackgroundThe Extent and Consequences of P-Hacking in Science
Head, M. L., Holman, L., Lanfear, R., Kahn, A. T., & Jennions, M. D. (2015) · PLOS Biology · doi:10.1371/journal.pbio.1002106 · Cited by 1,388
Nosek (2012) · doi:10.1177/1745691612459058 · Cited by 1,301
“…rather than pursuing additional evidence for or against ideas suggested previously; (b) reporting positive results and ignoring negative results (Fanelli, 2012; Greenwald, 1975; Ioannidis & Trikalinos, 2007; Rosenthal, 1979); and (c) pursuing design, reporting, and analysis strategies that…”
Influential
Metadata
- Authors
- Fanelli, D.
- Affiliations
- University of Edinburgh (GB)
- Corresponding author
- Fanelli, Daniele
- ORCID
- Fanelli, Daniele
- Venue
- Scientometrics
- Published
- 2011-09-11
- Volume
- 90
- Issue
- 3
- Pages
- 891-904
- ISSN
- 0138-9130 (ISSN-L)
- 1588-2861
- OpenAlex
- W2080209500
- Cited by
- 1,248
- References
- 62
- Citations by year
- 2026: 85 · 2025: 86 · 2024: 83 · 2023: 78 · 2022: 92 · 2021: 126 · 2020: 111 · 2019: 117 · 2018: 90 · 2017: 90 · 2016: 80 · 2015: 64 · 2014: 69 · 2013: 48 · 2012: 29
- FWCI
- 46.33
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Scientometrics (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- Funders
- Economic and Social Research Council (ES/F028180/1)
- Topics
- Social Sciences › Library and Information Sciences › scientometrics and bibliometrics research
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Social Sciences › Education › Academic integrity and plagiarism
- Keywords
- negative results, publication bias, hypothesis testing, research funding competition, research integrity, scientific objectivity, disciplinary differences, country differences, high-risk research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Negative results are disappearing from most disciplines and countries. https://app.cochat.ai/papers/10.1007/s11192-011-0494-7
- The paper
- Fanelli, D. (2012). Negative results are disappearing from most disciplines and countries. Scientometrics. https://doi.org/10.1007/s11192-011-0494-7
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.