Research accomplishments that are too good to be true
The DOI matches its Crossref record; 18 of the 18 references it cites were found in a registry or an index.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Poor research design and data analysis encourage false-positive findings.”
From The natural selection of bad science (2016) · cites this paper as [10]
In the citing paper
“Yet misuse of statistical procedures and poor methods has persisted and possibly grown.”
From The natural selection of bad science (2016) · cites this paper as [10]
In the citing paper
“In fields such as psychology, neuroscience and medicine, practices that increase false discoveries remain not only common, but normative [5–11].”
From The natural selection of bad science (2016) · cites this paper as [10]
Citations
Cites
1 retracted
RETRACTED ARTICLE: Volume therapy in the critically ill: is there a difference?
Boldt, J., Müller, M., Mentges, D., Papsdorf, M., & Hempelmann, G. (1998) · Intensive Care Medicine · doi:10.1007/s001340050511 · Cited by 109
RetractedMeasuring the Prevalence of Questionable Research Practices With Incentives for Truth Telling
John, L. K., Loewenstein, G., & Prelec, D. (2012) · Psychological Science · doi:10.1177/0956797611430953 · Cited by 2,239
Fanelli, D. (2009) · PLoS ONE · doi:10.1371/journal.pone.0005738 · Cited by 1,911 · cited 1×
“The frequency of fraud in science is difficult to estimate [6].”
BackgroundPuzzlingly High Correlations in fMRI Studies of Emotion, Personality, and Social Cognition
Vul, E., Harris, C., Winkielman, P., & Pashler, H. (2009) · Perspectives on Psychological Science · doi:10.1111/j.1745-6924.2009.01125.x · Cited by 1,475 · cited 1×
“The distinction between fraud, questionable research practices [9], extravagant voodoo correlations [10], and academic misery can be subtle.”
Background“Positive” results increase down the Hierarchy of the Sciences
Fanelli, D. (2010) · PLoS ONE · doi:10.1371/journal.pone.0010068 · Cited by 734 · cited 1×
“Many papers report significant results (over 90 % of papers in medicine and related fields do so) [7].”
BackgroundHonorary and ghost authorship in high impact biomedical journals: a cross sectional survey
Wislar, J. S., Flanagin, A., Fontanarosa, P. B., & DeAngelis, C. D. (2011) · BMJ · doi:10.1136/bmj.d6128 · Cited by 478 · cited 1×
“Many powerful academics are just jerks, and many have been given gift authorship [8] on papers with otherwise real data.”
BackgroundPublic Availability of Published Research Data in High-Impact Journals
Alsheikh-Ali, A. A., Qureshi, W., Al-Mallah, M. H., & Ioannidis, J. P. A. (2011) · PLoS ONE · doi:10.1371/journal.pone.0024357 · Cited by 363 · cited 1×
“This is already happening as a prerequisite for publication for many types of research in many major journals [12], but there is large heterogeneity.”
BackgroundSelf-citationCysticercosis as a major cause of epilepsy in Peru
Garcia, H. H., Gilman, R. H., Herrera, G., Diaz, F., Miranda, E., Gilman, R. H., Martinez, M., Alvarado, M. A., Tsang, V. C. W., & Pilcher, J. B. (1993) · The Lancet · doi:10.1016/0140-6736(93)90064-n · Cited by 227
The Imperative to Share Clinical Study Reports: Recommendations from the Tamiflu Experience
Doshi, P., Jefferson, T., & Del Mar, C. (2012) · PLoS Medicine · doi:10.1371/journal.pmed.1001201 · Cited by 165
Does declaration of competing interests affect readers' perceptions? A randomised trial
Chaudhry, S., Schroter, S., Smith, R., & Morris, J. (2002) · BMJ · doi:10.1136/bmj.325.7377.1391 · Cited by 119
Cited by
The natural selection of bad science
Smaldino, P. E., & McElreath, R. (2016) · Royal Society Open Science · doi:10.1098/rsos.160384 · Cited by 860
“…as psychology, neuroscience, and medicine, practices that increase false discoveries remain not only common, but normative (Enserink, 2012; Vul, Harris, Winkielman & Pashler, 2009; Peterson, 2016; Kerr, 1998; John, Loewenstein & Prelec, 2012; Ioannidis, 2014b; Simmons, Nelson & Simonsohn, 2011).”
BackgroundInfluentialSola, A., GOLOMBEK, S. G., Bueno, M. T. M., Lemus‐Varela, L., Zuluaga, C., Domínguez, F., Baquero, H., Sarmiento, A. Y., Natta, D., Perez, J. M. R., et al. (2014) · Acta Paediatrica · doi:10.1111/apa.12692 · Cited by 141
“sometimes the findings are just too good to be true (50).”
BackgroundSeshia, S. S., Makhinson, M., Phillips, D. F., & Young, G. B. (2014) · Journal of Evaluation in Clinical Practice · doi:10.1111/jep.12280 · Cited by 26
Sipido, K. R., & Nagyová, I. (2020) · European Journal of Public Health · doi:10.1093/eurpub/ckaa032 · Cited by 17
Perner, A., Citerio, G., Bakker, J., Bassetti, M., Benoît, D., Cecconi, M., Curtis, J. R., Doig, G. S., Herridge, M. S., Jaber, S., et al. (2015) · Intensive Care Medicine · doi:10.1007/s00134-015-3707-3 · Cited by 10
“False extravagant results are probably far more likely to arise from selective analysis and outcome reporting and data dredging rather than by fraud [80] .”
Background
Metadata
- Authors
- Ioannidis, J. P. A.
- Affiliations
- Stanford Medicine (US)
- Corresponding author
- Ioannidis, John P. A.
- Venue
- Intensive Care Medicine
- Published
- 2013-10-16
- Volume
- 40
- Issue
- 1
- Pages
- 99-101
- ISSN
- 0342-4642 (ISSN-L)
- 1432-1238
- OpenAlex
- W1972787233
- Cited by
- 12
- References
- 18
- Citations by year
- 2021: 1 · 2020: 1 · 2018: 1 · 2016: 1 · 2015: 3 · 2014: 5
- FWCI
- 7.93
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.springer.com/tdm (tdm)
- Locations
- Intensive Care Medicine (publishedVersion)
- PubMed (publishedVersion)
- Topics
- Social Sciences › Education › Academic integrity and plagiarism
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- research integrity, questionable research practices, publication bias, research misconduct, research critique
- MeSH terms
- Humans, Research Personnel, Scientific Misconduct, Biomedical Research
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Research accomplishments that are too good to be true. https://app.cochat.ai/papers/10.1007/s00134-013-3100-z
- The paper
- Ioannidis, J. P. A. (2014). Research accomplishments that are too good to be true. Intensive Care Medicine. https://doi.org/10.1007/s00134-013-3100-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.