Selective outcome reporting: telling and detecting true lies. The state of the science
Open accessThe DOI matches its Crossref record; 35 of the 35 references it cites were found in a registry or an index.
Abstract
Osteoarthritis is a common form of joint disease in the elderly and may cause severe pain and disability. Besides nonsteroidal anti-inflammatory drugs, the mainstay of management for osteoarthritic pain, transcutaneous electrostimulation (TENS), ultrasound and opioids have been advocated as viable treatment options [ 1 – 3 ]. However, the evidence for their effectiveness and safety is contradictory. The Cochrane database of systematic reviews offers a series of recently published reviews dealing with osteoarthritis, clarifying the therapeutic role of these interventions. In critically appraising what we already know using the GRADE Working Group grades of evidence, Rutjes et al. rate the quality of the originally published reports for key clinical core outcomes: pain, function and the number of patients experiencing an adverse event. In many of these instances, the overall quality of evidence is rated as low because, among other reasons, only a small proportion of included studies report a specific outcome (i.e., 8 out of 18 studies report the number of patients withdrawn because of adverse events) [ 3 ]. In these cases, the authors warn readers against the likely risk of selective outcome reporting bias.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“These studies have identified that outcome reporting bias is high in the literature [82,86].”
From Systematic review of knowledge translation strategies in the allied health professions (2012) · cites this paper as [86]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cochrane Handbook for Systematic Reviews of Interventions: Cochrane Book Series
(2008) · doi:10.1002/9780470712184 · Cited by 25,048
Why Most Published Research Findings Are False
Ioannidis, J. P. A. (2005) · PLoS Medicine · doi:10.1371/journal.pmed.0020124 · Cited by 10,505
Selective publication of antidepressant trials and its influence on apparent efficacy
Turner, E. H., Matthews, A. M., Linardatos, E., Tell, R. A., & Rosenthal, R. (2008) · New England Journal of Medicine · doi:10.1056/nejmsa065779 · Cited by 2,435
Publication Bias in Meta‐Analysis: Prevention, Assessment and Adjustments
(2005) · doi:10.1002/0470870168 · Cited by 2,368
A Social History of Truth: Civility and Science in Seventeenth-Century England
Shapin, S. (1994) · University of Chicago Press eBooks · doi:10.7208/chicago/9780226148847.001.0001 · Cited by 1,928
Chan, A.-W., Hróbjartsson, A., Haahr, M. T., Gøtzsche, P. C., & Altman, D. G. (2004) · JAMA · doi:10.1001/jama.291.20.2457 · Cited by 1,845 · cited 2×
“[21] find that the median number of efficacy outcome measures per trial to be 20 (10–90th”
BackgroundSystematic Review of the Empirical Evidence of Study Publication Bias and Outcome Reporting Bias
Dwan, K., Altman, D. G., Arnaiz, J. A., Bloom, J., Chan, A.-W., Cronin, E., Decullier, E., Easterbrook, P. J., Von Elm, E., Gamble, C., et al. (2008) · PLoS ONE · doi:10.1371/journal.pone.0003081 · Cited by 1,546 · cited 1×
“In fact, the prevalence of favourable results from the cohort of trials examined in the reported surveys is very high, and may reflect no true differences [18].”
BackgroundKirkham, J. J., Dwan, K. M., Altman, D. G., Gamble, C., Dodd, S., Smyth, R., & Williamson, P. R. (2010) · BMJ · doi:10.1136/bmj.c365 · Cited by 1,133
Self-citationConsequences of prejudice against the null hypothesis.
Greenwald, A. G. (1975) · Psychological Bulletin · doi:10.1037/h0076157 · Cited by 1,022 · cited 1×
“Publication bias originates in a prejudiced peerreview attitude: many reviewers are predisposed against recommending the publication of studies reporting nonsignificant findings [4].”
BackgroundComparison of Registered and Published Primary Outcomes in Randomized Controlled Trials
Mathieu, S. (2009) · JAMA · doi:10.1001/jama.2009.1242 · Cited by 730
Cited by
Systematic review of knowledge translation strategies in the allied health professions
Scott, S. D., Albrecht, L., O’Leary, K., Ball, G. D., Hartling, L., Hofmeyer, A., Jones, C. A., Klassen, T. P., Burns, K. K., Newton, A. S., et al. (2012) · Implementation Science · doi:10.1186/1748-5908-7-70 · Cited by 331
“These studies have identified that outcome reporting bias is high in the literature [82,86].”
Preoperative radiotherapy and curative surgery for the management of localised rectal carcinoma
Abraha, I., Aristei, C., Palumbo, I., Lupattelli, M., Trastulli, S., Cirocchi, R., Florio, R. D., & Valentini, V. (2018) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd002102.pub3 · Cited by 101
Self-citationLaparoscopic versus open resection for sigmoid diverticulitis
Abraha, I., Binda, G. A., Montedori, A., Arezzo, A., & Cirocchi, R. (2017) · Cochrane Database of Systematic Reviews · doi:10.1002/14651858.cd009277.pub2 · Cited by 98
Self-citationMilette, K., Roseman, M., & Thombs, B. D. (2010) · Journal of Psychosomatic Research · doi:10.1016/j.jpsychores.2010.09.015 · Cited by 71
Surgical wound closure by staples or sutures?
Cochetti, G. G., Abraha, I., Randolph, J., Montedori, A., Boni, A., Arezzo, A., Mazza, E., Vermandois, J. A. R. D., Cirocchi, R., & Mearini, E. E. (2020) · Medicine · doi:10.1097/md.0000000000020573 · Cited by 53
Self-citation
Metadata
- Authors
- Macura, A., Abraha, I., Kirkham, J., Gensini, G. F., Moja, L., & Iorio, A.
- Affiliations
- University of Perugia (IT)
- Regione Umbria (IT)
- University of Liverpool (GB)
- Azienda Ospedaliero-Universitaria Careggi (IT)
- Mario Negri Institute for Pharmacological Research (IT)
- Corresponding author
- Iorio, Alfonso
- Venue
- Internal and Emergency Medicine
- Published
- 2010-03-19
- Volume
- 5
- Issue
- 2
- Pages
- 151-155
- ISSN
- 1828-0447 (ISSN-L)
- 1970-9366
- OpenAlex
- W1982597946
- Cited by
- 19
- References
- 35
- Citations by year
- 2024: 1 · 2023: 2 · 2020: 2 · 2019: 1 · 2018: 3 · 2017: 4 · 2016: 1 · 2015: 2 · 2012: 2
- FWCI
- 0.99
- Type
- journal article
- Language
- en
- Open access
- hybrid
- doi.org
- Licence
- other-oa
- www.springer.com/tdm (tdm)
- Locations
- Internal and Emergency Medicine (publishedVersion, other-oa)
- PubMed (publishedVersion)
- Florence Research (University of Florence) (submittedVersion)
- Research Explorer (The University of Manchester) (submittedVersion)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Social Sciences › Library and Information Sciences › Academic Publishing and Open Access
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- selective outcome reporting, reporting bias, osteoarthritis, osteoarthritis pain, transcutaneous electrical nerve stimulation, ultrasound therapy, opioids, nonsteroidal anti-inflammatory drugs, adverse events, GRADE, outcome reporting quality
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Selective outcome reporting: telling and detecting true lies. The state of the science. https://app.cochat.ai/papers/10.1007/s11739-010-0371-z
- The paper
- Macura, A., Abraha, I., Kirkham, J., Gensini, G. F., Moja, L., & Iorio, A. (2010). Selective outcome reporting: telling and detecting true lies. The state of the science. Internal and Emergency Medicine. https://doi.org/10.1007/s11739-010-0371-z
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.