CoChat

Reporting Bias in Diagnostic and Prognostic Studies: Time for Action

Open access
Rifai, Nader, Altman, Douglas G, Bossuyt, Patrick M · 2008 · Clinical Chemistry
Cited by 57

The DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.

Abstract

Truth is not only violated by falsehood; it may be equally outraged by silence. —Henri-Frédéric Amiel (1812–1881) Publication bias and selective reporting are recognized problems in the biomedical literature (1)(2)(3). Positive or favorable findings are more likely to be reported than negative or inconclusive ones. Authors are often disappointed by negative findings and use multiple comparisons and subgroup analyses to generate positive results, while giving scant attention to analyses of negative results (4). Contrary to common beliefs, studies with positive results and those with negative results have been shown to be equivalent with respect to the quality of study design and execution (5), and authors and sponsors, rather than journal editors, appear to be primarily responsible for the reporting bias (5)(6)(7). Publication of only selected results distorts the research evidence base that underpins the practice of evidence-based medicine. This practice diminishes the value of systematic reviews and metaanalyses, leads to unnecessary duplication of efforts, and prevents the derivation of unbiased estimates for the risk–benefit ratio of a drug therapy or a diagnostic evaluation. Furthermore, such dubious publication practices are inconsistent with researchers’ moral responsibilities (8). Concerns over selective reporting of clinical trial results have been growing over the past several years (9)(10)(11). Comprehensive registration of clinical trials and public disclosure of study results have been suggested as the optimal solutions for this problem. Efforts to address this issue were intensified after the New York State Attorney General filed a lawsuit against GlaxoSmithKline on June 2, 2004, alleging the withholding of information regarding the efficacy and safety of paroxetine, a selective serotonin reuptake inhibitor, in children with depression (12). Shortly thereafter, the House of Delegates of the American Medical Association called on the US Department of Health and Human Services to establish a comprehensive national registry. Furthermore, the International Committee of Medical Journal Editors (ICMJE)1 published a statement in major medical journals requiring that starting July 1, 2005, all clinical trials must be registered as a condition to be considered for publication (13). Of all available registries at the time, the ICMJE recognized onlyhttp://www.clinicaltrials.org , which was authorized by the FDA Modernization Act of 1997 and sponsored by the US National Library of Medicine, as a registry that fulfilled the required criteria. Although the ICMJE establishes policy only for its 12 member journals (see http://www.icmje.org for a detailed description of the ICMJE and its purpose), the number of registered clinical trials increased suddenly by 67% after implementation of the ICMJE policy, from 15 000 to 25 000 (14). As of March 2008, approximately 52 000 clinical trials have been registered on this site. Although attention has been focused on clinical trials, selective publishing has also been reported as a problem in observational and laboratory-based investigations (4)(5)(6). In fact, reporting bias has been greater in observational and laboratory-based experimental studies than in randomized clinical trials (5). Unfortunately, no means are currently available to determine the real extent of this problem in diagnostic and prognostic studies, and such assessment is urgently needed (3)(15). While the problem of reporting bias was being addressed by medical organizations and journals, the clinical laboratory community was silently watching. We believe that it is time to act. It is imperative to create whatever measures are necessary to achieve the transparency in reporting of diagnostic and prognostic studies that the scientific community, the patients we serve, and the general public expect of our profession. The road map devised by our colleagues to tackle this issue for clinical trials can be used as a guide. We believe that only with the collaborative involvement of authors, sponsors, reviewers, journal editors, scientific professional organizations, and federal agencies can this issue be adequately addressed. We propose the following actions: (1) The scientific and medical communities should move away from the harmful notion that studies can usefully be classified as “positive” or “negative” in relation to the statistical significance of the results. Such terms cause much confusion, and indeed harm, through this bias that is introduced into the published literature. (2) Authors should recognize that “negative” results from well-conducted studies are as important to report as “positive” or “favorable” ones. A retrospective survey of 487 research projects approved by the Central Oxford Research Ethics Committee and conducted over a 4-year period showed that the quality of design and execution for positive and negative studies were equivalent (5). Furthermore, both positive and negative findi

Overview

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1373/clinchem.2008.108993

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Verification

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.

A few free checks a day · papers already verified open instantly · results are public

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Citations

Cites

Show all 8 references

Cited by

See all 57

Metadata

Authors
Rifai, N., Altman, D. G., & Bossuyt, P. M.
Venue
Clinical Chemistry
Published
2008-07-01
Volume
54
Issue
7
Pages
1101-1103
ISSN
  • 0009-9147 (ISSN-L)
  • 1530-8561
OpenAlex
W2053537559
Cited by
57
References
8
FWCI
3.75
Type
journal article
Language
en
Open access
bronze

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Reporting Bias in Diagnostic and Prognostic Studies: Time for Action. https://app.cochat.ai/papers/10.1373/clinchem.2008.108993
The paper
Rifai, N., Altman, D. G., & Bossuyt, P. M. (2008). Reporting Bias in Diagnostic and Prognostic Studies: Time for Action. Clinical Chemistry. https://doi.org/10.1373/clinchem.2008.108993

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.