The DOI matches its Crossref record; 118 of the 120 references it cites were found in a registry or an index.
Methodology and overt and hidden bias in reports of 196 double-blind trials of nonsteroidal antiinflammatory drugs in rheumatoid arthritis
Abstract
Important design aspects were decreasingly reported in NSAID trials over the years, whereas the quality of statistical analysis improved. In half of the trials, the effect variables in the methods and results sections were not the same, and the interpretation of the erythrocyte sedimentation rate in the reports seemed to depend on whether a significant difference was found. Statistically significant results appeared in 93 reports (47%). In 73 trials they favored only the new drug, and in 8 only the active control. All 39 trials with a significant difference in side effects favored the new drug. Choice of dose, multiple comparisons, wrong calculation, subgroup and within-groups analyses, wrong sampling units (in 63% of trials for effect variables, in 23% for side effects), change in measurement scale before analysis, baseline difference, and selective reporting of significant results were some of the verified or possible causes for the large proportion of results that favored the new drug. Doubtful or invalid statements were found in 76% of the conclusions or abstracts. Bias consistently favored the new drug in 81 trials, and the control in only one trial. It is not obvious how a reliable meta-analysis could be done in these trials.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“More than 20 y later, an analysis of 196 drug trials to treat rheumatoid arthritis concluded that 76% of the conclusions or abstracts contained “doubtful or invalid statements” (63).”
From Issues with data and analyses: Errors, underlying themes, and potential solutions (2018) · cites this paper as [63]
Citations
Cites
Primary, Secondary, and Meta-Analysis of Research
GLASS, G. V. (1976) · Educational Researcher · doi:10.3102/0013189x005010003 · Cited by 4,890
Clinical Trials: A Practical Approach.
Hill, I. D., & Pocock, S. J. (1984) · Biometrics · doi:10.2307/2531186 · Cited by 2,930
THERAPEUTIC CRITERIA IN RHEUMATOID ARTHRITIS
STEINBROCKER, O. (1949) · JAMA: The Journal of the American Medical Association · doi:10.1001/jama.1949.02900430001001 · Cited by 2,877
Nonparametric Statistical Methods.
Moore, D. S., Hollander, M., & Wolfe, D. A. (1974) · Journal of the American Statistical Association · doi:10.2307/2285701 · Cited by 2,857
Graphic representation of pain
Scott, J., & Huskisson, E. C. (1976) · Pain · doi:10.1016/0304-3959(76)90113-5 · Cited by 2,706
Peto, R., Pike, M. C., Armitage, P., Breslow, N. E., Cox, D. R., Howard, S. V., Mantel, N., McPherson, K., Peto, J., & Smith, P. G. (1976) · British Journal of Cancer · doi:10.1038/bjc.1976.220 · Cited by 2,294
Fundamentals of Clinical Trials
Friedman, L. M., Furberg, C. D., DeMets, D. L., Reboussin, D. M., & Granger, C. B. (2015) · doi:10.1007/978-3-319-18539-2 · Cited by 2,237
Confidence intervals rather than P values: estimation rather than hypothesis testing.
Gardner, M. J., & Altman, D. G. (1986) · BMJ · doi:10.1136/bmj.292.6522.746 · Cited by 2,010
Freiman, J. A., Chalmers, T. C., Smith, H., & Kuebler, R. R. (1978) · New England Journal of Medicine · doi:10.1056/nejm197809282991304 · Cited by 1,628
Regression Towards Mediocrity in Hereditary Stature.
Galton, F. (1886) · The Journal of the Anthropological Institute of Great Britain and Ireland · doi:10.2307/2841583 · Cited by 1,454
Research works printed but not linked: 3
- Ambroz, 1978, Deficiencies of randomized control trials, Clin Res, 26, 280A
- Fjellström, 1957, Phenylbutazone in active periods of rheumatoid arthritis, Acta Med Scand (Suppl), 320, 1
- Vallance, 1981, Survey of design and analysis of controlled trials of non-steroidal, anti-inflammatory drugs, Aust NZ J Med, 11, 719
Cited by
Moher, D., Hopewell, S., Schulz, K. F., Montori, V., Gotzsche, P. C., Devereaux, P. J., Elbourne, D., Egger, M., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c869 · Cited by 8,883
Self-citationThe Revised CONSORT Statement for Reporting Randomized Trials: Explanation and Elaboration
Altman, D. G., Schulz, K. F., Moher, D., Egger, M., Davidoff, F., Elbourne, D., Gøtzsche, P. C., Lang, T., & for the CONSORT Group (2001) · Annals of Internal Medicine · doi:10.7326/0003-4819-134-8-200104170-00012 · Cited by 3,835
Self-citationImproving the Quality of Reporting of Randomized Controlled Trials: The CONSORT Statement
Begg, C. (1996) · JAMA · doi:10.1001/jama.1996.03540080059030 · Cited by 3,127
External validity of randomised controlled trials: “To whom do the results of this trial apply?”
Rothwell, P. M. (2005) · The Lancet · doi:10.1016/s0140-6736(04)17670-8 · Cited by 2,544
Verhagen, A. P., de Vet, H. C. W., de Bie, R. A., Kessels, A. G. H., Boers, M., Bouter, L. M., & Knipschild, P. G. (1998) · Journal of Clinical Epidemiology · doi:10.1016/s0895-4356(98)00131-0 · Cited by 2,379
Metadata
- Authors
- Gøtzsche, P. C.
- Affiliations
- Hvidovre Hospital (DK)
- Corresponding author
- Gøtzsche, Peter C.
- ORCID
- Gøtzsche, Peter C.
- Venue
- Controlled Clinical Trials
- Publisher
- Elsevier BV
- Published
- 1989-03
- Volume
- 10
- Issue
- 1
- Pages
- 31-56
- ISSN
- 0197-2456 (ISSN-L)
- OpenAlex
- W1993398606
- Cited by
- 339
- References
- 120
- Citations by year
- 2026: 1 · 2025: 4 · 2024: 1 · 2023: 2 · 2022: 3 · 2021: 2 · 2020: 1 · 2019: 7 · 2018: 7 · 2017: 7 · 2016: 2 · 2015: 5 · 2014: 6 · 2013: 13 · 2012: 9
- FWCI
- 13.03
- Type
- journal article
- Language
- en
- Open access
- closed
- Licence
- www.elsevier.com/tdm/userlicense/1.0/ (tdm)
- Locations
- Controlled Clinical Trials (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Sundhed og Sygdom, Det Frie Forskningsråd
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Health Sciences › Nursing › Issues, ethics and legal aspects › Pharmaceutical industry and healthcare
- Keywords
- nonsteroidal anti-inflammatory drugs, rheumatoid arthritis, publication bias, selective reporting, erythrocyte sedimentation rate, adverse drug reactions, meta-analysis reliability
- MeSH terms
- Anti-Inflammatory Agents, Non-Steroidal, Arthritis, Rheumatoid, Biological Availability, Blood Sedimentation, Clinical Trials as Topic, Double-Blind Method, Humans, Informed Consent, Patient Compliance, Random Allocation, Research Design, Statistics as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Methodology and overt and hidden bias in reports of 196 double-blind trials of nonsteroidal antiinflammatory drugs in rheumatoid arthritis. https://app.cochat.ai/papers/10.1016/0197-2456(89)90017-2
- The paper
- Gøtzsche, P. C. (1989). Methodology and overt and hidden bias in reports of 196 double-blind trials of nonsteroidal antiinflammatory drugs in rheumatoid arthritis. Controlled Clinical Trials. https://doi.org/10.1016/0197-2456(89)90017-2
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.