Deficient Reporting and Interpretation of Non-Inferiority Randomized Clinical Trials in HIV Patients: A Systematic Review
Open accessThe DOI matches its Crossref record; 55 of the 55 references it cites were found in a registry or an index.
Abstract
OBJECTIVES: Non-inferiority (NI) randomized clinical trials (RCTs) commonly evaluate efficacy of new antiretroviral (ARV) drugs in human immunodeficiency virus (HIV) patients. Their reporting and interpretation have not been systematically evaluated. We evaluated the reporting of NI RCTs in HIV patients according to the CONSORT statement and assessed the degree of misinterpretation of RCTs when NI was inconclusive or not established. DESIGN: Systematic review. METHODS: PubMed, Web of Science, and Scopus were reviewed until December 2011. Selection and extraction was performed independently by three reviewers. RESULTS: Of the 42 RCTs (n = 21,919; range 41-3,316) selected, 23 were in ARV-naïve and 19 in ARV-experienced patients. Twenty-seven (64%) RCTs provided information about prior RCTs of the active comparator, and 37 (88%) used 2-sided CIs. Two thirds of trials used a NI margin between 10 and 12%, although only 12 explained the method to determine it. Blinding was used in 9 studies only. The main conclusion was based on both intention-to-treat (ITT) and per protocol (PP) analyses in 5 trials, on PP analysis only in 4 studies, and on ITT only in 31 studies. Eleven of 16 studies with NI inconclusive or not established highlighted NI or equivalence, and distracted readers with positive secondary results. CONCLUSIONS: There is poor reporting and interpretation of NI RCTs performed in HIV patients. Maximizing the reporting of the method of NI margin determination, use of blinding and both ITT and PP analyses, and interpreting negative NI according to actual primary findings will improve the understanding of results and their translation into clinical practice.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“One study in the field of HIV assessed the interpretation of noninferiority trial results and showed spin in two-thirds of the studies with inconclusive results (55).”
From Misrepresentation and distortion of research in biomedical literature (2018) · cites this paper as [55]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Piaggio, G., Elbourne, D. R., Pocock, S. J., Evans, S. J. W., Altman, D. G., & CONSORT Group, F. T. (2012) · JAMA · doi:10.1001/jama.2012.87802 · Cited by 2,428 · cited 4×
“The extended Consolidated Standards of Reporting Trials (CONSORT) statement of 2006 [3] has updated recommendations to guide the conduct and reporting of NI trials.”
BackgroundMethodResultInfluentialGallant, J. E. (2004) · JAMA · doi:10.1001/jama.292.2.191 · Cited by 1,341 · cited 4×
“Gallant/2004/ Gilead 903 [11] Pharmaceutical company South America, Europe, USA 48 weeks TDF 300/plac qd +3TC 150 bid+EFV600 qd (n = 299) d4T40/plac bid +3TC150 bid+ EFV600 qd (n = 301) Proportion of patients with HIV RNA levels ,400 copies/ml at week 48.”
BackgroundMethodInfluentialReporting of Noninferiority and Equivalence Randomized Trials: An Extension of the CONSORT Statement
Piaggio, G., Elbourne, D. R., Altman, D. G., Pocock, S. J., Evans, S. J. W., & CONSORT Group, F. T. (2006) · JAMA · doi:10.1001/jama.295.10.1152 · Cited by 1,153 · cited 4×
“The extended Consolidated Standards of Reporting Trials (CONSORT) statement of 2006 [3] has updated recommendations to guide the conduct and reporting of NI trials.”
BackgroundMethodResultInfluentialPlint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D. G., Hill, C., & Gaboury, I. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00557.x · Cited by 872
Boutron, I. (2010) · JAMA · doi:10.1001/jama.2010.651 · Cited by 842 · cited 3×
“Boutron et al identified the nature and frequency of spin in superiority RCTs with statistically non-significant results for primary outcomes [8].”
BackgroundMethodResultInfluentialLennox, J. L., DeJesus, E., Lazzarin, A., Pollard, R. B., Madruga, J. V. R., Berger, D. S., Zhao, J., Xu, X., Williams-Diaz, A., Rodgers, A. J., et al. (2009) · The Lancet · doi:10.1016/s0140-6736(09)60918-1 · Cited by 625 · cited 1×
“Lennox/2009/ STARTMRK [23] Pharmaceutical company 14 countries 48 weeks RAL based combination regimen (400 bid)+ TDF/FTC (n = 281) EFV based combination regimen (600 qd)+ TDF/FTC (n = 282) Achievement of ,50 vRNA copies/ml at week 48.”
MethodMolina, J.-M., Andrade-Villanueva, J., Echevarria, J., Chetchotisakd, P., Corral, J., David, N., Moyle, G., Mancini, M., Percival, L., Yang, R., et al. (2008) · The Lancet · doi:10.1016/s0140-6736(08)61081-8 · Cited by 486 · cited 1×
“Molina/2008/ CASTLE [19] Pharmaceutical company 29 countries 48 weeks ATV-RTV (300/ 100 qd)+TDF-FTC (300/200 qd) (n = 440) LPV-RTV(400/ 100 bid)+TDFFTC(300/200 qd) (n = 443) Proportion of patients with HIV RNA levels of ,50 copies/ml at 48 weeks.”
Kjaergard, L., & Als-Nielsen, B. (2002) · BMJ · doi:10.1136/bmj.325.7358.249 · Cited by 433 · cited 1×
“Secondarily, we stratified studies by a) year published: before 2007 vs since 2007; studies have shown improvement in reporting standards in RCTs post-CONSORT [9] and b) type of sponsor: government vs pharmaceutical companies; studies have shown that industry sponsored trials tend to draw pro industry conclusions (spo…”
MethodMolina, J.-M., Cahn, P., Grinsztejn, B., Lazzarin, A., Mills, A., Saag, M., Supparatpinyo, K., Walmsley, S., Crauwels, H., Rimsky, L. T., et al. (2011) · The Lancet · doi:10.1016/s0140-6736(11)60936-7 · Cited by 405 · cited 2×
“In 2 studies, NI margin was selected based on investigators assumptions [12,24]; 4 studies based on other publications or reviews [11,14,35,46]; 2 studies based on guidelines [28,32]; 2 studies, calculated based on previous trial results [20,31]; one study based on investigators assumption and other publications and r…”
BackgroundMethodOrtiz, R., DeJesus, E., Khanlou, H., Voronin, E., van Lunzen, J., Andrade-Villanueva, J., Fourie, J., De Meyer, S., De Pauw, M., Lefebvre, E., et al. (2008) · AIDS · doi:10.1097/qad.0b013e32830285fb · Cited by 387
Cited by
‘Spin’ in published biomedical literature: A methodological systematic review
Chiu, K., Grundy, Q., & Bero, L. (2017) · PLOS Biology · doi:10.1371/journal.pbio.2002173 · Cited by 317
Misrepresentation and distortion of research in biomedical literature
Boutron, I., & Ravaud, P. (2018) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1710755115 · Cited by 273
“One study in the field of HIV assessed the interpretation of noninferiority trial results and showed spin in two-thirds of the studies with inconclusive results (55).”
Defining the noninferiority margin and analysing noninferiority: An overview
Althunian, T. A., de Boer, A., Groenwold, R. H. H., & Klungel, O. H. (2017) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.13280 · Cited by 215
Lazarus, C., Haneef, R., Ravaud, P., & Boutron, I. (2015) · BMC Medical Research Methodology · doi:10.1186/s12874-015-0079-x · Cited by 137
Althunian, T. A., de Boer, A., Klungel, O. H., Insani, W. N., & Groenwold, R. H. H. (2017) · Trials · doi:10.1186/s13063-017-1859-x · Cited by 94
“This is in line with the range of margins that were defined by expert opinions in previous reviews (25 to 75%) [9, 11, 22, 23].”
Result
Metadata
- Authors
- Hernandez, A. V., Pasupuleti, V., Deshpande, A., Thota, P., Collins, J. A., & Vidal, J. E.
- Affiliations
- Case Western Reserve University (US)
- Cleveland Clinic (US)
- EsSALUD (PE)
- Venue
- PLoS ONE
- Publisher
- Public Library of Science (PLoS)
- Published
- 2013-05-03
- Volume
- 8
- Issue
- 5
- Pages
- e63272
- ISSN
- 1932-6203 (ISSN-L)
- PMC
- PMC3643946
- OpenAlex
- W2047788079
- Cited by
- 29
- References
- 55
- Citations by year
- 2026: 1 · 2025: 2 · 2024: 1 · 2023: 2 · 2022: 2 · 2021: 2 · 2020: 3 · 2019: 3 · 2018: 2 · 2017: 6 · 2016: 1 · 2015: 4
- FWCI
- 0.33
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Locations
- PLoS ONE (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, cc-by)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Figshare (submittedVersion, cc-by)
- LA Referencia (Red Federada de Repositorios Institucionales de Publicaciones Científicas) (submittedVersion, cc-by-nc-nd)
- Funders
- Cleveland Clinic
- Topics
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Infectious Diseases › HIV/AIDS drug development and treatment
- Keywords
- HIV, antiretroviral drugs, trial reporting quality, CONSORT, non-inferiority margin, blinding, intention-to-treat analysis, per-protocol analysis, secondary outcomes
- MeSH terms
- Data Interpretation, Statistical, Drug Administration Schedule, Humans, Research Design, HIV Infections, Randomized Controlled Trials as Topic, Databases, Bibliographic, Treatment Outcome, Anti-HIV Agents
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Deficient Reporting and Interpretation of Non-Inferiority Randomized Clinical Trials in HIV Patients: A Systematic Review. https://app.cochat.ai/papers/10.1371/journal.pone.0063272
- The paper
- Hernandez, A. V., Pasupuleti, V., Deshpande, A., Thota, P., Collins, J. A., & Vidal, J. E. (2013). Deficient Reporting and Interpretation of Non-Inferiority Randomized Clinical Trials in HIV Patients: A Systematic Review. PLoS ONE. https://doi.org/10.1371/journal.pone.0063272
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
