Quality of reporting of clinical non-inferiority and equivalence randomised trials - update and extension
Open accessAbstract
BACKGROUND: Non-inferiority and equivalence trials require tailored methodology and therefore adequate conduct and reporting is an ambitious task. The aim of our review was to assess whether the criteria recommended by the CONSORT extension were followed. METHODS: We searched the Medline database and the Cochrane Central Register for reports of randomised non-inferiority and equivalence trials published in English language. We excluded reports on bioequivalence studies, reports targeting on other than the main results of a trial, and articles of which the full-text version was not available. In total, we identified 209 reports (167 non-inferiority, 42 equivalence trials) and assessed the reporting and methodological quality using abstracted items of the CONSORT extension. RESULTS: Half of the articles did not report on the method of randomisation and only a third of the trials were reported to use blinding. The non-inferiority or equivalence margin was defined in most reports (94%), but was justified only for a quarter of the trials. Sample size calculation was reported for a proportion of 90%, but the margin was taken into account in only 78% of the trials reported. Both intention-to-treat and per-protocol analysis were presented in less than half of the reports. When reporting the results, a confidence interval was given for 85% trials. A proportion of 21% of the reports presented a conclusion that was wrong or incomprehensible. Overall, we found a substantial lack of quality in reporting and conduct. The need to improve also applied to aspects generally recommended for randomised trials. The quality was partly better in high-impact journals as compared to others. CONCLUSIONS: There are still important deficiencies in the reporting on the methodological approach as well as on results and interpretation even in high-impact journals. It seems to take more than guidelines to improve conduct and reporting of non-inferiority and equivalence trials.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Adherence of authors to the CONSORT guidelines is low and the quality of reporting remains insufficient.
“However, the adherence of authors to these guidelines is low and the quality of reporting remains insufficient [9–21].”
From Impact of an online writing aid tool for writing a randomized trial report: the COBWEB (Consort-based WEB tool) randomized controlled trial (2015) · cites this paper as [12]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-18 · Cited by 13,371 · see citing works
Measuring nominal scale agreement among many raters.
Fleiss, J. L. (1971) · Psychological Bulletin · doi:10.1037/h0031619 · Cited by 8,733 · see citing works
Moher, D., Schulz, K. F., & Altman, D. G. (2001) · The Lancet · doi:10.1016/s0140-6736(00)04337-3 · Cited by 5,373 · see citing works
Piaggio, G., Elbourne, D. R., Pocock, S. J., Evans, S. J. W., Altman, D. G., & CONSORT Group, F. T. (2012) · JAMA · doi:10.1001/jama.2012.87802 · Cited by 2,428 · see citing works
CONSORT 2010 Statement: updated guidelines for reporting parallel group randomised trials
the CONSORT Group, Schulz, K. F., Altman, D. G., & Moher, D. (2010) · Trials · doi:10.1186/1745-6215-11-32 · Cited by 1,871 · see citing works
Reporting of Noninferiority and Equivalence Randomized Trials: An Extension of the CONSORT Statement
Piaggio, G., Elbourne, D. R., Altman, D. G., Pocock, S. J., Evans, S. J. W., & CONSORT Group, F. T. (2006) · JAMA · doi:10.1001/jama.295.10.1152 · Cited by 1,153 · see citing works
Trials to assess equivalence: the importance of rigorous methods: Fig 1
Jones, B., Jarvis, P., Lewis, J. A., & Ebbutt, A. F. (1996) · BMJ · doi:10.1136/bmj.313.7048.36 · Cited by 1,032 · see citing works
Plint, A. C., Moher, D., Morrison, A., Schulz, K., Altman, D. G., Hill, C., & Gaboury, I. (2006) · Medical Journal of Australia · doi:10.5694/j.1326-5377.2006.tb00557.x · Cited by 872 · see citing works
Simera, I., Moher, D., Hirst, A., Hoey, J., Schulz, K. F., & Altman, D. G. (2010) · BMC Medicine · doi:10.1186/1741-7015-8-24 · Cited by 590 · see citing works
Statistical Principles for Clinical Trials
Kay, R. (1998) · Journal of International Medical Research · doi:10.1177/030006059802600201 · Cited by 573 · see citing works
Hopewell, S., Dutton, S., Yu, L.-M., Chan, A.-W., & Altman, D. G. (2010) · BMJ · doi:10.1136/bmj.c723 · Cited by 504 · see citing works
Quality of Reporting of Noninferiority and Equivalence Randomized Trials
Le Henanff, A., Giraudeau, B., Baron, G., & Ravaud, P. (2006) · JAMA · doi:10.1001/jama.295.10.1147 · Cited by 263 · see citing works
Hopewell, S., Altman, D. G., Moher, D., & Schulz, K. F. (2008) · Trials · doi:10.1186/1745-6215-9-20 · Cited by 241 · see citing works
Current issues in non‐inferiority trials
Fleming, T. R. (2007) · Statistics in Medicine · doi:10.1002/sim.2855 · Cited by 210 · see citing works
Are Peer Reviewers Encouraged to Use Reporting Guidelines? A Survey of 116 Health Research Journals
Hirst, A., & Altman, D. G. (2012) · PLoS ONE · doi:10.1371/journal.pone.0035621 · Cited by 200 · see citing works
Ivers, N. M., Taljaard, M., Dixon, S., Bennett, C., McRae, A., Taleban, J., Skea, Z., Brehaut, J. C., Boruch, R. F., Eccles, M. P., et al. (2011) · BMJ · doi:10.1136/bmj.d5886 · Cited by 193 · see citing works
Standards of Reporting of Randomized Controlled Trials in General Surgery
Balasubramanian, S. P., Wiener, M., Alshameeri, Z. A. F., Tiruvoipati, R., Elbourne, D. R., & Reed, M. (2006) · Annals of Surgery · doi:10.1097/01.sla.0000217640.11224.05 · Cited by 160 · see citing works
Ghimire, S., Kyung, E., Kang, W., & Kim, E. (2012) · Trials · doi:10.1186/1745-6215-13-77 · Cited by 140 · cited 1× · see citing works
“For a further differentiated assessment, we compared the quality of reporting of trials published in four high-impact general medical journals (JAMA, NEJM, Lancet and BMJ; selection such as in Ghimire 2012 [16]) with that of trials published in low-impact general medical journals and in speciality journals.”
(2006) · Statistics in Medicine · doi:10.1002/sim.2584 · Cited by 139 · see citing works
Wangge, G., Klungel, O. H., Roes, K. C. B., de Boer, A., Hoes, A. W., & Knol, M. J. (2010) · PLoS ONE · doi:10.1371/journal.pone.0013550 · Cited by 89 · see citing works
A systematic survey of the quality of research reporting in general orthopaedic journals
Parsons, N., Hiskens, R., Price, C., Achten, J., & Costa, M. L. (2011) · Journal of Bone and Joint Surgery - British Volume · doi:10.1302/0301-620x.93b9.27193 · Cited by 56 · see citing works
Koch, G. G. (2007) · Statistics in Medicine · doi:10.1002/sim.2923 · Cited by 22 · see citing works
Non‐inferiority trials: advances in concepts and methodology
D’Agostino, R. B. (2002) · Statistics in Medicine · doi:10.1002/sim.1423 · Cited by 22 · see citing works
Wang, J.-L., Sun, T.-T., Lin, Y.-W., Lu, R., & Fang, J. (2011) · BMC Medical Research Methodology · doi:10.1186/1471-2288-11-110 · Cited by 19 · see citing works
Quality of reporting of randomized controlled trials in polycystic ovary syndrome
Partsinevelou, A., & Zintzaras, E. (2009) · Trials · doi:10.1186/1745-6215-10-106 · Cited by 19 · see citing works
Eyawo, O., Lee, C.-W., Rachlis, B., & Mills, E. J. (2008) · Trials · doi:10.1186/1745-6215-9-69 · Cited by 15 · see citing works
Flagged first, then by citations
Cited by
Sorted by citations
Reporting of Noninferiority and Equivalence Randomized Trials: An Extension of the CONSORT Statement
Piaggio, G., Elbourne, D. R., Altman, D. G., Pocock, S. J., Evans, S. J. W., & CONSORT Group, F. T. (2006) · JAMA · doi:10.1001/jama.295.10.1152 · Cited by 1,153 · see citing works
Randomized controlled trials – a matter of design
Siepmann, T., Spieth, P. M., Kubasch, A. S., Penzlin, A. I., Illigens, B. M.-W., & Barlinn, K. (2016) · Neuropsychiatric Disease and Treatment · doi:10.2147/ndt.s101938 · Cited by 292 · see citing works
Defining the noninferiority margin and analysing noninferiority: An overview
Althunian, T. A., de Boer, A., Groenwold, R. H. H., & Klungel, O. H. (2017) · British Journal of Clinical Pharmacology · doi:10.1111/bcp.13280 · Cited by 221 · see citing works
A tutorial on methodological studies: the what, when, how and why
Mbuagbaw, L. C. E., Lawson, D. O., Puljak, L., Allison, D. B., & Thabane, L. (2020) · BMC Medical Research Methodology · doi:10.1186/s12874-020-01107-7 · Cited by 164 · see citing works
Rehal, S., Morris, T. P., Fielding, K., Carpenter, J. R., & Phillips, P. P. J. (2016) · BMJ Open · doi:10.1136/bmjopen-2016-012594 · Cited by 154 · see citing works
Barnes, C., Boutron, I., Giraudeau, B., Porcher, R., Altman, D. G., & Ravaud, P. (2015) · BMC Medicine · doi:10.1186/s12916-015-0460-y · Cited by 142 · see citing works
“However, the adherence of authors to these guidelines is low and the quality of reporting remains insufficient [9–21].”
BackgroundSkeppholm, M., Lindgren, L., Henriques, T., Vavruch, L., Löfgren, H., & Olerud, C. (2015) · The Spine Journal · doi:10.1016/j.spinee.2015.02.039 · Cited by 104 · see citing works
Althunian, T. A., de Boer, A., Klungel, O. H., Insani, W. N., & Groenwold, R. H. H. (2017) · Trials · doi:10.1186/s13063-017-1859-x · Cited by 88 · see citing works
Comparing vaccines: A systematic review of the use of the non-inferiority margin in vaccine trials
Donken, R., de Melker, H. E., Rots, N. Y., Berbers, G. A. M., & Knol, M. J. (2015) · Vaccine · doi:10.1016/j.vaccine.2015.01.072 · Cited by 47 · see citing works
Challenges in the Design and Interpretation of Noninferiority Trials
Macaya, F., Ryan, N., Salinas, P., & Pocock, S. (2017) · Journal of the American College of Cardiology · doi:10.1016/j.jacc.2017.06.039 · Cited by 47 · see citing works
Stucke, K., & Kieser, M. (2012) · Statistics in Medicine · doi:10.1002/sim.5461 · Cited by 37 · see citing works
Self-citationPong, S., Urner, M., Fowler, R., Mitsakakis, N., Seto, W., Hutchison, J. S., Science, M. E., & Daneman, N. (2021) · BMJ Open · doi:10.1136/bmjopen-2020-044480 · Cited by 36 · see citing works
Saussez, G., Bailly, R., Araneda, R., Paradis, J., Ebner‐Karestinos, D., Klöcker, A., Sogbossi, E. S., Riquelme, I., Brochard, S., & Bleyenheuft, Y. (2023) · Journal of NeuroEngineering and Rehabilitation · doi:10.1186/s12984-023-01218-4 · Cited by 34 · see citing works
Beato, M. (2022) · Frontiers in Sports and Active Living · doi:10.3389/fspor.2022.981836 · Cited by 26 · see citing works
Most noninferiority trials were not designed to preserve active comparator treatment effects
Tsui, M., Rehal, S., Jairath, V., & Kahan, B. C. (2019) · Journal of Clinical Epidemiology · doi:10.1016/j.jclinepi.2019.03.003 · Cited by 25 · see citing works
Design of non-inferiority randomized trials using the difference in restricted mean survival times
Weir, I. R., & Trinquart, L. (2018) · Clinical Trials · doi:10.1177/1740774518792259 · Cited by 24 · see citing works
van Ravenzwaaij, D., & Ioannidis, J. P. A. (2017) · PLoS ONE · doi:10.1371/journal.pone.0173184 · Cited by 23 · see citing works
Chalmers, J. R., Wojnarowska, F., Kirtschig, G., Mason, J. M., Childs, M., Whitham, D., Harman, K. E., Chapman, A., Walton, S., Schmidt, E., et al. (2017) · Health Technology Assessment · doi:10.3310/hta21100 · Cited by 22 · see citing works
Missing data handling in non‐inferiority and equivalence trials: A systematic review
Rabe, B. A., Day, S. J., Fiero, M. H., & Bell, M. L. (2018) · Pharmaceutical Statistics · doi:10.1002/pst.1867 · Cited by 18 · see citing works
Time to recognize three classes of non-inferiority trial margins
Saver, J. L., & Mistry, E. A. (2022) · Journal of NeuroInterventional Surgery · doi:10.1136/neurintsurg-2022-018879 · Cited by 15 · see citing works
Wan, M. T., Alvarez, J. L. R., Shin, D. B., Dommasch, E. D., Wu, J. J., & Gelfand, J. M. (2018) · Journal of the European Academy of Dermatology and Venereology · doi:10.1111/jdv.15174 · Cited by 12 · see citing works
Eisner, Z. J., Delaney, P. G., Pine, H., Yeh, K., Aleem, I. S., Raghavendran, K., & Widder, P. (2022) · Spinal Cord · doi:10.1038/s41393-022-00764-3 · Cited by 11 · see citing works
Non-Inferiority Trials: A Systematic Review on Methodological Quality and Reporting Standards
Sengul, A., Escobar, E., Flores, J. R., Kwok, M., Kono, S., Guyatt, G. H., & Jackevicius, C. A. (2024) · Journal of General Internal Medicine · doi:10.1007/s11606-024-08890-9 · Cited by 10 · see citing works
How do we know a treatment is good enough? A survey of non-inferiority trials
Attard, N., Totton, N., Gillies, K., & Goulão, B. (2022) · Trials · doi:10.1186/s13063-022-06911-8 · Cited by 10 · see citing works
Understanding Noninferiority Trials: What Stroke Specialists Should Know
Cavalcante, F., Treurniet, K. M., Kappelhof, M., Kaesmacher, J., Lingsma, H. F., Saver, J. L., Gralla, J., Fischer, U., Majoie, C. B. L. M., & Roos, Y. B. W. E. M. (2025) · Stroke · doi:10.1161/strokeaha.124.048024 · Cited by 9 · see citing works
Exploring how non-inferiority and equivalence are assessed in paediatrics: a systematic review
Aupiais, C., Zohar, S., Taverny, G., Roux, É. L., Boulkedid, R., & Alberti, C. (2018) · Archives of Disease in Childhood · doi:10.1136/archdischild-2018-314874 · Cited by 9 · see citing works
Gladstone, B. P., & Vach, W. (2015) · Open Access Journal of Clinical Trials · doi:10.2147/oajct.s74821 · Cited by 9 · see citing works
Bamat, N. A., Ekhaguere, O. A., Zhang, L., Flannery, D. D., Handley, S. C., Herrick, H. M., & Ellenberg, S. S. (2020) · Clinical Trials · doi:10.1177/1740774520941428 · Cited by 6 · see citing works
Assessing additional benefit in noninferiority trials
Kieser, M., & Stucke, K. (2014) · Biometrical Journal · doi:10.1002/bimj.201300227 · Cited by 5 · see citing works
Self-citationSauaia, A., Moore, E. E., Crebs, J. L., Maier, R. V., Hoyt, D. B., & Shackford, S. R. (2017) · The Journal of Trauma: Injury, Infection, and Critical Care · doi:10.1097/ta.0000000000001536 · Cited by 3 · see citing works
Angeli, F., Verdecchia, P., & Reboldi, G. (2019) · American Journal of Cardiovascular Drugs · doi:10.1007/s40256-019-00378-w · Cited by 3 · see citing works
Kuemmerli, C., Gallagher, I. J., Skipworth, R. J. E., & Laird, B. J. A. (2024) · BMJ Open · doi:10.1136/bmjopen-2024-089587 · Cited by 3 · see citing works
Designing a research protocol in clinical dermatology: Common errors and how to avoid them
Panda, S. (2015) · Indian Journal of Dermatology Venereology and Leprology · doi:10.4103/0378-6323.152168 · Cited by 3 · see citing works
How to Critically Appraise a Randomized Controlled Trial
Williams, H. C. (2014) · Wiley eBooks · doi:10.1002/9781118357606.ch9 · Cited by 3 · see citing works
The Non‐Inferiority Margins in Migraine Research ( NIMM ) Survey
Orr, S. L., Ramsay, T., Christie, S. N., Dodick, D. W., Gladstone, J. P., & Dowlatshahi, D. D. (2017) · Headache The Journal of Head and Face Pain · doi:10.1111/head.13048 · Cited by 2 · see citing works
Totton, N., Julious, S. A., Walters, S. J., & Coates, E. (2024) · Trials · doi:10.1186/s13063-024-08651-3 · Cited by 2 · see citing works
Some issues for the evaluation of noninferiority trials
Xie, X., Wang, M., Ng, V., & Sikich, N. (2018) · Journal of Comparative Effectiveness Research · doi:10.2217/cer-2018-0035 · Cited by 2 · see citing works
Rabe, B. A., & Bell, M. L. (2019) · Statistics in Biopharmaceutical Research · doi:10.1080/19466315.2019.1677493 · Cited by 2 · see citing works
Noninferiority Study Design: Application to Clinical Trials
Wong, G. C., Kotsis, S. V., Kim, H. M., & Chung, K. C. (2024) · Plastic & Reconstructive Surgery · doi:10.1097/prs.0000000000011633 · Cited by 1 · see citing works
Anticoagulants: Evidence-Based Medicine, Not Always Ethical
Marongiu, F., Mameli, A., Marongiu, S., & Barcellona, D. (2025) · Seminars in Thrombosis and Hemostasis · doi:10.1055/a-2716-5675 · Cited by 1 · see citing works
Salazar-Cifuentes, P., Contreras, T., Hernández, E., Leiva-Abarca, E., Castro-Flores, P., Juan, D. S., Araneda, R., & Ebner‐Karestinos, D. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-076774 · Cited by 1 · see citing works
Peng, X., Nie, X., & Ni, X. (2017) · Pediatric Investigation · doi:10.1002/ped4.12009 · Cited by 1 · see citing works
Evidence-Based Recommendations for Spine Surgery
Vaccaro, A. R., Fisher, C. G., Patel, A. A., Prasad, S. K., Chi, J., Mulpuri, K., Thomas, K. C., & Whang, P. G. (2013) · Spine · doi:10.1097/brs.0b013e3182982d32 · Cited by 1 · see citing works
Non-inferiority Clinical Trials: Treating Margin as Missing Information
Sidi, Y., Stockton, B., & Harel, O. (2024) · The New England Journal of Statistics in Data Science · doi:10.51387/24-nejsds57 · Cited by 1 · see citing works
The value of artificial disc replacement in cervical radiculopathy
Skeppholm, M. (2014) · Figshare · Cited by 1 · see citing works
Non-inferiority studies: a methodological and regulatory perspective
Althunian, T. A. (2019) · Utrecht University Repository (Utrecht University) · Cited by 1 · see citing works
Rebuttal to Drs. Markovina and Michalski
Hussein, A. A., & Cooperberg, M. R. (2015) · Brachytherapy · doi:10.1016/j.brachy.2015.07.004
Stereotactic radiosurgery for patients with brain metastases
Takiguchi, Y., Sekine, I., Iwasawa, S., Kurimoto, R., & Uehara, T. (2014) · The Lancet Oncology · doi:10.1016/s1470-2045(14)70182-2
Rigor in the Design of Observational Noninferiority Trials
DiNubile, M. J. (2013) · Clinical Infectious Diseases · doi:10.1093/cid/cit386
Yoram Vodovotz, B., & An, G. C. (2014) · Elsevier eBooks · doi:10.1016/b978-0-12-397884-4.00005-7
Missing Data in Non-Inferiority Clinical Trials
Rabe, B. A. (2019) · UA Campus Repository (The University of Arizona)
Kim, K. S., Tao, B. K.-L., Kaur, H., Mikhail, D., Leung, G., Bednar, E. D., Morassut, R. E., Leung, D., Miroshnychenko, A., Lynn, M., et al. (2025) · Journal of Investigative Dermatology · doi:10.1016/j.jid.2025.06.1581
Additional file 1 of How do we know a treatment is good enough? A survey of non-inferiority trials
Attard, N., Totton, N., Gillies, K., & Goulão, B. (2024) · Figshare · doi:10.6084/m9.figshare.26555324
- Authors
- Schiller, P., Burchardi, N., Niestroj, M., & Kieser, M.
- Affiliations
- Heidelberg University (DE)
- Philipps University of Marburg (DE)
- Corresponding author
- Schiller, Petra
- Venue
- Trials
- Published
- 2012-11-16
- Volume
- 13
- Issue
- 1
- Pages
- 214-214
- ISSN
- 1745-6215 (ISSN-L)
- PMC
- PMC3554513
- OpenAlex
- W2124422742
- Cited by
- 53
- References
- 26
- Citations by year
- 2025: 3 · 2024: 6 · 2023: 2 · 2022: 4 · 2021: 1 · 2020: 2 · 2019: 5 · 2018: 5 · 2017: 8 · 2016: 2 · 2015: 6 · 2014: 5 · 2013: 2 · 2012: 1
- FWCI
- 5.11
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Trials (publishedVersion, cc-by)
- Europe PMC (PubMed Central) (publishedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- Topics
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Physical Sciences › Mathematics › Statistics and Probability › Statistical Methods in Clinical Trials
- Social Sciences › Sociology and Political Science › Delphi Technique in Research
- Keywords
- equivalence trials, reporting quality, CONSORT extension, randomization methods, blinding, non-inferiority margin, sample size determination, intention-to-treat analysis, per-protocol analysis, confidence intervals, high-impact journals
- MeSH terms
- Humans, Periodicals as Topic, Quality Control, Research Design, Therapeutic Equivalency, Bibliometrics, Randomized Controlled Trials as Topic, Treatment Outcome, Guidelines as Topic, Guideline Adherence, Editorial Policies
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
