Ivermectin for COVID-19: Addressing Potential Bias and Medical Fraud
Open accessPublished version of a preprint
The DOI matches its Crossref record; 15 of the 15 references it cites were found in a registry or an index; 6 of the 20 sources its claims cite were checked for support.
Abstract
Ivermectin has become a controversial potential medicine for coronavirus disease 2019. Some early studies suggested clinical benefits in treatment of infection. However, the body of evidence includes studies of varying quality. Furthermore, some trials have now been identified as potentially fraudulent. We present a subgroup meta-analysis to assess the effects of stratifying by trial quality on the overall results. The stratification is based on the Cochrane Risk of Bias measures and raw data analysis where possible. The results suggest that the significant effect of ivermectin on survival was dependent on largely poor-quality studies. According to the potentially fraudulent study (risk ratio [RR], 0.08; 95% CI, 0.02-0.35), ivermectin improved survival ~12 times more in comparison with low-risk studies (RR, 0.96; 95% CI, 0.56-1.66). This highlights the need for rigorous quality assessments, for authors to share patient-level data, and for efforts to avoid publication bias for registered studies. These steps are vital to facilitate accurate conclusions on clinical treatments.
Overview
CoChat Summary
TL;DR
This subgroup meta-analysis found that ivermectin’s apparent survival benefit in COVID-19 depended on including poor-quality or potentially fraudulent trials. After excluding high-risk and fraudulent studies, the survival effect became nonsignificant.
Key findings
- Across all 12 survival studies (2628 participants), ivermectin was associated with a significant 51% increase in survival (95% CI, 0.28–0.86; P = .01).
- Excluding the potentially fraudulent Elgazzar study reduced the effect to a borderline significant 38% increase in survival (95% CI, 0.39–0.99; P = .05).
- Excluding high-risk-of-bias studies yielded a nonsignificant 10% increase in survival (95% CI, 0.57–1.42; P = .66), and excluding studies with some concerns yielded a nonsignificant 4% increase (95% CI, 0.56–1.66; P = .90).
- The potentially fraudulent study reported an RR of 0.08 (95% CI, 0.02–0.35), suggesting ivermectin improved survival about 12 times more than in low-risk studies (RR, 0.96; 95% CI, 0.56–1.66).
Methods
- The authors conducted a subgroup meta-analysis of clinical trials evaluating ivermectin for treatment of COVID-19, stratifying by trial quality and risk of bias.
- Trials were identified by systematic searching of 8 databases; quality was assessed with Cochrane RoB 2 and CONSORT, plus additional checks of baseline characteristics via chi-square tests, randomization dates, recruitment balance across centers, and patient-level databases where available for duplicate participants or unexpected homogeneity/heterogeneity.
- The survival analysis included 12 studies with 2628 participants: 4 low risk, 4 some concerns, 3 high risk, and 1 potentially fraudulent study.
Limitations
- The paper states that a key limitation of meta-analyses is the quality and completeness of available evidence, and that existing risk-of-bias tools are insufficient because they assume studies report accurate and complete findings.
- The paper states that publication bias affects meta-analyses, with positive and significant results more likely to be reported, and notes that not all registered trials have reported findings.
- The text makes evident that the analysis depends on published data and patient-level databases only “where available,” and that some included studies had unclear randomization, allocation concealment, blinding, or analyzed-participant details.
Model-written summary. Check it against the paper before relying on it.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
6 Valid · 1 Not valid · 12 Not checked · 17 Own results and interpretations
The cited sources support only part of this claim — read each source’s verdict below.
In the paper
“Before these inconsistencies were identified, the Elgazzar and Raad studies had been included in multiple meta-analyses, which suggested significant benefits for ivermectin in the treatment of COVID-19 [2, 3].”
§ Ivermectin for COVID-19: Addressing Potential Bias and Medical Fraud > Abstract
What the sources say
- Not matchedcites [2] Bryant, Ivermectin for prevention and treatment of COVID-19 infection: a systematic review, meta-analysis, and trial sequential analysis to inform clinical guidelines., Am J Ther
Its entry has no title and year that we can search by.
- Partly supportedcites [3] Kory, 2021, Review of the emerging evidence demonstrating the efficacy of ivermectin in the prophylaxis and treatment of COVID-19., Am J Ther sourceExperimental — accuracy not yet measured
In ‘Clinical studies of the efficacy of ivermectin in hospitalized patients’ (page unavailable), the paper discusses the Elgazzar treatment study and says its meta-analyses of controlled treatment trials found large, statistically significant benefits. Our copy does not identify a Raad study or establish that both studies were included in multiple meta-analyses; it also does not discuss when inconsistencies were identified. (LLM, conf=0.86)
plainstates a cause- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Not matched
Every source the paper cites for this claim was checked and supports it.
In the paper
“During our original assessment of studies, standardized Cochrane Risk of Bias measures (RoB 2) had classified several studies as “high risk of bias” [7].”
§ Ivermectin for COVID-19: Addressing Potential Bias and Medical Fraud > Abstract
What the sources say
- Supportedcites [7] Sterne, 2019, RoB 2: a revised tool for assessing risk of bias in randomised trials., BMJ source
The Summary Points identify RoB 2 as the revised Cochrane tool for assessing risk of bias in randomised trials and list “high risk of bias” as one of its judgments. The citation identifies the measure used; the classifications of several studies are described as the citing authors’ own assessment. (LLM, conf=0.92)
plain- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
- Supported
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On excluding the high risk of bias studies, ivermectin results in a nonsignificant 10% increase in survival (95% CI, 0.57–1.42; P = .66) (Figure 1; Supplementary Figure 3).”
§ Ivermectin for COVID-19: Addressing Potential Bias and Medical Fraud > Abstract
plainn = 2,628- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“The analysis demonstrates that on including all 12 studies, ivermectin results in a significant 51% increase in survival (95% CI, 0.28–0.86; P = .01) (Figure 1; Supplementary Figure 1).”
§ Ivermectin for COVID-19: Addressing Potential Bias and Medical Fraud > Abstract
boostedstates a causen = 2,628 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
A result the paper reports from its own data — it cites no other source for it, so there is none to check. The quote shows it is in the paper.
In the paper
“On excluding the potentially fraudulent Elgazzar study, ivermectin results in a borderline significant 38% increase in survival (95% CI, 0.39–0.99; P = .05) (Figure 1; Supplementary Figure 2).”
§ Ivermectin for COVID-19: Addressing Potential Bias and Medical Fraud > Abstract
plainstates a causen = 2,628 ·- Asserted: passes — The authors put it forward as true.
- Checkable: passes — It can be checked against evidence.
- Load-bearing: passes — The paper’s conclusions depend on it.
- Based: passes — The paper gives a reason why it holds.
12 more claims
Create a free account to see all 36 claims and every source verdict.
- Probably not a substantial claim. 11
- It may state two separate claims as one. 10
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The integrity of evidence synthesis is threatened by problematic randomised controlled trials (RCTs).”
From INSPECT-SR: a tool for assessing trustworthiness of randomised controlled trials (2025) · cites this paper as [2]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
Rated minor: it would not touch a result — a value no result rests on, a p-value that stays on the same side of the significance level, or a conflict that is clerical, resolved elsewhere in the paper, or outside its own findings.
In the paper
§ Ivermectin for COVID-19: Addressing Potential Bias and Medical Fraud > Abstract
“In July 2021, after the potentially fraudulent studies were identified, we retracted our published meta-analysis”
§ Ivermectin for COVID-19: Addressing Potential Bias and Medical Fraud > Abstract
“a study conducted in Lebanon by Raad et al. was also identified to have duplicate data for multiple participants when the patient-level database was analyzed in September 2021”
Cited works that were retracted
Works this paper cites that were later retracted, from the retraction notices publishers deposit. Major when the notice came out before this paper was published.
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
In the paper
“Samaha A, A, Mouawia H, et al. Effects of a single dose of ivermectin on viral and clinical outcomes in asymptomatic SARS-CoV-2 infected subjects: a pilot clinical trial in Lebanon. Viruses. In press. PMC8226630 34073401”
Cited work 10.3390/v13060989 · retracted 2021-05-26 · notice 10.3390/v13112154 · this paper published 2022-01-17
Rated major: it would touch a result — a value a result rests on, reported and recomputed p-values on opposite sides of the significance level, two passages that conflict with no sign which is right, or a cited work retracted before this paper was published.
Cited work 10.21203/rs.3.rs-100956/v2 · retracted 2020-11-16 · notice 10.21203/rs.3.rs-100956/v4 · this paper published 2022-01-17
A note, not an issue: for example, a cited work that was retracted only after this paper was published, which its authors could not have known.
In the paper
“Hill A, Garratt A, Levi J, et al. Meta-analysis of randomized trials of ivermectin to treat SARS-CoV-2 infection. Open Forum Infect Dis 2021; XXX:XXX–XX. PMC8420640 34796244”
Cited work 10.1093/ofid/ofab358 · retracted 2022-02-05 · notice 10.1093/ofid/ofac056 · this paper published 2022-01-17
Citations
Cites
3 retracted
Retracted: Meta-analysis of Randomized Trials of Ivermectin to Treat SARS-CoV-2 Infection
Hill, A., Garratt, A., Levi, J., Falconer, J., Ellis, L., McCann, K., Pilkington, V., Qavi, A., Wang, J., & Wentzel, H. (2021) · Open Forum Infectious Diseases · doi:10.1093/ofid/ofab358 · Cited by 90
Self-citationRetractedSamaha, A., Mouawia, H., Fawaz, M., Hassan, H., Salami, A., Bazzal, A., Saab, H., Al-Wakeel, M., Alsaabi, A., Chouman, M., et al. (2021) · Viruses · doi:10.3390/v13060989 · Cited by 37
RetractedWITHDRAWN: Efficacy and Safety of Ivermectin for Treatment and prophylaxis of COVID-19 PandemicPreprint
Elgazzar, A. G., Hani, B. M., Youssef, S. A., Hafez, M., Moussa, H. H., & El-Taweel, A. I. (2020) · Research Square · doi:10.21203/rs.3.rs-100956/v2 · Cited by 24
RetractedRoB 2: a revised tool for assessing risk of bias in randomised trials
Sterne, J. A. C., Savović, J., Page, M. J., Elbers, R. G., Blencowe, N. S., Boutron, I., Cates, C. J., Cheng, H.-Y., Corbett, M. S., Eldridge, S. M., et al. (2019) · BMJ · doi:10.1136/bmj.l4898 · Cited by 34,787 · cited 2×
“An in-depth evaluation of study quality was conducted, in addition to the standard Cochrane RoB 2 and CONSORT checklist [7].”
MethodRepurposed Antiviral Drugs for Covid-19 — Interim WHO Solidarity Trial Results
WHO Solidarity Trial Consortium (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2023184 · Cited by 2,745
The FDA-approved drug ivermectin inhibits the replication of SARS-CoV-2 in vitro.
Caly, L., Druce, J. D., Catton, M. G., Jans, D. A., & Wagstaff, K. M. (2020) · Antiviral Research · doi:10.1016/j.antiviral.2020.104787 · Cited by 2,179 · cited 1×
“In June 2020, ivermectin, a Food and Drug Administration (FDA)–approved antiparasitic drug, was shown to have antiviral effects against severe acute respiratory syndrome coronavirus 2 (SARSCoV-2) in vitro [1].”
BackgroundRepurposed antiviral drugs for COVID-19 –interim WHO SOLIDARITY trial resultsPreprint
Pan, H., Peto, R., Karim, Q. A., et al. (2020) · medRxiv · doi:10.1101/2020.10.15.20209817 · Cited by 634
Bryant, A., Lawrie, T. A., Dowswell, T., Fordham, E. J., Mitchell, S., Hill, S. R., & Tham, T. C. (2021) · American Journal of Therapeutics · doi:10.1097/mjt.0000000000001402 · Cited by 264
Kory, P., Meduri, G. U., Varon, J., Iglesias, J., & Marik, P. E. (2021) · American Journal of Therapeutics · doi:10.1097/mjt.0000000000001377 · Cited by 203 · cited 12×
“Ivermectin for COVID-19: Addressing Potential Bias and Medical Fraud”
BackgroundInfluentialOkumuş, N., Demirtürk, N., Çetinkaya, R. A., Güner, R., Avcı, İ. Y., Orhan, S., Konya, P. Ş., Şaylan, B., Karalezli, A., Yamanel, L., et al. (2021) · BMC Infectious Diseases · doi:10.1186/s12879-021-06104-9 · Cited by 131
Hashim, H. A., Maulood, M. F., Rasheed, A. M., Fatak, D. F., Kabah, K. K., & Abdulamir, A. S. (2020) · doi:10.1101/2020.10.26.20219345 · Cited by 98
Alkarkh Hospital, B., Hashim, H., Maulood, M., Alforat Hospital, B., Ali, C., Alkharkh General Directorate of Health, B., Rasheed, A., Alkharkh General Directorate of Health, B., Fatak, D., Alkharkh General Directorate of Health, B., et al. (2021) · Iraqi Journal of Medical Sciences · doi:10.22578/ijms.19.1.14 · Cited by 98
Flawed ivermectin preprint highlights challenges of COVID drug studies.
Reardon, S. (2021) · Nature · doi:10.1038/d41586-021-02081-w · Cited by 83 · cited 1×
“It has been reported that the data for ~79 participants were duplicates, some deaths were recorded on dates before the trial had started, and instances of plagiarism were identified in the text [12].”
BackgroundGheibi (2021) · doi:10.4103/1995-7645.318304 · Cited by 80
Meta-analysis of randomized trials of ivermectin to treat SARS-CoV-2 infectionPreprint
Hill, A. M., Abdulamir, A. S., Ahmed, S., et al. (2021) · Research Square · doi:10.21203/rs.3.rs-148845/v1 · Cited by 33
Self-citation
Cited by
Effect of Early Treatment with Ivermectin among Patients with Covid-19
Reis, G., Silva, E. A. S. M., Silva, D. C. M., Thabane, L., Milagres, A. C., Ferreira, T. S., dos Santos, C. V. Q., Campos, V. H. S., Nogueira, A. M. R., de Almeida, A. P. F. G., et al. (2022) · New England Journal of Medicine · doi:10.1056/nejmoa2115869 · Cited by 224
To curb research misreporting, replace significance and confidence by compatibility
Greenland, S., Mansournia, M. A., & Joffe, M. (2022) · Preventive Medicine · doi:10.1016/j.ypmed.2022.107127 · Cited by 130
Naggie, S., Boulware, D. R., Lindsell, C. J., Stewart, T. G., Gentile, N., Collins, S., McCarthy, M. W., Jayaweera, D., Castro, M., Sulkowski, M., et al. (2022) · JAMA · doi:10.1001/jama.2022.18590 · Cited by 95
Weibel, S., Popp, M., Reis, S., Skoetz, N., Garner, P., & Sydenham, E. (2023) · Research Synthesis Methods · doi:10.1002/jrsm.1599 · Cited by 93
Naggie, S., Boulware, D. R., Lindsell, C. J., Stewart, T. G., Slandzicki, A. J., Lim, S. C., Cohen, J., Kavtaradze, D., Amon, A. P., Gabriel, A., et al. (2023) · JAMA · doi:10.1001/jama.2023.1650 · Cited by 79
Metadata
- Authors
- Hill, A., Mirchandani, M., & Pilkington, V.
- Affiliations
- University of Liverpool (GB)
- Imperial College London (GB)
- University of Oxford (GB)
- Corresponding author
- Mirchandani, Manya
- Venue
- Open Forum Infectious Diseases
- Publisher
- Oxford University Press (OUP)
- Published
- 2022-01-17
- Volume
- 9
- Issue
- 2
- Pages
- ofab645-ofab645
- ISSN
- 2328-8957 (ISSN-L)
- PMC
- PMC8774052
- OpenAlex
- W4206432189
- Cited by
- 57
- References
- 15
- Citations by year
- 2026: 2 · 2025: 4 · 2024: 15 · 2023: 10 · 2022: 26
- FWCI
- 6.72
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- Locations
- Open Forum Infectious Diseases (publishedVersion, cc-by-nc-nd)
- Research Square (acceptedVersion, cc-by)
- PubMed Central (publishedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- Funders
- Rainwater Charitable Foundation
- Topics
- Health Sciences › Medicine › Infectious Diseases › COVID-19 Clinical Research Studies
- Social Sciences › Decision Sciences › Statistics, Probability and Uncertainty › Meta-analysis and systematic reviews
- Health Sciences › Medicine › Infectious Diseases › SARS-CoV-2 and COVID-19 Research
- Keywords
- ivermectin, COVID-19 pandemic, SARS-CoV-2, trial quality, risk of bias, publication bias, health care fraud, survival, antiviral therapy
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
The claim verdicts this report counts are experimental: their accuracy is not yet measured.
A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).
A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).
Cited sources are checked with a language model’s help (gpt-6-sol).
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.
