Effectiveness of mRNA COVID-19 vaccine booster doses against Omicron severe outcomes
Open accessPreprint — published as 10.1038/s41467-023-36566-1
Abstract
Background: To inform planning for further booster doses of COVID-19 vaccines, we estimated the effectiveness of monovalent mRNA vaccines against Omicron-associated severe outcomes in adults over time. Methods: We used a test-negative design and multivariable logistic regression to estimate vaccine effectiveness (VE; 2, 3, or 4 doses compared to unvaccinated individuals) and marginal effectiveness (3 or 4 doses compared to 2 doses) against Omicron-associated hospitalization or death among community-dwelling adults aged ≥50 years who were tested for SARS-CoV-2 between January 2, 2022 and October 1, 2022 in Ontario, Canada, stratified by age group and time since vaccination. We also compared VE during periods of Omicron BA.1/BA.2 and BA.4/BA.5 sublineage predominance. Results: We included 11,160 cases of Omicron-associated severe outcomes and 62,880 test-negative symptomatic controls. Depending on the age group, compared to unvaccinated individuals, VE was 91-98% 7-59 days after a third dose, waned to 76-87% after ≥240 days, was restored to 92-97% 7-59 days after a fourth dose, and waned to 86-89% after ≥120 days. Trends in marginal effectiveness were consistent with VE estimates. VE was lower during the BA.4/BA.5-predominant period compared to the BA.1/BA.2-predominant period based on the same intervals since vaccination. Conclusion: Our findings suggest that 1 or 2 booster doses of monovalent mRNA COVID-19 vaccines initially restored very strong protection against Omicron-associated severe outcomes in all age groups, but VE subsequently declined over time with some age-related differences, and particularly so during a period of BA.4/BA.5 predominance.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Eight studies assessed VE of primary series or first booster dose vaccination separately for at least two different Omicron subvariants (six assessed VE of both primary series and booster dose vaccination and two assessed VE of a booster dose only).
“Eight studies assessed VE of primary series or first booster dose vaccination separately for at least two different Omicron subvariants (six assessed VE of both primary series and booster dose vaccination and two assessed VE of a booster dose only, Tables 1 and 2) [21,24-26,28-33].”
From Assessing COVID-19 vaccine effectiveness against Omicron subvariants: Report from a meeting of the World Health Organization (2023) · cites this paper as [28]
The Introduction and Results (pages unavailable) show that this study assessed effectiveness after two doses and a third dose across BA.1/BA.2- and BA.4/BA.5-predominant periods. The Discussion explicitly says it could not estimate effectiveness against BA.1, BA.2, BA.4, and BA.5 separately. It therefore supports inclusion as a study comparing Omicron periods, but not the claim that it assessed individual subvariants separately. (LLM, conf=0.86)
Experimental — accuracy not yet measuredVE estimates between BA.1/2 and BA.4/5 predominant periods were not significantly different in the first 120 days after the booster dose.
“Of note, the VE estimates between the BA.1/2 and BA.4/5 predominant periods were not significantly different in the first 120 days after the booster dose.”
From Assessing COVID-19 vaccine effectiveness against Omicron subvariants: Report from a meeting of the World Health Organization (2023) · cites this paper as [28]
The Results (page not available) report a nonsignificant between-period difference 7–59 days after a third dose among adults aged 70–79 (p=0.08). That example supports the claim for one age group and interval, but the passages do not establish that differences were nonsignificant throughout the first 120 days after booster doses. The Discussion reports lower VE during BA.4/BA.5 predominance across the same post-vaccination intervals. (LLM, conf=0.78)
Experimental — accuracy not yet measuredAmong three studies that compared VE against BA.1/2 with BA.4/5, one showed a similar VE within the first four months following a booster dose, but lower VE against BA.4/5 beyond 4 months; one study showed similar VE at all periods; the third showed lower VE against BA.4/5 than BA.1/2 at all periods, though confidence intervals overlapped.
“Among three studies that compared VE against BA.1/2 with BA.4/5, one showed a similar VE within the first four months following a booster dose, but lower VE against BA.4/5 beyond 4 months; one study showed similar VE at all periods; the third showed lower VE against BA.4/5 than BA.1/2 at all periods, though confidence intervals overlapped [21,28,30].”
From Assessing COVID-19 vaccine effectiveness against Omicron subvariants: Report from a meeting of the World Health Organization (2023) · cites this paper as [28]
The Results report lower VE during BA.4/BA.5-predominant periods than during BA.1/BA.2-predominant periods at the same post-vaccination intervals. The confidence intervals overlap in the reported 7–59-day example, but not in the 180–239-day example, so the unqualified statement about overlapping intervals is not supported throughout. This paper is one of the three studies cited; the other studies' findings are not being attributed to it. (LLM, conf=0.84)
Experimental — accuracy not yet measuredSimilar trends were observed among the other age groups (though results presented for 70-79).
“Results were presented for 70-79-yearolds, although similar trends were observed among the other age groups.”
From Assessing COVID-19 vaccine effectiveness against Omicron subvariants: Report from a meeting of the World Health Organization (2023) · cites this paper as [28]
For the single study that evaluated VE separately for four different age groups, all age groups were included in the meta-regression; a sensitivity analysis was conducted including only a single age group (70-79 years).
“For the single study that evaluated VE separately for four different age groups, all age groups were included in the meta-regression; a sensitivity analysis was conducted including only a single age group (70-79 years) [28].”
From Assessing COVID-19 vaccine effectiveness against Omicron subvariants: Report from a meeting of the World Health Organization (2023) · cites this paper as [28]
In the study from Ontario where differences in vaccine effectiveness between BA.1/2 and BA.4/5 periods were large, differences in time since last dose were less than one month between subvariant periods.
“In contrast, in the study from Ontario where differences in VE between the BA.1/2 and BA.4/5 periods were large, differences in time since last dose were less than one month between subvariant periods [28].”
From Assessing COVID-19 vaccine effectiveness against Omicron subvariants: Report from a meeting of the World Health Organization (2023) · cites this paper as [28]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
A Bivalent Omicron-Containing Booster Vaccine against Covid-19
Chalkias, S., Harper, C., Vrbicky, K., Walsh, S. R., Essink, B., Brosz, A., McGhee, N., Tomassini, J. E., Chen, X., Chang, Y., et al. (2022) · New England Journal of Medicine · doi:10.1056/nejmoa2208343 · Cited by 627 · see citing works
Protection by a Fourth Dose of BNT162b2 against Omicron in Israel
(2022) · doi:10.1056/nejmoa2201570 · Cited by 376 · see citing works
Buchan, S. A., Chung, H., Brown, K. A., Austin, P. C., Fell, D. B., Gubbay, J. B., Nasreen, S., Schwartz, K. L., Sundaram, M. E., Tadrous, M., et al. (2022) · JAMA Network Open · doi:10.1001/jamanetworkopen.2022.32760 · Cited by 356 · see citing works
Self-citationChung, H., He, S., Nasreen, S., Sundaram, M. E., Buchan, S. A., Wilson, S. E., Chen, B., Calzavara, A., Fell, D. B., Austin, P. C., et al. (2021) · BMJ · doi:10.1136/bmj.n1943 · Cited by 307 · see citing works
Self-citationFourth Dose of BNT162b2 mRNA Covid-19 Vaccine in a Nationwide Setting
Magen, O., Waxman, J. G., Makov-Assif, M., Vered, R., Dicker, D., Hernán, M. A., Lipsitch, M., Reis, B. Y., Balicer, R. D., & Dagan, N. (2022) · New England Journal of Medicine · doi:10.1056/nejmoa2201688 · Cited by 279 · see citing works
Link-Gelles, R., Levy, M. E., Gaglani, M., Irving, S. A., Stockwell, M., Dascomb, K., DeSilva, M. B., Reese, S. E., Liao, I.-C., Ong, T. C., et al. (2022) · MMWR. Morbidity and Mortality Weekly Report · doi:10.15585/mmwr.mm7129e1 · Cited by 126 · see citing works
Effectiveness and Durability of the BNT162b2 Vaccine against Omicron Sublineages in South Africa
Collie, S., Nayager, J., Bamford, L., Bekker, L.-G., Zylstra, M., & Gray, G. (2022) · New England Journal of Medicine · doi:10.1056/nejmc2210093 · Cited by 97 · see citing works
Gazit, S., Saciuk, Y., Perez, G., Peretz, A., Pitzer, V. E., & Patalon, T. (2022) · BMJ · doi:10.1136/bmj-2022-071113 · Cited by 87 · see citing works
Surie, D., Bonnell, L., Adams, K., Gaglani, M., Ginde, A. A., Douin, D. J., Talbot, H. K., Casey, J. D., Mohr, N. M., Zepeski, A., et al. (2022) · MMWR. Morbidity and Mortality Weekly Report · doi:10.15585/mmwr.mm7142a3 · Cited by 59 · see citing works
Antibody responses to Omicron BA.4/BA.5 bivalent mRNA vaccine booster shotPreprint
Wang, Q., Bowen, A. D., Valdez, R., Gherasim, C., Gordon, A. L., Liu, L., & Ho, D. D. (2022) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2022.10.22.513349 · Cited by 41 · see citing works
Kislaya, I., Casaca, P., Borges, V., et al. (2022) · medRxiv · doi:10.1101/2022.07.25.22277996 · Cited by 14 · see citing works
Flagged first, then by citations
Research works printed but not linked: 3
- Andrews N, Stowe J, Kirsebom F, et al. Covid-19 vaccine effectiveness against the Omicron (B.1.1.529) variant. N Engl J Med. 2022;386(1532-1546). doi:10.1056/NEJMoa2119451 · DOI · Paper page
- Tseng HF, Ackerson BK, Bruxvoort KJ, et al. Effectiveness of mRNA-1273 against infection and COVID-19 hospitalization with SARS-CoV-2 Omicron subvariants: BA.1, BA.2, BA.2.12.1, BA.4, and BA.5. Published online October 1, 2022. doi:10.1101/2022.09.30.22280573 · DOI
- Collier AY, Miller J, Hachmann NP, et al. Immunogenicity of the BA.5 bivalent mRNA vaccine boosters. Published online October 25, 2022:2022.10.24.513619. doi:10.1101/2022.10.24.513619 · DOI
Cited by
Sorted by citations
Feikin, D. R., Higdon, M. M., Andrews, N., Collie, S., Deloria Knoll, M., Kwong, J. C., Link-Gelles, R., Pilishvili, T., & Patel, M. K. (2023) · Vaccine · doi:10.1016/j.vaccine.2023.02.020 · Cited by 36 · see citing works
Self-citationSong, S., Madewell, Z. J., Liu, M., Longini, I. M., & Yang, Y. (2023) · Frontiers in Public Health · doi:10.3389/fpubh.2023.1195908 · Cited by 34 · see citing works
- Authors
- Grewal, R., Nguyen, L., Buchan, S. A., Wilson, S. E., Nasreen, S., Austin, P. C., Brown, K. A., Fell, D. B., Gubbay, J., Schwartz, K. L., Tadrous, M., Wilson, K., & Kwong, J. C.
- Affiliations
- Public Health Ontario (CA)
- University of Toronto (CA)
- University of Ottawa (CA)
- University Health Network (CA)
- Corresponding author
- Kwong, Jeffrey C
- ORCID
- Venue
- Nature Communications
- Publisher
- openRxiv
- Published
- 2022-11-01
- Volume
- 14
- Issue
- 1
- Pages
- 1273-1273
- ISSN
- 2041-1723 (ISSN-L)
- PMC
- PMC9990563
- OpenAlex
- W4323534146
- Cited by
- 59
- References
- 12
- Citations by year
- 2026: 6 · 2025: 16 · 2024: 15 · 2023: 22
- FWCI
- 12.21
- Type
- journal article
- Language
- en
- Open access
- gold
- doi.org
- Licence
- cc-by
- Locations
- Nature Communications (publishedVersion, cc-by)
- medRxiv (acceptedVersion, cc-by-nc-nd)
- PubMed Central (publishedVersion, cc-by)
- PubMed (publishedVersion)
- RePEc: Research Papers in Economics (submittedVersion)
- DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
- SUNY Digital Repository Support (State University of New York System) (submittedVersion, cc-by)
- Funders
- Public Health Agency of Canada (CNF 151944, 151944)
- Public Health Agency
- University of Toronto
- Canadian Immunization Research Network (CNF 151944)
- Canadian Institutes of Health Research (151944, COVID-19, 151944_1)
- Department of Family and Community Medicine, University of Toronto
- Topics
- Health Sciences › Medicine › Infectious Diseases › SARS-CoV-2 and COVID-19 Research
- Physical Sciences › Mathematics › Modeling and Simulation › COVID-19 epidemiological studies
- Social Sciences › Health › Vaccine Coverage and Hesitancy
- Keywords
- mRNA vaccines, Omicron subvariants, BA.4/BA.5, vaccine effectiveness, waning immunity, severe outcomes, hospitalization, mortality, older adults, test-negative design, Ontario
- MeSH terms
- COVID-19, SARS-CoV-2, COVID-19 Vaccines, Adult, Humans, Immunization, Secondary, Ontario, RNA, Messenger
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review