The DOI matches its Crossref record; 17 of the 18 references it cites were found in a registry or an index.
BNT162b2 mRNA Covid-19 Vaccine in a Nationwide Mass Vaccination Setting
Open accessAbstract
BACKGROUND: As mass vaccination campaigns against coronavirus disease 2019 (Covid-19) commence worldwide, vaccine effectiveness needs to be assessed for a range of outcomes across diverse populations in a noncontrolled setting. In this study, data from Israel's largest health care organization were used to evaluate the effectiveness of the BNT162b2 mRNA vaccine. METHODS: All persons who were newly vaccinated during the period from December 20, 2020, to February 1, 2021, were matched to unvaccinated controls in a 1:1 ratio according to demographic and clinical characteristics. Study outcomes included documented infection with the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), symptomatic Covid-19, Covid-19-related hospitalization, severe illness, and death. We estimated vaccine effectiveness for each outcome as one minus the risk ratio, using the Kaplan-Meier estimator. RESULTS: Each study group included 596,618 persons. Estimated vaccine effectiveness for the study outcomes at days 14 through 20 after the first dose and at 7 or more days after the second dose was as follows: for documented infection, 46% (95% confidence interval [CI], 40 to 51) and 92% (95% CI, 88 to 95); for symptomatic Covid-19, 57% (95% CI, 50 to 63) and 94% (95% CI, 87 to 98); for hospitalization, 74% (95% CI, 56 to 86) and 87% (95% CI, 55 to 100); and for severe disease, 62% (95% CI, 39 to 80) and 92% (95% CI, 75 to 100), respectively. Estimated effectiveness in preventing death from Covid-19 was 72% (95% CI, 19 to 100) for days 14 through 20 after the first dose. Estimated effectiveness in specific subpopulations assessed for documented infection and symptomatic Covid-19 was consistent across age groups, with potentially slightly lower effectiveness in persons with multiple coexisting conditions. CONCLUSIONS: This study in a nationwide mass vaccination setting suggests that the BNT162b2 mRNA vaccine is effective for a wide range of Covid-19-related outcomes, a finding consistent with that of the randomized trial.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“The 7-day cutoff was chosen based on previous research the BNT162b2 vaccine effectivenesss1,11.”
From Waning effectiveness of the third dose of the BNT162b2 mRNA COVID-19 vaccine (2022) · cites this paper as [1]
In the citing paper
“Observational postmarketing studies, including this analysis, have consistently demonstrated a strong association between vaccination and risk reductions in COVID-19 hospitalization in immunocompetent individuals, suggesting that the high efficacy observed in mRNA clinical trials translates into beneficial effects in the community setting.2,3,10”
From Association Between mRNA Vaccination and COVID-19 Hospitalization and Disease Severity (2021) · cites this paper as [2]
In the citing paper
“It should be noted that high effectiveness (>80%) against severe disease and hospitalization has been reported for both BNT162b2 (refs93,94) and ChAdOx1 nCoV-19 (ref.95).”
From Immunological mechanisms of vaccine-induced protection against COVID-19 in humans (2021) · cites this paper as [93]
In the citing paper
“Some early post-implementation analyses have suggested that the mRNA vaccines also reduce the incidence of asymptomatic infection and the nasopharyngeal viral load in individuals who become infected despite the vaccination93,107, but it is yet unclear how this translates to risk of transmission.”
From Immunological mechanisms of vaccine-induced protection against COVID-19 in humans (2021) · cites this paper as [93]
In the citing paper
“Current epidemiological evidence is that the BNT162b2 Pfizer/BioNTech COVID-19 vaccine retains its efficacy against B.1.1.7 in the UK24 and in reports from Israel.28,29”
From Impact of SARS-CoV-2 variants on the total CD4+ and CD8+ T cell reactivity in infected or vaccinated individuals (2021) · cites this paper as [29]
In the citing paper
“A randomized, controlled trial and real-world studies have shown vaccine efficacy of 94 to 95% with the BNT162b2 vaccine (Pfizer–BioNTech) and vaccine effectiveness in preventing symptomatic coronavirus disease 2019 (Covid-19) 7 days or more after receipt of the second dose of vaccine.1,3-5”
From Waning Immune Humoral Response to BNT162b2 Covid-19 Vaccine over 6 Months (2021) · cites this paper as [3]
In the citing paper
“it is substantial and occurs during a time when neutralizing antibody titers are either very low or absent (Baden et al., 2020; Dagan et al., 2021; Polack et al., 2020).”
From SARS-CoV-2 mRNA vaccination induces functionally diverse antibodies to NTD, RBD, and S2 (2021) · cites this paper as Dagan et al., 2021
In the citing paper
“Since its rollout in late 2020 in Israel, the BNT162b2 messenger RNA vaccine (Pfizer–BioNTech) has been highly effective in preventing clinically significant coronavirus disease 2019 (Covid-19) caused by severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2).1-3”
From Covid-19 Breakthrough Infections in Vaccinated Health Care Workers (2021) · cites this paper as [3]
In the citing paper
“Variability in estimates of vaccine effectiveness between studies could result from differences in study design, testing protocols, and study populations”
In the citing paper
“BNT162b2, a messenger RNA (mRNA)-based vaccine, has demonstrated a high efficacy rate with an acceptable safety profile. 1 2”
In the citing paper
“Likewise, clinical studies have reported somewhat reduced efficacy and effectiveness against the B.1.1.7, B.1.351, and B.1.617.2 variants (10–12).”
From Durability of mRNA-1273 vaccine–induced antibodies against SARS-CoV-2 variants (2021) · cites this paper as [11]
In the citing paper
“In a mass vaccination study which included 3,159,136 participants from Israel, vaccine effectiveness of BNT162b2 as a two-dose scheme was 94%.397”
From Advances in COVID-19 mRNA vaccine development (2022) · cites this paper as [397]
In the citing paper
“>90% efficacy in real-world conditions in USA132 and Israel126”
From mRNA vaccines for infectious diseases: principles, delivery and clinical translation (2021) · cites this paper as [126]
In the citing paper
“In a mass vaccination campaign involving 3,159,136 participants in Israel, two doses of BNT162b2 were 94% effective at preventing symptomatic COVID-19, 87% effective at preventing hospitalizations and 92% effective at preventing the onset of severe COVID-19 (ref.126).”
From mRNA vaccines for infectious diseases: principles, delivery and clinical translation (2021) · cites this paper as [126]
In the citing paper
“Although BNT162b2 is a two-dose regimen, early protection after a single dose has been reported in clinical trials and on the basis of real-world data.5,19,20”
From Safety, immunogenicity, and efficacy of the BNT162b2 covid-19 vaccine in adolescents (2021) · cites this paper as [19]
In the citing paper
“Recent real-world data suggest that BNT162b2 prevents asymptomatic infection.19,27”
From Safety, immunogenicity, and efficacy of the BNT162b2 covid-19 vaccine in adolescents (2021) · cites this paper as [19]
In the citing paper
“Coronavirus disease 2019 (Covid-19) vaccines are highly effective against symptomatic disease and, more so, against severe disease and fatal outcomes caused by the original strain of SARS-CoV-2 as well as the alpha (B.1.1.7) variant that predominated in early 2021.”
From Effectiveness of COVID-19 vaccines against the Omicron (B.1.1.529) variant of concern (2021) · cites this paper as [14]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Nonparametric Estimation from Incomplete Observations
Kaplan, E. L., & Meier, P. (1958) · Journal of the American Statistical Association · doi:10.1080/01621459.1958.10501452 · Cited by 39,158
Safety and Efficacy of the BNT162b2 mRNA Covid-19 Vaccine
Polack, F. P., Thomas, S. J., Kitchin, N., Absalon, J., Gurtman, A., Lockhart, S., Perez, J. L., Pérez Marc, G., Moreira, E. D., Zerbini, C., et al. (2020) · New England Journal of Medicine · doi:10.1056/nejmoa2034577 · Cited by 14,592
Efficacy and Safety of the mRNA-1273 SARS-CoV-2 Vaccine
Baden, L. R., El Sahly, H. M., Essink, B., Kotloff, K., Frey, S., Novak, R., Diemert, D., Spector, S. A., Rouphael, N., Creech, C. B., et al. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2035389 · Cited by 10,119
Validation of a combined comorbidity index
Charlson, M., Szatrowski, T. P., Peterson, J., & Gold, J. (1994) · Journal of Clinical Epidemiology · doi:10.1016/0895-4356(94)90129-5 · Cited by 6,587
Using Big Data to Emulate a Target Trial When a Randomized Trial Is Not Available: Table 1.
Hernán, M. A., & Robins, J. M. (2016) · American Journal of Epidemiology · doi:10.1093/aje/kwv254 · Cited by 3,115
Self-citationAntibody resistance of SARS-CoV-2 variants B.1.351 and B.1.1.7
Wang, P., Nair, M. S., Liu, L., Iketani, S., Luo, Y., Guo, Y., Wang, M., Yu, J., Zhang, B., Kwong, P. D., et al. (2021) · Nature · doi:10.1038/s41586-021-03398-2 · Cited by 2,312
Negative Controls: A Tool for Detecting Confounding and Bias in Observational Studies
Lipsitch, M., Tchetgen Tchetgen, E., & Cohen, T. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181d61eeb · Cited by 1,583
Self-citationHernán, M. Á. (2009) · Epidemiology · doi:10.1097/ede.0b013e3181c1ea43 · Cited by 1,367
Self-citationZambrano, L. D., Ellington, S., Strid, P., Galang, R. R., Oduyebo, T., Tong, V. T., Woodworth, K. R., Nahabedian, J. F., Azziz-Baumgartner, E., Gilboa, S. M., et al. (2020) · MMWR Morbidity and Mortality Weekly Report · doi:10.15585/mmwr.mm6944e3 · Cited by 1,207
Harder, V. S., Stuart, E. A., & Anthony, J. C. (2010) · Psychological Methods · doi:10.1037/a0019623 · Cited by 802
Flagged first, then by citations
1 of the 18 references couldn’t be matched to a known paper.
Research works printed but not linked: 2
- Chodick G Tene L Patalon T et al. The effectiveness of the first dose of BNT162b2 vaccine in reducing SARS-CoV-2 infection 13-24 days after immunization: real-world evidence. January 29 2021 (https://www.medrxiv.org/content/10.1101/2021.01.27.21250612v1). preprint. · DOI
- Efrati I. Israel to extend COVID vaccine drive to anyone over 16 starting Thursday. Haaretz. February 3, 2021.
Cited by
Sorted by citations
Items 601–700 of 1,007
Knowledge barriers in a national symptomatic-COVID-19 testing programme
Graham, M. S., May, A., Varsavsky, T., Sudre, C. H., Murray, B. A. K., Kläser, K., Antonelli, M., Canas, L. S., Molteni, E., Marc Modat, A., et al. (2022) · PLOS Global Public Health · doi:10.1371/journal.pgph.0000028 · Cited by 34
Immune Response in Moderate to Critical Breakthrough COVID-19 Infection After mRNA Vaccination
Paniskaki, K., Anft, M., Meister, T. L., Marheinecke, C. S., Pfaender, S., Skrzypczyk, S., Seibert, F. S., Thieme, C. J., Konik, M., Dolff, S., et al. (2022) · Frontiers in Immunology · doi:10.3389/fimmu.2022.816220 · Cited by 33
“Taking into consideration that the anti-SARS-CoV-2 vaccines were shown to protect efficiently against critical and fatal COVID-19 manifestations, it is rather unusual to observe critical COVID-19 cases or patients who died due to COVID-19 in fully vaccinated population/cohorts (21).”
BackgroundBNT162b2 vaccine induces antibody release in saliva: a possible role for mucosal viral protection?
Darwich, A., Pozzi, C., Fornasa, G., Lizier, M., Azzolini, E., Spadoni, I., Carli, F., Voza, A., Desai, A., Ferrero, C. A., et al. (2022) · EMBO Molecular Medicine · doi:10.15252/emmm.202115326 · Cited by 34
“Recently, the results of a “real-world” vaccination trial in Israel (Dagan et al, 2021) and an interim study after one dose administration in the United Kingdom (Vasileiou et al, 2021) have been published.”
BackgroundPorru, S., Spiteri, G., Monaco, M. G. L., Valotti, A., Carta, A., Lotti, V., Diani, E., Lippi, G., Gibellini, D., & Verlato, G. (2022) · Vaccines · doi:10.3390/vaccines10020272 · Cited by 33
“At the end of 2020, the first vaccine was already made available, and as of December 27th 2020, many SARS-CoV-2 vaccination campaigns had begun, especially in developed countries [5].”
BackgroundSpleen-targeted nanosystems for immunomodulation
Wang, F., Lou, J., Gao, X., Zhang, L., Sun, F., Wang, Z., Ji, T., & Qin, Z. (2023) · Nano Today · doi:10.1016/j.nantod.2023.101943 · Cited by 36
Shim, E. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph18147578 · Cited by 33
Evaluation of adverse effects with COVID-19 vaccination in Pakistan
Abbas, D. S., Abbas, B., Amir, S., & Wajahat, M. (2021) · Pakistan Journal of Medical Sciences · doi:10.12669/pjms.37.7.4522 · Cited by 34
Healy, K., Pin, E., Chen, P., Söderdahl, G., Nowak, P., Mielke, S., Hansson, L., Bergman, P., Smith, C. I. E., Ljungman, P. T., et al. (2022) · Med · doi:10.1016/j.medj.2022.01.001 · Cited by 31
Bassi, J., Giannini, O., Silacci-Fregni, C., Pertusini, L., Hitz, P., Terrot, T., Franzosi, Y., Muoio, F., Saliba, C., Meury, M., et al. (2022) · PLoS ONE · doi:10.1371/journal.pone.0263328 · Cited by 33
“In particular, mRNA-based vaccines developed by Pfizer/BioNTech (BNT-162b2) and Moderna (mRNA1273) have demonstrated high safety and efficacy in healthy and at-risk individuals, including patients with chronic diseases, cancer and solid organ transplantation[11-14].”
BackgroundTakeuchi, J. S., Fukunaga, A., Yamamoto, S., Tanaka, A., Matsuda, K., Kimura, M., Kamikawa, A., Kito, Y., Maeda, K., Ueda, G., et al. (2022) · Scientific Reports · doi:10.1038/s41598-022-19581-y · Cited by 35
Canetti, M., Barda, N., Gilboa, M., Indenbaum, V., Mandelboim, M., Gonen, T., Asraf, K., Weiss-Ottolenghi, Y., Amit, S., Doolman, R., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-35480-2 · Cited by 33
“Autoimmune disease N (%) 12 (8) 20 (8) 4 (3) 15 (7)”
Self-citationDivergent COVID-19 vaccine policies: Policy mapping of ten European countries
van Kessel, R., Forman, R., Milstein, R., Mastylak, A., Czabanowska, K., Czypionka, T., Durand‐Zaleski, I., Hirche, A., Krysińska-Pisarek, M., Maynou, L., et al. (2023) · Vaccine · doi:10.1016/j.vaccine.2023.03.036 · Cited by 33
Effectiveness of the mRNA-1273 Vaccine during a SARS-CoV-2 Delta Outbreak in a Prison
Chin, E. T., Leidner, D., Zhang, Y., Long, E., Prince, L., Li, Y., Andrews, J. R., Studdert, D. M., Goldhaber-Fiebert, J. D., & Salomon, J. A. (2021) · New England Journal of Medicine · doi:10.1056/nejmc2114089 · Cited by 32
Bianchi, F. P., Germinario, C. A., Migliore, G., Vimercati, L., Martinelli, A., Lobifaro, A., Tafuri, S., Stefanizzi, P., Control Room Working Group, Amoruso, F., et al. (2021) · The Journal of Infectious Diseases · doi:10.1093/infdis/jiab262 · Cited by 32
Hennrich, A. A., Sawatsky, B., Santos-Mandujano, R., Banda, D. H., Oberhuber, M., Schopf, A., Pfaffinger, V., Wittwer, K., Riedel, C., Pfaller, C. K., et al. (2021) · PLOS Pathogens · doi:10.1371/journal.ppat.1009064 · Cited by 30
Salazar, P. M. D., Link, N., Lamarca, K., & Santillana, M. (2021) · Communications Medicine · doi:10.1038/s43856-021-00015-1 · Cited by 32
Butt, A. A., Peng, Y., Shaikh, O. S., & Mayr, F. (2021) · EClinicalMedicine · doi:10.1016/j.eclinm.2021.101117 · Cited by 33
Bianchi, F. P., Tafuri, S., Migliore, G., Vimercati, L., Martinelli, A., Lobifaro, A., Diella, G., Control Room Working Group, & Stefanizzi, P. (2021) · Vaccines · doi:10.3390/vaccines9101143 · Cited by 32
“In 2021, an observational study [9] investigated the effectiveness of the BNT162b2 mRNA vaccine in >1,000,000 Israeli inhabitants (half fully vaccinated and half unvaccinated) during the period from 20 December 2020 to 1 February 2021.”
BackgroundRottenstreich, A., Zarbiv, G., Oiknine‐Djian, E., Vorontsov, O. M., Zigron, R., Kleinstern, G., Wolf, D. G., & Porat, S. (2022) · Clinical Infectious Diseases · doi:10.1093/cid/ciac135 · Cited by 33
“Israel was one of the first countries to roll out its COVID-19 vaccination program, which resulted in a dramatic decline in COVID-19 cases across all age groups [20, 21].”
Dalvie, N. C., Tostanoski, L. H., Rodriguez‐Aponte, S. A., Kaur, K., Bajoria, S., Kumru, O. S., Martinot, A. J., Chandrashekar, A., McMahan, K., Mercado, N. B., et al. (2022) · Science Advances · doi:10.1126/sciadv.abl6015 · Cited by 32
So, H., Li, T., Chan, V., Tam, L., & Chan, P. K. (2022) · Therapeutic Advances in Musculoskeletal Disease · doi:10.1177/1759720x221089586 · Cited by 33
Safety and Effectiveness of Maternal COVID-19 Vaccines Among Pregnant People and Infants
Fleming-Dutra, K. E., Zauche, L. H., Roper, L. E., Ellington, S., Olson, C. K., Sharma, A. J., Woodworth, K. R., Tepper, N. K., Havers, F. P., Oliver, S. E., et al. (2023) · Obstetrics and Gynecology Clinics of North America · doi:10.1016/j.ogc.2023.02.003 · Cited by 35
“showed high VE against SARS-CoV-2 infection (Supplementary Table 2), and these results were similar to those in the general populations of those countries.(64,65) Goldshtein and colleagues conducted an observational cohort study among pregnant people in Israel during the first 4 months of vaccine rollout (December 19,…”
Emborg, H., Valentiner‐Branth, P., Schelde, A. B., Nielsen, K. F., Gram, M. A., Moustsen‐Helms, I. R., Chaine, M., Seidelin, U. H., & Nielsen, J. O. (2021) · medRxiv · doi:10.1101/2021.05.27.21257583 · Cited by 33
Vaccine Effectiveness of Two and Three Doses of BNT162b2 and Coronavac Against COVID-19 in Hong KongPreprint
McMenamin, M. E., Nealon, J., Lin, Y., Wong, J. Y., Cheung, J. K., Lau, E. H. Y., Wu, P., Leung, G. M., & Cowling, B. J. (2022) · SSRN Electronic Journal · doi:10.2139/ssrn.4064649 · Cited by 32
The benefits of large scale covid-19 vaccination
Dye, C. (2022) · BMJ · doi:10.1136/bmj.o867 · Cited by 34
Röltgen, K., Nielsen, S. C. A., Arunachalam, P. S., Yang, F., Hoh, R. A., Wirz, O. F., Lee, A. S., Gao, F., Mallajosyula, V., Li, C., et al. (2021) · doi:10.1101/2021.04.05.21254952 · Cited by 45
“Results from Phase III clinical trials and mass vaccination studies show promising results with high efficacy against severe COVID-19 and similar data across subgroups defined by age, sex, race, and the presence of coexisting conditions (Dagan et al., 2021; Polack et al., 2020).”
Izumo, T., Kuse, N., Awano, N., Tone, M., Sakamoto, K., Takada, K., Muto, Y., Fujimoto, K., Saiki, A., Ito, Y., et al. (2021) · Respiratory Investigation · doi:10.1016/j.resinv.2021.06.003 · Cited by 31
“[6] Dagan N, Barda N, Kepten E, Miron O, Perchik S, Katz MA, et al.”
Carazo, S., Talbot, D. C., Boulianne, N., Brisson, M., Gilca, R., Deceuninck, G., Brousseau, N., Drolet, M., Ouakki, M., Sauvageau, C., et al. (2021) · Clinical Infectious Diseases · doi:10.1093/cid/ciab739 · Cited by 32
“15 change VE estimates, HCWs with medical conditions at high risk of severe disease were frequently removed from direct patient care duties during the pandemic and their VE might be lower than the estimates for all HCWs [22].”
BackgroundEffectiveness of COVID‑19 vaccines and their challenges (Review)
Marfè, G., Perna, S., & Shukla, A. K. (2021) · Experimental and Therapeutic Medicine · doi:10.3892/etm.2021.10843 · Cited by 32
Hsu, L., Grüne, B., Buess, M., Joisten, C., Klobucnik, J., Nießen, J., Patten, D., Wolff, A., Wiesmüller, G. A., Kossow, A., et al. (2021) · Vaccines · doi:10.3390/vaccines9111267 · Cited by 31
Ge, C., Du, K., Luo, M., Shen, K., Zhou, Y., Guo, K., Liu, Y., Yin, C., Li, Y., Li, G., et al. (2022) · Experimental Hematology and Oncology · doi:10.1186/s40164-022-00299-6 · Cited by 33
“In response, many countries have adopted mass COVID-19 vaccination and booster shot programs [2, 3].”
BackgroundAyoub, H. H., Chemaitelly, H. S., Makhoul, M., Kanaani, Z. A., Al‐Kuwari, E., Butt, A. A., Coyle, P. V., Jeremijenko, A. M., Kaleeckal, A. H., Latif, A. N., et al. (2021) · BMJ Innovations · doi:10.1136/bmjinnov-2021-000677 · Cited by 30
Strategies for fighting pandemic virus infections: Integration of virology and drug delivery
Nakamura, T., Isoda, N., Sakoda, Y., & Harashima, H. (2022) · Journal of Controlled Release · doi:10.1016/j.jconrel.2022.01.046 · Cited by 32
“The BNT162b2 COVID-19 mRNA vaccine showed a 92% protective effect against SARS-CoV-2 infections and subjects who were vaccinated with the mRNA-1273 COVID-19 mRNA vaccine had SARS-CoV-2 specific IgA in their saliva [177,178].”
Safety of third SARS-CoV-2 vaccine (booster dose) during pregnancy
Dick, A., Rosenbloom, J. I., Karavani, G., Gutman‐Ido, E., Lessans, N., & Chill, H. H. (2022) · American Journal of Obstetrics & Gynecology MFM · doi:10.1016/j.ajogmf.2022.100637 · Cited by 31
“reduced morbidity and mortality in the general population.(5) Although the origi-”
Heterogeneity in Spatial Inequities in COVID-19 Vaccination Across 16 Large US Cities
Bilal, U., Mullachery, P. H., Schnake-Mahl, A. S., Rollins, H., McCulley, E. M., Kolker, J., Barber, S., & Roux, A. V. D. (2022) · American Journal of Epidemiology · doi:10.1093/aje/kwac076 · Cited by 31
“These vaccines have proven highly efficacious(6, 7) and effective(8), and represent one of the key tools to address the ongoing pandemic.”
Mrak, D., Sieghart, D., Simader, E., Tobudic, S., Radner, H., Mandl, P., Göschl, L., Koblischke, M., Hommer, N., Wagner, A., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-33036-y · Cited by 32
Shi, X., Li, K. Q., & Mukherjee, B. (2022) · American Journal of Epidemiology · doi:10.1093/aje/kwac203 · Cited by 33
Bouillon, K., Baricault, B., Botton, J., Jabagi, M.-J., Bertrand, M., Semenzato, L., Le Vu, S., Drouin, J., Dray-Spira, R., Weill, A., et al. (2022) · BMJ Medicine · doi:10.1136/bmjmed-2021-000104 · Cited by 31
Beta SARS-CoV-2 variant and BNT162b2 vaccine effectiveness in long-term care facilities in France
Lefèvre, B., Tondeur, L., Madec, Y., Grant, R., Lina, B., van der Werf, S., Rabaud, C., Fontanet, A. L., & Legoff, A. (2021) · The Lancet Healthy Longevity · doi:10.1016/s2666-7568(21)00230-0 · Cited by 29
Fernández-Ruiz, M., Almendro-Vázquez, P., Carretero, O., Ruiz-Merlo, T., Laguna-Goya, R., Juan, R. S., López‐Medrano, F., García‐Ríos, E., Más, V., Moreno-Batenero, M., et al. (2021) · Transplantation Direct · doi:10.1097/txd.0000000000001246 · Cited by 30
Chen, Y., Yang, W., Chen, H., Huang, L., Gao, J.-Y., Lin, C., Wang, Y.-C., Yang, C., Liu, Y., Hou, M., et al. (2022) · Journal of Biological Chemistry · doi:10.1016/j.jbc.2022.101658 · Cited by 30
Gueguen, J., Colosio, C., Bello, A. D., Scemla, A., N’Guyen, Y., Rouzaud, C., Carvalho-Schneider, C., Gautier-Vargas, G., Tremolières, P., Eddine, A. J., et al. (2022) · Kidney International Reports · doi:10.1016/j.ekir.2022.03.020 · Cited by 29
“30 Nowadays, it is clear that immune response to COVID-19 vaccination is affected by immunosuppressive drugs.”
Freund, O., Tau, L., Weiss, T. E., Zornitzki, L., Frydman, S., Jacob, G., & Bornstein, G. (2022) · PLoS ONE · doi:10.1371/journal.pone.0268050 · Cited by 31
“We found higher rate of critical disease (30%) and lower rate of ICU admission (10%) than previously described [7, 31, 32, 37].”
ResultFactors Influencing the Efficacy of COVID-19 Vaccines: A Quantitative Synthesis of Phase III Trials
Calzetta, L., Ritondo, B. L., Coppola, A., Matera, M., Daniele, N. D., & Rogliani, P. (2021) · Vaccines · doi:10.3390/vaccines9040341 · Cited by 26
“Moreover, a recent case control study conducted by the Clalit Institute for Research reported a reduction by 94% in symptomatic COVID-19 cases among 596,618 people who received two doses of the BNT162b2 vaccine, regardless of recipients’ age, compared to matched unvaccinated controls [51].”
BackgroundResultAssessing the long-term safety and efficacy of COVID-19 vaccines
Majeed, A., Papaluca, M., & Molokhia, M. (2021) · Journal of the Royal Society of Medicine · doi:10.1177/01410768211013437 · Cited by 30
“A study from Israel reported that the PfizerBioNTech vaccine was 94% effective at preventing symptomatic COVID-19 seven days after the second dose.(8)”
BackgroundDomi, M., Leitson, M., Gifford, D. R., Nicolaou, A., Sreenivas, K., & Bishnoi, C. (2021) · Journal of the American Geriatrics Society · doi:10.1111/jgs.17224 · Cited by 29
“, testing positive for COVID-19)(11) and similar to findings from Israel looking at the vaccine effectiveness in the general population.(10) Because COVID-19 resident infection rates were declining in the community before and during the Pharmacy Partnership vaccinations, we introduced the effect of time, or calendar w…”
BackgroundResultMateo‐Urdiales, A., Alegiani, S. S., Fabiani, M., Pezzotti, P., Filia, A., Massari, M., Riccardo, F., Tallon, M., Proietti, V., Manso, M. D., et al. (2021) · Eurosurveillance · doi:10.2807/1560-7917.es.2021.26.25.2100507 · Cited by 28
Potential COVID-19 Endgame Scenarios
Kofman, A. D., Kantor, R., & Adashi, E. Y. (2021) · JAMA · doi:10.1001/jama.2021.11042 · Cited by 30
Employment Loss in Informal Settlements during the Covid-19 Pandemic: Evidence from Chile
Gil, D., Domínguez, P., Undurraga, E. A., & Valenzuela, E. (2021) · Journal of Urban Health · doi:10.1007/s11524-021-00575-6 · Cited by 40
Comparative effectiveness of mRNA-1273 and BNT162b2 against symptomatic SARS-CoV-2 infection
Puranik, A., Lenehan, P. J., Silvert, E., Niesen, M. J. M., Corchado-García, J., O’Horo, J. C., Virk, A., Swift, M. D., Gordon, J. E., Speicher, L. L., et al. (2021) · Med · doi:10.1016/j.medj.2021.12.002 · Cited by 31
Butt, A. A., Peng, Y., Shaikh, O. S., Mayr, F., & Omer, S. B. (2021) · Clinical Infectious Diseases · doi:10.1093/cid/ciab1023 · Cited by 31
“[1, 2] In the real-world setting, effectiveness of these vaccines is similarly very high, consistently exceeding 90%.[3, 4] The Pfizer-BNT162b2 vaccine retains high level of effectiveness even in the Alpha (previously known as the B1.”
BackgroundMyocarditis following COVID-19 vaccination: incidence, mechanisms, and clinical considerations
Power, J. R., Keyt, L. K., & ADLER, E. D. (2022) · Expert Review of Cardiovascular Therapy · doi:10.1080/14779072.2022.2066522 · Cited by 32
Rennert, L., Ma, Z., McMahan, C. S., & Dean, D. (2022) · Nature Communications · doi:10.1038/s41467-022-31469-z · Cited by 31
Challenges in Estimating the Effectiveness of COVID-19 Vaccination Using Observational Data
Hulme, W. J., Williamson, E., Horne, E. M. F., Green, A. C. A., McDonald, H. I., Walker, A. J., Curtis, H. J., Morton, C. E., MacKenna, B., Croker, R., et al. (2023) · Annals of Internal Medicine · doi:10.7326/m21-4269 · Cited by 30
“Some observational analyses of the effect of COVID-19 vaccination have used this sequential-trial emulation approach (6).”
BackgroundSelf-citationRahman, M. O., Kamigaki, T., Thandar, M. M., Haruyama, R., Yan, F., Shibamura-Fujiogi, M., Khin Maung Soe, J., Islam, M. R., Yoneoka, D., Miyahara, R., et al. (2023) · BMJ Open · doi:10.1136/bmjopen-2023-076892 · Cited by 29
Cardiovascular Complications of COVID-19 Vaccines
Liu, R., Pan, J., Zhang, C., & Sun, X. (2022) · Frontiers in Cardiovascular Medicine · doi:10.3389/fcvm.2022.840929 · Cited by 28
“The BNT162b2 mRNA vaccine has been reported to be effective in a variety of COVID19 clinical trials (6).”
BackgroundHuang, Z., Xu, S., Liu, J., Wu, L., Qiu, J., Wang, N., Ren, J., Li, Z., Guo, X., Tao, F., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-37673-9 · Cited by 29
Fleurence, R., Kent, S., Adamson, B. J. S., Tcheng, J. E., Balicer, R., Ross, J. S., Haynes, K., Muller, P., Campbell, J., Bouée-Benhamiche, E., et al. (2024) · Value in Health · doi:10.1016/j.jval.2024.01.019 · Cited by 33
Self-citationCOVID-19 vaccination in Israel
Muhsen, K., & Cohen, D. (2021) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2021.07.041 · Cited by 29
Dementia Risk among Coronavirus Disease Survivors: A Nationwide Cohort Study in South Korea
Park, H.-Y., Song, I., & Oh, T.-K. (2021) · Journal of Personalized Medicine · doi:10.3390/jpm11101015 · Cited by 31
“Although vaccination began on 8 December 2020 [3,4], limitations with respect to the volume of vaccine production and the rapidity of administration presently hamper the development of herd immunity to COVID-19.”
BackgroundLessons from Israel's COVID-19 Green Pass program
Kamin-Friedman, S., & Peled-Raz, M. (2021) · Israel Journal of Health Policy Research · doi:10.1186/s13584-021-00496-4 · Cited by 29
Botton, J., Dray‐Spira, R., Baricault, B., Drouin, J., Bertrand, M., Jabagi, M.-J., Weill, A., & Zureik, M. (2021) · Vaccine · doi:10.1016/j.vaccine.2021.12.009 · Cited by 28
Haranaka, M., Baber, J., Ogama, Y., Yamaji, M., Aizawa, M., Kogawara, O., Scully, I. L., Lagkadinou, E., Türeci, Ö., Şahin, U., et al. (2021) · Nature Communications · doi:10.1038/s41467-021-27316-2 · Cited by 28
Biparatopic nanobodies protect mice from lethal challenge with SARS‐CoV‐2 variants of concern
Wagner, T. R., Schnepf, D., Beer, J., Klingel, K., Ruetalo, N., Kaiser, P. D., Junker, D., Sauter, M., Traenkle, B., Frecot, D. I., et al. (2021) · EMBO Reports · doi:10.15252/embr.202153865 · Cited by 27
“Despite the rapid development of effective vaccines, global immunity or alternatively eradication of SARS-CoV-2 is currently out of reach (Kwok et al , 2020; Dagan et al , 2021).”
Müller, M. K., Volzke, J., Subin, B., Müller, S. C., Sombetzki, M., Reisinger, E. C., & Müller‐Hilke, B. (2022) · BMC Medicine · doi:10.1186/s12916-022-02240-4 · Cited by 27
Urakawa, R., Isomura, E. T., Matsunaga, K., Kubota, K., & Ike, M. (2022) · BMC Infectious Diseases · doi:10.1186/s12879-022-07175-y · Cited by 29
“The results of other studies also supportsafety, efficacy and effectiveness [14, 20, 21].”
ResultGepner, Y., Mofaz, M., Oved, S., Yechezkel, M., Constantini, K., Goldstein, N., Eisenkraft, A., Shmueli, E., & Yamin, D. (2022) · Communications Medicine · doi:10.1038/s43856-022-00090-y · Cited by 29
Preferences for using the London Underground during the COVID-19 pandemic
Bansal, P., Kessels, R., Krueger, R., & Graham, D. J. (2022) · Transportation Research Part A Policy and Practice · doi:10.1016/j.tra.2022.03.033 · Cited by 33
“In addition, COVID-19 vaccines provide effective protection against symptomatic and asymptomatic infections with the virus (Dagan et al., 2021; Hall et al., 2021).”
Martellucci, C. A., Flacco, M. E., Soldato, G., Martino, G. D., Carota, R., Caponetti, A., & Manzoli, L. (2022) · Vaccines · doi:10.3390/vaccines10050662 · Cited by 29
Sagy, I., Zeller, L., Raviv, Y., Porges, T., Bieber, A., & Abu‐Shakra, M. (2022) · Rheumatology International · doi:10.1007/s00296-022-05203-3 · Cited by 32
“COVID-19 vaccine is highly effective in preventing COVID-19 complications, including hospitalization and death [1].”
BackgroundA Vaccination Strategy for Ontario COVID-19 Hotspots and Essential Workers
Mishra, S., Stall, N. M., Ma, H., Odutayo, A., Kwong, J. C., Allen, U., Brown, K. A., Bogoch, I. I., Erman, A., Huynh, T., et al. (2021) · doi:10.47326/ocsat.2021.02.26.1.0 · Cited by 29
“11 The model captured direct and indirect benefits of vaccinations within the hotspots, and within the lower - incidence FSAs.”
BackgroundResponse to BNT162b2 mRNA COVID-19 vaccine among healthcare workers in Italy: a 3-month follow-up
Ponticelli, D., Madotto, F., Conti, S., Antonazzo, I. C., Vitale, A., Ragione, G. D., Romano, M. L., Borrelli, M., Schiavone, B., Polosa, R., et al. (2021) · Internal and Emergency Medicine · doi:10.1007/s11739-021-02857-y · Cited by 29
North, C. M., Barczak, A. K., Goldstein, R. H., Healy, B. C., Finkelstein, D. M., Ding, D. D., Kim, A., Boucau, J., Shaw, B. M., Gilbert, R. F., et al. (2021) · Clinical Infectious Diseases · doi:10.1093/cid/ciab643 · Cited by 29
Vaccinations, Mobility and COVID-19 Transmission
Guo, J., Deng, C. R., & Гу, Ф. (2021) · International Journal of Environmental Research and Public Health · doi:10.3390/ijerph19010097 · Cited by 28
Zhao, Z., Niu, Y., Luo, L., Hu, Q., Yang, T., Chu, M., Chen, Q., Lei, Z., Rui, J., Song, C.-L., et al. (2020) · Infectious Diseases of Poverty · doi:10.1186/s40249-021-00922-4 · Cited by 43
Evaluation of Transplacental Antibody Transfer in SARS-CoV-2-Immunized Pregnant Women
Shen, C., Fu, Y.-C., Lin, Y.-P., Shen, C., Sun, D.-J., Shen, C., & Cheng, C. (2022) · Vaccines · doi:10.3390/vaccines10010101 · Cited by 27
“observed vaccine effectiveness for healthcare workers in long-term care facilities was even lower (16%, 14 days after one dose and until second dose) [32].”
BackgroundVerma, A. K., Kumar, I., Singh, P. K., Ansari, M. S., Singh, H. A., Sonkar, S., Prakash, A., Ojha, R., & Shukla, R. C. (2022) · European Radiology · doi:10.1007/s00330-021-08475-8 · Cited by 30
Witkowski, W., Gerlo, S., Smet, E. D., Wejda, M., Acar, D. D., Callens, S. F. J., Heytens, S., Padalko, E. Y., Vercruysse, H., Cools, P., et al. (2022) · Vaccines · doi:10.3390/vaccines10020260 · Cited by 28
“The unprecedented speed of the development and enrollment of the emergency-authorized vaccines [2–4], together with the immediately observed real-life effectiveness in preventing new infections [5,6], provided much-needed hope that the social restraints imposed all around the world could soon be lifted.”
BackgroundSaiag, E., Grupper, A., Avivi, I. M., Elkayam, O., Ram, R., Herishanu, Y., Cohen, Y. C., Perry, C., Furer, V., Katchman, H., et al. (2022) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2022.02.002 · Cited by 26
“The Pfizer-BioNTechmRNAvaccine (BNT162b2) has a 90% to 95% vaccine effectiveness according to several large real-world studies [1,2].”
Hitchings, M. D. T., Lewnard, J. A., Dean, N. E., Ko, A. I., Ranzani, O., Andrews, J. R., & Cummings, D. A. T. (2022) · Epidemiology · doi:10.1097/ede.0000000000001484 · Cited by 29
“23,24 25–29 Figure 1 shows a directed acyclic graph to represent the potential role of recent vaccination as a negative control exposure; it may share common sources of unmeasured confounding with full vaccination and be causally unrelated to the odds of acquiring or testing positive for COVID-19.”
BackgroundRisk of autoimmune skin and connective tissue disorders after mRNA-based COVID-19 vaccination
Ju, H. J., Lee, J. Y., Han, J. H., Lee, J. H., Bae, J. M., & Lee, S. (2023) · Journal of the American Academy of Dermatology · doi:10.1016/j.jaad.2023.05.017 · Cited by 28
Shooting at a Moving Target—Effectiveness and Emerging Challenges for SARS-CoV-2 Vaccine Development
Günl, F., Mecate-Zambrano, A., Rehländer, S., Hinse, S., Ludwig, S., & Brunotte, L. (2021) · Vaccines · doi:10.3390/vaccines9101052 · Cited by 27
“In addition, a reduction of 50–70% in the incidence of PCR-confirmed SARS-CoV-2 infections upon the first dose was reported [106].”
BackgroundIHEANACHO, C. O., Eze, U. I. H., & Adida, E. A. (2021) · Bulletin of the National Research Centre/Bulletin of the National Research Center · doi:10.1186/s42269-021-00607-w · Cited by 27
Declercq, J., Gerlo, S., Nevel, S. V., Ruyck, N. D., Holtappels, G., Delesie, L. M., Tobback, E., Lammens, I., Gerebtsov, N., Sedeyn, K., et al. (2024) · Science Translational Medicine · doi:10.1126/scitranslmed.adn2364 · Cited by 28
“Both vaccines exhibit robust immunogenicity and are effective in preventing severe disease and mortality ( 9 – 12 ).”
BackgroundHillus, D., Le, N. H., Tober‐Lau, P., Fietz, A., Hoffmann, C., Stegherr, R., Huang, L., Baumgarten, A., Voit, F., Bickel, M., et al. (2025) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(25)00018-0 · Cited by 34
Self-citationVicenti, I., Gatti, F., Scaggiante, R., Boccuto, A., Zago, D., Basso, M., Dragoni, F., Zazzi, M., & Parisi, S. G. (2021) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2021.05.033 · Cited by 27
COVID-19 Vaccine Platforms: Challenges and Safety Contemplations
Al-Jighefee, H. T., Najjar, H., Ahmed, M. N., Qush, A., Awwad, S., & Kamareddine, L. (2021) · Vaccines · doi:10.3390/vaccines9101196 · Cited by 29
Triple jeopardy in ageing: COVID-19, co-morbidities and inflamm-ageing
Rea, I. M., & Alexander, H. D. (2021) · Ageing Research Reviews · doi:10.1016/j.arr.2021.101494 · Cited by 27
Bongomin, F., Fleischer, B., Olum, R., Natukunda, B., Kiguli, S., Byakika‐Kibwika, P., Baluku, J. B., & Nakwagala, F. N. (2021) · Open Forum Infectious Diseases · doi:10.1093/ofid/ofab530 · Cited by 27
“However, in countries with high vaccine coverage, the proportion of vaccinated patients presenting with severe disease requiring hospitalization or resulting into deaths have remarkably decreased [10, 21], which is evidence that the vaccine works.”
BackgroundRapid antigen testing as a reactive response to surges in nosocomial SARS-CoV-2 outbreak risk
Smith, D. R., Duval, A., Zahar, J., the EMAE-MESuRS Working Group on Nosocomial SARS-CoV-2 Modelling, Hendrickx, N., Jean, K., Jijón, S., Oodally, A., Shirreff, G., Tamandjou, C. R. T., et al. (2022) · Nature Communications · doi:10.1038/s41467-021-27845-w · Cited by 28
Yamamoto, K. Z., Yasuo, N., & Sekijima, M. (2022) · Journal of Chemical Information and Modeling · doi:10.1021/acs.jcim.1c01087 · Cited by 27
Nasir, N. M., Joyosemito, I. S., Boerman, B., & Ismaniah, I. (2021) · Jurnal Pengabdian kepada Masyarakat UBJ · doi:10.31599/jabdimas.v4i2.662 · Cited by 31
Han, H. (2022) · Epidemiology and Infection · doi:10.1017/s0950268822000255 · Cited by 26
Coulaud, P.-J., Ablona, A., Bolduc, N., Fast, D., Bertrand, K., Ward, J. K., Greyson, D. L., Jauffret‐Roustide, M., & Knight, R. (2022) · Vaccine · doi:10.1016/j.vaccine.2022.02.085 · Cited by 27
“To achieve community immunity sufficient to stop transmission of the virus [5] and prevent severe COVID-19 [6], high levels of population immunity are needed [7].”
Bai, J., Chiba, A., Murayama, G., Kuga, T., Tamura, N., & Miyake, S. (2022) · Frontiers in Immunology · doi:10.3389/fimmu.2022.786586 · Cited by 27
Voss, E. A., Shoaibi, A., Lai, L. Y. H., Blacketer, C., Alshammari, T. M., Makadia, R., Haynes, K., Sena, A. G., Rao, G., Sandijk, S. V., et al. (2023) · EClinicalMedicine · doi:10.1016/j.eclinm.2023.101932 · Cited by 34
Efficacy and Safety of a Protein-Based SARS-CoV-2 Vaccine
Mostafavi, E., Eybpoosh, S., Karamouzian, M., Khalili, M., Haji‐Maghsoudi, S., Salehi-Vaziri, ., Khamesipour, A., Jalali, T., Nakhaeizadeh, M., Sharifi, H. P., et al. (2023) · JAMA Network Open · doi:10.1001/jamanetworkopen.2023.10302 · Cited by 26
COVID-19 vaccines for the European region: an unprecedented challenge
Kluge, H. H. P., & McKee, M. (2021) · The Lancet · doi:10.1016/s0140-6736(21)00709-1 · Cited by 24
Bosetti, P., Kiem, C. T., Andronico, A., Vittoria Colizza, A., Yazdanpanah, Y., Fontanet, A. L., Benamouzig, D., & Cauchemez, S. (2022) · BMC Medicine · doi:10.1186/s12916-022-02235-1 · Cited by 24
“[1], 60% at reducing the risk of infection [16] (impact on”
Background
Metadata
- Authors
- Dagan, N., Barda, N., Kepten, E., Miron, O., Perchik, S., Katz, M. A., Hernán, M. A., Lipsitch, M., Reis, B., & Balicer, R. D.
- Affiliations
- Ben-Gurion University of the Negev (IL)
- From the Clalit Research Institute, Innovation Division, Clalit Health Services, Tel Aviv (N.D., N.B., E.K., O.M., S.P., M.A.K., R.D.B.), and the School of Public Health, Faculty of Health Sciences, Ben Gurion University of the Negev, Be’er Sheva (O.M., M.A.K., R.D.B.) — both in Israel; University of Michigan School of Public Health, Ann Arbor (M.A.K.); and the Department of Biomedical Informatics (N.D., N.B.), Harvard Medical School (B.R.), the Departments of Epidemiology and Biostatistics (M.A.H.), and the Center for Communicable Disease Dynamics, Departments of Epidemiology and of Immunology and Infectious Diseases (M.L.), Harvard T.H. Chan School of Public Health, Harvard–MIT Division of Health Sciences and Technology (M.A.H.), and the Predictive Medicine Group, Computational Health Informatics Program, Boston Children’s Hospital (B.R.) — all in Boston.
- Corresponding author
- Balicer, Ran D.
- ORCID
- Venue
- New England Journal of Medicine
- Publisher
- Massachusetts Medical Society
- Published
- 2021-04-15
- Volume
- 384
- Issue
- 15
- Pages
- 1412-1423
- ISSN
- 0028-4793 (ISSN-L)
- 1533-4406
- PMC
- PMC7944975
- OpenAlex
- W3131688063
- Cited by
- 2,527
- References
- 18
- Citations by year
- 2026: 59 · 2025: 114 · 2024: 202 · 2023: 367 · 2022: 831 · 2021: 926
- FWCI
- 184.41
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- New England Journal of Medicine (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- Morris–Singer Fund
- Topics
- Health Sciences › Medicine › Infectious Diseases › SARS-CoV-2 and COVID-19 Research
- Social Sciences › Health › Vaccine Coverage and Hesitancy
- Health Sciences › Medicine › Infectious Diseases › COVID-19 Clinical Research Studies
- Keywords
- COVID-19 vaccine effectiveness, SARS-CoV-2 infection prevention, symptomatic COVID-19, COVID-19 hospitalization, severe COVID-19, COVID-19 mortality, mass vaccination campaigns, real-world effectiveness, comorbidities, Israel
- MeSH terms
- Immunogenicity, Vaccine, COVID-19, COVID-19 Vaccines, BNT162 Vaccine, Adolescent, Adult, Aged, Aged, 80 and over, Female, Hospitalization, Humans, Israel, Male, Middle Aged, Incidence, Treatment Outcome, Mass Vaccination, Kaplan-Meier Estimate, Young Adult
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review