Depletion-of-susceptibles Bias in Analyses of Intra-season Waning of Influenza Vaccine Effectiveness
Open accessAbstract
Bias arises in studies of waning vaccine effectiveness when higher-risk individuals are depleted from the at-risk population at different rates between study groups. We examined how this bias arises and how to avoid it. A reanalysis of data from California confirmed a finding of intra-season waning of influenza vaccine effectiveness.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Bias due to depletion of the susceptible population may lead to underestimation of vaccine effectiveness, even in the test-negative, case-control study design.
“Bias due to depletion of the susceptible population may lead to underestimation of vaccine effectiveness34, even in the test-negative, case–control, study design, which is less prone to effect of this bias13.”
From Duration of mRNA vaccine protection against SARS-CoV-2 Omicron BA.1 and BA.2 subvariants in Qatar (2022) · cites this paper as [34]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
The impact of heterogeneity in individual frailty on the dynamics of mortality
Vaupel, J. W., Mantón, K. G., & Stallard, E. (1979) · Demography · doi:10.2307/2061224 · Cited by 2,600 · see citing works
Hernán, M. Á. (2009) · Epidemiology · doi:10.1097/ede.0b013e3181c1ea43 · Cited by 1,367 · see citing works
Ferdinands, J. M., Fry, A. M., Reynolds, S. B., Petrie, J. G., Flannery, B. L., Jackson, M. L., & Belongia, E. A. (2016) · Clinical Infectious Diseases · doi:10.1093/cid/ciw816 · Cited by 197 · see citing works
Pebody, R. G., Andrews, N. J., McMenamin, J., et al. (2013) · Eurosurveillance · doi:10.2807/ese.18.05.20389-en · Cited by 163 · see citing works
Castilla, J., Martínez‐Baz, I., Martínez-Artola, V., Reina, G., Pozo, F., Cenoz, M. G., Guevara, M., Moran, J., Irisarri, F., Arriazu, M., et al. (2013) · Eurosurveillance · doi:10.2807/ese.18.05.20388-en · Cited by 157 · see citing works
Belongia, E. A., Sundaram, M. E., McClure, D. L., et al. (2014) · Vaccine · doi:10.1016/j.vaccine.2014.06.052 · Cited by 147 · see citing works
Kissling, E., Nunes, B., Robertson, C., Valenciano, M., Reuss, A. M., Larrauri, A., Cohen, J. M., Oroszi, B., Rizzo, C., Machado, A., et al. (2016) · Eurosurveillance · doi:10.2807/1560-7917.es.2016.21.16.30201 · Cited by 128 · see citing works
Intraseason Waning of Influenza Vaccine Effectiveness
Ray, G. T., Lewis, N., Klein, N. P., et al. (2018) · Clinical Infectious Diseases · doi:10.1093/cid/ciy770 · Cited by 118 · see citing works
Self-citationA Frailty Mixture Model for Estimating Vaccine Efficacy
Longini, I. M., & Halloran, M. E. (1996) · Journal of the Royal Statistical Society Series C (Applied Statistics) · doi:10.2307/2986152 · Cited by 99 · see citing works
Waning protection of influenza vaccination during four influenza seasons, 2011/2012 to 2014/2015
Puig‐Barberà, J., Mira‐Iglesias, A., Tortajada‐Girbés, M., López‐Labrador, F. X., Librero, J., Díez‐Domingo, J., Carballido‐Fernández, M., Carratalá‐Munuera, C., Medina, P. C., Gil-Guillén, V. F., et al. (2017) · Vaccine · doi:10.1016/j.vaccine.2017.09.035 · Cited by 59 · see citing works
Challenges of Vaccine Effectiveness and Waning Studies
Lipsitch, M. (2018) · Clinical Infectious Diseases · doi:10.1093/cid/ciy773 · Cited by 55 · see citing works
Self-citationTemporally Varying Relative Risks for Infectious Diseases
Goldstein, E., Pitzer, V. E., O’Hagan, J. J., & Lipsitch, M. (2016) · Epidemiology · doi:10.1097/ede.0000000000000571 · Cited by 36 · see citing works
Self-citationApparent declining efficacy in randomized trials
O’Hagan, J. J., Hernán, M. Á., Walensky, R. P., & Lipsitch, M. (2011) · AIDS · doi:10.1097/qad.0b013e32834e1ce7 · Cited by 35 · see citing works
Self-citationInfluenza Vaccine Effectiveness
Ferdinands, J. M., Patel, M. M., Foppa, I., et al. (2018) · Clinical Infectious Diseases · doi:10.1093/cid/ciy1084 · Cited by 19 · see citing works
Flagged first, then by citations
Research works printed but not linked: 1
- Ray GT, Lewis N, Klein NP, et al. Intra-season waning of influenza vaccine effec- tiveness. Clin Infect Dis 2018; 68:1623-30.
Cited by
Sorted by citations
Bobrovitz, N., Ware, H., Ma, X., Li, Z., Hosseini, R., Cao, C., Selemon, A., Whelan, M., Premji, Z., Issa, H., et al. (2023) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(22)00801-5 · Cited by 614 · see citing works
Duration of mRNA vaccine protection against SARS-CoV-2 Omicron BA.1 and BA.2 subvariants in Qatar
Chemaitelly, H., Ayoub, H. H., AlMukdad, S., Coyle, P., Tang, P., Yassine, H. M., Al-Khatib, H. A., Smatti, M. K., Hasan, M. R., Al-Kanaani, Z., et al. (2022) · Nature Communications · doi:10.1038/s41467-022-30895-3 · Cited by 228 · see citing works
Depletion-of-susceptibles bias in influenza vaccine waning studies: how to ensure robust results
Lipsitch, M., Goldstein, E., Ray, G. T., & Fireman, B. (2019) · Epidemiology and Infection · doi:10.1017/s0950268819001961 · Cited by 56 · see citing works
Self-citation
- Authors
- Ray, G. T., Lewis, N., Klein, N. P., Daley, M. F., Lipsitch, M., & Fireman, B.
- Affiliations
- Kaiser Permanente (US)
- Harvard University (US)
- Corresponding author
- Ray, G Thomas
- Venue
- Clinical Infectious Diseases
- Publisher
- Oxford University Press (OUP)
- Published
- 2019-07-27
- Volume
- 70
- Issue
- 7
- Pages
- 1484-1486
- ISSN
- 1058-4838 (ISSN-L)
- 1537-6591
- PMC
- PMC7318775
- OpenAlex
- W2966530972
- Cited by
- 48
- References
- 14
- Citations by year
- 2026: 5 · 2025: 9 · 2024: 7 · 2023: 4 · 2022: 9 · 2021: 2 · 2020: 7 · 2019: 5
- FWCI
- 4.38
- Type
- journal article
- Language
- en
- Open access
- bronze
- doi.org
- Licence
- academic.oup.com/journals/pages/open_access/funder_policies/chorus/standard_publication_model (vor)
- Locations
- Clinical Infectious Diseases (publishedVersion)
- PubMed Central (publishedVersion)
- PubMed (publishedVersion)
- Funders
- National Institute of Allergy and Infectious Diseases
- National Institutes of Health (#1R01AI107721-01)
- National Institute of General Medical Sciences (U54GM088558)
- Permanente Medical Group
- Topics
- Health Sciences › Medicine › Epidemiology › Influenza Virus Research Studies
- Social Sciences › Health › Vaccine Coverage and Hesitancy
- Health Sciences › Medicine › Epidemiology › Respiratory viral infections research
- Keywords
- influenza vaccine effectiveness, waning vaccine effectiveness, vulnerable populations
- MeSH terms
- Disease Susceptibility, Humans, Influenza, Human, Influenza Vaccines, Seasons, Vaccination, Bias
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
