How to detect and reduce potential sources of biases in studies of SARS-CoV-2 and COVID-19
Open accessThe DOI matches its Crossref record; 20 of the 20 references it cites were found in a registry or an index.
Abstract
In response to the coronavirus disease (COVID-19) pandemic, public health scientists have produced a large and rapidly expanding body of literature that aims to answer critical questions, such as the proportion of the population in a geographic area that has been infected; the transmissibility of the virus and factors associated with high infectiousness or susceptibility to infection; which groups are the most at risk of infection, morbidity and mortality; and the degree to which antibodies confer protection to re-infection. Observational studies are subject to a number of different biases, including confounding, selection bias, and measurement error, that may threaten their validity or influence the interpretation of their results. To assist in the critical evaluation of a vast body of literature and contribute to future study design, we outline and propose solutions to biases that can occur across different categories of observational studies of COVID-19. We consider potential biases that could occur in five categories of studies: (1) cross-sectional seroprevalence, (2) longitudinal seroprotection, (3) risk factor studies to inform interventions, (4) studies to estimate the secondary attack rate, and (5) studies that use secondary attack rates to make inferences about infectiousness and susceptibility.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Antibody responses to SARS-CoV-2 in patients with COVID-19
Long, Q.-X., Liu, B.-Z., Deng, H.-J., Wu, G.-C., Deng, K., Chen, Y.-K., Liao, P., Qiu, J.-F., Lin, Y., Cai, X.-F., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0897-1 · Cited by 2,876
Clinical and immunological assessment of asymptomatic SARS-CoV-2 infections
Long, Q.-X., Tang, X.-J., Shi, Q.-L., Li, Q., Deng, H.-J., Yuan, J., Hu, J.-L., Xu, W., Zhang, Y., Lv, F.-J., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0965-6 · Cited by 2,686
Immunological memory to SARS-CoV-2 assessed for up to 8 months after infection.
Dan, J. M., Mateus, J., Kato, Y., Hastie, K. M., Yu, E. D., Faliti, C. E., Grifoni, A., Ramirez, S. I., Haupt, S., Frazier, A., et al. (2021) · Science · doi:10.1126/science.abf4063 · Cited by 2,656
Evolution of antibody immunity to SARS-CoV-2
Gaebler, C., Wang, Z., Lorenzi, J. C. C., Muecksch, F., Finkin, S., Tokuyama, M., Cho, A., Jankovic, M., Schaefer-Babajew, D., Oliveira, T. Y., et al. (2021) · Nature · doi:10.1038/s41586-021-03207-w · Cited by 1,674
Pollán, M., Pérez-Gómez, B., Pastor-Barriuso, R., Oteo, J., Hernán, M. A., Pérez-Olmeda, M., Sanmartín, J. L., Fernández-García, A., Cruz, I., Fernández de Larrea, N., et al. (2020) · The Lancet · doi:10.1016/s0140-6736(20)31483-5 · Cited by 1,639
Negative Controls: A Tool for Detecting Confounding and Bias in Observational Studies
Lipsitch, M., Tchetgen Tchetgen, E., & Cohen, T. (2010) · Epidemiology · doi:10.1097/ede.0b013e3181d61eeb · Cited by 1,583 · cited 1×
“Moreover, negative control outcomes [34] (e.”
Self-citationXu, Y., Li, X., Zhu, B., Liang, H., Fang, C., Gong, Y., Guo, Q., Sun, X., Zhao, D., Shen, J., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-0817-4 · Cited by 1,415 · cited 1×
“Proposed solutions to accurately infer and compare infectiousness include testing stool samples in children because the duration of viral RNA shedding is longer so they are less likely to be misclassified [79, 80]; reporting differences in contact patterns, including activities/behaviors, duration of contact, contact…”
BackgroundEvaluating the Effects of SARS-CoV-2 Spike Mutation D614G on Transmissibility and Pathogenicity
Volz, E., Hill, V., McCrone, J. T., Price, A., Jorgensen, D., O’Toole, Á., Southgate, J., Johnson, R., Jackson, B., Nascimento, F. F., et al. (2021) · Cell · doi:10.1016/j.cell.2020.11.020 · Cited by 1,006
Poverty, inequality and COVID-19: the forgotten vulnerable
Patel, J. A., Nielsen, F. B. H., Badiani, A. A., Assi, S., Unadkat, V. A., Patel, B., Ravindrane, R., & Wardle, H. (2020) · Public Health · doi:10.1016/j.puhe.2020.05.006 · Cited by 882
Seasonal coronavirus protective immunity is short-lasting
Edridge, A. W. D., Kaczorowska, J., Hoste, A. C. R., Bakker, M., Klein, M., Loens, K., Jebbink, M. F., Matser, A., Kinsella, C. M., Rueda, P., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1083-1 · Cited by 767 · cited 1×
“Antibodies to seasonal coronaviruses have been shown to decline substantially within a period of a few months to a year [21].”
BackgroundHealth equity and COVID-19: global perspectives
Shadmi, E., Chen, Y., Dourado, I., Faran-Perach, I., Furler, J., Hangoma, P., Hanvoravongchai, P., Obando, C., Petrosyan, V., Rao, K. D., et al. (2020) · International Journal for Equity in Health · doi:10.1186/s12939-020-01218-z · Cited by 730
Leung, K., Shum, M. H., Leung, G. M., Lam, T. T., & Wu, J. T. (2021) · Eurosurveillance · doi:10.2807/1560-7917.es.2020.26.1.2002106 · Cited by 694
Functional SARS-CoV-2-Specific Immune Memory Persists after Mild COVID-19
Rodda, L. B., Netland, J., Shehata, L., Pruner, K. B., Morawski, P. A., Thouvenel, C. D., Takehara, K. K., Eggenberger, J., Hemann, E. A., Waterman, H. R., et al. (2021) · Cell · doi:10.1016/j.cell.2020.11.029 · Cited by 647
The time course of the immune response to experimental coronavirus infection of man
Callow, K. A., Parry, H. F., Sergeant, M., & Tyrrell, D. A. J. (1990) · Epidemiology and Infection · doi:10.1017/s0950268800048019 · Cited by 598
Addetia, A., Crawford, K. H. D., Dingens, A., Zhu, H., Roychoudhury, P., Huang, M.-L., Jerome, K. R., Bloom, J. D., & Greninger, A. L. (2020) · Journal of Clinical Microbiology · doi:10.1128/jcm.02107-20 · Cited by 525
Association between age and clinical characteristics and outcomes of COVID-19
Liu, Y., Mao, B., Liang, S., Yang, J.-W., Lu, H.-W., Chai, Y.-H., Wang, L., Zhang, L., Li, Q.-H., Zhao, L., et al. (2020) · European Respiratory Journal · doi:10.1183/13993003.01112-2020 · Cited by 427 · cited 1×
“Therefore rates of false negatives are expected to be higher among individuals with less severe disease [8, 16], such as younger individuals [17, 18], individuals who were recently infected and have not yet mounted an antibody response [8, 9], or individuals who were infected long before testing, as antibody titers wa…”
BackgroundRobust SARS-CoV-2-specific T cell immunity is maintained at 6 months following primary infection
Zuo, J., Dowell, A. C., Pearce, H., Verma, K., Long, H. M., Begum, J., Aiano, F., Amin-Chowdhury, Z., Hoschler, K., Brooks, T., et al. (2021) · Nature Immunology · doi:10.1038/s41590-021-00902-8 · Cited by 392
Secondary attack rate and superspreading events for SARS-CoV-2
Liu, Y., Eggo, R. M., & Kucharski, A. J. (2020) · The Lancet · doi:10.1016/s0140-6736(20)30462-1 · Cited by 350 · cited 1×
“1 3 contacts of a primary (index) case within a given time period [56].”
BackgroundReed, S. E. (1984) · Journal of Medical Virology · doi:10.1002/jmv.1890130208 · Cited by 147
Qiu, X., Nergiz, A. I., Maraolo, A. E., Bogoch, I. I., Low, N., & Cevik, M. (2021) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2021.01.011 · Cited by 135
Self-citation
Cited by
Qiu, X., Nergiz, A. I., Maraolo, A. E., Bogoch, I. I., Low, N., & Cevik, M. (2021) · Clinical Microbiology and Infection · doi:10.1016/j.cmi.2021.01.011 · Cited by 135
Self-citation(2022) · doi:10.1371/journal.pmed.1003987 · Cited by 81
(2022) · doi:10.1101/2022.01.20.22269581 · Cited by 13
Metadata
- Authors
- Accorsi, E. K., Qiu, X., Rumpler, E., Kennedy-Shaffer, L., Kahn, R., Joshi, K., Goldstein, E., Stensrud, M. J., Niehus, R., Cevik, M., & Lipsitch, M.
- Venue
- European Journal of Epidemiology
- Published
- 2021-02
- Volume
- 36
- Issue
- 2
- Pages
- 179-196
- ISSN
- 0393-2990 (ISSN-L)
- 1573-7284
- OpenAlex
- W3129344682
- Cited by
- 124
- References
- 20
- FWCI
- 19.21
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.