Generalisable long COVID subtypes: findings from the NIH N3C and RECOVER programmes
Open accessThe DOI matches its Crossref record; 14 of the 14 references it cites were found in a registry or an index.
Abstract
BACKGROUND: Stratification of patients with post-acute sequelae of SARS-CoV-2 infection (PASC, or long COVID) would allow precision clinical management strategies. However, long COVID is incompletely understood and characterised by a wide range of manifestations that are difficult to analyse computationally. Additionally, the generalisability of machine learning classification of COVID-19 clinical outcomes has rarely been tested. METHODS: We present a method for computationally modelling PASC phenotype data based on electronic healthcare records (EHRs) and for assessing pairwise phenotypic similarity between patients using semantic similarity. Our approach defines a nonlinear similarity function that maps from a feature space of phenotypic abnormalities to a matrix of pairwise patient similarity that can be clustered using unsupervised machine learning. FINDINGS: We found six clusters of PASC patients, each with distinct profiles of phenotypic abnormalities, including clusters with distinct pulmonary, neuropsychiatric, and cardiovascular abnormalities, and a cluster associated with broad, severe manifestations and increased mortality. There was significant association of cluster membership with a range of pre-existing conditions and measures of severity during acute COVID-19. We assigned new patients from other healthcare centres to clusters by maximum semantic similarity to the original patients, and showed that the clusters were generalisable across different hospital systems. The increased mortality rate originally identified in one cluster was consistently observed in patients assigned to that cluster in other hospital systems. INTERPRETATION: Semantic phenotypic clustering provides a foundation for assigning patients to stratified subgroups for natural history or therapy studies on PASC. FUNDING: NIH (TR002306/OT2HL161847-01/OD011883/HG010860), U.S.D.O.E. (DE-AC02-05CH11231), Donald A. Roux Family Fund at Jackson Laboratory, Marsico Family at CU Anschutz.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Multiple comparisons among means
Dunn, O. J. (1961) · Journal of the American Statistical Association · doi:10.1080/01621459.1961.10482090 · Cited by 5,006
Nalbandian, A., Sehgal, K., Gupta, A., Madhavan, M. V., McGroder, C., Stevens, J. S., Cook, J. R., Nordvig, A. S., Shalev, D., Sehrawat, T. S., et al. (2021) · Nature Medicine · doi:10.1038/s41591-021-01283-z · Cited by 4,862
Characterizing long COVID in an international cohort: 7 months of symptoms and their impact
Davis, H. E., Assaf, G. S., McCorkell, L., Wei, H., Low, R. J., Re'em, Y., Redfield, S., Austin, J. P., & Akrami, A. (2021) · eClinicalMedicine · doi:10.1016/j.eclinm.2021.101019 · Cited by 2,881
Self-citationAttributes and predictors of long COVID
Sudre, C. H., Murray, B., Varsavsky, T., Graham, M. S., Penfold, R. S., Bowyer, R. C., Pujol, J. C., Klaser, K., Antonelli, M., Canas, L. S., et al. (2021) · Nature Medicine · doi:10.1038/s41591-021-01292-y · Cited by 2,707
Long covid—mechanisms, risk factors, and management
Crook, H., Raza, S., Nowell, J., Young, M., & Edison, P. (2021) · BMJ · doi:10.1136/bmj.n1648 · Cited by 1,655
High-dimensional characterization of post-acute sequelae of COVID-19
Al-Aly, Z., Xie, Y., & Bowe, B. (2021) · Nature · doi:10.1038/s41586-021-03553-9 · Cited by 1,518 · cited 1×
“54 We suggest that analogous algorithms could be used to evaluate data gathered from prospective studies of long COVID patients to extend and deepen our characterization of phenotypic clusters by including data that are currently dif fi cult to ascertain reliably from EHR data, including symptoms…”
Long COVID or post-COVID-19 syndrome: putative pathophysiology, risk factors, and treatments
Yong, S. J. (2021) · Infectious Diseases · doi:10.1080/23744235.2021.1924397 · Cited by 1,339
Multiple early factors anticipate post-acute COVID-19 sequelae
Su, Y., Yuan, D., Chen, D. G., Ng, R. H., Wang, K., Choi, J., Li, S., Hong, S., Zhang, R., Xie, J., et al. (2022) · Cell · doi:10.1016/j.cell.2022.01.014 · Cited by 1,156
The human phenotype ontology: a tool for annotating and analyzing human hereditary disease
Robinson, P. N., Köhler, S., Bauer, S., Seelow, D., Horn, D., & Mundlos, S. (2008) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2008.09.017 · Cited by 1,034
Self-citationRaveendran, A. V., Jayadevan, R., & Sashidharan, S. (2021) · Diabetes & Metabolic Syndrome: Clinical Research & Reviews · doi:10.1016/j.dsx.2021.04.007 · Cited by 921 · cited 2×
“The mean similarity score for the randomly permuted clusters was never as high as the observed score over 1000 permutations, corresponding to an empirical p -value of less than 0.001 for each of the data partners 2 – 6.”
Influential100,000 Genomes Pilot on Rare-Disease Diagnosis in Health Care — Preliminary Report
The 100, 0. G. P. P. I. (2021) · New England Journal of Medicine · doi:10.1056/nejmoa2035790 · Cited by 716
Clinical Diagnostics in Human Genetics with Semantic Similarity Searches in Ontologies
Köhler, S., Schulz, M. H., Krawitz, P., Bauer, S., Dölken, S., Ott, C. E., Mundlos, C., Horn, D., Mundlos, S., & Robinson, P. N. (2009) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2009.09.003 · Cited by 590
Self-citationThe National COVID Cohort Collaborative (N3C): Rationale, design, infrastructure, and deployment
Haendel, M. A., Chute, C. G., Bennett, T. D., Eichmann, D. A., Guinney, J., Kibbe, W. A., Payne, P. R. O., Pfaff, E. R., Robinson, P. N., Saltz, J. H., et al. (2021) · Journal of the American Medical Informatics Association · doi:10.1093/jamia/ocaa196 · Cited by 553
Self-citationCharacterizing long COVID: deep phenotype of a complex condition
Deer, R. R., Rock, M. A., Vasilevsky, N., Carmody, L., Rando, H., Anzalone, A. J., Basson, M. D., Bennett, T. D., Bergquist, T., Boudreau, E. A., et al. (2021) · EBioMedicine · doi:10.1016/j.ebiom.2021.103722 · Cited by 200
Self-citation
Cited by
Development of a Definition of Postacute Sequelae of SARS-CoV-2 Infection
Thaweethai, T., Jolley, S. E., Karlson, E. W., Levitan, E. B., Levy, B., McComsey, G. A., McCorkell, L., Nadkarni, G. N., Parthasarathy, S., Singh, U., et al. (2023) · JAMA · doi:10.1001/jama.2023.8823 · Cited by 842
Self-citationLong COVID science, research and policy
Al-Aly, Z., Davis, H., McCorkell, L., Soares, L., Wulf-Hanson, S., Iwasaki, A., & Topol, E. J. (2024) · Nature Medicine · doi:10.1038/s41591-024-03173-6 · Cited by 538
Self-citationGreenhalgh, T., Sivan, M., Perlowski, A., & Nikolich, J. Ž. (2024) · The Lancet · doi:10.1016/s0140-6736(24)01136-x · Cited by 502
The Human Phenotype Ontology in 2024: phenotypes around the world
Gargano, M. A., Matentzoglu, N., Coleman, B., Addo-Lartey, E. B., Anagnostopoulos, A. V., Anderton, J., Avillach, P., Bagley, A. M., Bakštein, E., Balhoff, J. P., et al. (2024) · Nucleic Acids Research · doi:10.1093/nar/gkad1005 · Cited by 410
“A recent effort extracted phenotypic features for long COVID patients, and applied ML to define subtypes of long COVID ( 34 ,55 ).”
MethodSelf-citationAltmann, D. M., Whettlock, E. M., Liu, S., Arachchillage, D. J., & Boyton, R. J. (2023) · Nature Reviews Immunology · doi:10.1038/s41577-023-00904-7 · Cited by 389
Metadata
- Authors
- Reese, J. T., Blau, H., Casiraghi, E., Bergquist, T., Loomba, J. J., Callahan, T. J., Laraway, B., Antonescu, C., Coleman, B., Gargano, M., Wilkins, K. J., Cappelletti, L., Fontana, T., Ammar, N., Antony, B., Murali, T. M., Caufield, J. H., Karlebach, G., McMurry, J. A., Williams, A., Moffitt, R., Banerjee, J., Solomonides, A. E., Davis, H., Kostka, K., Valentini, G., Sahner, D., Chute, C. G., Madlock-Brown, C., Haendel, M. A., Robinson, P. N., Spratt, H., Visweswaran, S., Flack, J. E., Yoo, Y. J., Gabriel, D., Alexander, G. C., Mehta, H. B., Liu, F., Miller, R. T., Wong, R., Hill, E. L., Thorpe, L. E., & Divers, J.
- Venue
- eBioMedicine
- Publisher
- Elsevier BV
- Published
- 2023-01
- Volume
- 87
- Pages
- 104413
- ISSN
- 2352-3964 (ISSN-L)
- OpenAlex
- W4312061512
- Cited by
- 169
- References
- 14
- FWCI
- 18.06
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.