Laboratory Validation of a Clinical Metagenomic Sequencing Assay for Pathogen Detection in Cerebrospinal Fluid
Open accessPreprint — published as 10.1101/gr.238170.118 · Paper page
The DOI matches its Crossref record; 45 of the 45 references it cites were found in a registry or an index.
Abstract
Metagenomic next-generation sequencing (mNGS) for pan-pathogen detection has been successfully tested in proof-of-concept case studies in patients with acute illness of unknown etiology, but to date has been largely confined to research settings. Here we developed and validated an mNGS assay for diagnosis of infectious causes of meningitis and encephalitis from cerebrospinal fluid (CSF) in a licensed clinical laboratory. A clinical bioinformatics pipeline, SURPI+, was developed to rapidly analyze mNGS data, automatically report detected pathogens, and provide a graphical user interface for evaluating and interpreting results. We established quality metrics, threshold values, and limits of detection of between 0.16 – 313 genomic copies or colony forming units per milliliter for each representative organism type. Gross hemolysis and excess host nucleic acid reduced assay sensitivity; however, a spiked phage used as an internal control was a reliable indicator of sensitivity loss. Diagnostic test accuracy was evaluated by blinded mNGS testing of 95 patient samples, revealing 73% sensitivity and 99% specificity compared to original clinical test results, with 81% positive percent agreement and 99% negative percent agreement after discrepancy analysis. Subsequent mNGS challenge testing of 20 positive CSF samples prospectively collected from a cohort of pediatric patients hospitalized with meningitis, myelitis, and/or encephalitis showed 92% sensitivity and 96% specificity relative to conventional microbiological testing of CSF in identifying the causative pathogen. These results demonstrate the analytic performance of a laboratory-validated mNGS assay for pan-pathogen detection, to be used clinically for diagnosis of neurological infections from CSF.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Figures



Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Nevertheless, several groups have successfully validated mNGS in Clinical Laboratory Improvement Amendments (CLIA)-certified clinical laboratories for the diagnosis of infections, including meningitis or encephalitis36,37, sepsis33,57 and pneumonia58, and these assays are now available for clinical reference testing of patients.”
From Clinical metagenomics (2019) · cites this paper as [36]
In the citing paper
“A limitation of mNGS is that the sensitivity of the approach is critically dependent on the level of background. Tissues, for example, have increased human host background relative to cell-free body fluids, resulting in a reduced number and proportion of microbial reads and hence a decrease in mNGS sensitivity33,36,37.”
From Clinical metagenomics (2019) · cites this paper as [36]
In the citing paper
“Receiver–operator curve (ROC) analysis is a useful tool to determine optimal threshold values for a training set of clinical samples with known results, with verification of pre-established thresholds using an independent validation set36.”
From Clinical metagenomics (2019) · cites this paper as [36]
In the citing paper
“Ongoing monitoring is particularly important for mNGS assays to verify acceptable performance over time and to investigate atypical findings36.”
From Clinical metagenomics (2019) · cites this paper as [36]
In the citing paper
“Performance validation and verification for bioinformatics analysis constitute a time-consuming endeavour and include analysis of control and patient data sets and comparisons, with orthogonal clinical testing to determine the accuracy of the final result36.”
From Clinical metagenomics (2019) · cites this paper as [36]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Basic local alignment search tool
Altschul, S. F., Gish, W., Miller, W., Myers, E. W., & Lipman, D. J. (1990) · Journal of Molecular Biology · doi:10.1006/jmbi.1990.9999 · Cited by 98,669
Fast gapped-read alignment with Bowtie 2
Langmead, B., & Salzberg, S. L. (2012) · Nature Methods · doi:10.1038/nmeth.1923 · Cited by 56,400
Cutadapt removes adapter sequences from high-throughput sequencing reads
Martin, M. (2011) · EMBnet.journal · doi:10.14806/ej.17.1.200 · Cited by 33,889
Quality control and preprocessing of metagenomic datasets
Schmieder, R., & Edwards, R. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr026 · Cited by 5,072
Reagent and laboratory contamination can critically impact sequence-based microbiome analyses
Salter, S. J., Cox, M. J., Turek, E. M., Calus, S. T., Cookson, W. O., Moffatt, M. F., Turner, P., Parkhill, J., Loman, N. J., & Walker, A. W. (2014) · BMC Biology · doi:10.1186/s12915-014-0087-z · Cited by 3,463
Clinical Metagenomic Next-Generation Sequencing for Pathogen Detection
Gu, W., Miller, S., & Chiu, C. Y. (2019) · Annual Review of Pathology: Mechanisms of Disease · doi:10.1146/annurev-pathmechdis-012418-012751 · Cited by 1,458
Self-citationGranerod, J., Ambrose, H. E., Davies, N. W., Clewley, J. P., Walsh, A. L., Morgan, D., Cunningham, R., Zuckerman, M., Mutton, K. J., Solomon, T., et al. (2010) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(10)70222-x · Cited by 1,358
Clinical Metagenomic Sequencing for Diagnosis of Meningitis and Encephalitis
Wilson, M. R., Sample, H. A., Zorn, K. C., Arevalo, S., Yu, G., Neuhaus, J., Federman, S., Stryke, D., Briggs, B., Langelier, C., et al. (2019) · New England Journal of Medicine · doi:10.1056/nejmoa1803396 · Cited by 1,067
Self-citationActionable Diagnosis of Neuroleptospirosis by Next-Generation Sequencing
Wilson, M. R., Naccache, S. N., Samayoa, E., Biagtan, M., Bashir, H., Yu, G., Salamat, S. M., Somasekar, S., Federman, S., Miller, S., et al. (2014) · New England Journal of Medicine · doi:10.1056/nejmoa1401268 · Cited by 977
Self-citationSimner, P. J., Miller, S., & Carroll, K. C. (2018) · Clinical Infectious Diseases · doi:10.1093/cid/cix881 · Cited by 821
Self-citation
Research works printed but not linked: 1
- Meiser KL. 2002. Reporting results from studies evaluating diagnostic tests. In Clinical Microbiology Newsletter, Vol 24 (ed. FaD Administration), pp. 60-63. Elsevier, Inc.
Cited by
Items 601–662 of 662
Cai, H., Chen, H.-B., Wang, J.-H., Wh, W., & Tang, D. (2026) · BMC Pulmonary Medicine · doi:10.21203/rs.3.rs-9941047/v1
Clinical utility of metagenomic next-generation sequencing in infants with severe infections
Gao, Y., Huang, Y., Li, W., Huang, Y., Zhao, X., Chu, C., Zhang, X., Chen, J., Wang, Y., Li, Y., et al. (2026) · Frontiers in Microbiology · doi:10.3389/fmicb.2026.1842600
Xu, Y., Ren, R., Liu, W., Liu, L., Cui, X., Guo, J., & Li, S. (2026) · Microbiology Spectrum · doi:10.1128/spectrum.00374-26
Li, X., Zeng, L., Liu, Q., Yang, S., & Li, Z. (2026) · Research Square · doi:10.21203/rs.3.rs-10352170/v1
Liu, X., Fan, X., Wu, W., Ni, W., Hu, Y., Yang, Q., Wei, J., Fang, Y., Chen, X., Yang, J., et al. (2026) · Microbiology Spectrum · doi:10.1128/spectrum.04057-25
Zhang, Y., Li, Z., Sun, X., Wang, C., & Yu, Z. (2026) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2026.1772516
Gao, S., Song, L., Feng, Q., Li, Y., Liang, H., Lei, K., Li, Z., & Kisembo, P. (2026) · Experimental and Therapeutic Medicine · doi:10.3892/etm.2026.13262
Yang, J., He, L., Wang, J., Ren, T., Wang, H., & Wang, Y. (2026) · Experimental and Therapeutic Medicine · doi:10.3892/etm.2026.13267
Tozluyurt, A., & Acar, A. (2026) · Naunyn-Schmiedeberg s Archives of Pharmacology · doi:10.1007/s00210-026-05799-4
Griggio, L. B., Akiyama, V. S., Suptil, T., Vera, S. G. M., Felix, S. A. B., Pedroso, R., Vicente, L. D. O., Dourado, H. C. M., Evangelista, G. G., de Oliveira, C. V. L., et al. (2025) · Revista de Medicina Familiar y Comunidad · doi:10.66476/mf.v2n2.6273
RECENT ADVANCES IN DIAGNOSTIC TECHNIQUES FOR INFECTIOUS DISEASES
SAHAR ALASMAR ALAZMI, M. A. A., ALKHARASHI, M. A., ALAUJAN, A. A. A., AL-ESSA, H. O., ALSHANWANY, J. E., SOULAN, S. A., ALSHEBAYLI, B. A., MOUSA, S. M., ALGEZANI, M. S., & ALANAZI, F. T. (2024) · TPM Testing, psychometrics, methodology in applied psychology · doi:10.5281/zenodo.21988747
Behruznia, M., Cumley, N., Quarton, S., McGee, K. C., Jeff, C., Hatton, C., THICKETT, D. R., Parekh, D., Sapey, E., & McNally, A. (2026) · medRxiv · doi:10.64898/2026.08.18.26360573
Metagenomic next-generation sequencing in the diagnosis of viral encephalitis
Binay, U. D., Karakeçili, F., Barkay, O., & Sümer, B. (2026) · World Journal of Virology · doi:10.5501/wjv.124097
Guo, C., An, Y., Ye, J., Ma, Y., Zhao, Q., Wang, L., Ma, W., Zhang, M., Wang, M., Wang, Y., et al. (2026) · Frontiers in Public Health · doi:10.3389/fpubh.2026.1921801
Xu, Z., Wang, Y., Zhang, X., Guo, F., Chen, J., Geng, H., Li, Y., & Gao, Y. (2026) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2026.1868295
Gauthier, N. P. G., Kapoor, V., Gaston, D. C., Prasad, N., Nwaobia, P., Kraft, C. S., & Mittar, D. (2026) · Journal of Clinical Microbiology · doi:10.1128/jcm.00987-26
Silva, Í. T. S. D. S., Jimenez‐Vasquez, V., Rojas, N., Lope‐Pari, P., Barcena, L., Cáceres, O., Huaringa, M., Otárola, J., Balbuena, J., Marcos-Carbajal, P., et al. (2026) · Microbiology Research · doi:10.3390/microbiolres17090178
Dupuis, C., Perrin, H., Morel, E., & Martin, T. (2026) · Journal of Medical Sciences and Interdisciplinary Research · doi:10.51847/j0drdh5j9d
Chan, M., Toh, K. Y., Foo, K., Saravanan, N., Toh, T. S., Lim, L., Chionh, Y. T., Chang, J. H., & Wu, M. (2026) · medRxiv · doi:10.64898/2026.09.15.26363106
Sanderson, D., & Bennypaul, H. (2026) · Journal of Virological Methods · doi:10.1016/j.jviromet.2026.115472
Ding, L., Wang, H., & Li, F. (2026) · Frontiers in Medicine · doi:10.3389/fmed.2026.1941314
Trunfio, M. (n.d.) · Institutional Research Information System University of Turin (University of Turin)
Yang, L., Guo, C., Zhao, Q., 杨继勇, Zhang, H., Zhai, Y., & Ma, Y. (2026) · Frontiers in Microbiology · doi:10.3389/fmicb.2026.1979614
Socha, W., Krzysiak, M. K., Moniuszko, E., Kulik, P., Tomana, J., & Larska, M. (2026) · Viruses · doi:10.3390/v18101118
Wang, S., Li, J., Zhang, W., Wang, W., Dai, S., & Ma, L. (2026) · Research Square · doi:10.21203/rs.3.rs-11034431/v1
Lee, Y., Min, E., Park, Y. J., Kim, D.-G., Joo, D. J., Kim, M. S., Shin, S., Lee, S.-T., Lee, J. G., & Jeong, S. J. (2026) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2026.1930701
Bratosin, F., Branea, H. S., & Hogea, E. (2026) · Diagnostics · doi:10.3390/diagnostics16203375
Optimizing Pathogen Detection in Clinical Metagenomics
Ma, J., Hao, T., Bai, Y., Xiao, L., Yang, Q., Dai, P., & Wang, H. (2026) · Journal of Molecular Diagnostics · doi:10.1016/j.jmoldx.2026.09.003
Clinical utility of metagenomic sequencing in patients with febrile illness
Slunečko, J. (2026) · Repository of the University of Ljubljana (University of Ljubljana)
Feng, S., Liu, J., Zhang, X., Zhang, L., Zhao, S., Jiang, N., Cai, J., Zheng, Y., Gai, W., & Xu, C. (2026) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2026.1919428
Clinical pathogen adjudication in metagenomic sequencing using a large language modelPreprint
Wei, M., Zhao, Y., Fang, C., Zhang, S., Xu, K., Li, S., Liu, L., Pang, Y., Liang, L., Deng, Z., et al. (2026) · medRxiv · doi:10.64898/2026.10.16.26361411
Deng, H., Chen, K., & Chen, K. (2026) · Frontiers in Pediatrics · doi:10.3389/fped.2026.1900220
Zhang, H., Lai, X., Chen, C., Yan, X., Sun, J., Zheng, Y., Weng, Z., He, H., Xie, G., Lin, Y., et al. (2026) · International Journal of Infectious Diseases · doi:10.1016/j.ijid.2026.109192
Salam, J. U., Yousaf, M., Mir, B. A., & Lee, S. W. (2026) · Quality Management in Health Care · doi:10.1097/qmh.0000000000000600
Wei, L., Deng, W., Zhu, L., Zhang, R., Ye, Y., Zhao, C., Liu, J., Yang, Y., & He, J. (2026) · Viruses · doi:10.3390/v18111199
Culture-independent strain typing of Clostridioides difficile in fecal samples
Son, S. S., Ramaswamy, R., Blanco‐Míguez, A., Punčochář, M., Mengoni, C., Burgo, V., Smith, R. C., Woodson, C., Metcalfe, C. K., McSpadden, E., et al. (2026) · Nature Communications · doi:10.1038/s41467-026-78952-5
Accuracy of plasma cell-free DNA PCR versus mNGS for non-invasive diagnosis of invasive mold disease
Pusz-Bochenska, K., Murugesan, K., Senchyna, F., Lalljie, A., Budvytiene, I., & Banaei, N. (2026) · Journal of Clinical Microbiology · doi:10.1128/jcm.01175-26
Maamari, R. G., Williams, T. G. S., Zheng, C., Hack, B., Tomkins, O. M., Bakrania, P., Thangarajah, R., Ringue, I., Storey, N., Brown, J. R., et al. (2026) · The Lancet Infectious Diseases · doi:10.1016/s1473-3099(26)00479-2
Guo, K., Sun, Y., Deng, J., Tang, J., Zhao, J., Zhang, X., Yan, Y., 袁令民, Zhang, Y., Qiu, C., et al. (2026) · Frontiers in Cellular and Infection Microbiology · doi:10.3389/fcimb.2026.1918785
Muthanje, E. M., Kimita, G., Nyataya, J., Njue, W., Mulili, C., Mugweru, J., Mutai, B., Kituyi, S. N., & Waitumbi, J. (2022) · doi:10.1371/journal.pgph.0000122.r003
Gao, P., Fan, Y., Kong, X., Zhang, R., Chen, L., Jiang, Y., Liu, Y., Zhao, M., Deng, G., Cao, Y., et al. (2023) · doi:10.3389/fmicb.2023.1249085.s001
Wang, C., Yan, D., Huang, J., Yang, N., Shi, J., Pan, S., Lin, G., Liu, Y., Zhang, Y., Bian, X., et al. (2022) · doi:10.3389/fcimb.2022.957073.s001
Hou, Y., Zhang, M., Jiang, Q., Yang, Y., Liu, J., Yuan, K., Sun, Z., & Liu, X. (2023) · doi:10.3389/fcimb.2023.1169101.s002
Jiang, Z., Gai, W., Zhang, X., Zheng, Y., Jin, X., Han, Z., Ao, G., He, J., Shu, D., Liu, X., et al. (2024) · doi:10.3389/fcimb.2024.1345706.s002
Du, Y., Li, X., Liu, Y., Mu, S., Shen, D., Fan, S., Lou, Z., Zhang, S., Xia, H., Yuan, Y., et al. (2022) · doi:10.3389/fmicb.2022.919169.s003
Deng, W., Xu, H., Wu, Y., & Li, J. (2022) · doi:10.3389/fcimb.2022.950531.s001
Sun, H., Wang, F., Zhang, M., Xu, X., Li, M., Gao, W., Wu, X., Han, H., Wang, Q., Yao, G., et al. (2022) · doi:10.3389/fcimb.2022.872813.s001
Fan, S., Si, M., Xu, N., Yan, M., Pang, M., Liu, G., Gong, J., & Wang, H. (2022) · doi:10.3389/fmicb.2022.927842.s001
Hou, F., Qiao, Y., Qiao, Y., Shi, Y., Chen, M., Kong, M., Hu, X., Jiang, L., & Liu, X. (2025) · doi:10.3389/fcimb.2025.1530486.s001
Jia, K., Huang, S., Shen, C., Li, H., Zhang, Z., Wang, L., Zhao, G., Wu, Z., Lin, Y., Xia, H., et al. (2023) · doi:10.3389/fcimb.2023.1119020.s002
Orf, G. S., Ahouidi, A. D., Mata, M., Diedhiou, C., Mboup, A., Padane, A., Manga, N. M., Lawson, A. T. D.-D., Averhoff, F., Berg, M. G., et al. (2024) · doi:10.3389/fmicb.2024.1362714.s001
Sun, N., Chen, Y., Zhang, J., Cao, J., Huang, H., Wang, J., Guo, W., & Li, X. (2023) · doi:10.3389/fmicb.2023.1185216.s001
Zhang, S., Wu, G., Shi, Y., Liu, T., Xu, L., Dai, Y., Chang, W., & Ma, X. (2022) · doi:10.3389/fcimb.2022.979086.s001
Qu, C., Chen, Y., Ouyang, Y., Huang, W., Liu, F., Yan, L., Lu, R., Zeng, Y., & Liu, Z. (2022) · doi:10.3389/fneur.2022.989280.s004
Qu, Y., Ding, W., Liu, S., Wang, X., Wang, P., Liu, H., Xia, H., Chen, Y., & Jiang, H. (2022) · doi:10.3389/fmicb.2022.868160.s001
He, P., Wang, J., Ke, R., Zhang, W., Ning, P., Zhang, D., Yang, X., Shi, H., Fang, P., Ming, Z., et al. (2022) · doi:10.3389/fcimb.2022.1042945.s001
Xu, Y., Jiang, Y., Wang, Y., Meng, F., Qin, W., & Lin, Y. (2023) · doi:10.3389/fcimb.2023.1220943.s005
Liu, H., Zhang, Y., Chen, G., Sun, S., Wang, J., Chen, F., Liu, C., & Zhuang, Q. (2022) · doi:10.3389/fmed.2022.807174.s001
Liu, Q., Liu, X., Hu, B., Xu, H., Sun, R., Li, P., Zhang, Y., Yang, H., Ma, N., & Sun, X. (2023) · doi:10.3389/fcimb.2023.1192931.s001
Jiang, X., Yan, J., Huang, H., Ai, L., Yu, X., Zhong, P., Chen, Y., Liang, Z., Qiu, W., Huang, H., et al. (2023) · doi:10.3389/fgene.2023.1266990.s001
Wang, J., Wang, R., Yin, Y., Cheng, J., Wang, Y., Liu, S., Zhang, X., Tu, S., Guo, Y., Wang, Q., et al. (2026) · Open Forum Infectious Diseases · doi:10.1093/ofid/ofag724
Metadata
- Authors
- Miller, S., Naccache, S., Samayoa, E., Messacar, K., Arevalo, S., Federman, S., Stryke, D., Pham, E., Fung, B., Bolosky, W., Ingebrigtsen, D., Lorizio, W., Paff, S., Leake, J., Pesano, R., DeBiasi, R., Dominguez, Sr., & Chiu, C.
- Affiliations
- University of California, San Francisco (US)
- Children's Hospital Colorado (US)
- Quest Diagnostics (United States) (US)
- Venue
- Genome Research
- Publisher
- openRxiv
- Published
- 2018-05-25
- Volume
- 29
- Issue
- 5
- Pages
- 831-842
- ISSN
- 1088-9051 (ISSN-L)
- PMC
- PMC6499319
- OpenAlex
- W2951983907
- Cited by
- 583
- References
- 45
- Citations by year
- 2026: 56 · 2025: 109 · 2024: 96 · 2023: 87 · 2022: 94 · 2021: 61 · 2020: 49 · 2019: 29 · 2018: 2
- Type
- posted content
- Language
- en
- Open access
- bronze
- doi.org
- Locations
- Genome Research (publishedVersion)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- Europe PMC (PubMed Central) (publishedVersion, cc-by-nc)
- PubMed Central (publishedVersion, cc-by-nc)
- PubMed (publishedVersion)
- eScholarship (California Digital Library) (submittedVersion, cc-by-nc)
- HighWire Press Open Archive (submittedVersion)
- Funders
- Abbott Laboratories
- National Institutes of Health (4r33ai120977-03, R21/R33, UL1TR000004, UL1TR002535, TR000004, R21/R33 AI120977)
- University of California, San Francisco (TR000004, UL1-TR000004)
- Abbott Diagnostics
- National Heart, Lung, and Blood Institute (R01HL105704, U54HL119893)
- National Institute of Allergy and Infectious Diseases (R33-AI120977, R21AI120977)
- National Center for Advancing Translational Sciences (TR000004, UCSF-CTSI grant UL1 TR000004)
- Topics
- Health Sciences › Medicine › Microbiology (medical) › Bacterial Identification and Susceptibility Testing
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
- Life Sciences › Immunology and Microbiology › Microbiology › Bacterial Infections and Vaccines
- Keywords
- metagenomic next-generation sequencing, cerebrospinal fluid, meningitis, encephalitis, myelitis, diagnostic accuracy, detection limit, hemolysis, clinical microbiology
- MeSH terms
- Child, Encephalitis, Humans, Meningitis, Aseptic, Myelitis, Sensitivity and Specificity, Viruses, Computational Biology, Metagenomics, High-Throughput Nucleotide Sequencing
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.