Quantitative Framework for Model Evaluation in Microbiology Research Using Pseudomonas aeruginosa and Cystic Fibrosis Infection as a Test Case
Open accessThe DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Abstract
Laboratory models have become a cornerstone of modern microbiology. However, the accuracy of even the most commonly used models has never been evaluated. Here, we propose a quantitative framework based on gene expression data to evaluate model performance and apply it to models of Pseudomonas aeruginosa cystic fibrosis lung infection. We discovered that these models captured different aspects of P. aeruginosa infection physiology, and we identify which functional categories are and are not captured by each model. These methods will provide researchers with a solid basis to choose among laboratory models depending on the scientific question of interest and will help improve existing experimental models.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2
Love, M. I., Huber, W., & Anders, S. (2014) · Genome Biology · doi:10.1186/s13059-014-0550-8 · Cited by 95,106
UpSetR: an R package for the visualization of intersecting sets and their properties
Conway, J. R., Lex, A., & Gehlenborg, N. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx364 · Cited by 3,586
Lung Infections Associated with Cystic Fibrosis
Lyczak, J. B., Cannon, C. L., & Pier, G. B. (2002) · Clinical Microbiology Reviews · doi:10.1128/cmr.15.2.194-222.2002 · Cited by 1,628
Mouse Models of Human Disease: An Evolutionary Perspective
Perlman, R. L. (2016) · Evolution, Medicine, and Public Health · doi:10.1093/emph/eow014 · Cited by 647 · cited 1×
“laboratory models because they are thought to approximate the chemical and physical environment of human infections, especially in terms of the host immune response (34).”
Decade-long bacterial community dynamics in cystic fibrosis airways
Zhao, J., Schloss, P. D., Kalikin, L. M., Carmody, L. A., Foster, B. K., Petrosino, J. F., Cavalcoli, J. D., VanDevanter, D. R., Murray, S., Li, J. Z., et al. (2012) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1120577109 · Cited by 599
Essential genome of Pseudomonas aeruginosa in cystic fibrosis sputum
Turner, K. H., Wessel, A. K., Palmer, G. C., Murray, J. L., & Whiteley, M. (2015) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1419677112 · Cited by 432
Self-citationHendricks, M. R., Lashua, L. P., Fischer, D. K., Flitter, B. A., Eichinger, K. M., Durbin, J. E., Sarkar, S. N., Coyne, C. B., Empey, K. M., & Bomberger, J. M. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1516979113 · Cited by 168
Self-citation
Cited by
The biofilm life cycle: expanding the conceptual model of biofilm formation
Sauer, K., Stoodley, P., Goeres, D. M., Hall-Stoodley, L., Burmølle, M., Stewart, P. S., & Bjarnsholt, T. (2022) · Nature Reviews Microbiology · doi:10.1038/s41579-022-00767-0 · Cited by 1,404
Pseudomonas aeruginosa: ecology, evolution, pathogenesis and antimicrobial susceptibility
Letizia, M., Diggle, S. P., & Whiteley, M. (2025) · Nature Reviews Microbiology · doi:10.1038/s41579-025-01193-8 · Cited by 231
Self-citationGrace, A., Sahu, R., Owen, D. R., & Dennis, V. A. (2022) · Frontiers in Microbiology · doi:10.3389/fmicb.2022.1023523 · Cited by 170
A Pseudomonas aeruginosa small RNA regulates chronic and acute infection
Cao, P., Fleming, D., Moustafa, D. A., Dolan, S. K., Szymanik, K. H., Redman, W. K., Ramos, A., Diggle, F. L., Sullivan, C. S., Goldberg, J. B., et al. (2023) · Nature · doi:10.1038/s41586-023-06111-7 · Cited by 116
Self-citationR-pyocins as targeted antimicrobials against Pseudomonas aeruginosa
Mei, M., Estrada, I., Diggle, S. P., & Goldberg, J. B. (2025) · npj Antimicrobials and Resistance · doi:10.1038/s44259-025-00088-1 · Cited by 20
Metadata
- Authors
- Cornforth, D. M., Diggle, F. L., Melvin, J. A., Bomberger, J. M., & Whiteley, M.
- Venue
- mBio
- Publisher
- American Society for Microbiology
- Published
- 2020-02-25
- Volume
- 11
- Issue
- 1
- ISSN
- 2150-7511 (ISSN-L)
- 2161-2129
- OpenAlex
- W2999796954
- Cited by
- 130
- References
- 7
- FWCI
- 5.39
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.