SERGIO: A Single-Cell Expression Simulator Guided by Gene Regulatory Networks
Open accessThe DOI matches its Crossref record; 39 of the 39 references it cites were found in a registry or an index.
Abstract
A common approach to benchmarking of single-cell transcriptomics tools is to generate synthetic datasets that statistically resemble experimental data. However, most existing single-cell simulators do not incorporate transcription factor-gene regulatory interactions that underlie expression dynamics. Here, we present SERGIO, a simulator of single-cell gene expression data that models the stochastic nature of transcription as well as regulation of genes by multiple transcription factors according to a user-provided gene regulatory network. SERGIO can simulate any number of cell types in steady state or cells differentiating to multiple fates. We show that datasets generated by SERGIO are statistically comparable to experimental data generated by Illumina HiSeq2000, Drop-seq, Illumina 10X chromium, and Smart-seq. We use SERGIO to benchmark several single-cell analysis tools, including GRN inference methods, and identify Tcf7, Gata3, and Bcl11b as key drivers of T cell differentiation by performing in silico knockout experiments. SERGIO is freely available for download here: https://github.com/PayamDiba/SERGIO.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
UMAP: Uniform Manifold Approximation and Projection
McInnes, L., Healy, J., Saul, N., & Großberger, L. (2018) · Journal of Open Source Software · doi:10.21105/joss.00861 · Cited by 9,826 · cited 13×
“We used PCA to reduce the dimensionality of these data to the first 10 PCs, and then applied UMAP to obtain a two dimensional representation of single cells.”
InfluentialSCANPY: large-scale single-cell gene expression data analysis
Wolf, F. A., Angerer, P., & Theis, F. J. (2018) · Genome Biology · doi:10.1186/s13059-017-1382-0 · Cited by 8,881 · cited 2×
“Several studies offering novel analysis tools use in-house simulators to benchmark those tools (Van den Berge et al., 2018; Campbell and Yau, 2018; Chen et al., 2020; Gong et al., 2019; Korthauer et al., 2016; Risso et al., 2018; Wolf et al., 2018), while other studies specifically develop simulators for use by the co…”
Trapnell, C., Cacchiarelli, D., Grimsby, J., Pokharel, P., Li, S., Morse, M., Lennon, N. J., Livak, K. J., Mikkelsen, T. S., & Rinn, J. L. (2014) · Nature Biotechnology · doi:10.1038/nbt.2859 · Cited by 7,314 · cited 1×
“Trajectory inference in differentiation data sets allows researchers to assign a (partial) ordering among single cells along the differentiation trajectories, resulting in assignment of a so-called “pseudotime” value to the cell (Trapnell et al., 2014).”
Spatial reconstruction of single-cell gene expression data
Satija, R., Farrell, J. A., Gennert, D., Schier, A. F., & Regev, A. (2015) · Nature Biotechnology · doi:10.1038/nbt.3192 · Cited by 7,055 · cited 1×
“These tools, developed for a wide array of tasks such as clustering (Aibar et al., 2017; Kiselev et al., 2017; Satija et al., 2015), trajectory inference (Herring et al.”
Scenic: single-cell regulatory network inference and clustering.
Aibar, S., González-Blas, C. B., Moerman, T., Huynh-Thu, V. A., Imrichova, H., Hulselmans, G., Rambow, F., Marine, J.-C., Geurts, P., Aerts, J., et al. (2017) · Nature Methods · doi:10.1038/nmeth.4463 · Cited by 6,520
McCarthy, D. J., Chen, Y., & Smyth, G. K. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks042 · Cited by 5,195
La Manno, G., Soldatov, R., Zeisel, A., Braun, E., Hochgerner, H., Petukhov, V., Lidschreiber, K., Kastriti, M. E., Lönnerberg, P., Furlan, A., et al. (2018) · Nature · doi:10.1038/s41586-018-0414-6 · Cited by 4,118
Cell types in the mouse cortex and hippocampus revealed by single-cell RNA-seq
Zeisel, A., Muñoz-Manchado, A. B., Codeluppi, S., Lönnerberg, P., La Manno, G., Juréus, A., Marques, S., Munguba, H., He, L., Betsholtz, C., et al. (2015) · Science · doi:10.1126/science.aaa1934 · Cited by 3,124 · cited 12×
“We obtained the raw mouse cortex data set (Zeisel et al., 2015) from Gene Expression Omnibus (GEO) with accession GSE60361.”
InfluentialSingle-cell transcriptomics of 20 mouse organs creates a Tabula Muris
The Tabula Muris Consortium, coordination, O., coordination, L., processing, O. C. A., sequencing, L. P. A., analysis, C. D., annotation, C. T., Writing group, Supplemental text writing group, & Principal investigators (2018) · Nature · doi:10.1038/s41586-018-0590-4 · Cited by 2,842
Inferring Regulatory Networks from Expression Data Using Tree-Based Methods
Huynh-Thu, V. A., Irrthum, A., Wehenkel, L., & Geurts, P. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012776 · Cited by 2,131
Recovering Gene Interactions from Single-Cell Data Using Data Diffusion
van Dijk, D., Sharma, R., Nainys, J., Yim, K., Kathail, P., Carr, A. J., Burdziak, C., Moon, K. R., Chaffer, C. L., Pattabiraman, D., et al. (2018) · Cell · doi:10.1016/j.cell.2018.05.061 · Cited by 1,829
Single-cell RNA sequencing to explore immune cell heterogeneity
Papalexi, E., & Satija, R. (2018) · Nature Reviews Immunology · doi:10.1038/nri.2017.76 · Cited by 1,806
Intrinsic and extrinsic contributions to stochasticity in gene expression
Swain, P. S., Elowitz, M. B., & Siggia, E. D. (2002) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.162041399 · Cited by 1,661 · cited 1×
“This is expected, since the latter setting includes gene expression variation resulting only from biological noise, and even though extrinsic noise (fluctuations in TF levels reflected in target gene levels (Swain et al., 2002)) may be exploited to infer TF-gene relationships, such correlations are diluted by the pres…”
SC3: consensus clustering of single-cell RNA-seq data
Kiselev, V. Y., Kirschner, K., Schaub, M. T., Andrews, T., Yiu, A., Chandra, T., Natarajan, K. N., Reik, W., Barahona, M., Green, A. R., et al. (2017) · Nature Methods · doi:10.1038/nmeth.4236 · Cited by 1,500
The Technology and Biology of Single-Cell RNA Sequencing
Kolodziejczyk, A. A., Kim, J. K., Svensson, V., Marioni, J. C., & Teichmann, S. A. (2015) · Molecular Cell · doi:10.1016/j.molcel.2015.04.005 · Cited by 1,487
Modelling and analysis of gene regulatory networks
Karlebach, G., & Shamir, R. (2008) · Nature Reviews Molecular Cell Biology · doi:10.1038/nrm2503 · Cited by 1,296 · cited 1×
“, 2020), but these attempts do not explicitly incorporate the special properties of gene regulatory networks that have been reported in the literature (Karlebach and Shamir, 2008; Kepler and Elston, 2001; El Samad et al., 2005; Wilkinson, 2009), including non-linear response to TFs, intrinsic fluctuations in expressio…”
Computational and analytical challenges in single-cell transcriptomics
Stegle, O., Teichmann, S. A., & Marioni, J. C. (2015) · Nature Reviews Genetics · doi:10.1038/nrg3833 · Cited by 1,170 · cited 2×
“…biology today (Hedlund and Deng, 2018; Kelsey et al., 2017; Papalexi and Satija, 2018; Park et al., 2018), and have led to the rapid development of computational tools for analyzing the resulting data sets (Buettner et al., 2015; Butler et al., 2018; Stegle et al., 2015; Wolf et al., 2018).”
Buettner, F., Natarajan, K. N., Casale, F. P., Proserpio, V., Scialdone, A., Theis, F. J., Teichmann, S. A., Marioni, J. C., & Stegle, O. (2015) · Nature Biotechnology · doi:10.1038/nbt.3102 · Cited by 1,136 · cited 2×
“…biology today (Hedlund and Deng, 2018; Kelsey et al., 2017; Papalexi and Satija, 2018; Park et al., 2018), and have led to the rapid development of computational tools for analyzing the resulting data sets (Buettner et al., 2015; Butler et al., 2018; Stegle et al., 2015; Wolf et al., 2018).”
Single-cell RNA-seq denoising using a deep count autoencoder
Eraslan, G., Simon, L. M., Mircea, M., Mueller, N. S., & Theis, F. J. (2019) · Nature Communications · doi:10.1038/s41467-018-07931-2 · Cited by 1,084 · cited 1×
“, 2018), as well as pre-processing operations such as imputation (van Dijk et al., 2018; Eraslan et al., 2019; Li and Li, 2018), adopt complementary strategies whose relative merits and weaknesses are not clear a priori.”
Splatter: simulation of single-cell RNA sequencing data
Zappia, L., Phipson, B., & Oshlack, A. (2017) · Genome Biology · doi:10.1186/s13059-017-1305-0 · Cited by 905 · cited 6×
“The statistical details of these modules are borrowed from the Splatter simulation tool (Zappia et al., 2017) and re-implemented in SERGIO.”
InfluentialA cellular census of human lungs identifies novel cell states in health and in asthma
Vieira Braga, F. A., Kar, G., Berg, M., Carpaij, O. A., Polanski, K., Simon, L. M., Brouwer, S., Gomes, T., Hesse, L., Jiang, J., et al. (2019) · Nature Medicine · doi:10.1038/s41591-019-0468-5 · Cited by 896
Benchmarking algorithms for gene regulatory network inference from single-cell transcriptomic data
Pratapa, A., Jalihal, A. P., Law, J. N., Bharadwaj, A., & Murali, T. M. (2020) · Nature Methods · doi:10.1038/s41592-019-0690-6 · Cited by 792 · cited 18×
“For a fair comparison, in each experiment we set the “number of cell type” parameter in SERGIO and “number of simulation time” parameter in BoolODE to the same number.”
InfluentialCell Fates as High-Dimensional Attractor States of a Complex Gene Regulatory Network
Huang, S., Eichler, G., Bar-Yam, Y., & Ingber, D. E. (2005) · Physical Review Letters · doi:10.1103/physrevlett.94.128701 · Cited by 775 · cited 1×
“To mimic cellular heterogeneity commonly seen in single-cell data, SERGIO employs an intuitive definition of cell types as steady states of GRN dynamics (Huang et al., 2005).”
A general and flexible method for signal extraction from single-cell RNA-seq data
Risso, D., Perraudeau, F., Gribkova, S., Dudoit, S., & Vert, J.-P. (2018) · Nature Communications · doi:10.1038/s41467-017-02554-5 · Cited by 718 · cited 1×
“Several studies offering novel analysis tools use in-house simulators to benchmark those tools (Van den Berge et al., 2018; Campbell and Yau, 2018; Chen et al., 2020; Gong et al., 2019; Korthauer et al., 2016; Risso et al., 2018; Wolf et al., 2018), while other studies specifically develop simulators for use by the co…”
ZIFA: Dimensionality reduction for zero-inflated single-cell gene expression analysis
Pierson, E., & Yau, C. (2015) · Genome Biology · doi:10.1186/s13059-015-0805-z · Cited by 577 · cited 1×
“An empirical observation about scRNA-seq data reported in the literature is that there is an inverse relationship between the number of zeros in the recorded expression of a gene and its mean expression level across cells (Andrews and Hemberg, 2019; Pierson and Yau, 2015).”
Bonneau, R., Reiss, D. J., Shannon, P., Facciotti, M., Hood, L., Baliga, N. S., & Thorsson, V. (2006) · Genome Biology · doi:10.1186/gb-2006-7-5-r36 · Cited by 510 · cited 1×
“Expression data from TF knockout experiments can also be exploited by GRN inference algorithms (Bonneau et al., 2006), and knockout of regulators can be easily simulated in SERGIO to assess such algorithms.”
Developmental diversification of cortical inhibitory interneurons
Mayer, C., Hafemeister, C., Bandler, R. C., Machold, R., Batista Brito, R., Jaglin, X., Allaway, K., Butler, A., Fishell, G., & Satija, R. (2018) · Nature · doi:10.1038/nature25999 · Cited by 492 · cited 3×
“DS4 was compared against a published single-cell RNA-seq data from Medial Ganglionic Eminences (MGE), Caudal Ganglionic Eminences (CGE), and cortical regions of mouse sequenced by 10X chromium (Mayer et al., 2018), while DS5 and DS6 were respectively compared against data from human kidney (Lindström et al.”
InfluentialHochgerner, H., Zeisel, A., Lönnerberg, P., & Linnarsson, S. (2018) · Nature Neuroscience · doi:10.1038/s41593-017-0056-2 · Cited by 482
Matsumoto, H., Kiryu, H., Furusawa, C., Ko, M. S. H., Ko, S. B. H., Gouda, N., Hayashi, T., & Nikaido, I. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx194 · Cited by 439
Single-cell epigenomics: Recording the past and predicting the future
Kelsey, G., Stegle, O., & Reik, W. (2017) · Science · doi:10.1126/science.aan6826 · Cited by 415 · cited 1×
“Single-cell transcriptomics technologies are revolutionizing biology today (Hedlund and Deng, 2018; Kelsey et al., 2017; Papalexi and Satija, 2018; Park et al., 2018), and have led to the rapid development of computational tools for analyzing the resulting data sets (Buettner et al.”
A statistical approach for identifying differential distributions in single-cell RNA-seq experiments
Korthauer, K. D., Chu, L.-F., Newton, M. A., Li, Y., Thomson, J., Stewart, R., & Kendziorski, C. (2016) · Genome Biology · doi:10.1186/s13059-016-1077-y · Cited by 273 · cited 1×
“Several studies offering novel analysis tools use in-house simulators to benchmark those tools (Van den Berge et al., 2018; Campbell and Yau, 2018; Chen et al., 2020; Gong et al., 2019; Korthauer et al., 2016; Risso et al., 2018; Wolf et al., 2018), while other studies specifically develop simulators for use by the co…”
Chen, S., & Mar, J. C. (2018) · BMC Bioinformatics · doi:10.1186/s12859-018-2217-z · Cited by 235 · cited 3×
“, 2017; Chen and Mar, 2018), it is believed that such synthetic data do not exhibit the statistical characteristics of contemporary single-cell data sets (Chen and Mar, 2018).”
Papili Gao, N., Ud-Dean, S. M. M., Gandrillon, O., & Gunawan, R. (2018) · Bioinformatics · doi:10.1093/bioinformatics/btx575 · Cited by 235
Observation weights unlock bulk RNA-seq tools for zero inflation and single-cell applications
Van den Berge, K., Perraudeau, F., Soneson, C., Love, M. I., Risso, D., Vert, J.-P., Robinson, M. D., Dudoit, S., & Clement, L. (2018) · Genome Biology · doi:10.1186/s13059-018-1406-4 · Cited by 228
Single-cell transcriptomics unveils gene regulatory network plasticity
Iacono, G., Massoni-Badosa, R., & Heyn, H. (2019) · Genome Biology · doi:10.1186/s13059-019-1713-4 · Cited by 218
powsimR: power analysis for bulk and single cell RNA-seq experiments
Vieth, B., Ziegenhain, C., Parekh, S., Enard, W., & Hellmann, I. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx435 · Cited by 155
scMatch: a single-cell gene expression profile annotation tool using reference datasets
Hou, R., Denisenko, E., & Forrest, A. R. R. (2019) · Bioinformatics · doi:10.1093/bioinformatics/btz292 · Cited by 130
Network inference with Granger causality ensembles on single-cell transcriptomics
Deshpande, A., Chu, L.-F., Stewart, R., & Gitter, A. (2022) · Cell Reports · doi:10.1016/j.celrep.2022.110333 · Cited by 130
Bcl11b and combinatorial resolution of cell fate in the T-cell gene regulatory network
Longabaugh, W. J. R., Zeng, W., Zhang, J. A., Hosokawa, H., Jansen, C. S., Li, L., Romero-Wolf, M., Liu, P., Kueh, H. Y., Mortazavi, A., et al. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1610617114 · Cited by 89
Cited by
Statistics or biology: the zero-inflation controversy about scRNA-seq data
Jiang, R., Sun, T., Song, D., & Li, J. J. (2022) · Genome Biology · doi:10.1186/s13059-022-02601-5 · Cited by 614
Kaminow, B., Yunusov, D., & Dobin, A. (2021) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2021.05.05.442755 · Cited by 427
Osorio, D., Zhong, Y., Li, G., Xu, Q., Yang, Y., Tian, Y., Chapkin, R. S., Huang, J. Z., & Cai, J. J. (2022) · Patterns · doi:10.1016/j.patter.2022.100434 · Cited by 307
Network inference with Granger causality ensembles on single-cell transcriptomics
Deshpande, A., Chu, L.-F., Stewart, R., & Gitter, A. (2022) · Cell Reports · doi:10.1016/j.celrep.2022.110333 · Cited by 130
Yang, Y., Li, G., Zhong, Y., Xu, Q., Chen, B.-J., Lin, Y.-T., Chapkin, R. S., & Cai, J. J. (2023) · Nucleic Acids Research · doi:10.1093/nar/gkad450 · Cited by 48
Metadata
- Authors
- Dibaeinia, P., & Sinha, S.
- Venue
- Cell Systems
- Publisher
- Elsevier BV
- Published
- 2020-09
- Volume
- 11
- Issue
- 3
- Pages
- 252-271.e11
- ISSN
- 2405-4712 (ISSN-L)
- OpenAlex
- W3082292479
- Cited by
- 108
- References
- 39
- FWCI
- 3.46
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.