The DOI matches its Crossref record; 67 of the 67 references it cites were found in a registry or an index.
Benchmarking algorithms for gene regulatory network inference from single-cell transcriptomic data
Open accessPublished version of a preprint
Abstract
We present a systematic evaluation of state-of-the-art algorithms for inferring gene regulatory networks from single-cell transcriptional data. As the ground truth for assessing accuracy, we use synthetic networks with predictable trajectories, literature-curated Boolean models and diverse transcriptional regulatory networks. We develop a strategy to simulate single-cell transcriptional data from synthetic and Boolean networks that avoids pitfalls of previously used methods. Furthermore, we collect networks from multiple experimental single-cell RNA-seq datasets. We develop an evaluation framework called BEELINE. We find that the area under the precision-recall curve and early precision of the algorithms are moderate. The methods are better in recovering interactions in synthetic networks than Boolean models. The algorithms with the best early precision values for Boolean models also perform well on experimental datasets. Techniques that do not require pseudotime-ordered cells are generally more accurate. Based on these results, we present recommendations to end users. BEELINE will aid the development of gene regulatory network inference algorithms.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The cited source says what the claim attributes to it.
In the citing paper
“Despite extensive efforts, GRN inference accuracy has remained disappointingly low, marginally exceeding random predictions39.”
From Inferring gene regulatory networks from single-cell multiome data using atlas-scale external data (2025) · cites this paper as [39]
In the citing paper
“Experiments with targeted perturbations can be modeled as affecting individual nodes of a regulatory network model, enabling investigation of mechanistic processes and inference of regulatory interactions and their directionality11.”
From scPerturb: harmonized single-cell perturbation data (2024) · cites this paper as [11]
In the citing paper
“Cell-type-specific ground-truth GRNs were generated in the same manner as in a previous benchmarking study55.”
From Dissecting cell identity via network inference and in silico gene perturbation (2023) · cites this paper as [55]
In the citing paper
“GENIE3 emerged as one of the best-performing algorithms in a previous benchmarking study55.”
From Dissecting cell identity via network inference and in silico gene perturbation (2023) · cites this paper as [55]
In the citing paper
“GRN inference performance was evaluated by the AUROC and the early precision ratio (EPR), following the evaluation method used in a previous benchmarking study55.”
From Dissecting cell identity via network inference and in silico gene perturbation (2023) · cites this paper as [55]
In the citing paper
“Existing GRN tools utilize scRNA-seq data with thousands of pre-select genes and cells, because GRNs from full transcriptomes in large scRNA-seq datasets are often computationally intensive and intractable.13,15”
From SCING: Inference of robust, interpretable gene regulatory networks from single cell and spatial transcriptomics (2023) · cites this paper as [13]
In the citing paper
“In addition, benchmarking studies have shown limited accuracy of existing methods on both synthetic and real data.13”
From SCING: Inference of robust, interpretable gene regulatory networks from single cell and spatial transcriptomics (2023) · cites this paper as [13]
In the citing paper
“Although there exist other GRN inference approaches based on pseudotime analysis,23,24,25 their performance is generally inferior to those that rely solely on the scRNA-seq data.13”
From SCING: Inference of robust, interpretable gene regulatory networks from single cell and spatial transcriptomics (2023) · cites this paper as [13]
In the citing paper
“Validation of GRN inference tools has remained challenging.13”
From SCING: Inference of robust, interpretable gene regulatory networks from single cell and spatial transcriptomics (2023) · cites this paper as [13]
In the citing paper
“Since ground truth networks are unknown for many conditions across cell types and tissues, current GRN accuracy evaluations rely on inferring synthetic ground truth networks that may not capture biological or curated interactions that forsake tissue and cell-type specificity.13”
From SCING: Inference of robust, interpretable gene regulatory networks from single cell and spatial transcriptomics (2023) · cites this paper as [13]
In the citing paper
“To benchmark the performance of SCING, we selected three existing methods, namely GRNBOOST2, ppcor, and PIDCm with default parameters. These methods were selected based on previous benchmarking studies where superior performance of these methods were supported.13”
From SCING: Inference of robust, interpretable gene regulatory networks from single cell and spatial transcriptomics (2023) · cites this paper as [13]
In the citing paper
“Single cell multiomics has become a powerful tool for identifying regulatory interactions between genes, but the performance of existing tools is limited in both accuracy and scalability.13”
From SCING: Inference of robust, interpretable gene regulatory networks from single cell and spatial transcriptomics (2023) · cites this paper as [13]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Szklarczyk, D., Gable, A. L., Lyon, D., Junge, A., Wyder, S., Huerta-Cepas, J., Simonovic, M., Doncheva, N. T., Morris, J. H., Bork, P., et al. (2019) · Nucleic Acids Research · doi:10.1093/nar/gky1131 · Cited by 17,749
Comprehensive Integration of Single-Cell Data
Stuart, T., Butler, A., Hoffman, P., Hafemeister, C., Papalexi, E., Mauck, W. M., Hao, Y., Stoeckius, M., Smibert, P., & Satija, R. (2019) · Cell · doi:10.1016/j.cell.2019.05.031 · Cited by 15,453
Scenic: single-cell regulatory network inference and clustering.
Aibar, S., González-Blas, C. B., Moerman, T., Huynh-Thu, V. A., Imrichova, H., Hulselmans, G., Rambow, F., Marine, J.-C., Geurts, P., Aerts, J., et al. (2017) · Nature Methods · doi:10.1038/nmeth.4463 · Cited by 6,520
Saito, T., & Rehmsmeier, M. (2015) · PLOS ONE · doi:10.1371/journal.pone.0118432 · Cited by 5,309
La Manno, G., Soldatov, R., Zeisel, A., Braun, E., Hochgerner, H., Petukhov, V., Lidschreiber, K., Kastriti, M. E., Lönnerberg, P., Furlan, A., et al. (2018) · Nature · doi:10.1038/s41586-018-0414-6 · Cited by 4,118
Slingshot: cell lineage and pseudotime inference for single-cell transcriptomics
Street, K., Risso, D., Fletcher, R. B., Das, D., Ngai, J., Yosef, N., Purdom, E., & Dudoit, S. (2018) · BMC Genomics · doi:10.1186/s12864-018-4772-0 · Cited by 3,159
Single-cell RNA-seq reveals new types of human blood dendritic cells, monocytes, and progenitors
Villani, A.-C., Satija, R., Reynolds, G., Sarkizova, S., Shekhar, K., Fletcher, J., Griesbeck, M., Butler, A., Zheng, S., Lazo, S., et al. (2017) · Science · doi:10.1126/science.aah4573 · Cited by 2,413
Current best practices in single-cell RNA-seq analysis: a tutorial
Luecken, M. D., & Theis, F. J. (2019) · Molecular Systems Biology · doi:10.15252/msb.20188746 · Cited by 2,231
Inferring Regulatory Networks from Expression Data Using Tree-Based Methods
Huynh-Thu, V. A., Irrthum, A., Wehenkel, L., & Geurts, P. (2010) · PLoS ONE · doi:10.1371/journal.pone.0012776 · Cited by 2,131
TRRUST v2: an expanded reference database of human and mouse transcriptional regulatory interactions
Han, H., Cho, J.-W., Lee, S., Yun, A., Kim, H., Bae, D., Yang, S., Kim, C. Y., Lee, M., Kim, E., et al. (2017) · Nucleic Acids Research · doi:10.1093/nar/gkx1013 · Cited by 1,986
A comparison of single-cell trajectory inference methods
Saelens, W., Cannoodt, R., Todorov, H., & Saeys, Y. (2019) · Nature Biotechnology · doi:10.1038/s41587-019-0071-9 · Cited by 1,670
Wisdom of crowds for robust gene network inference
The DREAM5 Consortium, Marbach, D., Costello, J. C., Küffner, R., Vega, N. M., Prill, R. J., Camacho, D. M., Allison, K. R., Kellis, M., Collins, J. J., et al. (2012) · Nature Methods · doi:10.1038/nmeth.2016 · Cited by 1,667
Faith, J. J., Hayete, B., Thaden, J. T., Mogno, I., Wierzbowski, J., Cottarel, G., Kasif, S., Collins, J. J., & Gardner, T. S. (2007) · PLoS Biology · doi:10.1371/journal.pbio.0050008 · Cited by 1,563
Reverse engineering of regulatory networks in human B cells
Basso, K., Margolin, A. A., Stolovitzky, G. A., Klein, U., Dalla‐Favera, R., & Califano, A. (2005) · Nature Genetics · doi:10.1038/ng1532 · Cited by 1,408
Bayesian approach to single-cell differential expression analysis
Kharchenko, P. V., Silberstein, L., & Scadden, D. T. (2014) · Nature Methods · doi:10.1038/nmeth.2967 · Cited by 1,348
Buettner, F., Natarajan, K. N., Casale, F. P., Proserpio, V., Scialdone, A., Theis, F. J., Teichmann, S. A., Marioni, J. C., & Stegle, O. (2015) · Nature Biotechnology · doi:10.1038/nbt.3102 · Cited by 1,136
Benchmark and integration of resources for the estimation of human transcription factor activities
Garcia-Alonso, L., Holland, C. H., Ibrahim, M. M., Turei, D., & Saez-Rodriguez, J. (2019) · Genome Research · doi:10.1101/gr.240663.118 · Cited by 1,122
ppcor: An R Package for a Fast Calculation to Semi-partial Correlation Coefficients
Kim, S. (2015) · Communications for Statistical Applications and Methods · doi:10.5351/csam.2015.22.6.665 · Cited by 1,106
Exponential scaling of single-cell RNA-seq in the past decade
Svensson, V., Vento-Tormo, R., & Teichmann, S. A. (2018) · Nature Protocols · doi:10.1038/nprot.2017.149 · Cited by 1,034
Single-cell RNA-seq reveals dynamic paracrine control of cellular variation
Shalek, A. K., Satija, R., Shuga, J., Trombetta, J. J., Gennert, D., Lu, D., Chen, P., Gertner, R. S., Gaublomme, J. T., Yosef, N., et al. (2014) · Nature · doi:10.1038/nature13437 · Cited by 1,000
Accounting for technical noise in single-cell RNA-seq experiments
Brennecke, P., Anders, S., Kim, J. K., Kołodziejczyk, A. A., Zhang, X., Proserpio, V., Baying, B., Benes, V., Teichmann, S. A., Marioni, J. C., et al. (2013) · Nature Methods · doi:10.1038/nmeth.2645 · Cited by 979
A single-cell resolution map of mouse hematopoietic stem and progenitor cell differentiation
Nestorowa, S., Hamey, F. K., Pijuan Sala, B., Diamanti, E., Shepherd, M., Laurenti, E., Wilson, N. K., Kent, D. G., & Göttgens, B. (2016) · Blood · doi:10.1182/blood-2016-05-716480 · Cited by 768
Revealing strengths and weaknesses of methods for gene network inference
Marbach, D., Prill, R. J., Schaffter, T., Mattiussi, C., Floreano, D., & Stolovitzky, G. A. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.0913357107 · Cited by 755
The Human Cell Atlas: from vision to reality
Rozenblatt-Rosen, O., Stubbington, M. J. T., Regev, A., & Teichmann, S. A. (2017) · Nature · doi:10.1038/550451a · Cited by 638
Revealing the vectors of cellular identity with single-cell genomics
Wagner, A., Regev, A., & Yosef, N. (2016) · Nature Biotechnology · doi:10.1038/nbt.3711 · Cited by 632
Multilineage communication regulates human liver bud development from pluripotency
Camp, J. G., Sekine, K., Gerber, T., Loeffler-Wirth, H., Binder, H., Gac, M., Kanton, S., Kageyama, J., Damm, G., Seehofer, D., et al. (2017) · Nature · doi:10.1038/nature22796 · Cited by 621
GRNBoost2 and Arboreto: efficient and scalable inference of gene regulatory networks
Moerman, T., Aibar Santos, S., Bravo González-Blas, C., Simm, J., Moreau, Y., Aerts, J., & Aerts, S. (2019) · Bioinformatics · doi:10.1093/bioinformatics/bty916 · Cited by 621
Quantitative model for gene regulation by lambda phage repressor.
Ackers, G. K., Johnson, A. D., & Shea, M. A. (1982) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.79.4.1129 · Cited by 590
Gene Regulatory Network Inference from Single-Cell Data Using Multivariate Information Measures
Chan, T. E., Stumpf, M. P. H., & Babtie, A. C. (2017) · Cell Systems · doi:10.1016/j.cels.2017.08.014 · Cited by 578
Liu, Z., Wu, C., Miao, H., & Wu, H. (2015) · Database · doi:10.1093/database/bav095 · Cited by 555
Discovery of meaningful associations in genomic data using partial correlation coefficients
de la Fuente, A., Bing, N., Hoeschele, I., & Mendes, P. (2004) · Bioinformatics · doi:10.1093/bioinformatics/bth445 · Cited by 552
GeneNetWeaver: in silico benchmark generation and performance profiling of network inference methods
Schaffter, T., Marbach, D., & Floreano, D. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr373 · Cited by 549
Mimitou, E. P., Cheng, A., Montalbano, A., Hao, S., Stoeckius, M., Legut, M., Roush, T., Herrera, A., Papalexi, E., Ouyang, Z., et al. (2019) · Nature Methods · doi:10.1038/s41592-019-0392-0 · Cited by 520
Chu, L.-F., Leng, N., Zhang, J., Hou, Z., Mamott, D., Vereide, D. T., Choi, J., Kendziorski, C., Stewart, R., & Thomson, J. A. (2016) · Genome Biology · doi:10.1186/s13059-016-1033-x · Cited by 477
Matsumoto, H., Kiryu, H., Furusawa, C., Ko, M. S. H., Ko, S. B. H., Gouda, N., Hayashi, T., & Nikaido, I. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx194 · Cited by 439
Marbach, D., Schaffter, T., Mattiussi, C., & Floreano, D. (2009) · Journal of Computational Biology · doi:10.1089/cmb.2008.09tt · Cited by 430
Hayashi, T., Ozaki, H., Sasagawa, Y., Umeda, M., Danno, H., & Nikaido, I. (2018) · Nature Communications · doi:10.1038/s41467-018-02866-0 · Cited by 284
Deep learning for inferring gene relationships from single-cell expression data
Yuan, Y., & Bar‐Joseph, Z. (2019) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1911536116 · Cited by 270
Precrec: fast and accurate precision–recall and ROC curve calculations in R
Saito, T., & Rehmsmeier, M. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btw570 · Cited by 267
Chen, S., & Mar, J. C. (2018) · BMC Bioinformatics · doi:10.1186/s12859-018-2217-z · Cited by 235
Papili Gao, N., Ud-Dean, S. M. M., Gandrillon, O., & Gunawan, R. (2018) · Bioinformatics · doi:10.1093/bioinformatics/btx575 · Cited by 235
Mapping gene regulatory networks from single-cell omics data
Fiers, M. W. E. J., Minnoye, L., Aibar, S., Bravo González-Blas, C., Kalender Atak, Z., & Aerts, S. (2018) · Briefings in Functional Genomics · doi:10.1093/bfgp/elx046 · Cited by 235
Specht, A. T., & Li, J. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btw729 · Cited by 193
Inferring Causal Gene Regulatory Networks from Coupled Single-Cell Expression Dynamics Using Scribe
Qiu, X., Rahimzamani, A., Wang, L., Ren, B., Mao, Q., Durham, T., McFaline-Figueroa, J. L., Saunders, L., Trapnell, C., & Kannan, S. (2020) · Cell Systems · doi:10.1016/j.cels.2020.02.003 · Cited by 185
Hierarchical Differentiation of Myeloid Progenitors Is Encoded in the Transcription Factor Network
Krumsiek, J., Marr, C., Schroeder, T., & Theis, F. J. (2011) · PLoS ONE · doi:10.1371/journal.pone.0022649 · Cited by 178
Exponential scaling of single-cell RNA-seq in the last decadePreprint
Svensson, V., Vento‐Tormo, R., & Teichmann, S. A. (2017) · arXiv (Cornell University) · doi:10.48550/arxiv.1704.01379 · Cited by 169
Reconstructing gene regulatory dynamics from high-dimensional single-cell snapshot data
Ocone, A., Haghverdi, L., Mueller, N. S., & Theis, F. J. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv257 · Cited by 155
Sanchez-Castillo, M., Blanco, D., Tienda-Luna, I. M., Carrion, M. C., & Huang, Y. (2018) · Bioinformatics · doi:10.1093/bioinformatics/btx605 · Cited by 151
Jang, Y., Broun, A., Wang, C., Park, Y.-K., Zhuang, L., Lee, J., Froimchuk, E., Liu, C., & Ge, K. (2018) · Nucleic Acids Research · doi:10.1093/nar/gky982 · Cited by 150
Network inference with Granger causality ensembles on single-cell transcriptomics
Deshpande, A., Chu, L.-F., Stewart, R., & Gitter, A. (2022) · Cell Reports · doi:10.1016/j.celrep.2022.110333 · Cited by 130
Combining tree-based and dynamical systems for the inference of gene regulatory networks
Huynh‐Thu, V. A., & Sanguinetti, G. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btu863 · Cited by 126
Aubin-Frankowski, P.-C., & Vert, J.-P. (2020) · Bioinformatics · doi:10.1093/bioinformatics/btaa576 · Cited by 116
A Boolean Model of the Gene Regulatory Network Underlying Mammalian Cortical Area Development
Giacomantonio, C. E., & Goodhill, G. J. (2010) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1000936 · Cited by 112
Reconstructing blood stem cell regulatory network models from single-cell molecular profiles
Hamey, F., Nestorowa, S., Kinston, S., Kent, D. G., Wilson, N. K., & Göttgens, B. (2017) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1610609114 · Cited by 102
Woodhouse, S., Piterman, N., Wintersteiger, C. M., Göttgens, B., & Fisher, J. (2018) · BMC Systems Biology · doi:10.1186/s12918-018-0581-y · Cited by 97
BioModels: expanding horizons to include more modelling approaches and formats
Glont, M., Nguyen, T. V. N., Graesslin, M., Hälke, R., Ali, R., Schramm, J., Wimalaratne, S. M., Kothamachu, V. B., Rodriguez, N., Swat, M. J., et al. (2018) · Nucleic Acids Research · doi:10.1093/nar/gkx1023 · Cited by 89
BTR: training asynchronous Boolean models using single-cell expression data
Lim, C. Y., Wang, H., Woodhouse, S., Piterman, N., Wernisch, L., Fisher, J., & Göttgens, B. (2016) · BMC Bioinformatics · doi:10.1186/s12859-016-1235-y · Cited by 81
A Boolean network model of human gonadal sex determination
Ríos, O., Frías, S., Rodríguez, A., Kofman, S., Merchant‐Larios, H., Torres, L., & Mendoza, L. (2015) · Theoretical Biology and Medical Modelling · doi:10.1186/s12976-015-0023-0 · Cited by 48
Chen, H., Guo, J., Mishra, S. K., Robson, P., Niranjan, M., & Zheng, J. (2014) · Bioinformatics · doi:10.1093/bioinformatics/btu777 · Cited by 46
Towards inferring causal gene regulatory networks from single cell expression MeasurementsPreprint
Qiu, X., Rahimzamani, A., Wang, L., et al. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/426981 · Cited by 32
Network Inference with Granger Causality Ensembles on Single-Cell Transcriptomic DataPreprint
Deshpande, A. M., Chu, L., Stewart, R. M., et al. (2019) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/534834 · Cited by 32
Learning regulatory models for cell development from single cell transcriptomic data
Babtie, A. C., Chan, T. E., & Stumpf, M. P. H. (2017) · Current Opinion in Systems Biology · doi:10.1016/j.coisb.2017.07.013 · Cited by 32
Lovrics, A., Gao, Y., Juhász, B., Bock, I., Byrne, H. M., Dinnyés, A., & Kovács, K. A. (2014) · PLoS ONE · doi:10.1371/journal.pone.0111430 · Cited by 31
Network Inference from Single-Cell Transcriptomic Data
Todorov, H., Cannoodt, R., Saelens, W., & Saeys, Y. (2018) · Methods in molecular biology · doi:10.1007/978-1-4939-8882-2_10 · Cited by 24
Microbial Exposure Regulates the Development of Anti-Blood Group Antibodies
Arthur, C. M., Sullivan, H. C., Gerner‐Smidt, C., Kamili, N. A., Bennett, A. L., Patel, S. R., Henry, S., & Stowell, S. R. (2016) · Blood · doi:10.1182/blood.v128.22.20.20 · Cited by 17
Aubin-Frankowski, P.-C., & Vert, J. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/464479 · Cited by 15
Deep learning for inferring gene relationships from single-cell expression dataPreprint
Yuan, Y., & Bar‐Joseph, Z. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/365007 · Cited by 13
Cited by
Sorted by citations
A scalable SCENIC workflow for single-cell gene regulatory network analysis
Van de Sande, B., Flerin, C., Davie, K., De Waegeneer, M., Hulselmans, G., Aibar, S., Seurinck, R., Saelens, W., Cannoodt, R., Rouchon, Q., et al. (2020) · Nature Protocols · doi:10.1038/s41596-020-0336-2 · Cited by 1,494
scGPT: Towards Building a Foundation Model for Single-Cell Multi-omics Using Generative AI
Cui, H., Wang, C., Maan, H., Pang, K., Luo, F., & Wang, B. (2023) · doi:10.1101/2023.04.30.538439 · Cited by 1,694
“Existing GRN inference 295 methods often rely on correlation in static gene expression or pseudo-time estimates as a proxy for 296 causal graphs [50].”
MethodSCENIC+: single-cell multiomic inference of enhancers and gene regulatory networks
Bravo González-Blas, C., De Winter, S., Hulselmans, G., Hecker, N., Matetovici, I., Christiaens, V., Poovathingal, S., Wouters, J., Aibar, S., & Aerts, S. (2023) · Nature Methods · doi:10.1038/s41592-023-01938-4 · Cited by 778
Dissecting cell identity via network inference and in silico gene perturbation
Kamimoto, K., Stringa, B., Hoffmann, C. M., Jindal, K., Solnica-Krezel, L., & Morris, S. A. (2023) · Nature · doi:10.1038/s41586-022-05688-9 · Cited by 677
NCBI GEO: archive for gene expression and epigenomics data sets: 23-year update
Clough, E., Barrett, T., Wilhite, S. E., Ledoux, P., Evangelista, C. C., Kim, I. F., Tomashevsky, M., Marshall, K. A., Phillippy, K., Sherman, P. M., et al. (2023) · Nucleic Acids Research · doi:10.1093/nar/gkad965 · Cited by 573
Metadata
- Authors
- Pratapa, A., Jalihal, A. P., Law, J. N., Bharadwaj, A., & Murali, T. M.
- Affiliations
- Virginia Tech (US)
- Corresponding author
- Murali, T. M.
- Venue
- Nature Methods
- Published
- 2020-01-06
- Volume
- 17
- Issue
- 2
- Pages
- 147-154
- ISSN
- 1548-7091 (ISSN-L)
- 1548-7105
- PMC
- PMC7098173
- OpenAlex
- W2997831639
- Cited by
- 792
- References
- 63
- Citations by year
- 2026: 135 · 2025: 146 · 2024: 135 · 2023: 142 · 2022: 101 · 2021: 94 · 2020: 36
- FWCI
- 31.76
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Locations
- Nature Methods (publishedVersion)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Science Foundation (CCF-1617678, DBI-1759858)
- U.S. Department of Health & Human Services | NIH | National Cancer Institute (UH2CA203768)
- ODNI | Intelligence Advanced Research Projects Activity (W911NF-17-2-0105)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Microbial Metabolic Engineering and Bioproduction
- Keywords
- gene regulatory network inference, single-cell transcriptomics, single-cell RNA sequencing, algorithm benchmarking, synthetic gene regulatory networks, Boolean model, data simulation, pseudotime, precision and recall
- MeSH terms
- Algorithms, Sequence Analysis, RNA, Gene Regulatory Networks, Single-Cell Analysis, Transcriptome, Datasets as Topic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
