Conditional density-based analysis of T cell signaling in single-cell data
Open accessAbstract
Cellular circuits sense the environment, process signals, and compute decisions using networks of interacting proteins. To model such a system, the abundance of each activated protein species can be described as a stochastic function of the abundance of other proteins. High-dimensional single-cell technologies, such as mass cytometry, offer an opportunity to characterize signaling circuit-wide. However, the challenge of developing and applying computational approaches to interpret such complex data remains. Here, we developed computational methods, based on established statistical concepts, to characterize signaling network relationships by quantifying the strengths of network edges and deriving signaling response functions. In comparing signaling between naïve and antigen-exposed CD4 + T lymphocytes, we find that although these two cell subtypes had similarly wired networks, naïve cells transmitted more information along a key signaling cascade than did antigen-exposed cells. We validated our characterization on mice lacking the extracellular-regulated mitogen-activated protein kinase (MAPK) ERK2, which showed stronger influence of pERK on pS6 (phosphorylated-ribosomal protein S6), in naïve cells as compared with antigen-exposed cells, as predicted. We demonstrate that by using cell-to-cell variation inherent in single-cell data, we can derive response functions underlying molecular circuits and drive the understanding of how cells process signals.
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
The scale and precision of single-cell studies has continued to increase, reaching tens of thousands of cells for massively parallel scRNA-seq and millions of cells for mass cytometry protein measurements.
“The scale and precision of such studies has continued to increase, reaching tens of thousands of cells for massively parallel scRNA-seq30,31 and millions of cells for mass cytometry signature protein measurements32–34.”
From Revealing the vectors of cellular identity with single-cell genomics (2016) · cites this paper as [32]
A simple analysis of the joint density f(X, Y) is dominated by the most common cell types, but misses parts of the dynamic range that transpire only in rare subsets of cells but are key to uncovering the biologically meaningful signal of the relationship between proteins.
“Considering a given pair of proteins (say X and Y), it has been observed that a simple analysis of their joint density f(X, Y) is dominated by the most common cell types, but misses parts of the dynamic range that transpire only in rare subsets of cells but are key to uncovering the biologically meaningful signal of the relationship between proteins.”
From Revealing the vectors of cellular identity with single-cell genomics (2016) · cites this paper as [32]
Two complementary methods, DREVI and DREMI, tackled these challenges through visualization and quantification, respectively, in the context of single-cell mass cytometry (CyTOF) data for dozens of phosphoproteins across hundreds of thousands of cells.
“Two complementary methods, DREVI and DREMI32, tackled these challenges through visualization and quantification, respectively, in the context of single-cell mass cytometry (CyTOF) data for dozens of phosphoproteins across hundreds of thousands of cells.”
From Revealing the vectors of cellular identity with single-cell genomics (2016) · cites this paper as [32]
Using the latest protocols for massively parallel scRNA-seq and mass cytometry, a single laboratory can now readily collect tens of thousands to hundreds of thousands of single-cell RNA-seq profiles and tens of millions of single-cell protein profiles.
“Using the latest protocols for massively parallel scRNA-seq30,31 and mass cytometry32–34, a single laboratory can now readily collect tens of thousands to hundreds of thousands of single-cell RNA-seq profiles and tens of millions of single-cell protein profiles.”
From Revealing the vectors of cellular identity with single-cell genomics (2016) · cites this paper as [32]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Cites
On Estimation of a Probability Density Function and Mode
Parzen, E. (1962) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177704472 · Cited by 10,715 · see citing works
(2009) · Cited by 6,153 · see citing works
Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting
Cleveland, W. S., & Devlin, S. J. (1988) · Journal of the American Statistical Association · doi:10.1080/01621459.1988.10478639 · Cited by 5,740 · see citing works
Remarks on Some Nonparametric Estimates of a Density Function
Rosenblatt, M. (1956) · The Annals of Mathematical Statistics · doi:10.1214/aoms/1177728190 · Cited by 4,628 · see citing works
Differentiation of Effector CD4 T Cell Populations
Zhu, J., Yamane, H., & Paul, W. E. (2010) · Annual Review of Immunology · doi:10.1146/annurev-immunol-030409-101212 · Cited by 3,452 · see citing works
Detecting Novel Associations in Large Data Sets
Reshef, D. N., Reshef, Y., Finucane, H. K., Grossman, S. R., McVean, G., Turnbaugh, P. J., Lander, E. S., Mitzenmacher, M., & Sabeti, P. C. (2011) · Science · doi:10.1126/science.1205438 · Cited by 3,345 · see citing works
Bendall, S. C., Simonds, E. F., Qiu, P., Amir, E.-A. D., Krutzik, P. O., Finck, R., Bruggner, R. V., Melamed, R., Trejo, A., Ornatsky, O. I., et al. (2011) · Science · doi:10.1126/science.1198704 · Cited by 2,279 · see citing works
Self-citationSmith-Garvin, J. E., Koretzky, G. A., & Jordan, M. S. (2009) · Annual Review of Immunology · doi:10.1146/annurev.immunol.021908.132706 · Cited by 2,144 · see citing works
Highly multiplexed imaging of tumor tissues with subcellular resolution by mass cytometry
Giesen, C., Wang, H. A. O., Schapiro, D., Zivanovic, N., Jacobs, A., Hattendorf, B., Schüffler, P. J., Grolimund, D., Buhmann, J. M., Brandt, S., et al. (2014) · Nature Methods · doi:10.1038/nmeth.2869 · Cited by 1,951 · see citing works
Causal Protein-Signaling Networks Derived from Multiparameter Single-Cell Data
Sachs, K., Perez, O. D., Pe’er, D., Lauffenburger, D. A., & Nolan, G. P. (2005) · Science · doi:10.1126/science.1105809 · Cited by 1,724 · see citing works
Self-citationKernel density estimation via diffusion
Botev, Z. I., Grotowski, J. F., & Kroese, D. P. (2010) · The Annals of Statistics · doi:10.1214/10-aos799 · Cited by 1,689 · see citing works
Bandura, D. R., Baranov, V. I., Ornatsky, O. I., Antonov, A., Kinach, R., Lou, X., Pavlov, S., Vorobiev, S., Dick, J. E., & Tanner, S. D. (2009) · Analytical Chemistry · doi:10.1021/ac901049w · Cited by 1,295 · see citing works
The Duration of Antigenic Stimulation Determines the Fate of Naive and Effector T Cells
Iezzi, G., Karjalainen, K., & Lanzavecchia, A. (1998) · Immunity · doi:10.1016/s1074-7613(00)80461-6 · Cited by 909 · see citing works
Locally Weighted Regression: An Approach to Regression Analysis by Local Fitting
Cleveland, W. S., & Devlin, S. J. (1988) · Journal of the American Statistical Association · doi:10.2307/2289282 · Cited by 854 · see citing works
The mutual information: detecting and evaluating dependencies between variables
Steuer, R., Kurths, J., Daub, C. O., Weise, J., & Selbig, J. (2002) · Bioinformatics · doi:10.1093/bioinformatics/18.suppl_2.s231 · Cited by 815 · see citing works
Normalization of mass cytometry data with bead standards
Finck, R., Simonds, E. F., Jager, A., Krishnaswamy, S., Sachs, K., Fantl, W. J., Pe’er, D., Nolan, G. P., & Bendall, S. C. (2013) · Cytometry Part A · doi:10.1002/cyto.a.22271 · Cited by 737 · see citing works
Self-citationEquitability, mutual information, and the maximal information coefficient
Kinney, J. B., & Atwal, G. S. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1309933111 · Cited by 667 · see citing works
Multiplexed mass cytometry profiling of cellular states perturbed by small-molecule regulators
Bodenmiller, B., Zunder, E. R., Finck, R., Chen, T. J., Savig, E. S., Bruggner, R. V., Simonds, E. F., Bendall, S. C., Sachs, K., Krutzik, P. O., et al. (2012) · Nature Biotechnology · doi:10.1038/nbt.2317 · Cited by 546 · see citing works
Self-citationDual‐specificity MAP kinase phosphatases (MKPs): Shaping the outcome of MAP kinase signalling
Caunt, C. J., & Keyse, S. M. (2013) · The FEBS Journal · doi:10.1111/j.1742-4658.2012.08716.x · Cited by 535 · see citing works
A Systems Model of Signaling Identifies a Molecular Basis Set for Cytokine-Induced Apoptosis
Janes, K. A., Albeck, J. G., Gaudet, S., Sorger, P. K., Lauffenburger, D. A., & Yaffe, M. B. (2005) · Science · doi:10.1126/science.1116598 · Cited by 532 · see citing works
Estimation of the information by an adaptive partitioning of the observation space
Darbellay, G. A., & Vajda, I. (1999) · IEEE Transactions on Information Theory · doi:10.1109/18.761290 · Cited by 506 · see citing works
Cross-Validation and the Estimation of Conditional Probability Densities
Hall, P., Racine, J. S., & Li, Q. (2004) · Journal of the American Statistical Association · doi:10.1198/016214504000000548 · Cited by 499 · see citing works
Just-in-time transcription program in metabolic pathways
Zaslaver, A., Mayo, A., Rosenberg, R., Bashkin, P., Sberro, H., Tsalyuk, M., Surette, M. G., & Alon, U. S. (2004) · Nature Genetics · doi:10.1038/ng1348 · Cited by 471 · see citing works
Modeling T Cell Antigen Discrimination Based on Feedback Control of Digital ERK Responses
Altan-Bonnet, G. Y., & Germain, R. N. (2005) · PLoS Biology · doi:10.1371/journal.pbio.0030356 · Cited by 456 · see citing works
T cell receptor signalling networks: branched, diversified and bounded
Brownlie, R. J., & Zamoyska, R. (2013) · Nature Reviews Immunology · doi:10.1038/nri3403 · Cited by 453 · see citing works
Signaling by the Phosphoinositide 3-Kinase Family in Immune Cells
Okkenhaug, K. (2013) · Annual Review of Immunology · doi:10.1146/annurev-immunol-032712-095946 · Cited by 446 · see citing works
From TCR Engagement to T Cell Activation
Lanzavecchia, A., Iezzi, G., & Viola, A. (1999) · Cell · doi:10.1016/s0092-8674(00)80952-6 · Cited by 380 · see citing works
Reverse engineering cellular networks
Margolin, A. A., Wang, K., Lim, W. K., Kustagi, M., Nemenman, I., & Califano, A. (2006) · Nature Protocols · doi:10.1038/nprot.2006.106 · Cited by 379 · see citing works
Edgetic perturbation models of human inherited disorders
Zhong, Q., Simonis, N., Li, Q., Charloteaux, B., Heuze, F., Klitgord, N., Tam, S., Yu, H., Venkatesan, K., Mou, D., et al. (2009) · Molecular Systems Biology · doi:10.1038/msb.2009.80 · Cited by 359 · see citing works
Li, G., Yu, M., Lee, W.-W., Tsang, M., Krishnan, E., Weyand, C. M., & Goronzy, J. J. (2012) · Nature Medicine · doi:10.1038/nm.2963 · Cited by 349 · see citing works
Qualitative differences between naïve and memory T cells
Berard, M., & Tough, D. F. (2002) · Immunology · doi:10.1046/j.1365-2567.2002.01447.x · Cited by 239 · see citing works
CD4 and CD8 binding to MHC molecules primarily acts to enhance Lck delivery
Artyomov, M. N., Lis, M., Devadas, S., Davis, M. M., & Chakraborty, A. K. (2010) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1010568107 · Cited by 207 · see citing works
CD44 Regulates Survival and Memory Development in Th1 Cells
Baaten, B. J. G., Li, C.-R., Deiro, M. F., Lin, M., Linton, P. J., & Bradley, L. M. (2010) · Immunity · doi:10.1016/j.immuni.2009.10.011 · Cited by 183 · see citing works
Dominant Role of Antigen Dose in CD4+Foxp3+ Regulatory T Cell Induction and Expansion
Turner, M. S., Kane, L., & Morel, P. A. (2009) · The Journal of Immunology · doi:10.4049/jimmunol.0901459 · Cited by 172 · see citing works
Multifaceted regulation of T cells by CD44
Baaten, B. J. G., Li, C.-R., & Bradley, L. M. (2010) · Communicative & Integrative Biology · doi:10.4161/cib.3.6.13495 · Cited by 165 · see citing works
Memory CD4 T cells: generation, reactivation and re‐assignment
MacLeod, M. K. L., Kappler, J. W., & Marrack, P. (2010) · Immunology · doi:10.1111/j.1365-2567.2010.03260.x · Cited by 159 · see citing works
The Duration of T Cell Stimulation Is a Critical Determinant of Cell Fate and Plasticity
Miškov-Živanov, N., Turner, M. S., Kane, L., Morel, P. A., & Faeder, J. R. (2013) · Science Signaling · doi:10.1126/scisignal.2004217 · Cited by 113 · see citing works
Adachi, K., & Davis, M. M. (2011) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1017340108 · Cited by 111 · see citing works
Mapping Differentiation under Mixed Culture Conditions Reveals a Tunable Continuum of T Cell Fates
Antebi, Y. E., Reich-Zeliger, S., Hart, Y., Mayo, A., Eizenberg, I., Rimer, J., Putheti, P., Pe'er, D., & Friedman, N. (2013) · PLoS Biology · doi:10.1371/journal.pbio.1001616 · Cited by 100 · see citing works
Self-citationPolar Opposites: Erk Direction of CD4 T Cell Subsets
Chang, C., D’Souza, W. N., Ch’en, I. L., Pagès, G., Pouysségur, J., & Hedrick, S. Μ. (2012) · The Journal of Immunology · doi:10.4049/jimmunol.1103015 · Cited by 84 · see citing works
Thymic negative selection is functional in NOD mice
Mingueneau, M., Jiang, W., Feuerer, M., Mathis, D. J., & Benoist, C. O. (2012) · The Journal of Experimental Medicine · doi:10.1084/jem.20112593 · Cited by 63 · see citing works
Self-citationSignaling control of memory T cell generation and function
Chandok, M. R., & Färber, D. L. (2004) · Seminars in Immunology · doi:10.1016/j.smim.2004.08.009 · Cited by 61 · see citing works
Mingueneau, M., Krishnaswamy, S., Spitzer, M. H., Bendall, S. C., Stone, E. L., Hedrick, S. Μ., Pe’er, D., Mathis, D. J., Nolan, G. P., & Benoist, C. O. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1419337111 · Cited by 51 · see citing works
Self-citationJang, I. S., Margolin, A. A., & Califano, A. (2013) · Interface Focus · doi:10.1098/rsfs.2013.0011 · Cited by 31 · see citing works
Flagged first, then by citations
Research works printed but not linked: 4
- [9]DeGroot MH Schervish MJ Probability and statistics Addison-Wesley Boston 4 2012 xiv, 893
- [26]Cover TM Thomas JA Elements of information theory Wiley-Interscience Hoboken NJ 2 2006 xxiii 748
- [27]Hastie T Tibshirani R Friedman JH The elements of statistical learning: data mining, inference, and prediction: with 200 full-color illustrations Springer series in statistics Springer New York 2001 xvi 533
- [45]Rosenblatt M Multivariate Analysis II PR K Academic Press New York 1969 25 31
Cited by
Sorted by citations
Regev, A., Teichmann, S. A., Lander, E. S., Amit, I., Benoist, C., Birney, E., Bodenmiller, B., Campbell, P., Carninci, P., Clatworthy, M., et al. (2017) · eLife · doi:10.7554/elife.27041 · Cited by 2,232 · see citing works
Self-citationRecovering Gene Interactions from Single-Cell Data Using Data Diffusion
van Dijk, D., Sharma, R., Nainys, J., Yim, K., Kathail, P., Carr, A. J., Burdziak, C., Moon, K. R., Chaffer, C. L., Pattabiraman, D., et al. (2018) · Cell · doi:10.1016/j.cell.2018.05.061 · Cited by 1,829 · see citing works
Self-citationVisualizing structure and transitions in high-dimensional biological data
Moon, K. R., van Dijk, D., Wang, Z., Gigante, S., Burkhardt, D. B., Chen, W. S., Yim, K., Elzen, A. V. D., Hirn, M. J., Coifman, R. R., et al. (2019) · Nature Biotechnology · doi:10.1038/s41587-019-0336-3 · Cited by 1,065 · see citing works
Self-citationScaling single-cell genomics from phenomenology to mechanism
Tanay, A., & Regev, A. (2017) · Nature · doi:10.1038/nature21350 · Cited by 792 · see citing works
Revealing the vectors of cellular identity with single-cell genomics
Wagner, A., Regev, A., & Yosef, N. (2016) · Nature Biotechnology · doi:10.1038/nbt.3711 · Cited by 632 · see citing works
Reber, S. O., Siebler, P. H., Donner, N. C., Morton, J. T., Smith, D. G., Kopelman, J. M., Lowe, K. R., Wheeler, K. J., Fox, J. H., Hassell, J. E., et al. (2016) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1600324113 · Cited by 233 · see citing works
Computational methods for single-cell omics across modalities
Efremova, M., & Teichmann, S. A. (2020) · Nature Methods · doi:10.1038/s41592-019-0692-4 · Cited by 201 · see citing works
Inferring Causal Gene Regulatory Networks from Coupled Single-Cell Expression Dynamics Using Scribe
Qiu, X., Rahimzamani, A., Wang, L., Ren, B., Mao, Q., Durham, T., McFaline-Figueroa, J. L., Saunders, L., Trapnell, C., & Kannan, S. (2020) · Cell Systems · doi:10.1016/j.cels.2020.02.003 · Cited by 185 · see citing works
Multiscale PHATE identifies multimodal signatures of COVID-19
Kuchroo, M., Huang, J., Wong, P., Grenier, J.-C., Shung, D., Tong, A., Lucas, C., Klein, J., Burkhardt, D. B., Gigante, S., et al. (2022) · Nature Biotechnology · doi:10.1038/s41587-021-01186-x · Cited by 72 · see citing works
Self-citationUncovering axes of variation among single-cell cancer specimens
Chen, W. S., Zivanovic, N., van Dijk, D., Wolf, G., Bodenmiller, B., & Krishnaswamy, S. (2020) · Nature Methods · doi:10.1038/s41592-019-0689-z · Cited by 48 · see citing works
Self-citation
- Authors
- Krishnaswamy, S., Spitzer, M. H., Mingueneau, M., Bendall, S. C., Litvin, O., Stone, E., Pe’er, D., & Nolan, G. P.
- Affiliations
- Columbia University (US)
- Stanford University (US)
- Division of Immunology, Department of Microbiology and Immunobiology, Harvard Medical School, Boston, MA, USA.
- University of California San Diego (US)
- Corresponding author
- Pe’er, Dana
- Nolan, Garry P.
- Venue
- Science
- Published
- 2014-11-28
- Volume
- 346
- Issue
- 6213
- Pages
- 1250689-1250689
- ISSN
- 0036-8075 (ISSN-L)
- 1095-9203
- PMC
- PMC4334155
- OpenAlex
- W2079296583
- Cited by
- 225
- References
- 44
- Citations by year
- 2026: 8 · 2025: 14 · 2024: 8 · 2023: 18 · 2022: 16 · 2021: 15 · 2020: 29 · 2019: 17 · 2018: 25 · 2017: 34 · 2016: 25 · 2015: 14 · 2014: 1 · 2013: 1
- FWCI
- 10.12
- Type
- journal article
- Language
- en
- Open access
- green
- www.ncbi.nlm.nih.gov
- Locations
- Science (publishedVersion)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- eScholarship (California Digital Library) (submittedVersion)
- Funders
- National Heart, Lung, and Blood Institute (HV-10-05_, HHSN268201000034C)
- National Cancer Institute (U54CA121852, U54CA149145, R01CA130826, P01CA034233, CA 09011)
- National Institute of General Medical Sciences (R00GM104148)
- National Institute of Allergy and Infectious Diseases (U19AI100627, HHSN272200700038C, U19AI057229)
- National Institute of Diabetes and Digestive and Kidney Diseases (K01DK095008)
- National Center for Research Resources (S10RR027582)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Bioinformatics and Genomic Networks
- Keywords
- T cell signaling, signaling networks, conditional probability density, mass cytometry, single-cell data, naive CD4+ T cells, antigen-experienced T cells, ERK2, MAPK signaling, ribosomal protein S6, cell-to-cell variability
- MeSH terms
- Animals, Computer Simulation, Male, Mice, Mutant Strains, Receptors, Antigen, T-Cell, Signal Transduction, CD4-Positive T-Lymphocytes, Image Cytometry, eIF-2 Kinase, Mitogen-Activated Protein Kinase 1, Ribosomal Protein S6, Systems Biology, Mice, Single-Cell Analysis
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review