CyTOF workflow: Differential discovery in high-throughput high-dimensional cytometry datasets
Open accessThe DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Abstract
High dimensional mass and flow cytometry (HDCyto) experiments have become a method of choice for high throughput interrogation and characterization of cell populations.Here, we present an R-based pipeline for differential analyses of HDCyto data, largely based on Bioconductor packages. We computationally define cell populations using FlowSOM clustering, and facilitate an optional but reproducible strategy for manual merging of algorithm-generated clusters. Our workflow offers different analysis paths, including association of cell type abundance with a phenotype or changes in signaling markers within specific subpopulations, or differential analyses of aggregated signals. Importantly, the differential analyses we show are based on regression frameworks where the HDCyto data is the response; thus, we are able to model arbitrary experimental designs, such as those with batch effects, paired designs and so on. In particular, we apply generalized linear mixed models to analyses of cell population abundance or cell-population-specific analyses of signaling markers, allowing overdispersion in cell count or aggregated signals across samples to be appropriately modeled. To support the formal statistical analyses, we encourage exploratory data analysis at every step, including quality control (e.g. multi-dimensional scaling plots), reporting of clustering results (dimensionality reduction, heatmaps with dendrograms) and differential analyses (e.g. plots of aggregated signals).
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Moderated estimation of fold change and dispersion for RNA-seq data with DESeq2
Love, M. I., Huber, W., & Anders, S. (2014) · Genome Biology · doi:10.1186/s13059-014-0550-8 · Cited by 95,106
limma powers differential expression analyses for RNA-sequencing and microarray studies
Ritchie, M. E., Phipson, B., Wu, D., Hu, Y., Law, C. W., Shi, W., & Smyth, G. K. (2015) · Nucleic Acids Research · doi:10.1093/nar/gkv007 · Cited by 40,458
ConsensusClusterPlus: a class discovery tool with confidence assessments and item tracking
Wilkerson, M. D., & Hayes, D. N. (2010) · Bioinformatics · doi:10.1093/bioinformatics/btq170 · Cited by 5,669
McCarthy, D. J., Chen, Y., & Smyth, G. K. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks042 · Cited by 5,195
Data-Driven Phenotypic Dissection of AML Reveals Progenitor-like Cells that Correlate with Prognosis
Levine, J. H., Simonds, E. F., Bendall, S. C., Davis, K. L., Amir, E.-A. D., Tadmor, M. D., Litvin, O., Fienberg, H. G., Jager, A., Zunder, E. R., et al. (2015) · Cell · doi:10.1016/j.cell.2015.05.047 · Cited by 2,303
Bendall, S. C., Simonds, E. F., Qiu, P., Amir, E.-A. D., Krutzik, P. O., Finck, R., Bruggner, R. V., Melamed, R., Trejo, A., Ornatsky, O. I., et al. (2011) · Science · doi:10.1126/science.1198704 · Cited by 2,279
Monti, S., Tamayo, P., Mesirov, J., & Golub, T. (2003) · Machine Learning · doi:10.1023/a:1023949509487 · Cited by 2,116
FlowSOM: Using self‐organizing maps for visualization and interpretation of cytometry data
Van Gassen, S., Callebaut, B., Van Helden, M. J., Lambrecht, B. N., Demeester, P., Dhaene, T., & Saeys, Y. (2015) · Cytometry Part A · doi:10.1002/cyto.a.22625 · Cited by 1,919
Bendall, S. C., Davis, K. L., Amir, E.-A. D., Tadmor, M. D., Simonds, E. F., Chen, T. J., Shenfeld, D. K., Nolan, G. P., & Pe’er, D. (2014) · Cell · doi:10.1016/j.cell.2014.04.005 · Cited by 906
Moderated statistical tests for assessing differences in tag abundance
Robinson, M. D., & Smyth, G. K. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm453 · Cited by 856
Self-citationWattenberg, M., Viégas, F., & Johnson, I. (2016) · Distill · doi:10.23915/distill.00002 · Cited by 854
Normalization of mass cytometry data with bead standards
Finck, R., Simonds, E. F., Jager, A., Krishnaswamy, S., Sachs, K., Fantl, W., Pe'er, D., Nolan, G. P., & Bendall, S. C. (2013) · Cytometry Part A · doi:10.1002/cyto.a.22271 · Cited by 761
Diffusion maps for high-dimensional single-cell analysis of differentiation data
Haghverdi, L., Buettner, F., & Theis, F. J. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btv325 · Cited by 649
destiny : diffusion maps for large-scale single-cell data in R
Angerer, P., Haghverdi, L., Büttner, M., Theis, F. J., Marr, C., & Buettner, F. (2016) · Bioinformatics · doi:10.1093/bioinformatics/btv715 · Cited by 640
Critical assessment of automated flow cytometry data analysis techniques
The FlowCAP Consortium, Aghaeepour, N., The DREAM Consortium, Finak, G., Hoos, H., Mosmann, T. R., Brinkman, R., Gottardo, R., & Scheuermann, R. H. (2013) · Nature Methods · doi:10.1038/nmeth.2365 · Cited by 598
Zunder, E. R., Finck, R., Behbehani, G. K., Amir, E.-A. D., Krishnaswamy, S., Gonzalez, V. D., Lorang, C. G., Bjornson, Z., Spitzer, M. H., Bodenmiller, B., et al. (2015) · Nature Protocols · doi:10.1038/nprot.2015.020 · Cited by 596
flowCore: a Bioconductor package for high throughput flow cytometry
Hahne, F., LeMeur, N., Brinkman, R. R., Ellis, B., Haaland, P., Sarkar, D., Spidlen, J., Strain, E., & Gentleman, R. (2009) · BMC Bioinformatics · doi:10.1186/1471-2105-10-106 · Cited by 581
Spectral compensation for flow cytometry: Visualization artifacts, limitations, and caveats
Roederer, M. (2001) · Cytometry · doi:10.1002/1097-0320(20011101)45:3<194::aid-cyto1163>3.0.co;2-c · Cited by 558
Multiplexed mass cytometry profiling of cellular states perturbed by small-molecule regulators
Bodenmiller, B., Zunder, E. R., Finck, R., Chen, T. J., Savig, E. S., Bruggner, R. V., Simonds, E. F., Bendall, S. C., Sachs, K., Krutzik, P. O., et al. (2012) · Nature Biotechnology · doi:10.1038/nbt.2317 · Cited by 546
Web‐Based Analysis and Publication of Flow Cytometry Experiments
Kotecha, N., Krutzik, P. O., & Irish, J. M. (2010) · Current Protocols in Cytometry · doi:10.1002/0471142956.cy1017s53 · Cited by 511
Automated identification of stratifying signatures in cellular subpopulations
Bruggner, R. V., Bodenmiller, B., Dill, D. L., Tibshirani, R. J., & Nolan, G. P. (2014) · Proceedings of the National Academy of Sciences · doi:10.1073/pnas.1408792111 · Cited by 473
Computational flow cytometry: helping to make sense of high-dimensional immunology data
Saeys, Y., Van Gassen, S., & Lambrecht, B. N. (2016) · Nature Reviews Immunology · doi:10.1038/nri.2016.56 · Cited by 467
Comparison of clustering methods for high‐dimensional single‐cell flow and mass cytometry data
Weber, L. M., & Robinson, M. D. (2016) · Cytometry Part A · doi:10.1002/cyto.a.23030 · Cited by 378
Self-citationCytofkit: A Bioconductor Package for an Integrated Mass Cytometry Data Analysis Pipeline
Chen, H., Lau, M. C., Wong, M. T., Newell, E. W., Poidinger, M., & Chen, J. (2016) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1005112 · Cited by 355
Visualizing Large-scale and High-dimensional Data
Tang, J., Liu, J., Zhang, M., & Mei, Q. (2016) · Proceedings of the 25th International Conference on World Wide Web · doi:10.1145/2872427.2883041 · Cited by 306
COMPASS identifies T-cell subsets correlated with clinical outcomes
Lin, L., Finak, G., Ushey, K., Seshadri, C., Hawn, T. R., Frahm, N., Scriba, T. J., Mahomed, H., Hanekom, W., Bart, P.-A., et al. (2015) · Nature Biotechnology · doi:10.1038/nbt.3187 · Cited by 278
Optimizing a Multicolor Immunophenotyping Assay
Mahnke, Y. D., & Roederer, M. (2007) · Clinics in Laboratory Medicine · doi:10.1016/j.cll.2007.05.002 · Cited by 202
Finak, G., Frelinger, J., Jiang, W., Newell, E. W., Ramey, J., Davis, M. M., Kalams, S. A., De Rosa, S. C., & Gottardo, R. (2014) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1003806 · Cited by 197
Testing for differential abundance in mass cytometry data
Lun, A. T. L., Richard, A. C., & Marioni, J. C. (2017) · Nature Methods · doi:10.1038/nmeth.4295 · Cited by 181
Sensitive detection of rare disease-associated cell subsets via representation learning
Arvaniti, E., & Claassen, M. (2017) · Nature Communications · doi:10.1038/ncomms14825 · Cited by 179
SIMLR: A Tool for Large‐Scale Genomic Analyses by Multi‐Kernel Learning
Wang, B., Ramazzotti, D., Sano, L. D., Zhu, J., Pierson, E., & Batzoglou, S. (2017) · PROTEOMICS · doi:10.1002/pmic.201700232 · Cited by 146
van Unen, V., Li, N., Molendijk, I., Temurhan, M., Höllt, T., Jong, A. E. V. D. M., Verspaget, H. W., Mearin, M. L., Mulder, C. J. J., van Bergen, J., et al. (2016) · Immunity · doi:10.1016/j.immuni.2016.04.014 · Cited by 137
High-dimensional single-cell analysis reveals the immune signature of narcolepsy
Hartmann, F. J., Bernard‐Valnet, R., Queriault, C., Mrdjen, D., Weber, L. M., Galli, E., Krieg, C., Robinson, M. D., Nguyen, X., Dauvilliers, Y. A., et al. (2016) · The Journal of Experimental Medicine · doi:10.1084/jem.20160897 · Cited by 132
Self-citationCharacterizing cell subsets using marker enrichment modeling
Diggins, K. E., Greenplate, A. R., Leelatian, N., Wogsland, C. E., & Irish, J. M. (2017) · Nature Methods · doi:10.1038/nmeth.4149 · Cited by 132
Zhao, K., Lu, Z., Park, J. W., Zhou, Q., & Xing, Y. (2013) · Genome biology · doi:10.1186/gb-2013-14-7-r74 · Cited by 98
Mixture models for single-cell assays with applications to vaccine studies
Finak, G., McDavid, A., Chattopadhyay, P. K., Dominguez, M., Rosa, S. C. D., Roederer, M., & Gottardo, R. (2013) · Biostatistics · doi:10.1093/biostatistics/kxt024 · Cited by 78
Pejoski, D., Tchitchek, N., Pozo, A. R., Elhmouzi‐Younes, J., Yousfi, R., Rogez‐Kreuz, C., Clayette, P., Dereuddre‐Bosquet, N., Lévy, Y., Cosma, A., et al. (2016) · The Journal of Immunology · doi:10.4049/jimmunol.1502005 · Cited by 31
Lin, L., Frelinger, J., Jiang, W., Finak, G., Seshadri, C., Bart, P., Pantaleo, G., McElrath, J., Rosa, S. D., & Gottardo, R. (2015) · Cytometry Part A · doi:10.1002/cyto.a.22623 · Cited by 26
Another step on the path to mass cytometry standardization
Leipold, M. D. (2015) · Cytometry Part A · doi:10.1002/cyto.a.22661 · Cited by 19
Cheng, J., Hu, Y., Liu, Y., & Li, M. (2015) · Cancer Informatics · doi:10.4137/cin.s24832 · Cited by 12
Li, Y. H., Li, D., Samusik, N., Wang, X., Guan, L., Nolan, G. P., & Wong, W. H. (2017) · PLoS Computational Biology · doi:10.1371/journal.pcbi.1005875 · Cited by 10
Cheng, J., Hu, Y., Liu, Y., & Li, M. (2014) · Cancer Informatics · doi:10.4137/cin.s13971 · Cited by 7
Research works printed but not linked: 1
- L van der Maaten, 2008, Visualizing high-dimensional data using t-sne., J Mach Learn Res.
Cited by
Fecal microbiota transplant overcomes resistance to anti–PD-1 therapy in melanoma patients
Davar, D., Dzutsev, A. K., McCulloch, J. A., Rodrigues, R. R., Chauvin, J.-M., Morrison, R. M., Deblasio, R. N., Menna, C., Ding, Q., Pagliano, O., et al. (2021) · Science · doi:10.1126/science.abf3363 · Cited by 1,781
Severe COVID-19 Is Marked by a Dysregulated Myeloid Cell Compartment
Schulte-Schrepping, J., Reusch, N., Paclik, D., Baßler, K., Schlickeiser, S., Zhang, B., Krämer, B., Krammer, T., Brumhard, S., Bonaguro, L., et al. (2020) · Cell · doi:10.1016/j.cell.2020.08.001 · Cited by 1,461
Cloughesy, T. F., Mochizuki, A. Y., Orpilla, J. R., Hugo, W., Lee, A. H., Davidson, T. B., Wang, A. C., Ellingson, B. M., Rytlewski, J. A., Sanders, C. M., et al. (2019) · Nature Medicine · doi:10.1038/s41591-018-0337-7 · Cited by 1,382
Eleven grand challenges in single-cell data science
Lähnemann, D., Köster, J., Szczurek, E., McCarthy, D. J., Hicks, S. C., Robinson, M. D., Vallejos, C. A., Campbell, K. R., Beerenwinkel, N., Mahfouz, A., et al. (2020) · Genome Biology · doi:10.1186/s13059-020-1926-6 · Cited by 1,327
Self-citationSystems biological assessment of immunity to mild versus severe COVID-19 infection in humans
Arunachalam, P. S., Wimmers, F., Mok, C. K. P., Perera, R. A. P. M., Scott, M., Hagan, T., Sigal, N., Feng, Y., Bristow, L., Tak-Yin Tsang, O., et al. (2020) · Science · doi:10.1126/science.abc6261 · Cited by 1,186
Metadata
- Authors
- Nowicka, M., Krieg, C., Weber, L. M., Hartmann, F. J., Guglietta, S., Becher, B., Levesque, M. P., & Robinson, M. D.
- Venue
- F1000Research
- Publisher
- F1000 Research Ltd
- Published
- 2017-05-26
- Volume
- 6
- Pages
- 748
- ISSN
- 2046-1402 (ISSN-L)
- OpenAlex
- W4240098044
- Cited by
- 403
- References
- 42
- FWCI
- 8.54
- Type
- journal article
- Language
- en
- Open access
- gold
- Funders
- Swiss Institute of Bioinformatics
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.