Quantifying the effect of experimental perturbations at single-cell resolution
Open accessPublished version of a preprint
Abstract
Current methods for comparing single-cell RNA sequencing datasets collected in multiple conditions focus on discrete regions of the transcriptional state space, such as clusters of cells. Here we quantify the effects of perturbations at the single-cell level using a continuous measure of the effect of a perturbation across the transcriptomic space. We describe this space as a manifold and develop a relative likelihood estimate of observing each cell in each of the experimental conditions using graph signal processing. This likelihood estimate can be used to identify cell populations specifically affected by a perturbation. We also develop vertex frequency clustering to extract populations of affected cells at the level of granularity that matches the perturbation response. The accuracy of our algorithm at identifying clusters of cells that are enriched or depleted in each condition is, on average, 57% higher than the next-best-performing algorithm tested. Gene signatures derived from these clusters are more accurate than those of six alternative algorithms in ground truth comparisons. Matched treatment and control single-cell RNA sequencing samples are more accurately compared at the single-cell level.
Integrity signals
Registry
Cites
Statistics
Claims the paper makes
0 of 57 cited sources checked · 0 supported · 0 flagged
- Findingown data
The authors found cases where subsets within a cluster had divergent perturbation responses that published cluster-level analyses missed.
“We demonstrate cases where subsets of a cluster exhibit divergent responses to a perturbation that were missed in published analysis that was limited to clusters derived using data geometry alone.”
Quote in the paperSubstantial claim - Findingown data
The sample-associated density estimate for two conditions can be computed on 50,000 cells in under 8 minutes in a free Google Colaboratory notebook.
“The sample-associated density estimate for two conditions can be calculated on a dataset of 50,000 cells in less than 8 min in a free Google Colaboratory notebook”
Quote in the paperNot a substantial claim - Findingown data
The authors generated and characterized a human pancreatic islet dataset cultured for 24 hours with and without IFN-γ.
“we generated and characterized a dataset of human pancreatic islet cells cultured for 24 h with and without interferon-gamma (IFN-γ)”
Quote in the paperSubstantial claim - Findingown data
The responsive-mid cluster matched a transitional population with a structured distribution of input sample signals.
“The responsive–mid cluster matches our characterization of a transitional population with a structured distribution of input sample signals.”
Quote in the paperNot a substantial claim - Findingreasoning
The VFC-based approach recovers gene signatures more accurately than directly comparing two samples.
“we show in the following section that this approach is capable of recovering gene signatures more accurately than directly comparing two samples.”
Quote in the paperSubstantial claim
- Findingown data
MELD is robust to the number of captured cells, with only a 10% performance decrease when 65% of cells in the T cell dataset were removed.
“We also determined that the MELD algorithm is robust to the number of cells captured in the experiment, with only a 10% decrease in performance when 65% of the cells in the T cell dataset were removed (Supplementary Fig. 5).”
Quote in the paperNot a substantial claim - Findingown data
Twelve of the 28 published clusters warranted further VFC subclustering, yielding 50 final cluster labels.
“We found that 12 of the 28 published clusters warranted further subclustering with VFC, resulting in a total of 50 final cluster labels (Suppplementary Fig. 10j).”
Quote in the paperSubstantial claim - Findingown data
Knockout of negative TCR regulators including PTPN6, PTPN11, and EGR3 slightly increased the relative likelihood of the stimulation condition.
“We also found a slight increase in relative likelihood of the stimulation condition in cells in which negative regulators of TCR activation are knocked out, including PTPN6, PTPN11 and EGR3.”
Quote in the paperNot a substantial claim - Findingown data
VFC analysis found that several clusters contained biologically distinct subpopulations with divergent responses to chd knockout.
“Using VFC analysis, we found that several of these clusters contained biologically distinct subpopulations of cells with divergent responses to chd knockout.”
Quote in the paperSubstantial claim - Findingown data
Two beta cell clusters had intermediate IFN-γ relative likelihood values.
“Notably, we found two clusters of beta cells with intermediate IFN-γ relative likelihood values.”
Quote in the paperNot a substantial claim - Findingcitation
Established marker genes identified three major islet populations corresponding to alpha, beta, and delta cells.
“We then used established marker genes of islet cells35 to identify three major populations of cells corresponding to alpha, beta and delta cells”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [35] Muraro, M. J. et al. A single-cell transcriptome atlas of the human pancreas. Cell Syst. 3, 385–394 (2016).
Not checked in the free run.
- Findingown data
One beta cluster labeled non-responsive had high-frequency input sample signals indicative of a non-responsive population.
“Examining the distribution of input sample signals values in these intermediate cell types, we find that one cluster, which we label as non-responsive, exhibits high-frequency input sample signals indicative of a population of cells that does not respond to an experimental treatment.”
Quote in the paperNot a substantial claim - Findingown data
A rank sum test identified 911 genes differentially expressed in all three endocrine cell types between clusters with highest and lowest IFN-γ relative likelihood.
“Using a rank sum test to identify genes that change the most between the clusters with highest and lowest IFN-γ relative likelihood values within each endocrine population, we identified 911 genes differentially expressed in all three cell types.”
Quote in the paperSubstantial claim - Findingown data
Insulin showed the greatest expression difference, approximately 2.5-fold increased in non-responsive cells.
“The gene with the greatest difference in expression was insulin, the major hormone produced by beta cells, which is approximately 2.5-fold increased in the non-responsive cells (Fig. 6f).”
Quote in the paperSubstantial claim - Findingown data
Applying VFC to each endocrine cell type identified nine clusters in total.
“We next applied VFC to each of the three endocrine cell types and identified a total of nine clusters.”
Quote in the paperNot a substantial claim - Findingown data
The T cell activation signature contained 2,335 genes with q < 0.05 by rank sum test with Benjamini-Hochberg correction.
“We identified 2,335 genes with a q value < 0.05 as measured by a rank sum test with a Benjamini–Hochberg false discovery rate correction27.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [27] Fischer, D. Theislab/diffxpy. Theis Lab https://github.com/theislab/diffxpy (2020).
Not checked in the free run.
- Findingcitation
The authors' results agree with bulk RNA-seq validation showing strongest TCR response depletion with LCK, ZAP70, and LAT knockout.
“Encouragingly, our results agree with the bulk RNA sequencing validation experiment in ref.13, showing strongest depletion of TCR response with knockout of kinases LCK and ZAP70 and adaptor protein LAT.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [13] Datlinger, P. et al. Pooled CRISPR screening with single-cell transcriptome readout. Nat. Methods 14, 297–301 (2017). source
Not checked in the free run.
- Findingown data
A noticeable donor-ID batch effect was observed, driven by maximum glucagon, insulin, and somatostatin expression in alpha, beta, and delta cells.
“Examining the expression of marker genes for major cell types of the pancreas, we observed a noticeable batch effect associated with the donor ID, driven by the maximum expression of glucagon, insulin and somatostatin in alpha, beta and delta cells, respectively (Supplementary Fig. 11a).”
Quote in the paperSubstantial claim - Findingown data
The consensus IFN-γ signature included JAK-STAT pathway genes such as STAT1 and IRF1 and antiviral response genes such as MX1, OAS3, ISG20, and RSAD2.
“This consensus signature includes activation of genes in the JAK-STAT pathway, including STAT1 and IRF1 (ref.38), and in the IFN-mediated antiviral response, including MX1, OAS3, ISG20 and RSAD2 (refs.39–41).”
Quote in the paperSubstantial claim0 of 4 sources checked- cites [38] Ramana, C. V., Gil, M. P., Schreiber, R. D. & Stark, G. R. Stat1-dependent and -independent pathways in IFN-γ-dependent signaling. Trends Immunol. 23, 96–101 (2002). source
Not checked in the free run.
- cites [39] Sadler, A. J. & Williams, B. R. G. Interferon-inducible antiviral effectors. Nat. Rev. Immunol. 8, 559–568 (2008). source
Not checked in the free run.
- cites [40] Fitzgerald, K. A. The interferon inducible gene: viperin. J. Interferon Cytokine Res. 31, 131–135 (2011). source
Not checked in the free run.
- cites [41] Zheng, Z., Wang, L. & Pan, J. Interferon-stimulated gene 20-kDa protein (ISG20) in infection and disease: review and outlook. Intractable Rare Dis. Res. 6, 35–40 (2017). source
Not checked in the free run.
- Findingown data
Several clusters had a wide range of chordin-relative likelihood values, suggesting cells within them had different perturbation responses.
“However, we observed that several clusters had a wide range of chordin-relative likelihood values, suggesting that there are cells in these clusters with different perturbation responses.”
Quote in the paperSubstantial claim - Findingown data
Manual annotation of the three largest VFC-subdivided clusters revealed previously unreported effects of chd loss of function.
“To determine the biological relevance of the VFC clusters, we manually annotated each of the three largest clusters subdivided by VFC, revealing previously unreported effects of chd loss of function within this dataset.”
Quote in the paperSubstantial claim - Findingown data
For the GO terms highlighted in ref. 13, the MELD gene list had the highest combined score among all examined terms.
“Considering the Gene Ontology (GO) terms highlighted in ref.13, we found that the MELD gene list has the highest combined score in all of the gene terms we examined (Fig. 4d).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [13] Datlinger, P. et al. Pooled CRISPR screening with single-cell transcriptome readout. Nat. Methods 14, 297–301 (2017). source
Not checked in the free run.
- Findingown data
The most highly activated alpha cell cluster was enriched in donor 2.
“Furthermore, the most highly activated alpha cell cluster is enriched in donor 2.”
Quote in the paperNot a substantial claim - Findingreasoning
The MELD/VFC analysis framework outperforms the current best practice of clustering cells by gene expression and then computing differential abundance and differential expression within clusters.
“We have shown that our analysis framework improves over the current best practice of clustering cells based on gene expression and calculating differential abundance and differential expression within clusters.”
Quote in the paperSubstantial claim - Findingreasoning
The α-decaying kernel is susceptible to batch effects.
“Although the kernel in Equation (4) provides an effective way of capturing neighborhood structure in data, it is susceptible to batch effects.”
Quote in the paperSubstantial claim- Rests on an assumption: Batch effects can make within-batch affinities much higher than between-batch affinities, creating separation by batch rather than biological state.
- Findingown data
In the zebrafish dataset, published clusters contained biologically relevant subpopulations with divergent responses to the experimental perturbation.
“In our analysis of the zebrafish dataset, we showed that the published clusters contained biologically relevant subpopulations of cells with divergent responses to the experimental perturbation.”
Quote in the paperSubstantial claim - Findingown data
Gene set enrichment analysis of the signature genes found strong enrichment for IFN signaling pathway terms.
“To confirm the validity of our gene signatures, we use EnrichR28 to perform gene set enrichment analysis on the signature genes and found strong enrichment for terms associated with IFN signaling pathways (Supplementary Fig. 11d).”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [28] Kuleshov, M. V. et al. Enrichr: a comprehensive gene set enrichment analysis web server 2016 update. Nucleic Acids Res. 44, W90–W97 (2016). source
Not checked in the free run.
- Findingown data
In quantitative comparisons, MELD recovers the true conditional likelihood more accurately than simpler label-smoothing methods.
“As we show in our quantitative comparisons, this formulation performs better at deriving the true conditional likelihood in quantitative comparisons than simpler label-smoothing algorithms.”
Quote in the paperSubstantial claim - Findingreasoning
Gene signatures extracted using VFC-derived clusters outperform signatures from direct two-sample comparison or traditional clustering.
“We show that gene signatures extracted using these clusters outperform those derived from direct comparison of two samples or traditional clustering approaches.”
Quote in the paperSubstantial claim - Findingown data
Laplacian regularization acts as a low-pass filter over Laplacian eigenvalues, with β setting the cutoff.
“Supplementary Fig. 13 shows that this function is a low-pass filter on the Laplacian eigenvalues with cutoff parameterized by β.”
Quote in the paperSubstantial claim - Findingown data
Depending on α and ρ, the manifold heat filter can act as low-pass, band-pass, or high-pass.
“The parameters α and ρ change the filter from low pass to band pass or high pass.”
Quote in the paperNot a substantial claim - Findingown data
A previously unreported subpopulation of beta cells in pancreatic islets stimulated with IFN-γ appeared unresponsive to stimulation.
“We also described a previously unpublished dataset of pancreatic islet cells stimulated with IFN-γ and characterized a previously unreported subpopulation of beta cells that appeared unresponsive to stimulation.”
Quote in the paperNot a substantial claim - Findingown data
The best β values change as a function of the number of cells generated by Splatter when the underlying geometry is held constant.
“Supplementary Fig. 14b shows how the optimal β values vary as a function of the number of cells generated using Splatter while keeping the underlying geometry the same.”
Quote in the paperNot a substantial claim - Findingown data
A coarse grid search over MELD parameters found that α = 0 and ρ = 1 gave the best performance irrespective of the β parameter.
“A coarse-grained grid search revealed that setting α = 0 and ρ = 1 performed best regardless of the β parameter.”
Quote in the paperNot a substantial claim - Interpretationown data
The frequency composition of sample labels and relative likelihood scores can serve as the basis for vertex frequency clustering.
“Second, we show that the frequency composition of the sample label and the relative likelihood scores can be used as the basis for a clustering algorithm that we call vertex frequency clustering (VFC).”
Quote in the paperSubstantial claim - Premisecitation
The heat kernel uses diffusion to adapt locally in regions of varying data density, as seen in single-cell data.
“This kernel uses diffusion to provide local adaptivity in regions of varying data density21, such as is observed in single-cell data.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [21] Botev, Z. I., Grotowski, J. F. & Kroese, D. P. Kernel density estimation via diffusion. Ann. Stat. 38, 2916–2957 (2010). source
Not checked in the free run.
- Premisecitation
Nearly all prior work comparing single-cell datasets first partitions the data discretely before downstream analysis.
“Almost all previous work quantifying differences between single-cell datasets relies on discrete partitioning of the data before downstream analysis9–16.”
Quote in the paperSubstantial claim0 of 8 sources checked- cites [9] Patel, A. P. et al. Single-cell RNA-seq highlights intratumoral heterogeneity in primary glioblastoma. Science 344, 1396–1401 (2014). source
Not checked in the free run.
- cites [10] Finak, G. et al. MAST: a flexible statistical framework for assessing transcriptional changes and characterizing heterogeneity in single-cell RNA sequencing data. Genome Biol. 16, 278 (2015). source
Not checked in the free run.
- cites [11] Tirosh, I. et al. Dissecting the multicellular ecosystem of metastatic melanoma by single-cell RNA-seq. Science 352, 189–196 (2016). source
Not checked in the free run.
- cites [12] Jaitin, D. A. et al. Dissecting immune circuits by linking CRISPR-pooled screens with single-cell RNA-seq. Cell 167, 1883–1896 (2016). source
Not checked in the free run.
- cites [13] Datlinger, P. et al. Pooled CRISPR screening with single-cell transcriptome readout. Nat. Methods 14, 297–301 (2017). source
Not checked in the free run.
- cites [14] Gao, X., Hu, D., Gogol, M. & Li, H. ClusterMap: comparing analyses across multiple single cell RNA-seq profiles. Bioinformatics 35, 3038–3045 (2018). source
Not checked in the free run.
- cites [15] Wagner, D. E. et al. Single-cell mapping of gene expression landscapes and lineage in the zebrafish embryo. Science 360, 981–987 (2018). source
Not checked in the free run.
- cites [16] Farrell, J. A. et al. Single-cell reconstruction of developmental trajectories during zebrafish embryogenesis. Science 360, eaar3131 (2018). source
Not checked in the free run.
- Interpretationnone given
The authors' method measures perturbation effects per cell using a continuous quantity across the transcriptomic space.
“Here we quantify the effects of perturbations at the single-cell level using a continuous measure of the effect of a perturbation across the transcriptomic space.”
Quote in the paperSubstantial claim - Premisereasoning
The Gaussian kernel density estimator can be generalized to a manifold by using the eigenbasis of the Laplace operator as the kernel basis.
“However, this basis is not well defined for a Riemannian manifold, so we, instead, use the eigenbasis of the Laplace operator as our kernel basis.”
Quote in the paperSubstantial claim - Interpretationreasoning
Analyzing experimental effects only at the cluster level loses power available from single-cell data.
“However, reducing experimental analysis to the level of clusters sacrifices the power of single-cell data.”
Quote in the paperSubstantial claim - Interpretationnone given
The sample-associated relative likelihood can identify cell states that are most and least affected by an experimental treatment.
“First, the relative likelihoods of each condition can be used to identify the cell states most and least affected by an experimental treatment.”
Quote in the paperSubstantial claim - Interpretationnone given
Sample-associated density estimates allow identification of cells most and least affected by a perturbation.
“With the sample-associated density estimates, it is now possible to identify the cells that are most and least affected by an experimental perturbation.”
Quote in the paperSubstantial claim - Interpretationreasoning
Sample-associated relative likelihoods can be applied to scRNA-seq perturbation studies with different experimental designs.
“The sample-associated relative likelihoods can be used to analyze scRNA-seq perturbation studies of varying experimental designs.”
Quote in the paperSubstantial claim - Interpretationreasoning
VFC identifies populations with similar perturbation responses at the granularity of the response.
“VFC identifies populations of cells that are similarly affected (enriched, depleted or unchanged) between conditions at the level of granularity of the perturbation response.”
Quote in the paperSubstantial claim - Interpretationown data
MELD and VFC are suitable for characterizing a biological process such as TCR activation in a complex Cas9 knockout screen.
“Together, these results show that the MELD and VFC algorithms are suitable for characterizing a biological process, such as TCR activation in the context of a complex Cas9 knockout screen.”
Quote in the paperSubstantial claim - Premisecitation
Incomplete penetrance is expected in the zebrafish dataset because Cas9 mutagenesis is mosaic.
“We expect incomplete penetrance of the perturbation in this dataset because of the mosaic nature of Cas9 mutagenesis29.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [29] Yen, S.-T. et al. Somatic mosaicism and allele complexity induced by CRISPR/Cas9 RNA injections in mouse zygotes. Dev. Biol. 393, 3–9 (2014). source
Not checked in the free run.
- Interpretationreasoning
The VFC feature basis combines frequency information, relative likelihood magnitude, and the cell similarity graph to identify phenotypically similar populations with uniform perturbation response.
“The VFC feature basis combines this frequency information with the magnitude of the sample-associated relative likelihood and the cell similarity graph to identify phenotypically similar populations of cells with uniform response to a perturbation.”
Quote in the paperSubstantial claim - Interpretationreasoning
Clustering cells by transcriptome alone and then testing differential representation is problematic because cluster sizes may not match responsive population sizes.
“Existing methods cluster cells by transcriptome alone and then attempt to quantify the degree to which these clusters are differentially represented in the two conditions. However, this is problematic because the granularity, or sizes, of these clusters might not correspond to the sizes of the cell populations that respond similarly to experimental treatment.”
Quote in the paperSubstantial claim - Interpretationcitation
The non-responsive beta cluster resembles a recently described extreme beta cell population with elevated insulin mRNA that is more abundant in diabetic mice.
“This cluster of cells bears resemblance to a recently described ‘extreme’ population of beta cells that exhibit elevated insulin messenger RNA (mRNA) levels and are found to be more abundant in diabetic mice36,37.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [36] Xin, Y. et al. Pseudotime ordering of single human β-cells reveals states of insulin production and unfolded protein response. Diabetes 67, 1783–1794 (2018). source
Not checked in the free run.
- cites [37] Farack, L. et al. Transcriptional heterogeneity of beta cells in the intact pancreas. Dev. Cell 48, 115–125 (2019). source
Not checked in the free run.
- Interpretationown data
MELD and VFC outperform existing methods for analyzing multiple scRNA-seq datasets from different experimental conditions.
“These results confirm that MELD and VFC outperform existing methods for analyzing multiple scRNA-seq datasets from different experimental conditions.”
Quote in the paperSubstantial claim - Interpretationown data
The published clusters' resolution is too coarse because chordin-relative likelihood values are very widely distributed in several clusters.
“We infer that the resolution of the published clusters is too coarse because the distribution of chordin-relative likelihood values is very large for several of the clusters.”
Quote in the paperSubstantial claim - Interpretationcitation
VFC provides a feature basis for clustering based on the spectrogram of sample indicator signals.
“The VFC algorithm provides a feature basis for clustering based on the spectrogram23 of the sample indicator signals, which can be thought of as a histogram of frequency components of graph signals.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [23] Shuman, D. I., Ricaud, B. & Vandergheynst, P. Vertex-frequency analysis on graphs. Applied Comput. Harmon. Anal. 40, 260–291 (2016). source
Not checked in the free run.
- Interpretationreasoning
The magnitude of the relative likelihood alone does not fully describe differences in perturbation response.
“However, the magnitude of the relative likelihood does not give a complete picture of differences in response to a perturbation.”
Quote in the paperSubstantial claim - Interpretationreasoning
Distinguishing transitional from even-mixture cases requires considering both the relative likelihood magnitude and the frequency of input sample indicator signals over the manifold.
“To differentiate between such scenarios, we must consider not only the magnitude of the sample-associated relative likelihood but also the frequency of the input sample indicator signals over the manifold.”
Quote in the paperSubstantial claim - Interpretationown data
The gene signature from MELD and VFC outperformed standard differential expression analyses for a real-world experimental perturbation.
“Furthermore, the gene signature identified using the MELD and VFC outperformed standard differential expression analyses to identify the signature of a real-world experimental perturbation.”
Quote in the paperSubstantial claim - Interpretationnone given
Clustering cells before quantifying compositional differences can miss divergent responses of subpopulations within a cluster.
“Clustering before quantifying compositional differences can fail to identify the divergent responses of subpopulations of cells within a cluster.”
Quote in the paperSubstantial claim - Interpretationown data
Sample-associated relative likelihood can quantify differences among more than two conditions.
“Although most of the analysis here focuses on two-condition experiments, we show that it is possible to use the sample-associated relative likelihood to quantify the differences between more than two conditions.”
Quote in the paperSubstantial claim - Interpretationcitation
The MNN kernel adjustment alleviates batch effects in graph construction.
“To alleviate such effects, we adjust the kernel construction using an approach inspired by recent work in ref.49 on the MNN kernel.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites ref.49
Not checked in the free run.
- Rests on an assumption: Batch effects can make within-batch affinities much higher than between-batch affinities, creating separation by batch rather than biological state.
- Interpretationreasoning
For one parameter choice, MELD's density estimate matches Gaussian KDE on the graph.
“showing that our density estimate with a specific parameter set is equivalent to the Gaussian density estimate on the graph.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Single-cell data lie on a low-dimensional manifold embedded in ambient space.
- Interpretationcitation
Normalizing for density permits density estimation on the underlying manifold even with non-uniform sampling.
“This correction allows us to estimate density over the underlying geometry of the manifold even in the case where data are not uniformly sampled.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Single-cell data lie on a low-dimensional manifold embedded in ambient space.
- Rests on an assumption: Real single-cell data are rarely uniformly sampled from a manifold.
- Interpretationnone given
The sample-associated relative likelihood algorithm's key innovation is quantifying perturbation effects at single-cell resolution using manifold learning theory.
“The key innovation in the sample-associated relative likelihood algorithm is quantifying the effect of a perturbation at the resolution of single cells using theory from manifold learning.”
Quote in the paperSubstantial claim - Interpretationown data
MELD analysis can reveal biological insights in a clinically relevant experiment.
“Together, these results demonstrate the utility of MELD analysis to reveal biological insights in a clinically relevant biological experiment.”
Quote in the paperSubstantial claim - Interpretationcitation
With infinite samples, MELD's density estimate should approach the density on the continuous data manifold.
“This density estimate, as the number of samples goes to infinity, should converge to the density estimate along a continuous manifold formed by the data.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Single-cell data lie on a low-dimensional manifold embedded in ambient space.
- Interpretationown data
MELD analysis identified a beta cell population with high insulin expression that appears unaffected by IFN-γ stimulation.
“Here, we applied MELD analysis to identify the signature of IFN-γ stimulation across alpha, beta and delta cells, and we identified a population of beta cells with high insulin expression that appears unaffected by IFN-γ stimulation.”
Quote in the paperSubstantial claim - Interpretationnone given
A squared Laplacian allows the manifold heat filter to simplify to Laplacian regularization.
“In our results, we demonstrate a manifold heat filter that may be reduced to Laplacian regularization using a squared Laplacian.”
Quote in the paperNot a substantial claim - Premisecitation
For data drawn from a smooth density on the manifold, recovering manifold geometry requires dividing out that density.
“When the data are, instead, sampled from a smooth density X~q(x) over the manifold, then the density must be normalized out to recover the geometry of the manifold.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites ref.50
Not checked in the free run.
- The authors state this as an assumption: Single-cell data lie on a low-dimensional manifold embedded in ambient space.
- Rests on an assumption: Real single-cell data are rarely uniformly sampled from a manifold.
- Interpretationnone given
Unlike previous Laplacian filters, MELD parameters allow analysis of signals that combine several underlying changes at various frequencies.
“In contrast to previous works using Laplacian filters, our parameters allow analysis of signals that are combinations of several underlying changes occurring at various frequencies.”
Quote in the paperSubstantial claim - Interpretationnone given
Setting β = tλmax, α = 0, and φ = 1 makes the graph heat-equation solution match MELD.
“This is equivalent to MELD when β = tλmax, α = 0 and ϕ = 1.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Single-cell data lie on a low-dimensional manifold embedded in ambient space.
- Premisecitation
When ρ is an integer, columns of L^ρ are localized to ρ-hop neighborhoods.
“Each column of Lk is k − hoplocalized, meaning that Lijk is non-zero if and only if the there exists a path length k between vertex i and vertex j”
Quote in the paperSubstantial claim0 of 1 sources checked- cites ref.56, Section 5.2
Not checked in the free run.
- Interpretationreasoning
Combining samples from several distributions improves estimation of the shared manifold by using all data.
“This allows us to use samples from multiple distributions, in our case distributions over cellular states, which allows a better estimate of underlying manifold using all available data.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Single-cell data lie on a low-dimensional manifold embedded in ambient space.
- Interpretationcitation
Under uniform manifold sampling and a standard Gaussian graph kernel, the heat-equation construction converges to Gaussian KDE on the manifold.
“When data X are sampled uniformly from the manifold M and the standard Gaussian kernel is used to construct the graph, then Theorem 2.1 of ref.70, which proves the convergence of the eigenvalues of the discrete graph Laplacian to the continuous Laplacian and implies (20), converges to the Gaussian KDE on the manifold.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites ref.70
Not checked in the free run.
- The authors state this as an assumption: Single-cell data lie on a low-dimensional manifold embedded in ambient space.
- Interpretationreasoning
For low-pass filtering, Laplacian regularization is a special case of the manifold heat filter.
“Laplacian regularization is a sub-problem of the manifold heat filter that we will discuss for low-pass filtering.”
Quote in the paperNot a substantial claim - Interpretationnone given
Frequency trends of sample indicator signals allow inference of movements in cellular state space during experimental perturbation.
“The frequency trends of the sample indicator signals are important because they allow us to infer movements in the cellular state space that occur during experimental perturbation.”
Quote in the paperNot a substantial claim - Interpretationreasoning
The graph-filter frequency response for Laplacian regularization is hreg(λ) = (1+βλ)−1.
“Thus, Laplacian regularization is a graph filter with frequency response hreg(λ) = (1+βλ)−1.”
Quote in the paperSubstantial claim - Interpretationreasoning
MELD can be interpreted as applying Gaussian KDE on the discrete data manifold.
“The MELD algorithm can be thought of as a Gaussian KDE over the discrete manifold formed by the data.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Single-cell data lie on a low-dimensional manifold embedded in ambient space.
- Interpretationreasoning
At intermediate transcriptomic states between the extreme states most enriched in either condition, both low- and middle-frequency components of the sample indicator signal are observed.
“We note that, at intermediate cell transcriptomic states between the extreme states that are most enriched in either condition, we observe both low- and middle-frequency sample indicator signal components; see the blue cell in the cartoon in Fig. 2a.”
Quote in the paperSubstantial claim - Interpretationnone given
Using the actual input signal as a feature lets the clustering use both frequency and sign information from the raw experimental signal.
“Second, using the actual input signal as a feature allows the clustering to consider both frequency and sign information in the raw experimental signal.”
Quote in the paperSubstantial claim - Premisecitation
For any function f whose frequency content is concentrated around λ0, the modulated function Mkf is concentrated in frequency around λk.
“Furthermore, for any function f whose frequency content is localized around λ0, (Mkf) is localized in frequency around λk.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites ref.23
Not checked in the free run.
- Interpretationreasoning
By using windowed signals that are large and small, VFC can find clusters of both sizes that are similarly affected by an experimental perturbation.
“By considering windowed signals that are large (that is, contain many neighboring points) and small (that is, very proximal on the graph), we can identify clusters both large and small that are similarly affected by an experimental perturbation.”
Quote in the paperSubstantial claim - Interpretationreasoning
Trends in the sample indicator signal linked to low-frequency eigenvectors of the graph Laplacian are interpreted as biological transitions between cell states.
“Because the low-frequency eigenvectors of the graph Laplacian identify smoothly varying axes of variance through a graph, we associate trends in the sample indicator signal associated with these low-frequency eigenvectors as biological transitions between cell states.”
Quote in the paperSubstantial claim- Rests on an assumption: The graph Laplacian's low-frequency eigenvectors capture smoothly varying directions of variance across a graph.
- Interpretationreasoning
When a group of cells is completely unaffected by an experimental perturbation, only high-frequency variations in the sample indicator signal are expected, with no low-frequency transition component.
“Here, we expect to find only high-frequency variations in the sample indicator signal and no underlying transition or low-frequency component.”
Quote in the paperSubstantial claim - Premisecitation
Translating the normalized heat kernel, multiplying it element-wise with the target signal, and taking the Fourier transform yields a WGFT of f that is localized according to diffusion distance from each vertex to every other vertex.
“By translating this kernel, element-wise multiplying it with our target signal f and taking the Fourier transform of the result, we obtain a WGFT of f that is localized based on the diffusion distance23,57 from each vertex to every other vertex in the graph.”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [23] Shuman, D. I., Ricaud, B. & Vandergheynst, P. Vertex-frequency analysis on graphs. Applied Comput. Harmon. Anal. 40, 260–291 (2016). source
Not checked in the free run.
- cites [57] Perraudin, N., Ricaud, B., Shuman, D. & Vandergheynst, P. Global and local uncertainty principles for signals on graphs. APSIPA Trans. Signal Inform. Process. 7, E3 (2018); https://doi.org/10.1017/ATSIP.2018.2 source
Not checked in the free run.
- Interpretationcitation
For non-uniform sampling, density normalization yields an estimate of the underlying geometry that is not biased by density.
“When the density is non-uniformly sampled from the manifold, this allows an estimation of the underlying geometry unbiased by density.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Single-cell data lie on a low-dimensional manifold embedded in ambient space.
- Rests on an assumption: Real single-cell data are rarely uniformly sampled from a manifold.
- Interpretationreasoning
Including the relative likelihood of each sample in the clustering basis lets VFC account for the degree of enrichment of each cell group between conditions.
“Our second contribution is the inclusion of the relative likelihood of each sample in our basis for clustering. This allows VFC to take into account the degree of enrichment of each group of cells between condition.”
Quote in the paperSubstantial claim - Interpretationnone given
The multi-scale approach eliminates the need to choose a window size.
“Foremost, it removes the complexity of picking a window size.”
Quote in the paperSubstantial claim
- May combine two claims. 29
- Classified as probably not a substantial claim. 33
May combine two claims.
Findingown dataNon-responsive cell populations have high-frequency sample indicator signal components, whereas transitional populations have lower-frequency components.
“We observe that we can distinguish between non-responsive populations of cells with high-frequency sample indicator signal components and transitional populations with lower-frequency indicator signal components.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe most enriched clusters contained mesodermal cells, and the most depleted clusters contained dorsally derived neural cells, matching the reported ventralization phenotype after chd loss of function.
“We found that, overall, the most enriched clusters contain mesodermal cells, and the most depleted clusters contain dorsally derived neural cells matching the ventralization phenotype previously reported with chd loss of function30–32.”
Quote in the paperSubstantial claim0 of 3 sources checked- cites [30] Hammerschmidt, M. et al. Dino and mercedes, two genes regulating dorsal development in the zebrafish embryo. Development 123, 95–102 (1996). source
Not checked in the free run.
- cites [31] Schulte-Merker, S., Lee, K. J., McMahon, A. P. & Hammerschmidt, M. The zebrafish organizer requires chordino. Nature 387, 862–863 (1997). source
Not checked in the free run.
- cites [32] Fisher, S. & Halpern, M. E. Patterning the zebrafish axial skeleton requires early chordin function. Nat. Genet. 23, 442–446 (1999). source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataAfter filtering, 5,708 cells were available for further analysis.
“After filtering, we obtained 5,708 cells for further analysis.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
FindingcitationIn the Jurkat T cell dataset, stimulated and control conditions showed large overlap in cell states, as noted in the original study.
“We observed a large degree of overlap in cell states between the stimulated and control conditions, as noted in the original study13.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [13] Datlinger, P. et al. Pooled CRISPR screening with single-cell transcriptome readout. Nat. Methods 14, 297–301 (2017). source
Not checked in the free run.
May combine two claims.
Findingown dataThese beta clusters were cleanly separated on the PHATE plot, and beta cells had the largest range of IFN-γ relative likelihood scores.
“These clusters are cleanly separated on the PHATE plot of all islet cells (Fig. 6a), and, together, the beta cells represent the largest range of IFN-γ relative likelihood scores in the dataset.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataMELD outperformed other graph-smoothing algorithms by 10-52% on simulated data and 36-51% on real datasets.
“We found that MELD outperformed other graph-smoothing algorithms by 10–52% on simulated data and 36–51% on real datasets (Fig. 3 and Suppplementary Table 1).”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataThe non-responsive beta cluster lacked upregulation of IFN-γ-regulated genes such as STAT1, similar to the beta cluster with the lowest IFN-γ relative likelihood.
“Supporting this characterization, we find a lack of upregulation in IFN-γ-regulated genes, such as STAT1, in the non-responsive cluster, similarly to the cluster of beta cells with the lowest IFN-γ relative likelihood values (Fig. 6f).”
Quote in the paperSubstantial claimMay combine two claims.
FindingcitationThe effect of each Cas9 gene knockout varied widely, consistent with published results.
“We observed a large variation in the effect of each gene knockout consistent with the published results in ref.13.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [13] Datlinger, P. et al. Pooled CRISPR screening with single-cell transcriptome readout. Nat. Methods 14, 297–301 (2017). source
Not checked in the free run.
May combine two claims.
Findingown dataIn the tailbud presomitic mesoderm cluster, chordin-relative likelihoods ranged from 0.29 to 0.94, with some cells strongly enriched and others depleted.
“For example, the chordin-relative likelihoods within the tailbud, presomitic mesoderm (TPM) range from 0.29 to 0.94, indicating that some cells are strongly enriched, whereas others are depleted.”
Quote in the paperSubstantial claimMay combine two claims.
Findingown dataVFC was the top performer on every T cell simulation and best on average for the zebrafish dataset, with a 57% average performance increase over Louvain.
“When compared to six common clustering algorithms, including Leiden25 and CellHarmony26, VFC was the top performing algorithm on every simulation on the T cell data and best performing, on average, on the zebrafish dataset, with a 57% increase in average performance over Louvain, which was the next best algorithm”
Quote in the paperSubstantial claim0 of 2 sources checked- cites [25] Traag, V. A., Waltman, L. & van Eck, N. J. From Louvain to Leiden: guaranteeing well-connected communities. Sci. Rep. 9, 5233 (2019). source
Not checked in the free run.
- cites [26] DePasquale, E. A. K. et al. CellHarmony: cell-level matching and holistic comparison of single-cell transcriptomes. Nucleic Acids Res. 47, e138–e138 (2019). source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenResults are relatively robust to parameter values around the default setting (α=0, β=60, ρ=1).
“We note that the results are relatively robust to parameter values around this default setting.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
FindingreasoningWith α=0 and negative ρ, the filter is high-pass.
“if ρ is negative and α = 0, ρ controls a high-pass filter.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataAll alpha and delta cell clusters were depleted in donor 3, and the non-responsive beta cell cluster was enriched primarily in donor 1.
“We found that all of the alpha cell and delta cell clusters are depleted in donor 3, and the non-responsive beta cell cluster is enriched primarily in donor 1.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataLarger ρ values make the response sharper near the central frequency, reducing out-of-band response and boosting in-band response.
“Higher values of ρ lead to sharper tails (Supplementary Fig. 13d,e), limiting the frequency response outside of the target band but with increased response within the band.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingnone givenAt α=0, increasing positive ρ introduces additional low-frequency components into the response.
“When α = 0, ρ may be any integer, and it adds more low frequencies to the frequency response as it becomes more positive.”
Quote in the paperNot a substantial claimMay combine two claims.
Findingown dataA larger β makes the filter cutoff sharper and moves it closer to the central frequency.
“β steepens the cutoff of the filter and shifts it more toward its central frequency (Supplementary Fig. 13).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Findingnone givenThe MELD algorithm is efficient to compute.
“Furthermore, the MELD algorithm is efficient to compute.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Findingnone givenWith α>0, the manifold heat filter is band-pass.
“When α > 0, the manifold heat filter becomes a band-pass filter.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Findingown dataA fine-grained search over β found that the best values for MELD were between 50 and 75.
“A fine-grained search over parameters for β showed that optimal values were between 50 and 75 (Supplementary Fig. 14).”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
Findingown dataA set of 24 cells found only in chd embryos had 546-fold, 246-fold and 1,210-fold higher expression of Sh3Tc1, LOC101882117 and LOC101885394, respectively, than other cells, even though their average library size was in the lowest 12% of cells.
“During preliminary analysis, a group of 24 cells were identified originating exclusively from the chd embryos. Despite an average library size in the bottom 12% of cells, these cells exhibited 546-fold, 246-fold and 1,210-fold increased expression of Sh3Tc1, LOC101882117 and LOC101885394, respectively, relative to other cells.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisecitationThe cellular transcriptomic state space can be modeled as a smooth, low-dimensional manifold or a set of manifolds.
“We begin by modeling the cellular transcriptomic state space as a smooth, low-dimensional manifold or set of manifolds.”
Quote in the paperSubstantial claim0 of 7 sources checked- cites [2] Weinreb, C., Wolock, S., Klein, A. M. & Berger, B. SPRING: a kinetic interface for visualizing high dimensional single-cell expression data. Bioinformatics 34, 1246–1248 (2018). source
Not checked in the free run.
- cites [3] Moon, K. R. et al. Visualizing structure and transitions in high-dimensional biological data. Nat. Biotechnol. 37, 1482–1492 (2019). source
Not checked in the free run.
- cites [4] van Dijk, D. et al. Recovering gene interactions from single-cell data using data diffusion. Cell 174, 716–729 (2018). source
Not checked in the free run.
- cites [5] Shekhar, K. et al. Comprehensive classification of retinal bipolar neurons by single-cell transcriptomics. Cell 166, 1308–1323 (2016). source
Not checked in the free run.
- cites [6] Levine, J. H. et al. Data-driven phenotypic dissection of AML reveals progenitor-like cells that correlate with prognosis. Cell 162, 184–197 (2015). source
Not checked in the free run.
- cites [7] Xu, C. & Su, Z. Identification of cell types from single-cell transcriptomes using a novel clustering method. Bioinformatics 31, 1974–1980 (2015). source
Not checked in the free run.
- cites [8] Becht, E. et al. Dimensionality reduction for visualizing single-cell data using UMAP. Nat. Biotechnol. 37, 38–44 (2019). source
Not checked in the free run.
Classified as probably not a substantial claim.
InterpretationreasoningGene signatures of a perturbation are obtained by differential expression between VFC clusters.
“Third, we obtain gene signatures of a perturbation by performing differential expression between VFCs.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based).
Premisenone givenThe manifold model is a useful approximation for transcriptomic space because valid cellular states are low dimensional with smooth transitions.
“The manifold model is a useful approximation for the transcriptomic space because biologically valid cellular states are intrinsically low dimensional with smooth transitions between similar states.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationnone givenWhen data lie on a continuum, cluster boundaries are arbitrary and may not match populations with distinct condition differences.
“Additionally, when partitioning data along a continuum, cluster boundaries are somewhat arbitrary and might not correspond to populations with distinct differences between conditions.”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationnone givenNo contemporary method was suitable for resolving these cases, so the authors developed an algorithm integrating gene expression, relative likelihood magnitude, and sample-label frequency response.
“As no contemporary method is suitable for resolving these cases, we developed an algorithm that integrates gene expression, the magnitude of sample-associated relative likelihoods and the frequency response of the input sample labels over the cellular manifold”
Quote in the paperSubstantial claimClassified as probably not a substantial claim. May combine two claims.
Interpretationnone givenTransitional populations have input sample labels that change gradually or at low frequency, while even-mixture populations have labels that change frequently or at high frequency.
“Indeed, in the transitional case, the input sample labels change gradually or have low frequency over the manifold, and, in the even-mixture case, they change frequently between closely connected cells or have high frequency over the manifold.”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningIf a cluster contains multiple subpopulations with different perturbation responses, VFC can separate them and allow individual comparisons.
“However, if the cluster contains multiple subpopulations that each contain different responses to the perturbation, we can first separate these populations using VFC and then compare each subpopulation individually”
Quote in the paperSubstantial claimMay combine two claims.
InterpretationreasoningA relative likelihood of 0.5 can arise from multiple scenarios, including a transitional continuum or even mixing of a non-responsive subtype.
“For example, even in a two-sample experiment, there are multiple ways for a cell to have a sample-associated relative likelihood of 0.5.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningExtreme high insulin in a beta cell before IFN-γ exposure might inhibit the IFN-γ response pathway through an unknown mechanism.
“That these cells appear non-responsive to IFN-γ stimulation and exhibit extreme expression of insulin suggests that the presence of extreme high insulin in a beta cell before IFN-γ exposure might inhibit the IFN-γ response pathway through an unknown mechanism.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationVFC is an adaptation of the signal-biased spectral clustering method proposed in ref. 23.
“This method, which we call VFC, is an adaptation of the signal-biased spectral clustering proposed in ref.23.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [23] Shuman, D. I., Ricaud, B. & Vandergheynst, P. Vertex-frequency analysis on graphs. Applied Comput. Harmon. Anal. 40, 260–291 (2016). source
Not checked in the free run.
Classified as probably not a substantial claim.
Study design and conductreasoningMutual nearest neighbors kernel correction was applied across donors but not across IFN-γ treatment to correct donor batch effects while preserving relevant donor differences.
“To correct for this difference while preserving the relevant differences between donors, we applied the mutual nearest neighbors (MNN) kernel correction described in the Methods. Note that, here, the MNN correction was only applied across donors, not across the IFN-γ treatment.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S4 (based). May combine two claims.
InterpretationreasoningVFC-derived clusters share transcriptomic profiles, likelihood estimates, and sample-indicator frequency trends.
“The resultant clusters will have similar transcriptomic profiles, similar likelihood estimates and similar frequency trends of the sample indicator signals.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationnone givenThe MELD optimization can be solved analytically and yields relative likelihood as a smooth, de-noised signal while respecting multi-resolution changes in the likelihood landscape.
“This optimization, which can be solved analytically, allows us to derive the relative likelihood of each sample in a dataset as a smooth and de-noised signal, while also respecting multi-resolution changes in the likelihood landscape.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationActivation of both the JAK-STAT and antiviral pathways was previously reported in beta cells in response to IFN-γ.
“The activation of both of these pathways was previously reported in beta cells in response to IFN-γ42,43.”
Quote in the paperNot a substantial claim0 of 2 sources checked- cites [42] Hultcrantz, M. et al. Interferons induce an antiviral state in human pancreatic islet cells. Virology 367, 92–101 (2007). source
Not checked in the free run.
- cites [43] Stewart, A. F. et al. Human β-cell proliferation and intracellular signaling: part 3. Diabetes 64, 1872–1885 (2015). source
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
Premisenone givenA graph Laplacian serves both as an operator and in a quadratic form to quantify how smooth a function is over a graph.
“Thus, the graph Laplacian can be used as an operator and in a quadratic form to measure the smoothness of a function defined over a graph.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningThe unresponsive beta cell subpopulation is linked to a newly described beta cell subtype characterized by elevated insulin mRNA and distinct biological responses.
“We related this to emerging research describing a beta cell subtype marked by high insulin mRNA expression and unique biological responses.”
Quote in the paperNot a substantial claimMay combine two claims.
InterpretationreasoningDensity normalization lets MELD build a shared manifold from samples with different distributions while estimating each distribution's density on that support.
“By normalizing by density, we allow for construction of the manifold geometry from multiple differently distributed samples and individual density estimation for each of these densities on the same support.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Single-cell data lie on a low-dimensional manifold embedded in ambient space.
- Rests on an assumption: Real single-cell data are rarely uniformly sampled from a manifold.
Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.
PremisereasoningGraph Laplacian eigenvectors are orthonormal and, at a fixed dimension, minimize the Laplacian quadratic form.
“In summary, the eigenvectors of the graph Laplacian (1) are an orthonormal basis and (2) minimize the Laplacian quadratic form for a given dimension.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationMELD has already been used in several contexts.
“Indeed, MELD has already seen use in several contexts44–48.”
Quote in the paperNot a substantial claim0 of 5 sources checked- cites [44] Chen, X. et al. MLL-AF9 initiates transformation from fast-proliferating myeloid progenitors. Nat. Commun. 10, 5767 (2019). source
Not checked in the free run.
- cites [45] Dutrow, E. V. et al. The human accelerated region HACNS1 modifies developmental gene expression in humanized mice. Preprint at https://www.biorxiv.org/content/10.1101/2019.12.11.873075v1 (2019).
Not checked in the free run.
- cites [46] Savell, K. E. et al. A dopamine-induced gene expression signature regulates neuronal function and cocaine response. Sci. Adv. 6, eaba4221 (2020). source
Not checked in the free run.
- cites [47] Chung, K. M. et al. Endocrine–exocrine signaling drives obesity-associated pancreatic ductal adenocarcinoma. Cell 181, 832–847 (2020). source
Not checked in the free run.
- cites [48] Ravindra, N. G. et al. Single-cell longitudinal analysis of SARS-CoV-2 infection in human airway epithelium. Preprint at https://www.biorxiv.org/content/10.1101/2020.05.06.081695v2 (2020).
Not checked in the free run.
May combine two claims.
InterpretationreasoningUsing several samples whose distributions are unknown, MELD estimates a shared manifold geometry and then density and conditional density for each distribution.
“Building on these two works, MELD allows us to estimate the manifold geometry using multiple samples with unknown distribution along it and estimate density and conditional density for each distribution on this shared manifold.”
Quote in the paperSubstantial claim- The authors state this as an assumption: Single-cell data lie on a low-dimensional manifold embedded in ambient space.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.
Interpretationnone givenWhen data are uniformly sampled from the manifold, density around each point is constant and density normalization has no effect.
“When the data are uniformly sampled from the manifold, then the density around each point is constant, and this normalization has no effect.”
Quote in the paperNot a substantial claim- The authors state this as an assumption: Single-cell data lie on a low-dimensional manifold embedded in ambient space.
Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenFor sufficiently large sets of samples, obtaining the Fourier basis directly may cost less than repeated application of the Chebyshev approximation.
“For sufficiently large sets of samples, such as when considering hundreds of conditions, the computational cost of obtaining the Fourier basis directly might be less than repeated application of the approximation operator”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataIFN-γ upregulates canonical signaling pathways in all three endocrine cell types, but the delta cell response is subtly different from alpha or beta cells.
“From these results, we conclude that, although IFN-γ leads to upregulation of the canonical signaling pathways in all three cell types, the response to stimulation in delta cells is subtly different to that of alpha or beta cells.”
Quote in the paperSubstantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
InterpretationreasoningFor small sets of sample indicator signals, Chebyshev approximations provide the simplest and most efficient way to implement MELD.
“For application of the manifold heat filter to a small set of input sample indicator signals, Chebyshev approximations offer the simplest and most efficient implementation of our proposed algorithm.”
Quote in the paperNot a substantial claimMay combine two claims.
Interpretationown dataIt is possible to identify donor-specific changes in gene expression or clusters differentially abundant between donors.
“As with the sample-associated relative likelihood derived for the IFN-γ response, it is also possible to identify donor-specific changes in gene expression or clusters of cells differentially abundant between each donor.”
Quote in the paperSubstantial claimClassified as probably not a substantial claim.
PremisecitationThe α-decaying kernel is an effective way to build graphs for scRNA-seq.
“In our implementation, we use α-decaying kernel proposed in ref.3 because, in practice, it provides an effective graph construction for scRNA-seq analysis.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites ref.3
Not checked in the free run.
May combine two claims.
InterpretationreasoningBy subtracting from L's diagonal, α shifts the Laplacian harmonic that minimizes the problem, thereby modulating the frequency response.
“The parameter α removes values from the diagonal of L. This results in a modulation of frequency response by translating the Laplacian harmonic that yields the minimal value for the problem (Equation (13)).”
Quote in the paperSubstantial claimMay combine two claims.
Interpretationown dataThe best β parameter for MELD changes with the structure of the dataset and with the number of cells.
“We note that the optimal β parameter will vary with dataset structure and the number of cells.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
Premisenone givenSaturating the WGFT elements with tanh and then running k-means is connected to spectral clustering because the features used by k-means are coefficients of graph harmonics.
“This operation has connections to spectral clustering as the features that k-means is run on are coefficients of graph harmonics.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing), S4 (based).
Interpretationnone givenWhen α = 0 and ρ = 1, the MELD filter reduces to the standard heat kernel.
“This is expected because, with these settings, the MELD filter is the standard heat kernel.”
Quote in the paperNot a substantial claimProbably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThe windowed Fourier transform identifies how a signal's frequency composition changes over time by taking slices of the signal and applying a Fourier decomposition to each window independently.
“In the time domain, the windowed Fourier transform (WFT) identifies changing frequency composition of a signal over time by taking slices of the signal (for example, a sliding window of 10 s) and applying a Fourier decomposition to each window independently58.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites [58] Mallat, S.A. Wavelet Tour of Signal Processing: The Sparse Way (Academic Press, 2008).
Not checked in the free run.
Classified as probably not a substantial claim.
PremisecitationRecent work in graph signal processing has extended the construction of the windowed Fourier transform to graph signals.
“Recent works in GSP have generalized the construction of WFT to graph signals23.”
Quote in the paperSubstantial claim0 of 1 sources checked- cites [23] Shuman, D. I., Ricaud, B. & Vandergheynst, P. Vertex-frequency analysis on graphs. Applied Comput. Harmon. Anal. 40, 260–291 (2016). source
Not checked in the free run.
Probably not a substantial claim: may not pass S4 (based). May combine two claims.
Interpretationnone givenPt is effectively a diffusion operator and can be constructed efficiently by treating it as a Markov matrix and normalizing the graph adjacency by degree.
“For scalability, we leverage the fact that Pt is effectively a diffusion operator and, thus, can be built efficiently by treating it as a Markov matrix and normalizing the graph adjacency by the degree.”
Quote in the paperNot a substantial claimClassified as probably not a substantial claim.
PremisecitationThe generalized modulation operator Mk moves the DC component of f to λk.
“Instead, the generalized modulation Mk translates the DC component of f, f^(0), to λk—that is, (Mkf^)(λk)=f^(0).”
Quote in the paperSubstantial claim0 of 1 sources checked- cites ref.23
Not checked in the free run.
Probably not a substantial claim: may not pass S3 (load-bearing).
PremisecitationThose 24 cells were annotated in ref.15 as belonging to seven cell types, including Tailbud-Spinal Cord and Neural-Midbrain.
“These cells were annotated in ref.15 as belonging to seven cell types, including the Tailbud–Spinal Cord and Neural–Midbrain.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites ref.15
Not checked in the free run.
May combine two claims.
PremisecitationThe generalized translation operator inherits some properties of its classical counterpart, but it is not isometric and depends on the graph on which it is built.
“Reference23 demonstrates that this operator inherits various properties of its classical counterpart; however, the operator is not isometric and is affected by the graph that it is built on.”
Quote in the paperNot a substantial claim0 of 1 sources checked- cites Reference23
Not checked in the free run.
The paper relies on this without support.
No prior benchmarks exist for measuring how well an algorithm captures density changes between scRNA-seq samples.
“No previous benchmarks exist to quantify the ability of an algorithm to capture changes in density between scRNA-seq samples.”
The paper relies on this without support.
No studies have examined the effect of IFN-γ on pancreatic islet cells at single-cell resolution.
“but no studies have addressed this system at single-cell resolution.”
The paper relies on this without support.
The effect of a treatment condition may be diffuse across all cells or confined to particular populations.
“Furthermore, each single-cell dataset comprises several intrinsic structures of heterogeneous cells, and the effect of the treatment condition could be diffuse across all cells or isolated to particular populations.”
The paper relies on this without support.
Quantifying differences between scRNA-seq conditions is difficult because biological effects are subtle relative to biological and technical noise.
“However, quantifying these differences is challenging owing to the subtlety of most biological effects relative to the biological and technical noise inherent to single-cell data.”
The authors state this as an assumption.
Single-cell data lie on a low-dimensional manifold embedded in ambient space.
“A common assumption is that the data exist on a manifold of low intrinsic dimensionality in ambient space.”
The paper relies on this without support.
Real single-cell data are rarely uniformly sampled from a manifold.
“However, real data are rarely uniformly sampled from a manifold.”
The paper relies on this without support.
Batch effects can make within-batch affinities much higher than between-batch affinities, creating separation by batch rather than biological state.
“such batch effects can cause affinities within each batch and are often much higher than between batches, thus creating separation between batches rather than following the underlying biological state.”
The paper relies on this without support.
The graph Laplacian's low-frequency eigenvectors capture smoothly varying directions of variance across a graph.
“Because the low-frequency eigenvectors of the graph Laplacian identify smoothly varying axes of variance through a graph, we associate trends in the sample indicator signal associated with these low-frequency eigenvectors as biological transitions between cell states.”
The paper relies on this without support.
The graph Fourier transform lacks the ability to show local changes in graph-signal frequency content across different graph regions.
“Although the GFT is useful for exploring the frequency content of a signal, it is unable to identify how the frequency content of graph signals change locally over different regions of the graph.”
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
Several distance measures for scRNA-seq have been explored, including Wasserstein distance, maximum mean discrepancy, neighborhood-based measures, and energy distance.
“Multiple distance measures for scRNA-seq have been explored by the single-cell community in recent years, including Wasserstein distance computed in an optimal transport framework22,23, maximum mean discrepancy24, neighborhood-based measures17,18, and energy distance (E-distance)20.”
From scPerturb: harmonized single-cell perturbation data (2024) · cites this paper as [17]
Studies with mixtures of cell types have developed complex methods for quantifying similarity between heterogeneous cell populations.
“Studies with mixtures of cell types have developed complex methods for quantifying similarity between heterogeneous cell populations17-19.”
From scPerturb: harmonized single-cell perturbation data (2024) · cites this paper as [17]
Other clustering-free methods do not use the replication structure of the experimental design to account for technical variability between samples.
“However, these methods do not exploit the replication structure in the experimental design to account for technical variability between samples.”
From Differential abundance testing on single-cell data using k-nearest neighbor graphs (2022) · cites this paper as [8]
Existing clustering-free differential abundance methods either fail to model variability in cell numbers between replicate samples or are mainly built for pairwise comparisons, which restricts their use in more complex experimental designs.
“However, these have different limitations, where they either do not model variability in cell numbers between replicate samples or are primarily designed for pairwise comparisons. This limits their application to datasets with more complex experimental designs”
From Differential abundance testing on single-cell data using k-nearest neighbor graphs (2022) · cites this paper as [8]
MELD and DAseq are built for pairwise comparisons and cannot easily be extended to complex experimental designs with continuous variables, multifactorial conditions or nuisance covariates.
“In addition, MELD and DAseq are designed for pairwise comparisons between two biological conditions, and cannot be easily extended to detect differential abundance with complex experimental designs, including continuous variables (age, time points), multifactorial conditions or nuisance covariates.”
From Differential abundance testing on single-cell data using k-nearest neighbor graphs (2022) · cites this paper as [8]
MELD estimates the probability density of each sample across a KNN graph and uses this to quantify the relative likelihood that a cell would be observed in one condition versus the others.
“MELD estimates the probability density of each sample over a KNN graph, which is then used to quantify the relative likelihood that each cell would be observed in one condition relative to the others.”
From Differential abundance testing on single-cell data using k-nearest neighbor graphs (2022) · cites this paper as [8]
MELD does not carry out statistical inference; instead, the user sets a threshold on per-cell likelihoods to classify a cell as belonging to a differentially abundant region or not.
“MELD does not perform any statistical inference, instead the user selects a threshold on the per-cell likelihoods to define a cell as being in a DA region or not.”
From Differential abundance testing on single-cell data using k-nearest neighbor graphs (2022) · cites this paper as [8]
VFC clusters cells that exhibit similar responses to a perturbation (enriched, depleted, or unchanged), providing a detailed view of perturbation responses.
“Moving away from unsupervised clustering approaches based on mere data geometry, VFC clusters cells that exhibit similar responses to a perturbation (enriched, depleted, or unchanged), providing a detailed view of perturbation responses.”
From A mini-review on perturbation modelling across single-cell omic modalities (2024) · cites this paper as [36]
MELD-VFC quantifies the perturbation effect by calculating alterations in the probability density of the experimental condition compared to the control.
“MELD-VFC quantifies the perturbation effect by calculating alterations in the probability density of the experimental condition compared to the control.”
From A mini-review on perturbation modelling across single-cell omic modalities (2024) · cites this paper as [36]
MELD-VFC regards single-cell experiments as samples from a probability density function over the underlying transcriptomic manifold plane.
“MELD-VFC[36] regards single-cell experiments as samples from a probability density function over the underlying transcriptomic manifold plane.”
From A mini-review on perturbation modelling across single-cell omic modalities (2024) · cites this paper as [36]
Differential expression between VFCs allows extraction of gene signatures associated with a perturbation.
“Lastly, the differential expression between VFCs allows the extraction of gene signatures associated with a perturbation.”
From A mini-review on perturbation modelling across single-cell omic modalities (2024) · cites this paper as [36]
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
Each contradiction between two passages listed here was confirmed by an independent check.
The Gaussian kernel and heat equation use different diffusion rates
MinorThe Gaussian kernel shown has a denominator of 4t in its exponent, corresponding to a heat equation with coefficient 1 on the Laplacian. The stated equation instead uses coefficient 1/2.
“(17)K(x,y,t)=1(4πt)d/2e−‖x−y‖22/4t”
“(18)∂∂tf^(x,t)=12∂2∂x2f^(x,t),x∈X,t>0”
The Laplacian quadratic form is missing a factor of one-half
MinorWith the stated definition L = D − W, summing the squared difference over both i and j counts each undirected edge twice. The displayed expression for fTLf therefore needs a factor of one-half.
“This quantity is more fundamentally known as the Laplacian quadratic form, (7)fTLf=∑i,jWij(f(i)−f(j))2.”
“(5)L:=D−W, where D is the degree matrix, which is a diagonal matrix with Dii = d(i) = ΣjWij containing the degrees of the vertices of the graph defined by W.”
The clustering comparison counts five competitors as six
MinorThe results say VFC was compared with six clustering algorithms, but the Methods list only five: k-means, spectral clustering, Louvain, Leiden and CellHarmony.
“When compared to six common clustering algorithms, including Leiden25 and CellHarmony26, VFC was the top performing algorithm”
“VFC was compared to k-means, spectral clustering, Louvain, Leiden and CellHarmony.”
The filter output is mislabeled as a windowed transform
MinorBy the paper's definitions, Hf applies the inverse graph Fourier transform to the filtered coefficients. It is a filtered signal, not a windowed graph Fourier transform.
“A manipulation using Equation (8) will verify that Hf is the windowed graph Fourier transform (WGFT) of f^filt.”
“As this transformation is unitary, the inverse graph Fourier transform (IGFT) is f=Ψf^.”
The citation lists haven’t been fetched yet
References 85 · Cited by 226
Research works printed but not linked: 2
- Dutrow, E. V. et al. The human accelerated region HACNS1 modifies developmental gene expression in humanized mice. Preprint at https://www.biorxiv.org/content/10.1101/2019.12.11.873075v1 (2019). · DOI
- Mallat, S.A. Wavelet Tour of Signal Processing: The Sparse Way (Academic Press, 2008).
- Authors
- Burkhardt, D. B., Stanley, J. S., Tong, A., Perdigoto, A. L., Gigante, S. A., Herold, K. C., Wolf, G., Giraldez, A. J., van Dijk, D., & Krishnaswamy, S.
- Affiliations
- Yale University (US)
- Mila - Quebec Artificial Intelligence Institute (CA)
- Corresponding author
- Krishnaswamy, Smita
- ORCID
- Venue
- Nature Biotechnology
- Published
- 2021-02-08
- Volume
- 39
- Issue
- 5
- Pages
- 619-629
- ISSN
- 0733-222X (ISSN-L)
- 1087-0156
- 1546-1696
- PMC
- PMC8122059
- OpenAlex
- W3127234302
- Semantic Scholar
- ae0bd1fc031e6b91c1595c77d9451d01f440284b
- Cited by
- 226
- References
- 85
- Citations by year
- 2026: 30 · 2025: 54 · 2024: 50 · 2023: 38 · 2022: 33 · 2021: 14 · 2020: 5 · 2019: 2
- FWCI
- 11.21
- Type
- journal article
- Language
- en
- Open access
- green
- doi.org
- Licence
- Locations
- Nature Biotechnology (publishedVersion)
- bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
- PubMed (publishedVersion)
- PubMed Central (acceptedVersion)
- Funders
- National Institutes of Health (UL1TR001863)
- National Institute of General Medical Sciences (R01GM130847, R01GM135929)
- U.S. National Library of Medicine (T15LM007056)
- National Center for Advancing Translational Sciences
- Eunice Kennedy Shriver National Institute of Child Health and Human Development (R01HD100035, F31HD097958)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
- Keywords
- single-cell RNA sequencing, perturbation response, single-cell transcriptomics, graph signal processing, cell population identification, gene expression signatures
- MeSH terms
- Algorithms, Computer Simulation, Humans, Cluster Analysis, Likelihood Functions, Sequence Analysis, RNA, Computational Biology, Single-Cell Analysis, Transcriptome
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-05.
Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-05.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review