Cited by 226Single-cell and spatial transcriptomicsGene expression and cancer classificationGene Regulatory Network Analysis

Quantifying the effect of experimental perturbations at single-cell resolution

Open access
Burkhardt, Daniel B., Stanley, Jay S., Tong, Alexander, Perdigoto, Ana Luisa, Gigante, Scott A., Herold, Kevan C., Wolf, Guy, Giraldez, Antonio J. +2 more·2021·Nature Biotechnology

Published version of a preprint

Abstract

Current methods for comparing single-cell RNA sequencing datasets collected in multiple conditions focus on discrete regions of the transcriptional state space, such as clusters of cells. Here we quantify the effects of perturbations at the single-cell level using a continuous measure of the effect of a perturbation across the transcriptomic space. We describe this space as a manifold and develop a relative likelihood estimate of observing each cell in each of the experimental conditions using graph signal processing. This likelihood estimate can be used to identify cell populations specifically affected by a perturbation. We also develop vertex frequency clustering to extract populations of affected cells at the level of granularity that matches the perturbation response. The accuracy of our algorithm at identifying clusters of cells that are enriched or depleted in each condition is, on average, 57% higher than the next-best-performing algorithm tested. Gene signatures derived from these clusters are more accurate than those of six alternative algorithms in ground truth comparisons. Matched treatment and control single-cell RNA sequencing samples are more accurately compared at the single-cell level.

Integrity signals

Registry

Crossref · 10.1038/s41587-020-00803-5

Cites

Statistics

Nothing to recompute.

Claims the paper makes

0 of 57 cited sources checked · 0 supported · 0 flagged

  • Findingown data

    The authors found cases where subsets within a cluster had divergent perturbation responses that published cluster-level analyses missed.

    “We demonstrate cases where subsets of a cluster exhibit divergent responses to a perturbation that were missed in published analysis that was limited to clusters derived using data geometry alone.”
    Quote in the paperSubstantial claim
  • Findingown data

    The sample-associated density estimate for two conditions can be computed on 50,000 cells in under 8 minutes in a free Google Colaboratory notebook.

    “The sample-associated density estimate for two conditions can be calculated on a dataset of 50,000 cells in less than 8 min in a free Google Colaboratory notebook”
    Quote in the paperNot a substantial claim
  • Findingown data

    The authors generated and characterized a human pancreatic islet dataset cultured for 24 hours with and without IFN-γ.

    “we generated and characterized a dataset of human pancreatic islet cells cultured for 24 h with and without interferon-gamma (IFN-γ)”
    Quote in the paperSubstantial claim
  • Findingown data

    The responsive-mid cluster matched a transitional population with a structured distribution of input sample signals.

    “The responsive–mid cluster matches our characterization of a transitional population with a structured distribution of input sample signals.”
    Quote in the paperNot a substantial claim
  • Findingreasoning

    The VFC-based approach recovers gene signatures more accurately than directly comparing two samples.

    “we show in the following section that this approach is capable of recovering gene signatures more accurately than directly comparing two samples.”
    Quote in the paperSubstantial claim
  • May combine two claims. 29
  • Classified as probably not a substantial claim. 33
  • May combine two claims.

    Findingown data

    Non-responsive cell populations have high-frequency sample indicator signal components, whereas transitional populations have lower-frequency components.

    “We observe that we can distinguish between non-responsive populations of cells with high-frequency sample indicator signal components and transitional populations with lower-frequency indicator signal components.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The most enriched clusters contained mesodermal cells, and the most depleted clusters contained dorsally derived neural cells, matching the reported ventralization phenotype after chd loss of function.

    “We found that, overall, the most enriched clusters contain mesodermal cells, and the most depleted clusters contain dorsally derived neural cells matching the ventralization phenotype previously reported with chd loss of function30–32.”
    Quote in the paperSubstantial claim0 of 3 sources checked
    • cites [30] Hammerschmidt, M. et al. Dino and mercedes, two genes regulating dorsal development in the zebrafish embryo. Development 123, 95–102 (1996). source

      Not checked in the free run.

    • cites [31] Schulte-Merker, S., Lee, K. J., McMahon, A. P. & Hammerschmidt, M. The zebrafish organizer requires chordino. Nature 387, 862–863 (1997). source

      Not checked in the free run.

    • cites [32] Fisher, S. & Halpern, M. E. Patterning the zebrafish axial skeleton requires early chordin function. Nat. Genet. 23, 442–446 (1999). source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    After filtering, 5,708 cells were available for further analysis.

    “After filtering, we obtained 5,708 cells for further analysis.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingcitation

    In the Jurkat T cell dataset, stimulated and control conditions showed large overlap in cell states, as noted in the original study.

    “We observed a large degree of overlap in cell states between the stimulated and control conditions, as noted in the original study13.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [13] Datlinger, P. et al. Pooled CRISPR screening with single-cell transcriptome readout. Nat. Methods 14, 297–301 (2017). source

      Not checked in the free run.

  • May combine two claims.

    Findingown data

    These beta clusters were cleanly separated on the PHATE plot, and beta cells had the largest range of IFN-γ relative likelihood scores.

    “These clusters are cleanly separated on the PHATE plot of all islet cells (Fig. 6a), and, together, the beta cells represent the largest range of IFN-γ relative likelihood scores in the dataset.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    MELD outperformed other graph-smoothing algorithms by 10-52% on simulated data and 36-51% on real datasets.

    “We found that MELD outperformed other graph-smoothing algorithms by 10–52% on simulated data and 36–51% on real datasets (Fig. 3 and Suppplementary Table 1).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The non-responsive beta cluster lacked upregulation of IFN-γ-regulated genes such as STAT1, similar to the beta cluster with the lowest IFN-γ relative likelihood.

    “Supporting this characterization, we find a lack of upregulation in IFN-γ-regulated genes, such as STAT1, in the non-responsive cluster, similarly to the cluster of beta cells with the lowest IFN-γ relative likelihood values (Fig. 6f).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingcitation

    The effect of each Cas9 gene knockout varied widely, consistent with published results.

    “We observed a large variation in the effect of each gene knockout consistent with the published results in ref.13.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [13] Datlinger, P. et al. Pooled CRISPR screening with single-cell transcriptome readout. Nat. Methods 14, 297–301 (2017). source

      Not checked in the free run.

  • May combine two claims.

    Findingown data

    In the tailbud presomitic mesoderm cluster, chordin-relative likelihoods ranged from 0.29 to 0.94, with some cells strongly enriched and others depleted.

    “For example, the chordin-relative likelihoods within the tailbud, presomitic mesoderm (TPM) range from 0.29 to 0.94, indicating that some cells are strongly enriched, whereas others are depleted.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    VFC was the top performer on every T cell simulation and best on average for the zebrafish dataset, with a 57% average performance increase over Louvain.

    “When compared to six common clustering algorithms, including Leiden25 and CellHarmony26, VFC was the top performing algorithm on every simulation on the T cell data and best performing, on average, on the zebrafish dataset, with a 57% increase in average performance over Louvain, which was the next best algorithm”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [25] Traag, V. A., Waltman, L. & van Eck, N. J. From Louvain to Leiden: guaranteeing well-connected communities. Sci. Rep. 9, 5233 (2019). source

      Not checked in the free run.

    • cites [26] DePasquale, E. A. K. et al. CellHarmony: cell-level matching and holistic comparison of single-cell transcriptomes. Nucleic Acids Res. 47, e138–e138 (2019). source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    Results are relatively robust to parameter values around the default setting (α=0, β=60, ρ=1).

    “We note that the results are relatively robust to parameter values around this default setting.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    With α=0 and negative ρ, the filter is high-pass.

    “if ρ is negative and α = 0, ρ controls a high-pass filter.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    All alpha and delta cell clusters were depleted in donor 3, and the non-responsive beta cell cluster was enriched primarily in donor 1.

    “We found that all of the alpha cell and delta cell clusters are depleted in donor 3, and the non-responsive beta cell cluster is enriched primarily in donor 1.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Larger ρ values make the response sharper near the central frequency, reducing out-of-band response and boosting in-band response.

    “Higher values of ρ lead to sharper tails (Supplementary Fig. 13d,e), limiting the frequency response outside of the target band but with increased response within the band.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    At α=0, increasing positive ρ introduces additional low-frequency components into the response.

    “When α = 0, ρ may be any integer, and it adds more low frequencies to the frequency response as it becomes more positive.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    A larger β makes the filter cutoff sharper and moves it closer to the central frequency.

    “β steepens the cutoff of the filter and shifts it more toward its central frequency (Supplementary Fig. 13).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    The MELD algorithm is efficient to compute.

    “Furthermore, the MELD algorithm is efficient to compute.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    With α>0, the manifold heat filter is band-pass.

    “When α > 0, the manifold heat filter becomes a band-pass filter.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    A fine-grained search over β found that the best values for MELD were between 50 and 75.

    “A fine-grained search over parameters for β showed that optimal values were between 50 and 75 (Supplementary Fig. 14).”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Findingown data

    A set of 24 cells found only in chd embryos had 546-fold, 246-fold and 1,210-fold higher expression of Sh3Tc1, LOC101882117 and LOC101885394, respectively, than other cells, even though their average library size was in the lowest 12% of cells.

    “During preliminary analysis, a group of 24 cells were identified originating exclusively from the chd embryos. Despite an average library size in the bottom 12% of cells, these cells exhibited 546-fold, 246-fold and 1,210-fold increased expression of Sh3Tc1, LOC101882117 and LOC101885394, respectively, relative to other cells.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    The cellular transcriptomic state space can be modeled as a smooth, low-dimensional manifold or a set of manifolds.

    “We begin by modeling the cellular transcriptomic state space as a smooth, low-dimensional manifold or set of manifolds.”
    Quote in the paperSubstantial claim0 of 7 sources checked
    • cites [2] Weinreb, C., Wolock, S., Klein, A. M. & Berger, B. SPRING: a kinetic interface for visualizing high dimensional single-cell expression data. Bioinformatics 34, 1246–1248 (2018). source

      Not checked in the free run.

    • cites [3] Moon, K. R. et al. Visualizing structure and transitions in high-dimensional biological data. Nat. Biotechnol. 37, 1482–1492 (2019). source

      Not checked in the free run.

    • cites [4] van Dijk, D. et al. Recovering gene interactions from single-cell data using data diffusion. Cell 174, 716–729 (2018). source

      Not checked in the free run.

    • cites [5] Shekhar, K. et al. Comprehensive classification of retinal bipolar neurons by single-cell transcriptomics. Cell 166, 1308–1323 (2016). source

      Not checked in the free run.

    • cites [6] Levine, J. H. et al. Data-driven phenotypic dissection of AML reveals progenitor-like cells that correlate with prognosis. Cell 162, 184–197 (2015). source

      Not checked in the free run.

    • cites [7] Xu, C. & Su, Z. Identification of cell types from single-cell transcriptomes using a novel clustering method. Bioinformatics 31, 1974–1980 (2015). source

      Not checked in the free run.

    • cites [8] Becht, E. et al. Dimensionality reduction for visualizing single-cell data using UMAP. Nat. Biotechnol. 37, 38–44 (2019). source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Gene signatures of a perturbation are obtained by differential expression between VFC clusters.

    “Third, we obtain gene signatures of a perturbation by performing differential expression between VFCs.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    The manifold model is a useful approximation for transcriptomic space because valid cellular states are low dimensional with smooth transitions.

    “The manifold model is a useful approximation for the transcriptomic space because biologically valid cellular states are intrinsically low dimensional with smooth transitions between similar states.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given

    When data lie on a continuum, cluster boundaries are arbitrary and may not match populations with distinct condition differences.

    “Additionally, when partitioning data along a continuum, cluster boundaries are somewhat arbitrary and might not correspond to populations with distinct differences between conditions.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationnone given

    No contemporary method was suitable for resolving these cases, so the authors developed an algorithm integrating gene expression, relative likelihood magnitude, and sample-label frequency response.

    “As no contemporary method is suitable for resolving these cases, we developed an algorithm that integrates gene expression, the magnitude of sample-associated relative likelihoods and the frequency response of the input sample labels over the cellular manifold”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Interpretationnone given

    Transitional populations have input sample labels that change gradually or at low frequency, while even-mixture populations have labels that change frequently or at high frequency.

    “Indeed, in the transitional case, the input sample labels change gradually or have low frequency over the manifold, and, in the even-mixture case, they change frequently between closely connected cells or have high frequency over the manifold.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    If a cluster contains multiple subpopulations with different perturbation responses, VFC can separate them and allow individual comparisons.

    “However, if the cluster contains multiple subpopulations that each contain different responses to the perturbation, we can first separate these populations using VFC and then compare each subpopulation individually”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationreasoning

    A relative likelihood of 0.5 can arise from multiple scenarios, including a transitional continuum or even mixing of a non-responsive subtype.

    “For example, even in a two-sample experiment, there are multiple ways for a cell to have a sample-associated relative likelihood of 0.5.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    Extreme high insulin in a beta cell before IFN-γ exposure might inhibit the IFN-γ response pathway through an unknown mechanism.

    “That these cells appear non-responsive to IFN-γ stimulation and exhibit extreme expression of insulin suggests that the presence of extreme high insulin in a beta cell before IFN-γ exposure might inhibit the IFN-γ response pathway through an unknown mechanism.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    VFC is an adaptation of the signal-biased spectral clustering method proposed in ref. 23.

    “This method, which we call VFC, is an adaptation of the signal-biased spectral clustering proposed in ref.23.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [23] Shuman, D. I., Ricaud, B. & Vandergheynst, P. Vertex-frequency analysis on graphs. Applied Comput. Harmon. Anal. 40, 260–291 (2016). source

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    Mutual nearest neighbors kernel correction was applied across donors but not across IFN-γ treatment to correct donor batch effects while preserving relevant donor differences.

    “To correct for this difference while preserving the relevant differences between donors, we applied the mutual nearest neighbors (MNN) kernel correction described in the Methods. Note that, here, the MNN correction was only applied across donors, not across the IFN-γ treatment.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationreasoning

    VFC-derived clusters share transcriptomic profiles, likelihood estimates, and sample-indicator frequency trends.

    “The resultant clusters will have similar transcriptomic profiles, similar likelihood estimates and similar frequency trends of the sample indicator signals.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationnone given

    The MELD optimization can be solved analytically and yields relative likelihood as a smooth, de-noised signal while respecting multi-resolution changes in the likelihood landscape.

    “This optimization, which can be solved analytically, allows us to derive the relative likelihood of each sample in a dataset as a smooth and de-noised signal, while also respecting multi-resolution changes in the likelihood landscape.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Activation of both the JAK-STAT and antiviral pathways was previously reported in beta cells in response to IFN-γ.

    “The activation of both of these pathways was previously reported in beta cells in response to IFN-γ42,43.”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [42] Hultcrantz, M. et al. Interferons induce an antiviral state in human pancreatic islet cells. Virology 367, 92–101 (2007). source

      Not checked in the free run.

    • cites [43] Stewart, A. F. et al. Human β-cell proliferation and intracellular signaling: part 3. Diabetes 64, 1872–1885 (2015). source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    A graph Laplacian serves both as an operator and in a quadratic form to quantify how smooth a function is over a graph.

    “Thus, the graph Laplacian can be used as an operator and in a quadratic form to measure the smoothness of a function defined over a graph.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    The unresponsive beta cell subpopulation is linked to a newly described beta cell subtype characterized by elevated insulin mRNA and distinct biological responses.

    “We related this to emerging research describing a beta cell subtype marked by high insulin mRNA expression and unique biological responses.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationreasoning

    Density normalization lets MELD build a shared manifold from samples with different distributions while estimating each distribution's density on that support.

    “By normalizing by density, we allow for construction of the manifold geometry from multiple differently distributed samples and individual density estimation for each of these densities on the same support.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Single-cell data lie on a low-dimensional manifold embedded in ambient space.
    • Rests on an assumption: Real single-cell data are rarely uniformly sampled from a manifold.
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisereasoning

    Graph Laplacian eigenvectors are orthonormal and, at a fixed dimension, minimize the Laplacian quadratic form.

    “In summary, the eigenvectors of the graph Laplacian (1) are an orthonormal basis and (2) minimize the Laplacian quadratic form for a given dimension.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    MELD has already been used in several contexts.

    “Indeed, MELD has already seen use in several contexts44–48.”
    Quote in the paperNot a substantial claim0 of 5 sources checked
    • cites [44] Chen, X. et al. MLL-AF9 initiates transformation from fast-proliferating myeloid progenitors. Nat. Commun. 10, 5767 (2019). source

      Not checked in the free run.

    • cites [45] Dutrow, E. V. et al. The human accelerated region HACNS1 modifies developmental gene expression in humanized mice. Preprint at https://www.biorxiv.org/content/10.1101/2019.12.11.873075v1 (2019).

      Not checked in the free run.

    • cites [46] Savell, K. E. et al. A dopamine-induced gene expression signature regulates neuronal function and cocaine response. Sci. Adv. 6, eaba4221 (2020). source

      Not checked in the free run.

    • cites [47] Chung, K. M. et al. Endocrine–exocrine signaling drives obesity-associated pancreatic ductal adenocarcinoma. Cell 181, 832–847 (2020). source

      Not checked in the free run.

    • cites [48] Ravindra, N. G. et al. Single-cell longitudinal analysis of SARS-CoV-2 infection in human airway epithelium. Preprint at https://www.biorxiv.org/content/10.1101/2020.05.06.081695v2 (2020).

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Using several samples whose distributions are unknown, MELD estimates a shared manifold geometry and then density and conditional density for each distribution.

    “Building on these two works, MELD allows us to estimate the manifold geometry using multiple samples with unknown distribution along it and estimate density and conditional density for each distribution on this shared manifold.”
    Quote in the paperSubstantial claim
    • The authors state this as an assumption: Single-cell data lie on a low-dimensional manifold embedded in ambient space.
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based). May combine two claims.

    Interpretationnone given

    When data are uniformly sampled from the manifold, density around each point is constant and density normalization has no effect.

    “When the data are uniformly sampled from the manifold, then the density around each point is constant, and this normalization has no effect.”
    Quote in the paperNot a substantial claim
    • The authors state this as an assumption: Single-cell data lie on a low-dimensional manifold embedded in ambient space.
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    For sufficiently large sets of samples, obtaining the Fourier basis directly may cost less than repeated application of the Chebyshev approximation.

    “For sufficiently large sets of samples, such as when considering hundreds of conditions, the computational cost of obtaining the Fourier basis directly might be less than repeated application of the approximation operator”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    IFN-γ upregulates canonical signaling pathways in all three endocrine cell types, but the delta cell response is subtly different from alpha or beta cells.

    “From these results, we conclude that, although IFN-γ leads to upregulation of the canonical signaling pathways in all three cell types, the response to stimulation in delta cells is subtly different to that of alpha or beta cells.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationreasoning

    For small sets of sample indicator signals, Chebyshev approximations provide the simplest and most efficient way to implement MELD.

    “For application of the manifold heat filter to a small set of input sample indicator signals, Chebyshev approximations offer the simplest and most efficient implementation of our proposed algorithm.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    It is possible to identify donor-specific changes in gene expression or clusters differentially abundant between donors.

    “As with the sample-associated relative likelihood derived for the IFN-γ response, it is also possible to identify donor-specific changes in gene expression or clusters of cells differentially abundant between each donor.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    The α-decaying kernel is an effective way to build graphs for scRNA-seq.

    “In our implementation, we use α-decaying kernel proposed in ref.3 because, in practice, it provides an effective graph construction for scRNA-seq analysis.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites ref.3

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    By subtracting from L's diagonal, α shifts the Laplacian harmonic that minimizes the problem, thereby modulating the frequency response.

    “The parameter α removes values from the diagonal of L. This results in a modulation of frequency response by translating the Laplacian harmonic that yields the minimal value for the problem (Equation (13)).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    The best β parameter for MELD changes with the structure of the dataset and with the number of cells.

    “We note that the optimal β parameter will vary with dataset structure and the number of cells.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisenone given

    Saturating the WGFT elements with tanh and then running k-means is connected to spectral clustering because the features used by k-means are coefficients of graph harmonics.

    “This operation has connections to spectral clustering as the features that k-means is run on are coefficients of graph harmonics.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Interpretationnone given

    When α = 0 and ρ = 1, the MELD filter reduces to the standard heat kernel.

    “This is expected because, with these settings, the MELD filter is the standard heat kernel.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The windowed Fourier transform identifies how a signal's frequency composition changes over time by taking slices of the signal and applying a Fourier decomposition to each window independently.

    “In the time domain, the windowed Fourier transform (WFT) identifies changing frequency composition of a signal over time by taking slices of the signal (for example, a sliding window of 10 s) and applying a Fourier decomposition to each window independently58.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [58] Mallat, S.A. Wavelet Tour of Signal Processing: The Sparse Way (Academic Press, 2008).

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Premisecitation

    Recent work in graph signal processing has extended the construction of the windowed Fourier transform to graph signals.

    “Recent works in GSP have generalized the construction of WFT to graph signals23.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [23] Shuman, D. I., Ricaud, B. & Vandergheynst, P. Vertex-frequency analysis on graphs. Applied Comput. Harmon. Anal. 40, 260–291 (2016). source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based). May combine two claims.

    Interpretationnone given

    Pt is effectively a diffusion operator and can be constructed efficiently by treating it as a Markov matrix and normalizing the graph adjacency by degree.

    “For scalability, we leverage the fact that Pt is effectively a diffusion operator and, thus, can be built efficiently by treating it as a Markov matrix and normalizing the graph adjacency by the degree.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    The generalized modulation operator Mk moves the DC component of f to λk.

    “Instead, the generalized modulation Mk translates the DC component of f, f^(0), to λk—that is, (Mkf^)(λk)=f^(0).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites ref.23

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Those 24 cells were annotated in ref.15 as belonging to seven cell types, including Tailbud-Spinal Cord and Neural-Midbrain.

    “These cells were annotated in ref.15 as belonging to seven cell types, including the Tailbud–Spinal Cord and Neural–Midbrain.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites ref.15

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    The generalized translation operator inherits some properties of its classical counterpart, but it is not isometric and depends on the graph on which it is built.

    “Reference23 demonstrates that this operator inherits various properties of its classical counterpart; however, the operator is not isometric and is affected by the graph that it is built on.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Reference23

      Not checked in the free run.

56 of 56
  • The paper relies on this without support.

    No prior benchmarks exist for measuring how well an algorithm captures density changes between scRNA-seq samples.

    “No previous benchmarks exist to quantify the ability of an algorithm to capture changes in density between scRNA-seq samples.”
  • The paper relies on this without support.

    No studies have examined the effect of IFN-γ on pancreatic islet cells at single-cell resolution.

    “but no studies have addressed this system at single-cell resolution.”
  • The paper relies on this without support.

    The effect of a treatment condition may be diffuse across all cells or confined to particular populations.

    “Furthermore, each single-cell dataset comprises several intrinsic structures of heterogeneous cells, and the effect of the treatment condition could be diffuse across all cells or isolated to particular populations.”
  • The paper relies on this without support.

    Quantifying differences between scRNA-seq conditions is difficult because biological effects are subtle relative to biological and technical noise.

    “However, quantifying these differences is challenging owing to the subtlety of most biological effects relative to the biological and technical noise inherent to single-cell data.”
  • The authors state this as an assumption.

    Single-cell data lie on a low-dimensional manifold embedded in ambient space.

    “A common assumption is that the data exist on a manifold of low intrinsic dimensionality in ambient space.”
  • The paper relies on this without support.

    Real single-cell data are rarely uniformly sampled from a manifold.

    “However, real data are rarely uniformly sampled from a manifold.”
  • The paper relies on this without support.

    Batch effects can make within-batch affinities much higher than between-batch affinities, creating separation by batch rather than biological state.

    “such batch effects can cause affinities within each batch and are often much higher than between batches, thus creating separation between batches rather than following the underlying biological state.”
  • The paper relies on this without support.

    The graph Laplacian's low-frequency eigenvectors capture smoothly varying directions of variance across a graph.

    “Because the low-frequency eigenvectors of the graph Laplacian identify smoothly varying axes of variance through a graph, we associate trends in the sample indicator signal associated with these low-frequency eigenvectors as biological transitions between cell states.”
  • The paper relies on this without support.

    The graph Fourier transform lacks the ability to show local changes in graph-signal frequency content across different graph regions.

    “Although the GFT is useful for exploring the frequency content of a signal, it is unable to identify how the frequency content of graph signals change locally over different regions of the graph.”
9 of 9

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Several distance measures for scRNA-seq have been explored, including Wasserstein distance, maximum mean discrepancy, neighborhood-based measures, and energy distance.

    “Multiple distance measures for scRNA-seq have been explored by the single-cell community in recent years, including Wasserstein distance computed in an optimal transport framework22,23, maximum mean discrepancy24, neighborhood-based measures17,18, and energy distance (E-distance)20.”

    From scPerturb: harmonized single-cell perturbation data (2024) · cites this paper as [17]

  • Studies with mixtures of cell types have developed complex methods for quantifying similarity between heterogeneous cell populations.

    “Studies with mixtures of cell types have developed complex methods for quantifying similarity between heterogeneous cell populations17-19.”

    From scPerturb: harmonized single-cell perturbation data (2024) · cites this paper as [17]

  • Other clustering-free methods do not use the replication structure of the experimental design to account for technical variability between samples.

    “However, these methods do not exploit the replication structure in the experimental design to account for technical variability between samples.”
  • Existing clustering-free differential abundance methods either fail to model variability in cell numbers between replicate samples or are mainly built for pairwise comparisons, which restricts their use in more complex experimental designs.

    “However, these have different limitations, where they either do not model variability in cell numbers between replicate samples or are primarily designed for pairwise comparisons. This limits their application to datasets with more complex experimental designs”
  • MELD and DAseq are built for pairwise comparisons and cannot easily be extended to complex experimental designs with continuous variables, multifactorial conditions or nuisance covariates.

    “In addition, MELD and DAseq are designed for pairwise comparisons between two biological conditions, and cannot be easily extended to detect differential abundance with complex experimental designs, including continuous variables (age, time points), multifactorial conditions or nuisance covariates.”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • The Gaussian kernel and heat equation use different diffusion rates

    Minor

    The Gaussian kernel shown has a denominator of 4t in its exponent, corresponding to a heat equation with coefficient 1 on the Laplacian. The stated equation instead uses coefficient 1/2.

  • The Laplacian quadratic form is missing a factor of one-half

    Minor

    With the stated definition L = D − W, summing the squared difference over both i and j counts each undirected edge twice. The displayed expression for fTLf therefore needs a factor of one-half.

  • The clustering comparison counts five competitors as six

    Minor

    The results say VFC was compared with six clustering algorithms, but the Methods list only five: k-means, spectral clustering, Louvain, Leiden and CellHarmony.

  • The filter output is mislabeled as a windowed transform

    Minor

    By the paper's definitions, Hf applies the inverse graph Fourier transform to the filtered coefficients. It is a filtered signal, not a windowed graph Fourier transform.

4 of 4

The citation lists haven’t been fetched yet

References 85 · Cited by 226

Research works printed but not linked: 2

  1. Dutrow, E. V. et al. The human accelerated region HACNS1 modifies developmental gene expression in humanized mice. Preprint at https://www.biorxiv.org/content/10.1101/2019.12.11.873075v1 (2019). · DOI
  2. Mallat, S.A. Wavelet Tour of Signal Processing: The Sparse Way (Academic Press, 2008).

Authors
Burkhardt, D. B., Stanley, J. S., Tong, A., Perdigoto, A. L., Gigante, S. A., Herold, K. C., Wolf, G., Giraldez, A. J., van Dijk, D., & Krishnaswamy, S.
Affiliations
  • Yale University (US)
  • Mila - Quebec Artificial Intelligence Institute (CA)
Corresponding author
Krishnaswamy, Smita
Venue
Nature Biotechnology
Published
2021-02-08
Volume
39
Issue
5
Pages
619-629
ISSN
  • 0733-222X (ISSN-L)
  • 1087-0156
  • 1546-1696
OpenAlex
W3127234302
Cited by
226
References
85
Citations by year
2026: 30 · 2025: 54 · 2024: 50 · 2023: 38 · 2022: 33 · 2021: 14 · 2020: 5 · 2019: 2
FWCI
11.21
Type
journal article
Language
en
Open access
Locations
  • Nature Biotechnology (publishedVersion)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by-nc-nd)
  • PubMed (publishedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • National Institutes of Health (UL1TR001863)
  • National Institute of General Medical Sciences (R01GM130847, R01GM135929)
  • U.S. National Library of Medicine (T15LM007056)
  • National Center for Advancing Translational Sciences
  • Eunice Kennedy Shriver National Institute of Child Health and Human Development (R01HD100035, F31HD097958)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene Regulatory Network Analysis
Keywords
single-cell RNA sequencing, perturbation response, single-cell transcriptomics, graph signal processing, cell population identification, gene expression signatures
MeSH terms
Algorithms, Computer Simulation, Humans, Cluster Analysis, Likelihood Functions, Sequence Analysis, RNA, Computational Biology, Single-Cell Analysis, Transcriptome

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-05.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-05.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review