Cited by 22Single-cell and spatial transcriptomicsGenomics and Phylogenetic StudiesGene expression and cancer classification

Evaluation of genetic demultiplexing of single-cell sequencing data from model species

Open access
Cardiello, Joseph F, Joven Araus, Alberto, Giatrellis, Sarantis, Helsens, Clement, Simon, András, Leigh, Nicholas D·2023·Life Science Alliance

Published version of a preprint

Abstract

Single-cell sequencing (sc-seq) provides a species agnostic tool to study cellular processes. However, these technologies are expensive and require sufficient cell quantities and biological replicates to avoid artifactual results. An option to address these problems is pooling cells from multiple individuals into one sc-seq library. In humans, genotype-based computational separation (i.e., demultiplexing) of pooled sc-seq samples is common. This approach would be instrumental for studying non-isogenic model organisms. We set out to determine whether genotype-based demultiplexing could be more broadly applied among species ranging from zebrafish to non-human primates. Using such non-isogenic species, we benchmark genotype-based demultiplexing of pooled sc-seq datasets against various ground truths. We demonstrate that genotype-based demultiplexing of pooled sc-seq samples can be used with confidence in several non-isogenic model organisms and uncover limitations of this method. Importantly, the only genomic resource required for this approach is sc-seq data and a de novo transcriptome. The incorporation of pooling into sc-seq study designs will decrease cost while simultaneously increasing the reproducibility and experimental options in non-isogenic model organisms.

AI snapshot

Written from the paper’s full text.

TL;DR

SNP-based genetic demultiplexing can accurately separate pooled single-cell/single-nucleus RNA-seq samples from diverse model species, including zebrafish, African green monkey, axolotl, Xenopus, and salamanders, often without a common SNP VCF or a high-quality genome. The approach fails in highly inbred mice and has variable heterotypic doublet detection, so the authors recommend pilot validation and combining SNP-based with transcriptomic doublet detection.

Key findings

  • In silico pooled datasets were demultiplexed with high accuracy: 99–100% of zebrafish cells, 95–99% of axolotl cells, and comparable African green monkey cells were correctly assigned by souporcell; souporcell, Vireo, and Freemuxlet gave highly concordant results, while scSplit diverged for one zebrafish individual.
  • Heterotypic doublet detection was the largest discrepancy: souporcell identified 55% of synthetic heterotypic true doublets in the three-zebrafish pool, 82% in a five-monkey pool, and 66% in a three-monkey pool, suggesting sample number affects doublet detection efficiency.
  • SNP-based demultiplexing failed in highly inbred mice: 99.7% of cells were unassigned for both C57BL/6 and DBA/1J in silico pools; successful datasets had SNP densities of 0.34/kb (axolotl), 0.86/kb (African green monkey), and 3.57/kb (zebrafish), whereas inbred mouse strains had 0.013 and 0.19 SNPs/kb, implying a possible minimum of 0.2–0.34 SNPs/kb.
  • In experimentally pooled data, souporcell agreed with orthogonal labels on 86–92% of Xenopus cells, 78–93% of Pleurodeles cells, and 73–96% of CMO-labeled salamander cells; in a 30-zebrafish pool, souporcell assigned 95.1% of 25,279 cells, reported an 18.6% doublet rate versus an expected ~20%, and identified all 30 embryos with 275–1,517 cells per individual.

Methods

  • The authors benchmarked SNP-based demultiplexers (souporcell, Vireo, Freemuxlet, scSplit) on published and newly generated scRNA-seq/snRNA-seq datasets from zebrafish, African green monkey, axolotl, inbred mice, Xenopus laevis, Pleurodeles waltl, and Notophthalmus viridescens, using in silico pooling of individually sequenced samples and experimentally pooled cells.
  • Ground truths came from individual sample origin, fluorescent transgenic markers, lipid/CMO hashing, or barnyard species mapping; souporcell was selected for deeper testing because it required the fewest inputs and worked with de novo transcriptomes and without a VCF.
  • Analyses used Cell Ranger, Demuxafy singularity containers, Seurat/MULTIseqDemux in R, Python notebooks for read-depth and assignment benchmarking, and VCFtools for SNP density calculations.

Limitations

  • The paper states that in silico pooling is less challenging than experimentally pooled data because it lacks ambient RNA and real heterotypic doublets, and that the 30-zebrafish pool lacked an orthogonal ground truth, so those large-pool assignments could not be validated.
  • The authors state that doublet detection by SNP-based demultiplexers was variable and that it is unclear whether souporcell over-assigns doublets in some experimental datasets; they recommend combining SNP-based and transcriptomic doublet detection.
  • The paper states that the exact SNP density cutoff is not quantitatively established and recommends pilot experiments with a secondary demultiplexing method or in silico pooling; it also notes that highly inbred animals are incompatible with SNP-based demultiplexing.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.26508/lsa.202301979

Cites

82 of 82 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

34 of 43 cited sources checked · 18 supported · 1 flagged · accuracy not yet measured

  • Premisecitation

    DBA/1J mice have ∼5 × 10^6 total SNPs and indels.

    “We also attempted SNP-based demultiplexing of in silico–pooled data from DBA/1J mice (Shinozaki et al, 2022) which have ∼5 × 106 total SNPs and indels (Doran et al, 2016).”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Doran et al, 2016 source

      Table 1 in “Identification of SNPs and indels” reports 5,129,920 SNPs and 955,621 indels for DBA/1J. That is approximately 6.1 million combined; the cited figure of approximately 5 million counts the SNPs alone. (LLM, conf=0.90)

      Checked by a reasoning model — may be wrong.

      Experimental — accuracy not yet measured
  • Premisecitation

    A recent study collected single animal scRNA-seq datasets from the thymus of zebrafish.

    “A recent study collected single animal scRNA-seq datasets from the thymus of zebrafish (Rubin et al, 2022).”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Rubin et al, 2022 source
  • Premisecitation

    The lack of biological replicates is a major cause of false discoveries in scRNA-seq.

    “This is a serious drawback as the lack of biological replicates has also been shown to be a major cause of false discoveries (Hicks et al, 2018; Squair et al, 2021).”
    Quote in the paperSubstantial claim1 of 2 sources checked
    • cites Hicks et al, 2018 source
    • cites Squair et al, 2021 source
  • Premisecitation

    A published dataset of Xenopus laevis scRNA-seq data contains eight experimentally pooled samples from three Xenopus transgenic lines that each overexpress a different fluorescent gene.

    “We analyzed a published dataset of Xenopus laevis scRNA-seq data containing eight experimentally pooled samples from three Xenopus transgenic lines that each overexpress a different fluorescent gene (Lin et al, 2021) (Fig 2A).”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Lin et al, 2021 source

      The STAR★Methods (Method details; page unavailable) describe Xenopus scRNA-seq data with two three-sample blastema pools and a two-sample limb-bud/mature-tissue pool, accounting for eight pooled sample preparations. They say the three animal batches in the blastema pools each expressed a different fluorescent color signal, but do not establish that all eight samples came from only three transgenic lines or that each line overexpressed a different fluorescent gene. (LLM, conf=0.85)

      Experimental — accuracy not yet measured
  • Findingcitation

    SNP-based demultiplexing was unsuccessful on an in silico-pooled mixture of three C57BL/6 mice samples, with 99.7% of cells being unassigned by souporcell or Vireo.

    “Our efforts to apply SNP-based demultiplexing to an in silico–pooled mixture of three C57BL/6 mice samples (Crowl et al, 2022) were unsuccessful, with 99.7% of cells being unassigned by souporcell or Vireo (data not shown).”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites Crowl et al, 2022 source
  • May combine two claims. 28
  • Classified as probably not a substantial claim. 25
  • The quote only partly states this claim. 1
  • May combine two claims.

    Premisecitation

    Outside of human samples, SNP-based demultiplexing has been applied to demultiplex plasmodium samples and across mouse strains.

    “Outside of human samples, SNP-based demultiplexing has been applied to demultiplex other species: plasmodium samples, and across mouse strains (Heaton et al, 2020; Mylka et al, 2022).”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites Heaton et al, 2020 source

      The Validation and Benchmarking section reports using souporcell to separate six genetically distinct Plasmodium falciparum strains, supporting the Plasmodium example. The cited paper does not report demultiplexing across mouse strains, so it supports only one of the two examples in the sentence. (LLM, conf=0.87)

      Experimental — accuracy not yet measured
    • cites Mylka et al, 2022 source
  • May combine two claims.

    Premisecitation

    A high-quality genome and a common SNP VCF file are available for zebrafish.

    “Two useful resources for applying SNP-based demultiplexing are available for zebrafish, a high-quality genome (Howe et al, 2013), and a common SNP variant, variant call format (VCF) file for the species (LaFave et al, 2014).”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites Howe et al, 2013 source
    • cites LaFave et al, 2014 source

      The LaFave citation is attached to the SNP-file claim, not the genome claim. The paper reports downloadable zebrafish variant information in its Abstract (page not provided), but describes variants identified in the NHGRI-1 line and does not identify a common SNP VCF file for the species. (LLM, conf=0.86)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    SNP-based approaches have been benchmarked and shown to be highly effective at separating human samples.

    “SNP-based approaches have been benchmarked and shown to be highly effective at separating human samples (Kang et al, 2018; Huang et al, 2019; Xu et al, 2019; Heaton et al, 2020; Weber et al, 2021).”
    Quote in the paperSubstantial claim2 of 3 sources checked
    • cites Kang et al, 2018 source
    • cites Huang et al, 2019 source
    • cites Xu et al, 2019

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Classified as probably not a substantial claim. May combine two claims.

    Premisecitation

    The African green monkey is a pre-clinically relevant species, with a published genome and SNP variant VCF file available for use.

    “The African green monkey is a pre-clinically relevant species, with a published genome (Warren et al, 2015) and SNP variant VCF file available for use (Huang et al, 2015).”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites Warren et al, 2015 source
    • cites Huang et al, 2015 source

      The Methods (Execution of the sequencing strategy; page not specified) state that SNP genotype data from 721 vervets were deposited in NCBI and are publicly available under BioProject PRJEB7923. This supports the availability of SNP variant data attributed to Huang et al., but our copy does not identify an available file in VCF format. The separate genome citation is to Warren et al. and is not assessed here. (LLM, conf=0.83)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    A genome and SNP variant VCF file are available for the axolotl, but its large genome provides a distinct challenge when using computational tools.

    “A genome (Nowoshilow et al, 2018; Smith et al, 2019) and SNP variant VCF file (Timoshevskaya et al, 2021) are available for the axolotl, but its large genome provides a distinct challenge when using computational tools.”
    Quote in the paperNot a substantial claim2 of 3 sources checked
    • cites Nowoshilow et al, 2018

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

    • cites Smith et al, 2019 source
    • cites Timoshevskaya et al, 2021 source

      The Results (page not provided) say that individual axolotl polymorphisms are accessible through the SalSite genome browser, supporting the availability of SNP variant data. Our copy does not establish that a downloadable VCF file is available. The genome citations are to other papers, not this source. (LLM, conf=0.83)

      Experimental — accuracy not yet measured
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Xenopus is a common laboratory animal that has a published high-quality genome.

    “Xenopus is another common laboratory animal that has a published high-quality genome (Session et al, 2016).”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Session et al, 2016 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The axolotl is an example of an organism for which scRNA-seq has enabled cell level study of regeneration and immunology for the first time.

    “The axolotl is an example of the type of organism for which scRNA-seq has enabled cell level study of regeneration and immunology for the first time (Gerber et al, 2018; Leigh et al, 2018; Rodgers et al, 2020; Lin et al, 2021; Lust et al, 2022; Ye et al, 2022).”
    Quote in the paperNot a substantial claim3 of 3 sources checked
    • cites Gerber et al, 2018 source

      The Abstract and Summary report that scRNA-seq enabled the first molecular profiling of individual axolotl connective-tissue cells during limb regeneration. The section on the Cre-loxP reporter system also identifies an immune-cell cluster, but the paper focuses on connective-tissue regeneration rather than a cell-level study of immunology. That part of the claim is not supported by this source. (LLM, conf=0.85)

      Experimental — accuracy not yet measured
    • cites Leigh et al, 2018 source
    • cites Rodgers et al, 2020 source
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Pooling different mouse strains reportedly does allow for SNP-based demultiplexing.

    “Although the vast majority of murine work is performed on a single strain, pooling different strains reportedly does allow for SNP-based demultiplexing (Mylka et al, 2022).”
    Quote in the paperNot a substantial claim1 of 1 sources checked
    • cites Mylka et al, 2022 source
  • May combine two claims.

    Premisecitation

    The Spanish ribbed newt, Pleurodeles waltl, has a high-quality de novo transcriptome and more recently a high-quality genome but no available common SNPs VCF file.

    “The Spanish ribbed newt, Pleurodeles waltl, is ar reemerging regenerative model organism, which has a high-quality de novo transcriptome (Matsunami et al, 2019) and more recently a high-quality genome (Brown et al, 2022, Preprint) but no available common SNPs VCF file.”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites Matsunami et al, 2019 source
    • cites Brown et al, 2022, Preprint source
  • May combine two claims.

    Premisecitation

    Sample pooling can enable scRNA-seq experiments with limited cell quantities and can identify doublets.

    “Sample pooling can also enable scRNA-seq experiments with limited cell quantities and can identify doublets which, depending on cell loading, can make up a substantial portion of sequenced droplets (DePasquale et al, 2019).”
    Quote in the paperSubstantial claim1 of 1 sources checked
    • cites DePasquale et al, 2019 source

      The Introduction says cell hashing can identify doublets and that multiplet frequency rises with greater cell loading. The STAR Methods report a super-loaded dataset with a 22.2% doublet rate. Neither passage says that sample pooling enables scRNA-seq experiments with limited cell quantities. (LLM, conf=0.88)

      Experimental — accuracy not yet measured
  • May combine two claims.

    Premisecitation

    Demultiplexing of pooled scRNA-seq is required to associate metadata with individual samples to account for between sample variation, replicate strengthened differential expression analysis, and confirmation of sample representation across scRNA-seq datasets and cell clusters.

    “Demultiplexing of pooled scRNA-seq is required to associate metadata with individual samples to account for between sample variation, replicate strengthened differential expression analysis, and confirmation of sample representation across scRNA-seq datasets and cell clusters (Squair et al, 2021; Zimmerman et al, 2021).”
    Quote in the paperSubstantial claim2 of 2 sources checked
    • cites Squair et al, 2021 source

      Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

      Experimental — accuracy not yet measured
    • cites Zimmerman et al, 2021 source

      Split into 2 atoms — 0 confirmed, 2 partially supported, 0 disputed, 0 misattributed, 0 unverifiable. Expand the claim to see per-atom verdicts.

      Experimental — accuracy not yet measured
  • May combine two claims.

    Findingown data

    Souporcell identified 55% of synthetic heterotypic true doublets from the zebrafish dataset, making doublet detection the largest discrepancy in this analysis.

    “The relatively poor performance (55% heterotypic true doublets identified) of souporcell at identifying synthetic heterotypic doublets from this zebrafish dataset made doublet detection the largest discrepancy in this analysis.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Souporcell relies on intergenotypic doublet detection, so homotypic true doublets can be removed.
  • May combine two claims.

    Findingown data

    The computational requirements for the zebrafish dataset were similar between souporcell, Vireo, Freemuxlet, and scSplit, with Freemuxlet finishing the quickest and scSplit requiring the least memory.

    “The computational requirements for this dataset were similar between these tools, with Freemuxlet finishing the quickest and scSplit requiring the least memory (Table S1).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Souporcell, Vireo, and Freemuxlet gave highly concordant results on the synthetically pooled zebrafish data, with scSplit giving divergent assignments for one individual.

    “We found that souporcell, Vireo, and Freemuxlet gave highly concordant results, with scSplit giving divergent assignments for one individual (Fig S1A and B).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The SNP density of the successfully demultiplexed datasets was higher at 0.34/kb (axolotl), 0.86/kb (African green monkey), and 3.57/kb (zebrafish).

    “In comparison to the inbred mouse strains, the SNP density of the successfully demultiplexed datasets was higher at 0.34/kb (axolotl), 0.86/kb (African green monkey), and 3.57/kb (zebrafish).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The fluorescent-based approach succeeded in assigning the Xenopus transgenic line of origin, but the low number of fluorescent gene counts left many cells without sufficient data to make an assignment prediction.

    “Although this approach succeeded in assigning the Xenopus transgenic line of origin, the low number of fluorescent gene counts left many cells without sufficient data to make an assignment prediction (Figs 2B and S6).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    All 30 embryos were identified in the final dataset, ranging from 275 to 1,517 cells per individual zebrafish.

    “All 30 embryos were identified in this final dataset, ranging from 275 to 1,517 cells per individual zebrafish (Table S2 and Fig S7A).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The doublet rate reported by souporcell was 18.6%, close to the expected 20%.

    “Although this experiment does not have a ground truth to compare with, we found that the doublet rate reported by souporcell was 18.6%, close to the expected 20%.”
    Quote in the paperSubstantial claim
    • Rests on an assumption: Souporcell relies on intergenotypic doublet detection, so homotypic true doublets can be removed.
  • May combine two claims.

    Findingown data

    scds assigned many doublets not assigned by souporcell and vice versa.

    “We found that scds assigned many doublets not assigned by souporcell and vice versa (Fig S11).”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Findingnone given

    The memory-efficient script allows for pooling without a VCF file.

    “In addition, this memory-efficient script allows for pooling without a VCF file, which will be critical for all researchers interested in benchmarking SNP demuxers in organisms without VCF files available.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    In relation to Cellplex-based assignments, both computational approaches are in high agreement, but assign doublet identities to some Cellplex-based singlet assignments.

    “In relation to Cellplex-based assignments, both computational approaches are in high agreement, but assign doublet identities to some Cellplex-based singlet assignments.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    There is dramatic variation between individuals in the Pleurodeles splenocyte data, with clusters derived primarily from one animal.

    “Furthermore, though these samples were pooled and sequenced as one sample, we find dramatic variation between individuals in the Pleurodeles splenocyte data (i.e., clusters derived from primarily one animal).”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Findingown data

    The other 12 clusters were composed of cells from less than 30 replicates (animals), breaking the common assumption and suggesting a possible source of artifacts in interpreting results from these clusters.

    “The other 12 clusters were composed of cells from less than 30 replicates (animals), breaking the common assumption and suggesting a possible source of artifacts in interpreting results from these clusters (Fig S7B).”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The green monkey libraries had low reads/cell.

    “Because of low reads/cell in these libraries, we selected barcodes using Seurat with between 1,000 and 2,000 features.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Findingown data

    Freemuxlet failed when using the downloaded VCF file but was successful when inputting the VCF and minimap.bam generated via souporcell.

    “We found that Freemuxlet failed when using the downloaded VCF file but was successful when inputting the VCF and minimap.bam generated via souporcell when running souporcell without a VCF.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    The souporcell internal freebayes command failed.

    “The remapping and variant calling stages of souporcell were run externally because of problems with timeouts on the remapping process with the large salamander transcriptome, and issues with the souporcell internal freebayes command failing.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    The modified synth_pool.py script stabilizes memory use throughout the pooling.

    “To enable more widespread use, we now stabilized memory use throughout the pooling and added an option (--noregionFile) which can pool in the absence of a VCF file.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing), S4 (based).

    Findingnone given

    The modified synth_pool.py script can produce identical pooled BAM files to the original.

    “This script can produce identical pooled BAM files to the original.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingown data

    The remapping process of souporcell had timeouts with the large salamander transcriptome.

    “The remapping and variant calling stages of souporcell were run externally because of problems with timeouts on the remapping process with the large salamander transcriptome, and issues with the souporcell internal freebayes command failing.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingreasoning

    The modified synth_pool.py script includes a --noregionFile option that can pool in the absence of a VCF file.

    “To enable more widespread use, we now stabilized memory use throughout the pooling and added an option (--noregionFile) which can pool in the absence of a VCF file.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Findingnone given

    The Chlorocebus_sabeus 1.1 assembly did not have an annotation file available.

    “This assembly did not have an annotation file available, and we generated a gtf file for this GenBank assembly using minimap2 (Li, 2018) and the below described steps.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Methods for analyzing pooled data and for enabling the demultiplexing of pooled scRNA-seq samples are varied in concept and accuracy.

    “Methods for analyzing pooled data and for enabling the demultiplexing (also known as demuxing) of pooled scRNA-seq samples are varied in concept and accuracy and have been recently reviewed (Zhang et al, 2022).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites Zhang et al, 2022 source
  • May combine two claims.

    Interpretationreasoning

    SNP-based demultiplexing lowers burdens and substantially broadens the use of scRNA-seq to study cellular processes in most organisms.

    “This lowers burdens and substantially broadens the use of scRNA-seq to study cellular processes in most organisms.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Study design and conductreasoning

    Synthetic pooling creates a pooled sample that has cell origin information and synthetic doublets.

    “This synthetic pooling creates a pooled sample that has cell origin information and synthetic doublets.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationnone given

    Synthetically pooled data are less challenging for an SNP-based demultiplexing algorithm than experimentally pooled samples.

    “Although synthetically pooled data are less challenging for an SNP-based demultiplexing algorithm than experimentally pooled samples, the individually sequenced libraries provide a ground truth for definitive benchmarking of SNP-based assignments.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    The study used a diverse swath of methods, each with unique strengths, to validate the widespread use of SNP-based demultiplexing.

    “We used a diverse swath of methods, each with unique strengths, to validate the widespread use of SNP-based demultiplexing.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Study design and conductown data

    Two pieces of evidence point towards the reliability of the 30 zebrafish results: the high accuracy of assignments from all the in silico pooled datasets and that souporcell fails to provide assignments in the inbred mouse datasets.

    “Two pieces of evidence point towards the reliability of these results (1) the high accuracy of assignments from all the in silico pooled datasets and (2) that souporcell fails to provide assignments in the inbred mouse datasets (see previous subheading).”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisenone given

    According to the manufacturer, 25,279 cells would result in ∼20% of droplets being doublets.

    “We found this dataset to contain 25,279 cells, which according to the manufacturer would result in ∼20% of droplets being doublets.”
    Quote in the paperSubstantial claim
  • The quote only partly states this claim.

    Study design and conductreasoning

    Without a benchmarking assessment from a ground truth derived from a distinct technology, it is uncertain if the 30 zebrafish sample results can be trusted.

    “However, without a benchmarking assessment from a ground truth derived from a distinct technology, it is uncertain if these results can be trusted.”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Interpretationown data

    Souporcell may be a viable means to identify biological replicates in large pools, which will provide informative metadata and enhance analysis for future experiments.

    “Altogether, this suggests that souporcell may be a viable means to identify biological replicates in large pools, which will provide informative metadata and enhance analysis for future experiments.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    Only cells that had sufficient read depth and fluorescent gene detection were selected for benchmarking in the Pleurodeles analysis.

    “As performed in the Xenopus analysis, we selected only cells that had sufficient read depth and fluorescent gene detection for benchmarking (Figs 3B and S8A–H).”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Study design and conductreasoning

    Stringent filtering was used to ensure that only cells likely to have accurate origin assignment by the fluorescent gene-based demultiplexing method would be used to benchmark SNP-based demultiplexing.

    “To avoid benchmarking results with low-quality cells, stringent filtering was used to ensure that only cells likely to have accurate origin assignment by the fluorescent gene–based demultiplexing method would be used to benchmark SNP-based demultiplexing.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Study design and conductown data

    Viabilities of non-erythroid cells were 85%, 98.4%, and 91.6% in eBFP, eGFP, and mCherry animals, respectively.

    “Viabilities of non-erythroid cells (based on cellular morphology) were 85%, 98.4%, and 91.6% in eBFP, eGFP, and mCherry animals, respectively.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    The original synth_pool.py script only allowed for pooling in the presence of a VCF file.

    “To pool bams, we modified the original synth_pool.py script from Vireo’s GitHub repository which was memory intensive and only allowed for pooling in the presence of a VCF file (https://zenodo.org/record/7929057).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites https://zenodo.org/record/7929057

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    We removed low quality, low-depth cells for further benchmarking analysis.

    “We removed low quality, low-depth cells for further benchmarking analysis and identified which souporcell individual assignments corresponded to each CMO through analyzing the correlation of assignments between the two methods (Fig 4B).”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationown data

    Freemuxlet may be able to be fed a sample-derived VCF, and this may be more reliable than a low-quality common SNPs VCF file.

    “This implies that Freemuxlet may be able to be fed a sample-derived VCF (and that this may be more reliable than a low-quality common SNPs VCF file).”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim. May combine two claims.

    Premisenone given

    C. aethiops has a robust VCF file available (European Variation Archive: PRJEB7923) that needs to be used in conjunction with genome assembly Chlorocebus_sabeus 1.1 (GCA_000409795.2).

    “C. aethiops has a robust VCF file available (European Variation Archive: PRJEB7923) that needs to be used in conjunction with genome assembly Chlorocebus_sabeus 1.1 (GCA_000409795.2).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites European Variation Archive: PRJEB7923

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Study design and conductnone given

    All experiments were carried out according to local and European ethical permits.

    “All experiments were carried out in post-metamorphic P. waltl and N. viridescens at Karolinska Institutet and were performed according to local and European ethical permits.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    The original synth_pool.py script from Vireo's GitHub repository was memory intensive.

    “To pool bams, we modified the original synth_pool.py script from Vireo’s GitHub repository which was memory intensive and only allowed for pooling in the presence of a VCF file (https://zenodo.org/record/7929057).”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites https://zenodo.org/record/7929057

      Couldn’t be matched to a paper in Crossref, so it can’t be checked.

49 of 49
  • The paper relies on this without support.

    Sample pooling is an effective means to increase biological replicate throughput while simultaneously decreasing batch effects and costs.

    “Sample pooling is an effective means to increase biological replicate throughput while simultaneously decreasing batch effects and costs.”
  • The paper relies on this without support.

    SNP-based computational approaches are expected to perform well in human samples because of their high genetic diversity and wealth of available genomic resources.

    “Relative to laboratory species, SNP-based computational approaches are expected to perform well in human samples because of their high genetic diversity and wealth of available genomic resources.”
  • The paper relies on this without support.

    The presence of doublets in single-cell RNA sequencing is a major confounder.

    “The presence of doublets in single-cell RNA sequencing is a major confounder.”
  • The paper relies on this without support.

    Souporcell relies on intergenotypic doublet detection, so homotypic true doublets can be removed.

    “Homotypic true doublets created during synthetic pooling were removed, as souporcell relies on intergenotypic doublet detection.”
  • The authors state this as an assumption.

    Assuming the worst-case scenario that souporcell is over-assigning doublets, this is a relatively harmless mistake because standard analysis would subsequently remove these doublets from downstream analysis.

    “However, assuming the worst-case scenario: that souporcell is over-assigning doublets, this is a relatively harmless mistake considering that a standard analysis would subsequently remove these doublets from downstream analysis.”
  • The paper relies on this without support.

    Fluorescent-based assignments provide a ground truth for benchmarking souporcell cell assignments.

    “We designed this experiment to only contain non-erythroid spleen cells from one individual of each transgenic newt line, making it technically feasible to benchmark souporcell cell assignments for individuals through comparisons to fluorescent-based assignments (Fig 3A).”
  • The paper relies on this without support.

    Notophthalmus viridescens has only a de novo transcriptome and no published common SNP VCF file.

    “Notophthalmus is another salamander species studied for its regenerative capacity but equipped with only a de novo transcriptome and no published common SNP VCF file.”
  • The paper relies on this without support.

    SNP-based demultiplexers can only detect doublets from two different individuals (heterotopic doublets), and the proportion of heterotypic doublets increases with sample number in the pool (e.g., three samples = 66%, four samples = 75%).

    “SNP-based demultiplexers can only detect doublets from two different individuals (i.e., heterotopic doublets) which occurs at increasing ratios as sample number in the pool increases (e.g., three samples = 66% heterotypic doublets, four samples 75% heterotypic doublets, etc.).”
  • The paper relies on this without support.

    SNP-based demuxers often struggle when applied to datasets from species with large reference genomes or de novo transcriptomes (which typically have many contigs).

    “A secondary hurdle for applying SNP-based demuxers is that these tools often struggle when applied to datasets from species with large reference genomes or de novo transcriptomes (which typically have many contigs).”
  • The paper relies on this without support.

    Batch correction algorithms cannot be used if there are no metadata distinguishing replicates.

    “Although a variety of batch correction algorithms are available for single-cell studies (Tran et al, 2020), these cannot be used if there are no metadata distinguishing replicates.”
  • The authors state this as an assumption.

    Only the troublet portion of souporcell is capable of detecting heterotypic doublets.

    “Note: we only expected the troublet portion of souporcell to be capable of detecting heterotypic doublets, so for downstream analysis of this synthetically pooled data, we removed all homotypic doublets.”
11 of 11

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

  • Figure S7B switches the basis of the doublet percentages

    Minor

    The text describes Figure S7B as showing doublet percentages within clusters, whereas the caption says the percentages are per animal.

  • Figure S7A is cited for cells per animal but describes animals per cluster

    Minor

    The text cites Figure S7A for the number of cells assigned to each zebrafish, but the caption says panel A shows the number of animals per cluster-a different quantity.

2 of 2

Cites

Flagged first, then by citations

5 of the 87 references couldn’t be matched to a known paper.

Cited by

Sorted by citations

Authors
Cardiello, J. F., Joven Araus, A., Giatrellis, S., Helsens, C., Simon, A., & Leigh, N. D.
Affiliations
  • Lund University (SE)
  • Department of Cell and Molecular Biology, Karolinska Institute
  • Karolinska Institutet (SE)
  • Institute of Bioengineering, Ecole Polytechnique Fédérale de Lausanne
Corresponding author
Leigh, Nicholas D
Venue
Life Science Alliance
Published
2023-05-17
Volume
6
Issue
8
Pages
e202301979
ISSN
2575-1077 (ISSN-L)
OpenAlex
W4377011406
Cited by
21
References
87
Citations by year
2026: 1 · 2025: 11 · 2024: 9
FWCI
1.65
Type
journal article
Language
en
Open access
Locations
  • Life Science Alliance (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
  • PubMed (publishedVersion)
  • PubMed Central (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
  • Lund University Publications (Lund University) (submittedVersion)
Funders
  • Knut och Alice Wallenbergs Stiftelse
  • Vetenskapsrådet (2020-01486)
  • EC | European Research Council
  • Cancerfonden
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Single-cell and spatial transcriptomics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Genomics and Phylogenetic Studies
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Molecular Biology › Gene expression and cancer classification
Keywords
single-cell sequencing, de novo transcriptome, zebrafish, non-human primates, reproducibility
MeSH terms
Animals, Humans, Zebrafish, Reproducibility of Results, Sequence Analysis, RNA, Genomics, Transcriptome

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-13.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-13.

Cited sources are checked by gpt-6-sol.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review