Cited by 455Genetic Associations and EpidemiologyGenomics and Rare DiseasesGenetic Mapping and Diversity in Plants and Animals

Statistical analysis strategies for association studies involving rare variants

Open access
Bansal, Vikas, Libiger, Ondrej, Torkamani, Ali, Schork, Nicholas J.·2010·Nature Reviews Genetics

Abstract

The limitations of genome-wide association (GWA) studies that focus on the phenotypic influence of common genetic variants have motivated human geneticists to consider the contribution of rare variants to phenotypic expression. The increasing availability of high-throughput sequencing technologies has enabled studies of rare variants but these methods will not be sufficient for their success as appropriate analytical methods are also needed. We consider data analysis approaches to testing associations between a phenotype and collections of rare variants in a defined genomic region or set of regions. Ultimately, although a wide variety of analytical approaches exist, more work is needed to refine them and determine their properties and power in different contexts.

AI snapshot

Written from the paper’s full text.

TL;DR

This review surveys statistical strategies for testing whether collections of rare variants in genomic regions associate with phenotypes, emphasizing collapsing approaches and alternatives. It concludes that many methods exist but their relative power and robustness remain insufficiently characterized.

Key findings

  • Rare variants, conventionally defined as variants with frequencies below 1% but sometimes considered below 0.1% or 0.01%, are expected to contribute to complex traits alongside common variants, yet single-variant association tests have low power even in large samples.
  • Collapsing rare variants into sets and testing collective frequency differences can substantially improve power; extensions include frequency weighting, functional annotation, regression-based modeling, and sequence-similarity or diversity methods.
  • Regression-based collapsed-variant models can accommodate covariates, common variants, interactions, and quantitative traits, but correlated predictors and many variables raise overfitting and collinearity concerns; regularized methods such as ridge regression and LASSO are proposed as remedies.
  • Power comparisons are limited: most compare a new method with single-locus tests, simulate mainly under extreme allelic heterogeneity, and often ignore other scenarios or linkage disequilibrium. In one cited empirical comparison, 11 methods plus 9 high-dimensional regression procedures applied to FAAH and MGLL data from 142 morbidly obese and 147 control subjects did not consistently agree on the most associated regions or likely causal variants.

Methods

  • Narrative review of statistical analysis approaches for rare-variant association studies, not a primary empirical study.
  • Organizes methods into three broad categories: group summary statistics such as CAST, CMC, and weighted-sum tests; sequence similarity or diversity approaches; and multiple regression or data-mining methods, while also discussing collapsing by function or proximity, moving windows, and multiple-testing issues.
  • Draws on published examples and power studies, including cited sequencing data from FAAH and MGLL in 142 morbidly obese and 147 control subjects and a comparison of 11 rare-variant methods plus 9 high-dimensional regression procedures.

Limitations

  • The paper states that more work is needed to refine methods and determine their properties and power across contexts; power studies are not exhaustive, often use extreme allelic heterogeneity simulations, and rarely consider other effect scenarios, linkage disequilibrium, or hierarchical functional collapsing.
  • The paper notes that not enough time has elapsed to compare all methods in a large study, some methods are designed only for specific situations, and assumptions of population-genetics simulation models are unclear.
  • Evident from the text: as a review, it does not provide new primary data or a systematic quantitative meta-analysis; its conclusions about method performance rely on cited studies and conceptual discussion.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1038/nrg2867

Cites

155 of 155 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Claims the paper makes

0 of 113 cited sources checked · 0 supported · 0 flagged

  • Findingreasoning

    The effect of collapsing variants and testing their collective frequency differences on power can be substantial.

    “The effect of collapsing variants and testing their collective frequency differences on power can be substantial, as depicted in Figure 1B.”
    Quote in the paperSubstantial claim
  • Premisecitation

    Many genetic and epigenetic factors, including multiple rare single nucleotide variants, copy number variations, and other structural variation, likely contribute to common complex diseases.

    “It is now widely believed that many genetic and epigenetic factors are likely to contribute to common complex diseases, including multiple rare SNVs (defined by convention as those that have frequencies < 1%), copy number variations (CNVs), and other forms of structural variation. 3–12”
    Quote in the paperSubstantial claim0 of 10 sources checked
    • cites [3] Pinto, D. et al. Functional impact of global rare copy number variation in autism spectrum disorders. Nature 466, 368–372 (2010). source

      Not checked in the free run.

    • cites [4] Frazer, K. A., Murray, S. S., Schork, N. J. & Topol, E. J. Human genetic variation and its contribution to complex traits. Nature Rev. Genet. 10, 241–251 (2009). source

      Not checked in the free run.

    • cites [5] Tycko, B. Mapping allele-specific DNA methylation: a new tool for maximizing information from GWAS. Am. J. Hum. Genet. 86, 109–112 (2010). source

      Not checked in the free run.

    • cites [6] Kong, A. et al. Parental origin of sequence variants associated with complex diseases. Nature 462, 868–874 (2009). source

      Not checked in the free run.

    • cites [7] Eichler, E. E. et al. Completing the map of human genetic variation. Nature 447, 161–165 (2007). source

      Not checked in the free run.

    • cites [8] Hunter, D. J. Gene–environment interactions in human diseases. Nature Rev. Genet. 6, 287–298 (2005). source

      Not checked in the free run.

    • cites [9] Cordell, H. J. Detecting gene–gene interactions that underlie human diseases. Nature Rev. Genet. 10, 392–404 (2009). source

      Not checked in the free run.

    • cites [10] Bodmer, W. & Bonilla, C. Common and rare variants in multifactorial susceptibility to common diseases. Nature Genet. 40, 695–701 (2008). source

      Not checked in the free run.

    • cites [11] Schork, N. J., Murray, S. S., Frazer, K. A. & Topol, E. J. Common vs. rare allele hypotheses for complex diseases. Curr. Opin. Genet. Dev. 19, 212–219 (2009). source

      Not checked in the free run.

    • cites [12] Cirulli, E. T. et al. Common genetic variation and performance on standardized cognitive tests. Eur. J. Hum. Genet. 18, 815–820 (2010). source

      Not checked in the free run.

  • Premisecitation

    Sequencing studies focusing on specific genes have shown that collections of rare variants can associate with particular phenotypes.

    “Fifth, importantly, sequencing studies focusing on specific genes have shown that collections of rare variants can indeed associate with particular phenotypes (Table 1).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Table 1

      Not checked in the free run.

  • Interpretationcitation

    Collapsing sets of rare variants into a single group and testing their collective frequency differences can overcome the power issues associated with testing rare variants individually.

    “In order to overcome power issues associated with testing rare variants individually, one could ‘collapse’ sets of rare variants into a single group and test their collective frequency differences between cases and controls.28, 30”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [28] Li, B. & Leal, S. M. Methods for detecting associations with rare variants for common diseases: application to analysis of sequence data. Am. J. Hum. Genet. 83, 311–321 (2008). One of the first papers to comprehensively evaluate statistical methods for testing collapsed sets of rare variants to a trait. The paper discussed both distance-based and regression approaches. source

      Not checked in the free run.

    • cites [30] Morgenthaler, S. & Thilly, W. G. A strategy to discover genes that carry multi-allelic or mono-allelic risk for common diseases: a cohort allelic sums test (CAST). Mutat. Res. 615, 28–56 (2007). This paper introduced the notion of collapsing sets of variants into a single group whose collective frequency could be contrasted between groups. source

      Not checked in the free run.

  • Premisecitation

    Obtaining phase from sequence data alone is not trivial.

    “Thus, leveraging phase information in an association study of rare variants may be crucial, but obtaining phase from sequence data alone is not trivial.24, 91–93”
    Quote in the paperSubstantial claim0 of 4 sources checked
    • cites [24] Roach, J. C. et al. Analysis of genetic inheritance in a family quartet by whole-genome sequencing. Science 328, 636–639 (2010). source

      Not checked in the free run.

    • cites [91] Andres, A. M. et al. Understanding the accuracy of statistical haplotype inference with sequence data of known phase. Genet. Epidemiol. 31, 659–671 (2007). source

      Not checked in the free run.

    • cites [92] Kim, J. H., Waterman, M. S. & Li, L. M. Accuracy assessment of diploid consensus sequences. IEEE/ACM Trans. Comput. Biol. Bioinform. 4, 88–97 (2007). source

      Not checked in the free run.

    • cites [93] Levy, S. et al. The diploid genome sequence of an individual human. PLoS Biol. 5, e254 (2007). source

      Not checked in the free run.

  • May combine two claims. 16
  • Classified as probably not a substantial claim. 15
  • May combine two claims.

    Premisecitation

    Rare variant effects can manifest as compound heterozygosity, the unmasking of deleterious variants through deletions on a homologous chromosome, and other haplotype context-dependent phenomena.

    “Rare variant effects can manifest as compound heterozygosity,90 the ‘unmasking’ of deleterious variants via deletions on a homologous chromosome12, and other haplotype context-dependent phenomena.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [90] Zschocke, J. Dominant versus recessive: molecular mechanisms in metabolic disease. J. Inherit. Metab. Dis. 31, 599–618 (2008). source

      Not checked in the free run.

    • cites [12] Cirulli, E. T. et al. Common genetic variation and performance on standardized cognitive tests. Eur. J. Hum. Genet. 18, 815–820 (2010). source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Premisenone given

    Controlling for false positive findings due to multiple testing is necessary.

    “Controlling for false positive findings due to multiple testing is necessary.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Interpretationcitation

    Combining rare variants into a single predictor variable should increase the fraction of variation explained by the variants as a whole and hence increase power to detect their collective effects.

    “This strategy should increase the fraction of variation explained by the variants as a whole and hence increase the power to detect their collective, rather than individual, effects.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [33] Morris, A. P. & Zeggini, E. An evaluation of statistical approaches to rare variant analysis in genetic association studies. Genet. Epidemiol. 34, 188–193 (2010). source

      Not checked in the free run.

  • May combine two claims.

    Premisenone given

    Not all analysis methods proposed for rare variant studies can accommodate additional factors in their formulations, and not all can accommodate quantitative trait analysis unless the phenotype is broken into quantiles and stratified analysis is pursued.

    “Not all analysis methods proposed for rare variant studies, however, can accommodate additional factors in their formulations and hence leverage conditioning effects. In addition, not all models can accommodate quantitative trait analysis unless the phenotype is broken into quantiles and stratified analysis is pursued (Table 2).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites Table 2

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable), S4 (based).

    Interpretationnone given

    There is no reason to believe that the extreme allelic heterogeneity setting is the rule rather than the exception for rare variant influences on phenotypic expression.

    “Although conceptually easier to accommodate in statistical analysis models, there is no reason to believe that the EAH setting is the rule rather than the exception with respect to rare variant influences on phenotypic expression.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable), S3 (load-bearing), S4 (based).

    Interpretationnone given

    The use of functional annotations to guide collapsing of rare variants in association studies will only be as good as the science behind those annotations.

    “Although there are a number of ways to leverage functional annotations to guide the collapsing of rare variants in association studies, their use will only be as good as the science behind those annotations.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Genome-wide association studies focused on common single nucleotide variants have identified some disease-associated variants, but most genetic variants contributing to complex disease susceptibility remain undiscovered.

    “Despite the success of genome wide association (GWA) studies in identifying common single nucleotide variants (SNVs) that contribute to complex diseases1, the vast majority of genetic variants contributing to disease susceptibility are yet to be discovered.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [1] Manolio, T. A., Brooks, L. D. & Collins, F. S. A HapMap harvest of insights into the genetics of common disease. J. Clin. Invest. 118, 1590–1605 (2008). source

      Not checked in the free run.

    • cites [2] Manolio, T. A. et al. Finding the missing heritability of complex diseases. Nature 461, 747–753 (2009). This paper describes the motivation for considering alternative approaches to discovering the genes that influence common complex diseases. It essentially argues that current GWA study paradigms focusing on common variants have failed to identify the majority of genetic variants that influence particular phenotypes. source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Flaws with measures such as Fst and Gst may prevent them from reliably capturing diversity, differences in diversity, or population differentiation in some trivial settings because of their focus on heterozygosity.

    “In addition, flaws with measures such as Fst and Gst have been pointed out that may not allow them to reliably capture diversity, differences in diversity, or population differentiation in general in some of the most trivial settings, given their focus on heterozygosity.50”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [50] Jost, L. GST and its relatives do not measure differentiation. Mol. Ecol. 17, 4015–4026 (2008). source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing). May combine two claims.

    Premisecitation

    Ridge regression and LASSO have been considered in genetic association analysis contexts, and other methods have been proposed.

    “Two such techniques, ridge regression74 and the LASSO75,76 have been considered in genetic association analysis contexts, and other methods have also been proposed as well.77–80, 81”
    Quote in the paperNot a substantial claim0 of 8 sources checked
    • cites [74] Malo, N., Libiger, O. & Schork, N. J. Accommodating linkage disequilibrium in genetic-association analyses via ridge regression. Am. J. Hum. Genet. 82, 375–385 (2008). source

      Not checked in the free run.

    • cites [75] Hoggart, C. J., Whittaker, J. C., De Iorio, M. & Balding, D. J. Simultaneous analysis of all SNPs in genome-wide and re-sequencing association studies. PLoS Genet. 4, e1000130 (2008). Refs 74 and 75 introduced regularized regression techniques for accommodating a large number of predictors in a genetic association study and to separate causally associated from non-causally associated variants. source

      Not checked in the free run.

    • cites [76] Zhou, H., Sehl, M. E., Sinsheimer, J. S. & Lange, K. Association screening of common and rare genetic variants by penalized regression. Bioinformatics 6 Aug 2010 (doi:10.1093/bioinformatics/btq448). source

      Not checked in the free run.

    • cites [77] Clark, T. G., De Iorio, M., Griffiths, R. C. & Farrall, M. Finding associations in dense genetic maps: a genetic algorithm approach. Hum. Hered. 60, 97–108 (2005). source

      Not checked in the free run.

    • cites [78] Guo, W. & Lin, S. Generalized linear modeling with regularization for detecting common disease rare haplotype association. Genet. Epidemiol. 33, 308–316 (2009). source

      Not checked in the free run.

    • cites [79] Luan, Y. H. & Li, H. Z. Group additive regression models for genomic data analysis. Biostatistics 9, 100–113 (2008). source

      Not checked in the free run.

    • cites [80] Kwee, L. C., Liu, D. W., Lin, X. H., Ghosh, D. & Epstein, M. P. A powerful and flexible multilocus association test for quantitative traits. Am. J. Hum. Genet. 82, 386–397 (2008). source

      Not checked in the free run.

    • cites [81] Capanu, M. & Begg, C. B. Hierarchical modeling for estimating relative risks of rare genetic variants: properties of the pseudo-likelihood method. Biometrics 5 Aug 2010 (doi:10.1111/j.1541-0420.2010.01469.x). source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Linkage analysis approaches require sampling family members, and many phenotypes may not exhibit familial aggregation, undermining the motivation to consider family-based studies.

    “In addition, linkage analysis approaches not only come with the often difficult and expensive need to sample family members, but many phenotypes may not exhibit familial aggregation, undermining the motivation to consider family-based studies10.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [10] Bodmer, W. & Bonilla, C. Common and rare variants in multifactorial susceptibility to common diseases. Nature Genet. 40, 695–701 (2008). source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Premisecitation

    Transmission/disequilibrium tests may have merit in the analysis of rare variants.

    “although transmission/disequilibrium tests may have merit in the analysis of rare variants.71”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [71] Oexle, K. A remark on rare variants. J. Hum. Genet. 55, 219–226 (2010). source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Morris and Zeggini did not consider conditioning effects or problems associated with analyses involving many correlated predictor variables.

    “However, they did not consider conditioning effects (Figure 1C) or problems associated with analyses involving many correlated predictor variables.33”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [33] Morris, A. P. & Zeggini, E. An evaluation of statistical approaches to rare variant analysis in genetic association studies. Genet. Epidemiol. 34, 188–193 (2010). source

      Not checked in the free run.

  • May combine two claims.

    Interpretationreasoning

    Groups of collapsed variants could be correlated because of linkage disequilibrium with another common variant in the model, or because of how variant subsets are grouped by functional annotation.

    “For example, collapsed sets of variants might be correlated due to LD with an additional common variant included in the model or due to the manner in which different subsets of variants are collapsed based on functional annotations”
    Quote in the paperSubstantial claim
  • May combine two claims.

    Premisecitation

    In diversity measures, q values less than 1 produce a measure that emphasizes rare variants, and q values greater than 1 produce a measure that emphasizes common variants.

    “Thus, the use of q values less than 1.0 produces a measure that emphasizes rare variants and the use of λ values greater than 1.0 produces a measure that emphasizes common variants.50, 129”
    Quote in the paperNot a substantial claim0 of 2 sources checked
    • cites [50] Jost, L. GST and its relatives do not measure differentiation. Mol. Ecol. 17, 4015–4026 (2008). source

      Not checked in the free run.

    • cites [129] Hill, M. O. Diversity and evenness — unifying notation and its consequences. Ecology 54, 427–432 (1973). source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    The CMC statistic appropriately controls type I error rates even when non-functional variants are included in the set of variants to be tested, and it has better power than the standard CAST method.

    “The CMC statistic has desirable properties in that it appropriately controls type I error rates even when non-functional variants are included in the set of variants to be tested, and has better power than the standard CAST method.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [28] Li, B. & Leal, S. M. Methods for detecting associations with rare variants for common diseases: application to analysis of sequence data. Am. J. Hum. Genet. 83, 311–321 (2008). One of the first papers to comprehensively evaluate statistical methods for testing collapsed sets of rare variants to a trait. The paper discussed both distance-based and regression approaches. source

      Not checked in the free run.

  • May combine two claims.

    Premisenone given

    Classical DNA sequence diversity measures and traditional population differentiation measures can provide insight into differences between groups over many rare variants, but their utility and power have not been assessed in association analysis settings.

    “These methods are more or less agnostic to allele frequencies, but can provide insight into differences between groups over many rare variants. However, their utility and power have not been assessed in association analysis settings.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [47] Hartl, D. L. & Clark, A. G. Principles of Population Genetics (Sinauer Associates, Sunderland, Massachusetts, 2007).

      Not checked in the free run.

    • cites [48] Holsinger, K. E. & Weir, B. S. Genetics in geographically structured populations: defining, estimating and interpreting FST . Nature Rev. Genet. 10, 639–650 (2009). source

      Not checked in the free run.

    • cites [49] Nei, M. Molecular Evolutionary Genetics (Columbia Univ. Press, New York, 1987). source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    The CAST method as first proposed does not easily accommodate covariates, cannot be used with quantitative phenotypes, and does not consider weighting of variants using variant frequency or functional annotations.

    “The method as first proposed does not easily accommodate covariates, cannot be used with quantitative phenotypes, and does not consider weighting of the variants using, for example, variant frequency or functional annotations.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [30] Morgenthaler, S. & Thilly, W. G. A strategy to discover genes that carry multi-allelic or mono-allelic risk for common diseases: a cohort allelic sums test (CAST). Mutat. Res. 615, 28–56 (2007). This paper introduced the notion of collapsing sets of variants into a single group whose collective frequency could be contrasted between groups. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Using 11 methods from this review and 9 high-dimensional regression procedures, Bansal et al. found that the methods disagree on which gene regions are most associated and which variants are most likely causal.

    “They applied 11 of the methods described in this review plus 9 high-dimensional regression procedures, and showed that the methods do not consistently agree on the most strongly associated regions of the genes or the most likely causal variants.”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [86] Bansal, V., Libiger, O., Torkamani, A. & Schork, N. J. An application and empirical comparison of statistical analysis methods for associating rare variants to a complex phenotype. Pacific Symposium on Biocomputing Proceedings (in the press).

      Not checked in the free run.

  • Classified as probably not a substantial claim.

    Interpretationreasoning

    Nearly every such power study contrasts a new method with basic single-locus tests, a comparison that fails to capture the new method's sophistication or usefulness.

    “For example, almost all such studies consider comparisons between a proposed novel method and simple single locus analyses, which is an obvious comparison at some level, but does not reflect the sophistication and utility of the proposed method.”
    Quote in the paperSubstantial claim
  • Probably not a substantial claim: may not pass S2 (checkable). May combine two claims.

    Interpretationreasoning

    A comprehensive regression model could reduce worries about confounding variables and about assessing variant function.

    “Such an approach might mitigate a range of concerns, for example about accommodating confounding variables and the functional assessment of variants.”
    Quote in the paperNot a substantial claim
  • May combine two claims.

    Premisecitation

    Nearly all these studies simulated data under some form of the EAH model for rare variant effects, ignoring alternative scenarios and the impact of linkage disequilibrium among multiple common and rare variants.

    “In addition, almost all of the studies considered simulations under some version of the EAH model of rare variant effects and do not consider other scenarios (Figure 2) or the influence of LD structure among multiple common and rare variants (of the type that might create ‘synthetic associations’85).”
    Quote in the paperSubstantial claim0 of 1 sources checked
    • cites [85] Dickson, S. P., Wang, K., Krantz, I., Hakonarson, H. & Goldstein, D. B. Rare variants create synthetic genome-wide associations. PLoS Biol. 8, e1000294 (2010). source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    From a practical implementation perspective, it is not clear what benefits more advanced analysis methods offer.

    “The advantages of more sophisticated data analysis methods are therefore unclear from a practical and implementation standpoint.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationreasoning

    Regression-based methods that simultaneously handle covariates, known genetic factors, allelic heterogeneity, and multiple collapsed variant sets are clearly beneficial.

    “Thus, for example, methods which can accommodate covariates, previously identified genetic factors, allelic heterogeneity, and different sets of collapsed variants simultaneously, such as regression-based methods, are clearly advantageous.”
    Quote in the paperNot a substantial claim
  • Classified as probably not a substantial claim.

    Interpretationnone given

    It remains uncertain whether the population genetics model assumptions underlying many published power simulations are appropriate.

    “Finally, although many such published power studies simulate data assuming a population genetics model for the propagation of rare variants, the appropriateness of the assumptions of these models is unclear.”
    Quote in the paperSubstantial claim
  • Classified as probably not a substantial claim.

    Premisecitation

    Bansal and colleagues analyzed sequence data from the FAAH and MGLL genes in 142 morbidly obese cases and 147 controls.

    “In this light, Bansal et al.86 recently considered the analysis of sequencing data obtained on two genes, FAAH and MGLL, thought be associated with morbid obesity among 142 morbidly obese and 147 control subjects discussed in a previous study66.”
    Quote in the paperSubstantial claim0 of 2 sources checked
    • cites [86] Bansal, V., Libiger, O., Torkamani, A. & Schork, N. J. An application and empirical comparison of statistical analysis methods for associating rare variants to a complex phenotype. Pacific Symposium on Biocomputing Proceedings (in the press).

      Not checked in the free run.

    • cites [66] Bhatia, G. et al. A covering method for detecting genetic associations between rare variants and common phenotypes. PLoS Genet. (in the press).

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S2 (checkable).

    Interpretationcitation

    These findings highlight a need for simulation and theoretical work comparing different methods.

    “Their results emphasize the need for simulation and theoretical studies of different methodologies.”
    Quote in the paperNot a substantial claim
  • Probably not a substantial claim: may not pass S3 (load-bearing).

    Interpretationcitation

    For rare variant analysis, logic regression could be an especially appealing regression method, at least theoretically.

    “Logic regression67 may be a particularly attractive regression-based approach, at least in theory, for the analysis of rare variants.”
    Quote in the paperNot a substantial claim0 of 1 sources checked
    • cites [67] Kooperberg, C., Ruczinski, I., LeBlanc, M. L. & Hsu, L. Sequence analysis using logic regression. Genet. Epidemiol. 21 (Suppl. 1), S626–S631 (2001). One of the first papers to consider statistical methods for identifying optimal sets of predictors of a phenotype from sequence data based purely on the strength of statistical association. This paper proposed a novel regression method for this task. source

      Not checked in the free run.

  • May combine two claims.

    Premisecitation

    Certain approaches, including those of Li and Leal and Madsen and Browning, ignore the direction of a rare variant's effect, while others are built to account for it.

    “For example, some methods do not take into account the possible direction of a rare variant effect, such as the methods described by Li and Leal28 and Madsen and Browning34 whereas other methods are designed to handle these situations40.”
    Quote in the paperNot a substantial claim0 of 3 sources checked
    • cites [28] Li, B. & Leal, S. M. Methods for detecting associations with rare variants for common diseases: application to analysis of sequence data. Am. J. Hum. Genet. 83, 311–321 (2008). One of the first papers to comprehensively evaluate statistical methods for testing collapsed sets of rare variants to a trait. The paper discussed both distance-based and regression approaches. source

      Not checked in the free run.

    • cites [34] Madsen, B. E. & Browning, S. R. A groupwise association test for rare mutations using a weighted sum statistic. PLoS Genet. 5, e1000384 (2009). source

      Not checked in the free run.

    • cites [40] Han, F. & Pan, W. A data-adaptive sum test for disease association with multiple common or rare variants. Hum. Hered. 70, 42–54 (2010). source

      Not checked in the free run.

  • Probably not a substantial claim: may not pass S4 (based).

    Premisenone given

    To date, no study has examined tests in a hierarchical collapsing framework that uses functional annotations to distinguish genuinely causal variants from sets of rare variants that only contain causal variants.

    “In addition, studies so far have not considered tests within a hierarchical collapsing framework that leverages functional annotations of genomic regions to separate truly causal variants from collections of rare variants that merely contain causal variants.”
    Quote in the paperNot a substantial claim
29 of 29
  • The authors state this as an assumption.

    Some formulations of collapsed tests assume that each subject is likely to have only a single rare variant.

    “First, some formulations of collapsed tests assume that each subject is likely to have only a single rare variant.”
  • The authors state this as an assumption.

    Similarity-based approaches assume some form of interaction among variants or at least a simple shaping of gene function by the balance of variations an individual possesses.

    “Thus, such approaches assume some form of interaction among variants or at least a simple shaping of gene function by the balance of variations an individual possesses.”
  • The paper relies on this without support.

    Current sequencing protocols have inherent error rates.

    “Given that current sequencing protocols have inherent error rates, more research is needed to understand how false positive variant calls and nucleotide misassignments in sequence-based association studies of rare variants will impact inferences.”
  • The paper relies on this without support.

    In traditional linear regression, severe multicollinearity leads to numerical and interpretive problems.

    “Furthermore, strong multicollinearity is known to cause numerical and interpretation issues in traditional linear regression analysis.”
  • The paper relies on this without support.

    When a standard linear regression has many predictors, or more predictors than subjects, it is prone to numerical instability and overfitting.

    “Having many independent variables, or more independent variables than subjects, creates enormous potential for numerical instabilities and overfitting in standard linear regression models.”
  • The paper relies on this without support.

    The number of common, rare, or collapsed variant sets that affect a phenotype, and the nature of their effects, cannot be known in advance.

    “This is problematic in the context of genetic association analyses since one will not necessarily know a priori how many common, rare, or collapsed sets of variants might influence a phenotype, nor what kind of effects those variants have.”
6 of 6

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

Cites

Flagged first, then by citations

1 of the 156 references couldn’t be matched to a known paper.

Research works printed but not linked: 2

  1. Lehmann, E. L. Nonparametric Statistical Methods Based on Ranks (McGraw–Hill, New York, 1975).
  2. Ickstadt, K., Selinski, S. & Muller, T. D. in SFB 475 Komplexitatsreduktion in Multivariaten Datenstrukturen (Univ. Dortmund, Germany, 2005).

Cited by

Sorted by citations

Authors
Bansal, V., Libiger, O., Torkamani, A., & Schork, N. J.
Affiliations
Scripps Research Institute (US)
Corresponding author
Schork, Nicholas J.
Venue
Nature Reviews Genetics
Published
2010-10-13
Volume
11
Issue
11
Pages
773-785
ISSN
  • 1471-0056 (ISSN-L)
  • 1471-0064
OpenAlex
W2007733142
Cited by
455
References
156
Citations by year
2026: 3 · 2025: 4 · 2024: 8 · 2023: 7 · 2022: 8 · 2021: 14 · 2020: 13 · 2019: 21 · 2018: 21 · 2017: 22 · 2016: 31 · 2015: 39 · 2014: 60 · 2013: 52 · 2012: 94
FWCI
6.85
Type
journal article
Language
en
Open access
Locations
  • Nature Reviews Genetics (publishedVersion)
  • PubMed (publishedVersion)
  • Europe PMC (PubMed Central) (acceptedVersion)
  • PubMed Central (acceptedVersion)
Funders
  • National Institutes of Health (5u01da024417-02, n01mh22005-16-0-1)
  • National Institute on Aging (R01AG030474, U19AG023122)
  • National Heart, Lung, and Blood Institute (R01HL089655)
  • National Institute of Mental Health (N01MH022005, R01MH078151, R01MH080134, P50MH081755)
  • National Institute on Drug Abuse (U01-DA024417, U01 DA024417-01)
  • National Cancer Institute (U54CA143906)
  • National Center for Research Resources (UL1RR025774)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genomics and Rare Diseases
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Mapping and Diversity in Plants and Animals
Keywords
rare variants, association studies, statistical power, next-generation sequencing, common diseases, genome-wide association study, genetic epidemiology
MeSH terms
Data Interpretation, Statistical, Gene Frequency, Humans, Phenotype, Case-Control Studies, Polymorphism, Single Nucleotide, Genome-Wide Association Study, DNA Copy Number Variations

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Claims read by deepseek-v4.1-flash under definition version 3 (extract-v3) on 2026-10-06.

Classified by jev-1.13-20260917 (gold-guideline-v0.2) on 2026-10-06.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review