The DOI matches its Crossref record; 42 of the 42 references it cites were found in a registry or an index.
Efficient analysis of large-scale genome-wide data with two R packages: bigstatsr and bigsnpr
Open accessAbstract
Motivation: Genome-wide datasets produced for association studies have dramatically increased in size over the past few years, with modern datasets commonly including millions of variants measured in dozens of thousands of individuals. This increase in data size is a major challenge severely slowing down genomic analyses, leading to some software becoming obsolete and researchers having limited access to diverse analysis tools. Results: Here we present two R packages, bigstatsr and bigsnpr, allowing for the analysis of large scale genomic data to be performed within R. To address large data size, the packages use memory-mapping for accessing data matrices stored on disk instead of in RAM. To perform data pre-processing and data analysis, the packages integrate most of the tools that are commonly used, either through transparent system calls to existing software, or through updated or improved implementation of existing methods. In particular, the packages implement fast and accurate computations of principal component analysis and association studies, functions to remove single nucleotide polymorphisms in linkage disequilibrium and algorithms to learn polygenic risk scores on millions of single nucleotide polymorphisms. We illustrate applications of the two R packages by analyzing a case–control genomic dataset for celiac disease, performing an association study and computing polygenic risk scores. Finally, we demonstrate the scalability of the R packages by analyzing a simulated genome-wide dataset including 500 000 individuals and 1 million markers on a single desktop computer. Availability and implementation: https://privefl.github.io/bigstatsr/ and https://privefl.github.io/bigsnpr/. Supplementary information: Supplementary data are available at Bioinformatics online.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
R: A Language and Environment for Statistical Computing
R Core Team (2025) · doi:10.32614/r.manuals · Cited by 352,181
XGBoost: A Scalable Tree Boosting System
Chen, T., & Guestrin, C. (2016) · Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining · doi:10.1145/2939672.2939785 · Cited by 54,569
Regression shrinkage and selection via the lasso
Tibshirani, R. (1996) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1996.tb02080.x · Cited by 51,482
PLINK: a tool set for whole-genome association and population-based linkage analyses.
Purcell, S., Neale, B., Todd-Brown, K., Thomas, L., Ferreira, M. A. R., Bender, D., Maller, J., Sklar, P., de Bakker, P. I. W., Daly, M. J., et al. (2007) · The American Journal of Human Genetics · doi:10.1086/519795 · Cited by 34,089
Regularization and Variable Selection Via the Elastic Net
Zou, H., & Hastie, T. (2005) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2005.00503.x · Cited by 20,957
Regularization Paths for Generalized Linear Models via Coordinate Descent
Friedman, J., Hastie, T., & Tibshirani, R. (2010) · Journal of Statistical Software · doi:10.18637/jss.v033.i01 · Cited by 19,927
The variant call format and VCFtools
Danecek, P., Auton, A., Abecasis, G., Albers, C. A., Banks, E., DePristo, M. A., Handsaker, R. E., Lunter, G., Marth, G. T., Sherry, S. T., et al. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr330 · Cited by 16,200
Second-generation PLINK: rising to the challenge of larger and richer datasets
Chang, C. C., Chow, C. C., Tellier, L. C., Vattikuti, S., Purcell, S. M., & Lee, J. J. (2015) · Gigascience · doi:10.1186/s13742-015-0047-8 · Cited by 12,709
Principal components analysis corrects for stratification in genome-wide association studies
Price, A. L., Patterson, N. J., Plenge, R. M., Weinblatt, M. E., Shadick, N. A., & Reich, D. (2006) · Nature Genetics · doi:10.1038/ng1847 · Cited by 10,248
Browning, S. R., & Browning, B. L. (2007) · The American Journal of Human Genetics · doi:10.1086/521987 · Cited by 3,210
A reference panel of 64,976 haplotypes for genotype imputation
the Haplotype Reference Consortium (2016) · Nature Genetics · doi:10.1038/ng.3643 · Cited by 2,836
A high-performance computing toolset for relatedness and principal component analysis of SNP data
Zheng, X., Levine, D., Shen, J., Gogarten, S. M., Laurie, C., & Weir, B. S. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts606 · Cited by 2,524
GenABEL: an R library for genome-wide association analysis
Aulchenko, Y. S., Ripke, S., Isaacs, A., & van Duijn, C. M. (2007) · Bioinformatics · doi:10.1093/bioinformatics/btm108 · Cited by 1,836
Browning, B. L., & Browning, S. R. (2009) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2009.01.005 · Cited by 1,640
Genotype imputation for genome-wide association studies
Marchini, J., & Howie, B. (2010) · Nature Reviews Genetics · doi:10.1038/nrg2796 · Cited by 1,627
Power and predictive accuracy of polygenic risk scores
Dudbridge, F. (2013) · PLoS Genetics · doi:10.1371/journal.pgen.1003348 · Cited by 1,509 · cited 1×
“A PRS is defined as the sum of allele counts of the remaining SNPs weighted by the corresponding regression coefficients (Chatterjee et al. , 2013; Dudbridge, 2013; Euesden et al. , 2015).”
MethodRcpp: Seamless R and C++Integration
Eddelbuettel, D., & François, R. (2011) · Journal of Statistical Software · doi:10.18637/jss.v040.i08 · Cited by 1,318
Modeling Linkage Disequilibrium Increases Accuracy of Polygenic Risk Scores
Vilhjálmsson, B. J., Yang, J., Finucane, H. K., Gusev, A., Lindström, S., Ripke, S., Genovese, G., Loh, P.-R., Bhatia, G., Do, R., et al. (2015) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2015.09.001 · Cited by 1,303
PRSice: Polygenic Risk Score software
Euesden, J., Lewis, C. M., & O’Reilly, P. F. (2015) · Bioinformatics · doi:10.1093/bioinformatics/btu848 · Cited by 1,191
topicmodels : An R Package for Fitting Topic Models
Grün, B., & Hornik, K. (2011) · Journal of Statistical Software · doi:10.18637/jss.v040.i13 · Cited by 1,072
Multiple common variants for celiac disease influencing immune gene expression
Dubois, P. C. A., Trynka, G., Franke, L., Hunt, K. A., Romanos, J., Curtotti, A., Zhernakova, A., Heap, G. A. R., Ádány, R., Aromaa, A., et al. (2010) · Nature Genetics · doi:10.1038/ng.543 · Cited by 1,024
pcadapt : an Rpackage to perform genome scans for selection based on principal component analysis
Luu, K., Bazin, E., & Blum, M. G. B. (2017) · Molecular Ecology Resources · doi:10.1111/1755-0998.12592 · Cited by 971
Self-citationStrong Rules for Discarding Predictors in Lasso-Type Problems
Tibshirani, R., Bien, J., Friedman, J., Hastie, T., Simon, N., Taylor, J., & Tibshirani, R. J. (2012) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.1467-9868.2011.01004.x · Cited by 653
Deflation Techniques for an Implicitly Restarted Arnoldi Iteration
Lehoucq, R. B., & Sorensen, D. C. (1996) · SIAM Journal on Matrix Analysis and Applications · doi:10.1137/s0895479895281484 · Cited by 618
Long-Range LD Can Confound Genome Scans in Admixed Populations
Price, A. L., Weale, M. E., Patterson, N., Myers, S. R., Need, A. C., Shianna, K. V., Ge, D., Rotter, J. I., Torres, E., Taylor, K. D., et al. (2008) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2008.06.005 · Cited by 443
ProbABEL package for genome-wide association analysis of imputed data
Aulchenko, Y. S., Struchalin, M. V., & van Duijn, C. M. (2010) · BMC Bioinformatics · doi:10.1186/1471-2105-11-134 · Cited by 396
FlashPCA2: principal component analysis of Biobank-scale genotype datasets
Abraham, G., Qiu, Y., & Inouye, M. (2017) · Bioinformatics · doi:10.1093/bioinformatics/btx299 · Cited by 383
Fast Principal-Component Analysis Reveals Convergent Evolution of ADH1B in Europe and East Asia
Galinsky, K. J., Bhatia, G., Loh, P.-R., Georgiev, S., Mukherjee, S., Patterson, N. J., & Price, A. L. (2016) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2015.12.022 · Cited by 371
Chatterjee, N., Wheeler, B., Sampson, J., Hartge, P., Chanock, S. J., & Park, J.-H. (2013) · Nature Genetics · doi:10.1038/ng.2579 · Cited by 362
Fast Principal Component Analysis of Large-Scale Genome-Wide Data
(2014) · doi:10.1371/journal.pone.0093766 · Cited by 305
Nelson, M. R., Bryc, K., King, K. S., Indap, A., Boyko, A. R., Novembre, J., Briley, L. P., Maruyama, Y., Waterworth, D. M., Waeber, G., et al. (2008) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2008.08.005 · Cited by 293
Complex disease and phenotype mapping in the domestic dog
Hayward, J. J., Castelhano, M. G., Oliveira, K. C., Corey, E., Balkman, C., Baxter, T. L., Casal, M. L., Center, S. A., Fang, M., Garrison, S. J., et al. (2016) · Nature Communications · doi:10.1038/ncomms10460 · Cited by 271
Gogarten, S. M., Bhangale, T., Conomos, M. P., Laurie, C. A., McHugh, C. P., Painter, I., Zheng, X., Crosslin, D. R., Levine, D., Lumley, T., et al. (2012) · Bioinformatics · doi:10.1093/bioinformatics/bts610 · Cited by 206
Population structure, migration, and diversifying selection in the Netherlands
Abdellaoui, A., Hottenga, J., de Knijff, P., Nivard, M. G., Xiao, X., Scheet, P. A., Brooks, A. I., Ehli, E. A., Hu, Y., Davies, G. E., et al. (2013) · European Journal of Human Genetics · doi:10.1038/ejhg.2013.48 · Cited by 154
Scalable Strategies for Computing with Massive Data
Kane, M. J., Emerson, J. W., & Weston, S. (2013) · Journal of Statistical Software · doi:10.18637/jss.v055.i14 · Cited by 149
Effective Genetic-Risk Prediction Using Mixed Models
Golan, D., & Rosset, S. (2014) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2014.09.007 · Cited by 46
SparSNP: Fast and memory-efficient analysis of all SNPs for phenotype prediction
Abraham, G., Kowalczyk, A., Zobel, J., & Inouye, M. (2012) · BMC Bioinformatics · doi:10.1186/1471-2105-13-88 · Cited by 39
Sikorska, K., Lesaffre, E. M. E. H., Groenen, P. J. F., & Eilers, P. H. C. (2013) · BMC Bioinformatics · doi:10.1186/1471-2105-14-166 · Cited by 39
ccSVM: correcting Support Vector Machines for confounding factors in biological data classification
Li, L., Rakitsch, B., & Borgwardt, K. M. (2011) · Bioinformatics · doi:10.1093/bioinformatics/btr204 · Cited by 33
Fast accurate missing SNP genotype local imputation
Wang, Y., Cai, Z., Stothard, P., Moore, S., Goebel, R. G., Wang, L., & Lin, G. (2012) · BMC Research Notes · doi:10.1186/1756-0500-5-404 · Cited by 26
Palmer, C. D., & Pe’er, I. (2016) · PLoS Genetics · doi:10.1371/journal.pgen.1006091 · Cited by 20
Nielsen, J., & Mailund, T. (2008) · BMC Bioinformatics · doi:10.1186/1471-2105-9-526 · Cited by 4
Cited by
Tutorial: a guide to performing polygenic risk score analyses
Choi, S. W., Mak, T. S.-H., & O’Reilly, P. F. (2020) · Nature Protocols · doi:10.1038/s41596-020-0353-1 · Cited by 1,946
LDpred2: better, faster, stronger
Privé, F., Arbel, J., & Vilhjálmsson, B. J. (2021) · Bioinformatics · doi:10.1093/bioinformatics/btaa1029 · Cited by 726
Self-citationThe sequences of 150,119 genomes in the UK Biobank
Halldorsson, B. V., Eggertsson, H. P., Moore, K. H. S., Hauswedell, H., Eiriksson, O., Ulfarsson, M. O., Palsson, G., Hardarson, M. T., Oddsson, A., Jensson, B. O., et al. (2022) · Nature · doi:10.1038/s41586-022-04965-x · Cited by 448
Privé, F., Aschard, H., Carmi, S., Folkersen, L., Hoggart, C., O’Reilly, P. F., & Vilhjálmsson, B. J. (2022) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2021.11.008 · Cited by 375
Self-citationPolygenic scoring accuracy varies across the genetic ancestry continuum
Ding, Y., Hou, K., Xu, Z., Pimplaskar, A., Petter, E., Boulier, K., Privé, F., Vilhjálmsson, B. J., Olde Loohuis, L. M., & Pasaniuc, B. (2023) · Nature · doi:10.1038/s41586-023-06079-4 · Cited by 307
Self-citation
Metadata
- Authors
- Privé, F., Aschard, H., Ziyatdinov, A., & Blum, M. G. B.
- Venue
- Bioinformatics
- Publisher
- Oxford University Press (OUP)
- Published
- 2018-03-30
- Volume
- 34
- Issue
- 16
- Pages
- 2781-2787
- ISSN
- 1367-4803 (ISSN-L)
- 1367-4811
- OpenAlex
- W2794694102
- Cited by
- 368
- References
- 42
- FWCI
- 12.91
- Type
- journal article
- Language
- en
- Open access
- hybrid
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.