The DOI matches its Crossref record; 48 of the 48 references it cites were found in a registry or an index.
Comparison and integration of deleteriousness prediction methods for nonsynonymous SNVs in whole exome sequencing studies
Open accessAbstract
Accurate deleteriousness prediction for nonsynonymous variants is crucial for distinguishing pathogenic mutations from background polymorphisms in whole exome sequencing (WES) studies. Although many deleteriousness prediction methods have been developed, their prediction results are sometimes inconsistent with each other and their relative merits are still unclear in practical applications. To address these issues, we comprehensively evaluated the predictive performance of 18 current deleteriousness-scoring methods, including 11 function prediction scores (PolyPhen-2, SIFT, MutationTaster, Mutation Assessor, FATHMM, LRT, PANTHER, PhD-SNP, SNAP, SNPs&GO and MutPred), 3 conservation scores (GERP++, SiPhy and PhyloP) and 4 ensemble scores (CADD, PON-P, KGGSeq and CONDEL). We found that FATHMM and KGGSeq had the highest discriminative power among independent scores and ensemble scores, respectively. Moreover, to ensure unbiased performance evaluation of these prediction scores, we manually collected three distinct testing datasets, on which no current prediction scores were tuned. In addition, we developed two new ensemble scores that integrate nine independent scores and allele frequency. Our scores achieved the highest discriminative power compared with all the deleteriousness prediction scores tested and showed low false-positive prediction rate for benign yet rare nonsynonymous variants, which demonstrated the value of combining information from multiple orthologous approaches. Finally, to facilitate variant prioritization in WES studies, we have pre-computed our ensemble scores for 87 347 044 possible variants in the whole-exome and made them publicly available through the ANNOVAR software and the dbNSFP database.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Cortes, C., & Vapnik, V. (1995) · Machine Learning · doi:10.1007/bf00994018 · Cited by 59,421
ANNOVAR: functional annotation of genetic variants from high-throughput sequencing data
Wang, K., Li, M., & Hakonarson, H. (2010) · Nucleic Acids Research · doi:10.1093/nar/gkq603 · Cited by 14,621
Self-citationpROC: an open-source package for R and S+ to analyze and compare ROC curves
Robin, X., Turck, N., Hainard, A., Tiberti, N., Lisacek, F., Sanchez, J.-C., & Müller, M. (2011) · BMC Bioinformatics · doi:10.1186/1471-2105-12-77 · Cited by 13,697
A method and server for predicting damaging missense mutations.
Adzhubei, I. A., Schmidt, S., Peshkin, L., Ramensky, V. E., Gerasimova, A., Bork, P., Kondrashov, A. S., & Sunyaev, S. R. (2010) · Nature Methods · doi:10.1038/nmeth0410-248 · Cited by 13,194
Hapeman, D. E. (1991) · Technometrics · doi:10.1080/00401706.1991.10484817 · Cited by 9,373
A map of human genome variation from population-scale sequencing.
The 1000 Genomes Project Consortium (2010) · Nature · doi:10.1038/nature09534 · Cited by 7,877
An integrated map of genetic variation from 1,092 human genomes
The 1000 Genomes Project Consortium (2012) · Nature · doi:10.1038/nature11632 · Cited by 7,711
Kumar, P., Henikoff, S., & Ng, P. C. (2009) · Nature Protocols · doi:10.1038/nprot.2009.86 · Cited by 6,521 · cited 1×
“2, released in Feb, 2013) (15), SIFT (Human_db_37_ensembl_63, released inAugust, 2011) (16), MutationTaster (data retrieved in 2013) (8),MutationAssessor (release 2) (2), FATHMM (v2.”
A general framework for estimating the relative pathogenicity of human genetic variants
Kircher, M., Witten, D. M., Jain, P., O'Roak, B. J., Cooper, G. M., & Shendure, J. (2014) · Nature Genetics · doi:10.1038/ng.2892 · Cited by 6,183
The ENCODE Project Consortium (2007) · Nature · doi:10.1038/nature05874 · Cited by 5,223
Cited by
REVEL: An Ensemble Method for Predicting the Pathogenicity of Rare Missense Variants
Ioannidis, N. M., Rothstein, J. H., Pejaver, V., Middha, S., McDonnell, S. K., Baheti, S., Musolf, A., Li, Q., Holzinger, E., Karyadi, D., et al. (2016) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2016.08.016 · Cited by 2,908
Cunningham, F., Achuthan, P., Akanni, W., Allen, J., Amode, M. R., Armean, I. M., Bennett, R., Bhai, J., Billis, K., Boddu, S., et al. (2019) · Nucleic Acids Research · doi:10.1093/nar/gky1113 · Cited by 925
“We have also extended the range of impact predictions available in our transcript variant tables, adding results from CADD (30), MetaLR (31), MutationAssessor (32) and REVEL, alongside the pre-existing SIFT and PolyPhen-2 results (33) (see Figure 2).”
MethodInterVar: Clinical Interpretation of Genetic Variants by the 2015 ACMG-AMP Guidelines
Li, Q., & Wang, K. (2017) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2017.01.004 · Cited by 1,038
Self-citationLiu, X., Wu, C., Li, C., & Boerwinkle, E. (2016) · Human Mutation · doi:10.1002/humu.22932 · Cited by 983
Self-citationInferring the molecular and phenotypic impact of amino acid variants with MutPred2
Pejaver, V., Urresti, J., Lugo-Martinez, J., Pagel, K. A., Lin, G. N., Nam, H.-J., Mort, M., Cooper, D. N., Sebat, J., Iakoucheva, L. M., et al. (2020) · Nature Communications · doi:10.1038/s41467-020-19669-x · Cited by 923
Contribution of rare inherited and de novo variants in 2,871 congenital heart disease probands
Jin, S. C., Homsy, J., Zaidi, S., Lu, Q., Morton, S., DePalma, S. R., Zeng, X., Qi, H., Chang, W., Sierant, M. C., et al. (2017) · Nature Genetics · doi:10.1038/ng.3970 · Cited by 875
“The MetaSVM algorithm, annotated using dbNSFP version 2.9 52 , was used to predict deleteriousness of missense variants (annotated as “D-Mis”) using software defaults 53 .”
InfluentialGenomic variant annotation and prioritization with ANNOVAR and wANNOVAR
Yang, H., & Wang, K. (2015) · Nature Protocols · doi:10.1038/nprot.2015.105 · Cited by 861
Self-citationDe novo mutations in congenital heart disease with neurodevelopmental and other congenital anomalies
Homsy, J., Zaidi, S., Shen, Y., Ware, J. S., Samocha, K. E., Karczewski, K. J., DePalma, S. R., McKean, D., Wakimoto, H., Gorham, J., et al. (2015) · Science · doi:10.1126/science.aac9396 · Cited by 856
Jagadeesh, K. A., Wenger, A. M., Berger, M. J., Guturu, H., Stenson, P. D., Cooper, D. N., Bernstein, J. A., & Bejerano, G. (2016) · Nature Genetics · doi:10.1038/ng.3703 · Cited by 846
A catalog of genetic loci associated with kidney function from analyses of a million individuals
Study, L. C., Wuttke, M., Program, V. A. M. V., Li, Y., Li, M., Sieber, K. B., Feitosa, M. F., Gorski, M., Tin, A., Wang, L., et al. (2019) · Nature Genetics · doi:10.1038/s41588-019-0407-x · Cited by 846
Self-citationLiu, X., Li, C., Mou, C., Dong, Y., & Tu, Y. (2020) · Genome Medicine · doi:10.1186/s13073-020-00803-9 · Cited by 657
Self-citationGenetics and Genomics of Congenital Heart Disease
Zaidi, S., & Brueckner, M. (2017) · Circulation Research · doi:10.1161/circresaha.116.309140 · Cited by 565
Predicting the clinical impact of human mutation with deep neural networks
Sundaram, L., Gao, H., Padigepati, S. R., McRae, J. F., Li, Y., Kosmicki, J. A., Fritzilas, N., Hakenberg, J., Dutta, A., Shon, J., et al. (2018) · Nature Genetics · doi:10.1038/s41588-018-0167-z · Cited by 493
SPARK: A US Cohort of 50,000 Families to Accelerate Autism Research
Feliciano, P., Daniels, A. M., Green Snyder, L., Beaumont, A., Camba, A., Esler, A., Gulsrud, A. G., Mason, A., Gutierrez, A., Nicholson, A., et al. (2018) · Neuron · doi:10.1016/j.neuron.2018.01.015 · Cited by 455
Self-citationA clinically applicable integrative molecular classification of meningiomas
Nassiri, F., Liu, J., Patil, V., Mamatjan, Y., Wang, J. Z., Hugh-White, R., Macklin, A. M., Khan, S., Singh, O., Karimi, S., et al. (2021) · Nature · doi:10.1038/s41586-021-03850-3 · Cited by 449
Bruna, A., Rueda, O. M., Greenwood, W., Batra, A. S., Callari, M., Batra, R. N., Pogrebniak, K., Sandoval, J., Cassidy, J. W., Tufegdzic-Vidakovic, A., et al. (2016) · Cell · doi:10.1016/j.cell.2016.08.041 · Cited by 448
Multiplex assessment of protein variant abundance by massively parallel sequencing
Matreyek, K. A., Starita, L. M., Stephany, J. J., Martin, B., Chiasson, M. A., Gray, V. E., Kircher, M., Khechaduri, A., Dines, J. N., Hause, R. J., et al. (2018) · Nature Genetics · doi:10.1038/s41588-018-0122-z · Cited by 436
Target genes, variants, tissues and transcriptional pathways influencing human serum urate levels
Study, G. C. K. D., Tin, A., Study, L. C., Program, V. A. M. V., Marten, J., Halperin Kuhns, V. L., Li, Y., Wuttke, M., Kirsten, H., Sieber, K. B., et al. (2019) · Nature Genetics · doi:10.1038/s41588-019-0504-x · Cited by 399
Self-citationWong, M., Mayoh, C., Lau, L. M. S., Khuong-Quang, D.-A., Pinese, M., Kumar, A., Barahona, P., Wilkie, E. E., Sullivan, P., Bowen-James, R., et al. (2020) · Nature Medicine · doi:10.1038/s41591-020-1072-4 · Cited by 393
The DNA methylation landscape of advanced prostate cancer
Zhao, S. G., Chen, W. S., Li, H., Foye, A., Zhang, M., Sjöström, M., Aggarwal, R., Playdle, D., Liao, A., Alumkal, J. J., et al. (2020) · Nature Genetics · doi:10.1038/s41588-020-0648-8 · Cited by 351
Amyere, M., Revencu, N., Helaers, R., Pairet, E., Baselga, E., Cordisco, M., Chung, W., Dubois, J., Lacour, J.-P., Martorell, L., et al. (2017) · Circulation · doi:10.1161/circulationaha.116.026886 · Cited by 302
PERCH: A Unified Framework for Disease Gene Prioritization: HUMAN MUTATION
Feng, B.-J. (2017) · Human Mutation · doi:10.1002/humu.23158 · Cited by 289
“Others have combined these assessments to produce an overall prediction, yielding a better performance than any predictor alone [González-Pérez and López-Bigas, 2011; Kircher et al., 2014; Dong et al., 2015].”
BackgroundClinPred: Prediction Tool to Identify Disease-Relevant Nonsynonymous Single-Nucleotide Variants
Alirezaie, N., Kernohan, K. D., Hartley, T., Majewski, J., & Hocking, T. D. (2018) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2018.08.005 · Cited by 270
CLCN2 chloride channel mutations in familial hyperaldosteronism type II
Scholl, U. I., Stölting, G., Schewe, J., Thiel, A., Tan, H., Nelson-Williams, C., Vichot, A. A., Jin, S. C., Loring, E., Untiet, V., et al. (2018) · Nature Genetics · doi:10.1038/s41588-018-0048-5 · Cited by 266
Li, X., Li, Z., Zhou, H., Gaynor, S. M., Liu, Y., Chen, H., Sun, R., Dey, R., Arnett, D. K., Aslibekyan, S., et al. (2020) · Nature Genetics · doi:10.1038/s41588-020-0676-4 · Cited by 263
Self-citationSPEACH_AF: Sampling protein ensembles and conformational heterogeneity with Alphafold2
Stein, R. A., & Mchaourab, H. S. (2022) · PLOS Computational Biology · doi:10.1371/journal.pcbi.1010483 · Cited by 258
Long-read sequencing and de novo assembly of a Chinese genome
Shi, L., Guo, Y., Dong, C., Huddleston, J., Yang, H., Han, X., Fu, A., Li, Q., Li, N., Gong, S., et al. (2016) · Nature Communications · doi:10.1038/ncomms12065 · Cited by 257
Self-citationPMut: a web-based tool for the annotation of pathological variants on proteins, 2017 update
López-Ferrando, V., Gazzo, A., de la Cruz, X., Orozco, M., & Gelpí, J. L. (2017) · Nucleic Acids Research · doi:10.1093/nar/gkx313 · Cited by 253
Evaluation of in silico algorithms for use with ACMG/AMP clinical variant interpretation guidelines
Ghosh, R., Oak, N., & Plon, S. E. (2017) · Genome biology · doi:10.1186/s13059-017-1353-5 · Cited by 233
Zhang, L., Yao, Y., Zhang, S., Liu, Y., Guo, H., Ahmed, M., Bell, T., Zhang, H., Han, G., Lorence, E., et al. (2019) · Science Translational Medicine · doi:10.1126/scitranslmed.aau1167 · Cited by 233
Isolated polycystic liver disease genes define effectors of polycystin-1 function
Besse, W., Dong, K., Choi, J., Punia, S., Fedeles, S. V., Choi, M., Gallagher, A.-R., Huang, E. B., Gulati, A., Knight, J., et al. (2017) · Journal of Clinical Investigation · doi:10.1172/jci90129 · Cited by 203
Genetic Costs of Domestication and Improvement
Moyers, B. T., Morrell, P. L., & McKay, J. K. (2018) · Journal of Heredity · doi:10.1093/jhered/esx069 · Cited by 216
Van Egeren, D., Escabi, J., Nguyen, M., Liu, S., Reilly, C. R., Patel, S., Kamaz, B., Kalyva, M., DeAngelo, D. J., Galinsky, I., et al. (2021) · Cell Stem Cell · doi:10.1016/j.stem.2021.02.001 · Cited by 206
Yoneda, Z. T., Anderson, K. C., Quintana, J. A., O’Neill, M. J., Sims, R. A., Glazer, A. M., Shaffer, C. M., Crawford, D. M., Stricker, T., Ye, F., et al. (2021) · JAMA Cardiology · doi:10.1001/jamacardio.2021.3370 · Cited by 192
Functional dysregulation of CDC42 causes diverse developmental phenotypes
Martinelli, S., Krumbach, O. H. F., Pantaleoni, F., Coppola, S., Amin, E., Pannone, L., Nouri, K., Farina, L., Dvorsky, R., Lepri, F., et al. (2018) · The American Journal of Human Genetics · doi:10.1016/j.ajhg.2017.12.015 · Cited by 188
Jamialahmadi, O., Mancina, R. M., Ciociola, E., Tavaglione, F., Luukkonen, P. K., Baselli, G., Malvestiti, F., Thuillier, D., Raverdy, V., Männistö, V., et al. (2021) · Gastroenterology · doi:10.1053/j.gastro.2020.12.023 · Cited by 148
REVEL and BayesDel outperform other in silico meta-predictors for clinical variant classification
Tian, Y., Pesaran, T., Chamberlin, A., Fenwick, R. B., Li, S., Gau, C.-L., Chao, E. C., Lu, H.-M., Black, M. H., & Qian, D. (2019) · Scientific Reports · doi:10.1038/s41598-019-49224-8 · Cited by 114
Predicting functional effect of missense variants using graph attention neural networks
Zhang, H., Xu, M. S., Fan, X., Chung, W. K., & Shen, Y. (2022) · Nature Machine Intelligence · doi:10.1038/s42256-022-00561-w · Cited by 98
Clinical utility of genomic analysis in adults with idiopathic liver disease
Hakim, A., Zhang, X., DeLisle, A., Oral, E. A., Dykas, D., Drzewiecki, K., Assis, D. N., Silveira, M., Batisti, J., Jain, D., et al. (2019) · Journal of Hepatology · doi:10.1016/j.jhep.2019.01.036 · Cited by 81
Wang, W., Corominas, R., & Lin, G. N. (2019) · Frontiers in Genetics · doi:10.3389/fgene.2019.00258 · Cited by 70
“To this end, several studies (Gnad et al., 2013; Dong et al., 2015; Miosge et al., 2015; IonitaLaza et al., 2016) have extensively reviewed these computational annotation tools.”
BackgroundLi, Q., Ren, Z., Cao, K., Li, M. M., Wang, K., & Zhou, Y. (2022) · Science Advances · doi:10.1126/sciadv.abj1624 · Cited by 66
Self-citationHuman CRY1 variants associate with attention deficit/hyperactivity disorder
Onat, O. E., Kars, M. E., Gül, Ş., Bilguvar, K., Wu, Y., Özhan, A., Aydın, C., Başak, A. N., Trusso, M. A., Goracci, A., et al. (2020) · Journal of Clinical Investigation · doi:10.1172/jci135500 · Cited by 47
“The potential impact of missense variants was predicted using MetaSVM (54) and Combined Annotation–Dependent Depletion (CADD) (55) tools, and that of splice site variants located ±3 bp of exon-intron junctions was predicted using dbscSNV-ADA/-RF (56) and Spidex scores (ref.”
MethodNovice, T., Kariminia, A., Del Bel, K. L., Lu, H., Sharma, M., Lim, C. J., Read, J., Lugt, M. V., Hannibal, M. C., O’Dwyer, D., et al. (2020) · Journal of Clinical Immunology · doi:10.1007/s10875-019-00731-3 · Cited by 44
VIPdb, a genetic variant impact predictor database
Hu, Z., Yu, C., Furutsuki, M., Andreoletti, G., Ly, M., Hoskins, R., Adhikari, A. N., & Brenner, S. E. (2019) · Human Mutation · doi:10.1002/humu.23858 · Cited by 37
Hepatic SREBP signaling requires SPRING to govern systemic lipid metabolism in mice and humans
Hendrix, S., Kingma, J., Ottenhoff, R., Valiloo, M., Svecla, M., Zijlstra, L. F., Sachdev, V., Kovac, K., Levels, J. H. M., Jongejan, A., et al. (2023) · Nature Communications · doi:10.1038/s41467-023-40943-1 · Cited by 34
Personalised analytics for rare disease diagnostics
Anderson, D., Baynam, G., Blackwell, J. M., & Lassmann, T. (2019) · Nature Communications · doi:10.1038/s41467-019-13345-5 · Cited by 24
Kock, K. H., Kimes, P. K., Gisselbrecht, S. S., Inukai, S., Phanor, S. K., Anderson, J. T., Ramakrishnan, G., Lipper, C. H., Song, D., Kurland, J. V., et al. (2024) · Nature Communications · doi:10.1038/s41467-024-47396-0 · Cited by 24
Pathways linking Alzheimer’s disease risk genes expressed highly in microglia
Hodges, A. K., Piers, T. M., Collier, D., Cousins, O., & Pocock, J. M. (2021) · Neuroimmunology and Neuroinflammation · doi:10.20517/2347-8659.2020.60 · Cited by 21
González-del Pozo, M., Fernández-Suárez, E., Bravo-Gil, N., Méndez-Vidal, C., Martín-Sánchez, M., Rodríguez-de la Rúa, E., Ramos-Jiménez, M., Morillo-Sánchez, M. J., Borrego, S., & Antiñolo, G. (2022) · npj Genomic Medicine · doi:10.1038/s41525-022-00286-0 · Cited by 21
PRESCOTT: a population aware, epistatic, and structural model accurately predicts missense effects
Tekpinar, M., David, L., Henry, T., & Carbone, A. (2025) · Genome Biology · doi:10.1186/s13059-025-03581-y · Cited by 18
Insights for variant clinical interpretation based on a benchmark of 65 variant effect predictors
Radjasandirane, R., Diharce, J., Gelly, J.-C., & de Brevern, A. G. (2025) · Genomics · doi:10.1016/j.ygeno.2025.111036 · Cited by 15
mvPPT: A Highly Efficient and Sensitive Pathogenicity Prediction Tool for Missense Variants
Tong, S.-Y., Fan, K., Zhou, Z.-W., Liu, L.-Y., Zhang, S.-Q., Fu, Y., Wang, G.-Z., Zhu, Y., & Yu, Y.-C. (2023) · Genomics, Proteomics & Bioinformatics · doi:10.1016/j.gpb.2022.07.005 · Cited by 9
Ittisoponpisan, S., & David, A. (2018) · Journal of the Endocrine Society · doi:10.1210/js.2018-00077 · Cited by 8
(2023) · doi:10.1101/2023.02.25.530050 · Cited by 8
Prediction of Kv11.1 potassium channel PAS-domain variants trafficking via machine learning
Immadisetty, K., Fang, X., Ramon, G. S., Hartle, C. M., McCoy, T. P., Center, R. G., Mirshahi, T., Delisle, B. P., & Kekenes-Huskey, P. M. (2023) · Journal of Molecular and Cellular Cardiology · doi:10.1016/j.yjmcc.2023.05.002 · Cited by 5
Pawar, A. S., Somers, P., Alex, A., Grana, J., Feist, V. K., George, S. S., Jalnapurkar, S. S., Antony, C., Verner, R., White-Brown, S. K., et al. (2025) · Genes & Development · doi:10.1101/gad.352602.125 · Cited by 3
Hwang, J. Y., Chai, P., Nawaz, S., Choi, J., Lopez-Giraldez, F., Hussain, S., Bilguvar, K., Mane, S., Lifton, R. P., Ahmad, W., et al. (2023) · doi:10.7554/elife.90095.2 · Cited by 2
Metadata
- Authors
- Dong, C., Wei, P., Jian, X., Gibbs, R., Boerwinkle, E., Wang, K., & Liu, X.
- Venue
- Human Molecular Genetics
- Publisher
- Oxford University Press (OUP)
- Published
- 2014-12-30
- Volume
- 24
- Issue
- 8
- Pages
- 2125-2137
- ISSN
- 0964-6906 (ISSN-L)
- 1460-2083
- OpenAlex
- W2129952088
- Cited by
- 1,128
- References
- 48
- FWCI
- 30.51
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.