Working toward precision medicine: Predicting phenotypes from exomes in the Critical Assessment of Genome Interpretation (CAGI) challenges
Open accessThe DOI matches its Crossref record; 8 of the 8 references it cites were found in a registry or an index.
Abstract
Precision medicine aims to predict a patient's disease risk and best therapeutic options by using that individual's genetic sequencing data. The Critical Assessment of Genome Interpretation (CAGI) is a community experiment consisting of genotype-phenotype prediction challenges; participants build models, undergo assessment, and share key findings. For CAGI 4, three challenges involved using exome-sequencing data: Crohn's disease, bipolar disorder, and warfarin dosing. Previous CAGI challenges included prior versions of the Crohn's disease challenge. Here, we discuss the range of techniques used for phenotype prediction as well as the methods used for assessing predictive models. Additionally, we outline some of the difficulties associated with making predictions and evaluating them. The lessons learned from the exome challenges can be applied to both research and clinical efforts to improve phenotype prediction from genotype. In addition, these challenges serve as a vehicle for sharing clinical and research exome data in a secure manner with scientists who have a broad range of expertise, contributing to a collaborative effort to advance our understanding of genotype-phenotype relationships.
Overview
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Free: it reads the open-access text and checks the first 5 claims that cite a source we can check. Create a free account to check every claim.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
The NHGRI GWAS Catalog, a curated resource of SNP-trait associations
Welter, D., MacArthur, J., Morales, J., Burdett, T., Hall, P., Junkins, H., Klemm, A., Flicek, P., Manolio, T., Hindorff, L., et al. (2014) · Nucleic Acids Research · doi:10.1093/nar/gkt1229 · Cited by 2,707 · cited 1×
“Similar to the top approach, many groups used variants previously found to be associated in genome-wide association studies; the NHGRI catalog was a popular choice to identify these associated variants (Welter et al., 2014).”
Stanley: The robot that won the DARPA Grand Challenge
Thrun, S., Montemerlo, M., Dahlkamp, H., Stavens, D., Aron, A., Diebel, J., Fong, P., Gale, J., Halpenny, M., Hoffmann, G., et al. (2006) · Journal of Field Robotics · doi:10.1002/rob.20147 · Cited by 2,237 · cited 1×
“…systems, protein structure prediction, biomedical natural language processing, autonomous vehicles, and collaborative filtering for consumer preferences (Bell & Koren, 2007; Morgan et al., 2008; Moult, Fidelis, Kryshtafovych, Schwede, & Tramontano, 2014; Thrun et al., 2006; Walker et al., 2001).”
Background(1975) · New England Journal of Medicine · doi:10.1056/nejm197507312930513 · Cited by 1,017
The genetics and immunopathogenesis of inflammatory bowel disease
Cho, J. H. (2008) · Nature Reviews Immunology · doi:10.1038/nri2340 · Cited by 940 · cited 3×
“Crohn’s disease is a chronic inflammatory bowel disease marked by transmural inflammation of the gastrointestinal tract that can occur anywhere from the mouth to the rectum (Cho, 2008).”
InfluentialLessons from the Netflix prize challenge
Bell, R. M., & Koren, Y. (2007) · ACM SIGKDD Explorations Newsletter · doi:10.1145/1345448.1345465 · Cited by 727
Clinical assessment incorporating a personal genome
Ashley, E. A., Butte, A. J., Wheeler, M. T., Chen, R., Klein, T. E., Dewey, F. E., Dudley, J. T., Ormond, K. E., Pavlovic, A., Morgan, A. A., et al. (2010) · The Lancet · doi:10.1016/s0140-6736(10)60452-7 · Cited by 674
Self-citationGenome-wide association studies in diverse populations
Rosenberg, N. A., Huang, L., Jewett, E. M., Szpiech, Z. A., Jankovic, I., & Boehnke, M. (2010) · Nature Reviews Genetics · doi:10.1038/nrg2760 · Cited by 566
The genetic interpretation of area under the ROC curve in genomic profiling
Wray, N. R., Yang, J., Goddard, M. E., & Visscher, P. M. (2010) · PLoS Genetics · doi:10.1371/journal.pgen.1000864 · Cited by 334
Cited by
Wells, D. K., van Buuren, M. M., Dang, K. K., Hubbard-Lucey, V. M., Sheehan, K. C. F., Campbell, K. M., Lamb, A., Ward, J. P., Sidney, J., Blazquez, A. B., et al. (2020) · Cell · doi:10.1016/j.cell.2020.09.015 · Cited by 538
“, 2020), predicting phenotype from exome sequencing (Daneshjou et al., 2017), multi-target drug identification (Schlessinger et al.”
BackgroundSelf-citationStafford, I. S., Kellermann, M., Mossotto, E., Beattie, R. M., MacArthur, B. D., & Ennis, S. (2020) · npj Digital Medicine · doi:10.1038/s41746-020-0229-3 · Cited by 272
Gubatan, J., Levitte, S., Patel, A., Balabanis, T., Wei, M. T., & Sinha, S. R. (2021) · World Journal of Gastroenterology · doi:10.3748/wjg.v27.i17.1920 · Cited by 121
DOME: recommendations for supervised machine learning validation in biology
Walsh, I., Fishman, D., Garcia-Gasulla, D., Titma, T., Pollastri, G., ELIXIR Machine Learning Focus Group, Capriotti, E., Casadio, R., Capella-Gutierrez, S., Cirillo, D., et al. (2021) · Nature Methods · doi:10.1038/s41592-021-01205-4 · Cited by 282
Self-citationBIAS: Transparent reporting of biomedical image analysis challenges
Maier-Hein, L., Reinke, A., Kozubek, M., Martel, A. L., Arbel, T., Eisenmann, M., Hanbury, A., Jannin, P., Müller, H., Onogur, S., et al. (2020) · Medical Image Analysis · doi:10.1016/j.media.2020.101796 · Cited by 9
“Challenges are becoming increasingly important in various fields, ranging from protein structure, to systems biology, text mining, and genomics, thanks to initiatives such as CASP (Critical Assessment of Techniques for Protein Structure Prediction) [31], BioCreative (Critical Assessment of Information Extraction in Bi…”
Metadata
- Authors
- Daneshjou, R., Wang, Y., Bromberg, Y., Bovo, S., Martelli, P. L., Babbi, G., Lena, P. D., Casadio, R., Edwards, M., Gifford, D., Jones, D. T., Sundaram, L., Bhat, R. R., Li, X., Pal, L. R., Kundu, K., Yin, Y., Moult, J., Jiang, Y., Pejaver, V., Pagel, K. A., Li, B., Mooney, S. D., Radivojac, P., Shah, S., Carraro, M., Gasparini, A., Leonardi, E., Giollo, M., Ferrari, C., Tosatto, S. C. E., Bachar, E., Azaria, J. R., Ofran, Y., Unger, R., Niroula, A., Vihinen, M., Chang, B., Wang, M. H., Franke, A., Petersen, B., Pirooznia, M., Zandi, P., McCombie, R., Potash, J. B., Altman, R. B., Klein, T. E., Hoskins, R. A., Repo, S., Brenner, S. E., & Morgan, A. A.
- Venue
- Human Mutation
- Publisher
- Wiley
- Published
- 2017-07-07
- Volume
- 38
- Issue
- 9
- Pages
- 1182-1192
- ISSN
- 1059-7794 (ISSN-L)
- 1098-1004
- OpenAlex
- W2699811267
- Cited by
- 46
- References
- 8
- FWCI
- 3.27
- Type
- journal article
- Language
- en
- Open access
- bronze
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.