Cited by 81Genomics and Rare DiseasesGenetic Associations and EpidemiologyBRCA gene mutations in cancer

Recommendations for the collection and use of multiplexed functional data for clinical variant interpretation

Open access
On behalf of the Brotman Baty Institute Mutational Scanning Working Group, Gelman, Hannah, Dines, Jennifer N., Berg, Jonathan, Berger, Alice H., Brnich, Sarah, Hisama, Fuki M., James, Richard G. +5 more·2019·Genome Medicine

Abstract

Variants of uncertain significance represent a massive challenge to medical genetics. Multiplexed functional assays, in which the functional effects of thousands of genomic variants are assessed simultaneously, are increasingly generating data that can be used as additional evidence for or against variant pathogenicity. Such assays have the potential to resolve variants of uncertain significance, thereby increasing the clinical utility of genomic testing. Existing standards from the American College of Medical Genetics and Genomics (ACMG)/Association for Molecular Pathology (AMP) and new guidelines from the Clinical Genome Resource (ClinGen) establish the role of functional data in variant interpretation, but do not address the specific challenges or advantages of using functional data derived from multiplexed assays. Here, we build on these existing guidelines to provide recommendations to experimentalists for the production and reporting of multiplexed functional data and to clinicians for the evaluation and use of such data. By following these recommendations, experimentalists can produce transparent, complete, and well-validated datasets that are primed for clinical uptake. Our recommendations to clinicians and diagnostic labs on how to evaluate the quality of multiplexed functional datasets, and how different datasets could be incorporated into the ACMG/AMP variant-interpretation framework, will hopefully clarify whether and how such data should be used. The recommendations that we provide are designed to enhance the quality and utility of multiplexed functional data, and to promote their judicious use.

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Integrity signals

Registry

Crossref · 10.1186/s13073-019-0698-7

Cites

8 of 8 references verified0 citation errors · 0 not checkable

Statistics

Claims the paper makes

The claims and statistics of this paper haven’t been checked yet.

Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.

A few free checks a day · papers already verified open instantly · results are public

Claims other papers make about this one

Each is checked against this paper’s own text: does it say what the citing paper says it does?

  • Rigorous functional studies are considered strong evidence (PS3/BS3) by the widely used American College of Medical Genetics and Genomics/Association for Molecular Pathology (ACMG/AMP) genetic diagnostic guidelines.

    “Rigorous functional studies are considered strong evidence (PS3/BS3) by the widely used American College of Medical Genetics and Genomics/Association for Molecular Pathology (ACMG/AMP) genetic diagnostic guidelines.”

    From Massively parallel functional genomic assays in endocrinology: from promise to delivery (2026) · cites this paper as [38]

    The Background identifies PS3/BS3 as the ACMG/AMP framework’s Pathogenic Strong and Benign Strong evidence levels for functional data. But the Germline variants section says evidence can reach *up to* PS3/BS3 depending on assay quality and the individual variant, and the Conclusions caution that not all functional data reach strong evidence. The claim omits that qualification. (LLM, conf=0.87)

    Experimental — accuracy not yet measured
  • In the context of a Bayesian decision-making framework, rigorous functional studies can effectively play a deterministic role in classifying variants.

    “In the context of a Bayesian decision-making framework they can effectively play a deterministic role in classifying variants (25, 38, 39), thereby potentially making major inroads into the ‘VUS problem’.”

    From Massively parallel functional genomic assays in endocrinology: from promise to delivery (2026) · cites this paper as [38]

    The ‘Germline variants’ section says that functional data can be assigned Bayesian odds of pathogenicity and incorporated into variant-classification frameworks. It does not describe the data as deterministic: their evidentiary strength depends on the variant’s score and measurement error, as well as assay quality and predictive power. The ‘Multiplexed functional data as evidence for variant interpretation’ section says they are incorporated with existing clinical and in silico evidence. (LLM, conf=0.88)

    Experimental — accuracy not yet measured
  • The second key design consideration is whether or not the functional readout of the chosen downstream assay is relevant to the clinical condition or phenotype being studied.

    “The second key design consideration is whether or not the functional readout of the chosen downstream assay is relevant to the clinical condition or phenotype being studied (38).”
  • Attempts to develop standards and a statistical framework for assessment of diagnostic performance of functional assays lagged behind efforts to curate and assess gene variants, but a rigorous approach has been proposed.

    “Attempts to develop standards, and a statistical framework, for assessment of the diagnostic performance of functional assays lagged somewhat behind efforts to curate and assess gene variants, but a rigorous approach to this has been proposed (38).”

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

The self-check needs the paper’s full text.

Cites

Flagged first, then by citations

Research works printed but not linked: 43

  1. [1]Landrum MJ Lee JM Riley GR Jang W Rubinstein WS Church DM ClinVar: public archive of relationships among sequence variation and human phenotype Nucleic Acids Res. 2014 42 D980 D985 10.1093/nar/gkt1113 24234437 PMC3965032 · DOI · Paper page
  2. [2]Cline MS Liao RG Parsons MT Paten B Alquaddoomi F Antoniou A BRCA challenge: BRCA exchange as a global resource for variants in BRCA1 and BRCA2 PLoS Genet. 2018 14 e1007752 10.1371/journal.pgen.1007752 30586411 PMC6324924 · DOI
  3. [3]Starita LM Ahituv N Dunham MJ Kitzman JO Roth FP Seelig G Variant interpretation: functional assays to the rescue Am J Hum Genet. 2017 101 315 325 10.1016/j.ajhg.2017.07.014 28886340 PMC5590843 · DOI · Paper page
  4. [4]Fowler DM Araya CL Fleishman SJ Kellogg EH Stephany JJ Baker D High-resolution mapping of protein sequence-function relationships Nat Methods. 2010 7 741 746 10.1038/nmeth.1492 20711194 PMC2938879 · DOI · Paper page
  5. [5]Patwardhan RP Lee C Litvin O Young DL Pe’Er D Shendure J High-resolution analysis of DNA regulatory elements by synthetic saturation mutagenesis Nat Biotechnol. 2009 27 1173 1175 10.1038/nbt.1589 19915551 PMC2849652 · DOI · Paper page
  6. [7]Starita LM Young DL Islam M Kitzman JO Gullingsrud J Hause RJ Massively parallel functional analysis of BRCA1 RING domain variants Genetics. 2015 200 413 422 10.1534/genetics.115.175802 25823446 PMC4492368 · DOI
  7. [8]Findlay GM Daza RM Martin B Zhang MD Leith AP Gasperini M Accurate classification of BRCA1 variants with saturation genome editing Nature. 2018 562 217 222 10.1038/s41586-018-0461-z 30209399 PMC6181777 · DOI · Paper page
  8. [9]Starita LM Islam MM Banerjee T Adamovich AI Gullingsrud J Fields S A multiplex homology-directed DNA repair assay reveals the impact of more than 1,000 BRCA1 missense substitution variants on protein function Am J Hum Genet. 2018 103 498 508 10.1016/j.ajhg.2018.07.016 30219179 PMC6174279 · DOI
  9. [10]Weile J Sun S Cote AG Knapp J Verby M Mellor JC A framework for exhaustively mapping functional missense variants Mol Syst Biol. 2017 13 957 10.15252/msb.20177908 29269382 PMC5740498 · DOI · Paper page
  10. [11]Suiter CC, Moriyama T, Matreyek KA, Yang W, Scaletti ER, Nishii R, et al. Massive parallel variant characterization identifies NUDT15 alleles associated with thiopurine toxicity. bioRxiv. 2019; 740837. doi: https://doi.org/10.1101/740837. PMC7071893 32094176 · DOI
  11. [12]Majithia AR Tsuda B Agostini M Gnanapradeepan K Rice R Peloso G Prospective functional classification of all possible missense variants in PPARG Nat Genet. 2016 48 1570 1575 10.1038/ng.3700 27749844 PMC5131844 · DOI · Paper page
  12. [13]Mighell TL Evans-Dutson S O’Roak BJ A saturation mutagenesis approach to understanding PTEN lipid phosphatase activity and genotype-phenotype relationships Am J Hum Genet. 2018 102 943 955 10.1016/j.ajhg.2018.03.018 29706350 PMC5986715 · DOI · Paper page
  13. [14]Matreyek KA Starita LM Stephany JJ Martin B Chiasson MA Gray VE Multiplex assessment of protein variant abundance by massively parallel sequencing Nat Genet. 2018 50 874 882 10.1038/s41588-018-0122-z 29785012 PMC5980760 · DOI · Paper page
  14. [15]Ahler E Register AC Chakraborty S Fang L Dieter EM Sitko KA A combined approach reveals a regulatory mechanism coupling Src’s kinase activity, localization, and phosphotransferase-independent functions Mol Cell. 2019 74 393 408 10.1016/j.molcel.2019.02.003 30956043 PMC6474823 · DOI
  15. [16]Giacomelli AO Yang X Lintner RE McFarland JM Duby M Kim J Mutational processes shape the landscape of TP53 mutations in human cancer Nat Genet. 2018 50 1381 1387 10.1038/s41588-018-0204-y 30224644 PMC6168352 · DOI · Paper page
  16. [17]Kotler E Shani O Goldfeld G Lotan-Pompan M Tarcic O Gershoni A A systematic p53 mutation library links differential functional impact to cancer mutation pattern and evolutionary conservation Mol Cell. 2018 71 178 190 10.1016/j.molcel.2018.06.012 29979965 · DOI
  17. [18]Boettcher S Miller PG Sharma R McConkey M Leventhal M Krivtsov AV A dominant-negative effect drives selection of TP53 missense mutations in myeloid malignancies Science. 2019 365 599 604 10.1126/science.aax3649 31395785 PMC7327437 · DOI · Paper page
  18. [19]Kircher M Xiong C Martin B Schubach M Inoue F Bell RJA Saturation mutagenesis of twenty disease-associated regulatory elements at single base-pair resolution Nat Commun. 2019 10 3583 10.1038/s41467-019-11526-w 31395865 PMC6687891 · DOI · Paper page
  19. [20]Klein JC Keith A Rice SJ Shepherd C Agarwal V Loughlin J Functional testing of thousands of osteoarthritis-associated variants for regulatory activity Nat Commun. 2019 10 2434 10.1038/s41467-019-10439-y 31164647 PMC6547687 · DOI · Paper page
  20. [21]Mester JL Ghosh R Pesaran T Huether R Karam R Hruska KS Gene-specific criteria for PTEN variant curation: recommendations from the ClinGen PTEN Expert Panel Hum Mutat. 2018 39 1581 1592 10.1002/humu.23636 30311380 PMC6329583 · DOI
  21. [24]Brnich SE, Abou Tayoun AN, Couch FJ, Cutting GR, Greenblatt MS, Heinen CD, et al. Recommendations for application of the functional evidence PS3/BS3 criterion using the ACMG/AMP sequence variant interpretation framework. Genome Med. 2019. 10.1186/s13073-019-0690-2. PMC6938631 31892348 · DOI
  22. [26]Highsmith WE Jr Burch LH Zhou Z Olsen JC Strong TV Smith T Identification of a splice site mutation (2789+ 5 G> A) associated with small amounts of normal CFTR mRNA and mild cystic fibrosis Hum Mutat. 1997 9 332 338 10.1002/(SICI)1098-1004(1997)9:4<332::AID-HUMU5>3.0.CO;2-7 9101293 · DOI
  23. [27]Highsmith WE Burch LH Zhou Z Olsen JC Boat TE Spock A A novel mutation in the cystic fibrosis gene in patients with pulmonary disease but normal sweat chloride concentrations N Engl J Med. 1994 331 974 980 10.1056/NEJM199410133311503 7521937 · DOI · Paper page
  24. [28]Hung M-C Link W Protein localization in disease and therapy J Cell Sci. 2011 124 3381 3392 10.1242/jcs.089110 22010196 · DOI
  25. [30]Mizutani A Matsuzaki A Momoi MY Fujita E Tanabe Y Momoi T Intracellular distribution of a speech/language disorder associated FOXP2 mutant Biochem Biophys Res Commun. 2007 353 869 874 10.1016/j.bbrc.2006.12.130 17196932 · DOI
  26. [31]Yue P Li Z Moult J Loss of protein structure stability as a major causative factor in monogenic disease J Mol Biol. 2005 353 459 473 10.1016/j.jmb.2005.08.020 16169011 · DOI
  27. [34]Wan X Pavlidis P Sharing and reusing gene expression profiling data in neuroscience Neuroinformatics. 2007 5 161 175 10.1007/s12021-007-0012-5 17917127 PMC2980754 · DOI
  28. [35]Perez-Riverol Y Alpi E Wang R Hermjakob H Vizcaíno JA Making proteomics data accessible and reusable: current state of proteomics databases and repositories Proteomics. 2015 15 930 949 10.1002/pmic.201400302 25158685 PMC4409848 · DOI
  29. [36]Brazma A Hingamp P Quackenbush J Sherlock G Spellman P Stoeckert C Minimum information about a microarray experiment (MIAME)-toward standards for microarray data Nat Genet. 2001 29 365 371 10.1038/ng1201-365 11726920 · DOI · Paper page
  30. [37]Esposito D, Weile J, Shendure J, Starita LM, Papenfuss AT, Roth FP, et al. An open-source platform to distribute and interpret data from multiplexed assays of variant effect. bioRxiv. 2019; 555797. doi: 10.1101/555797v1. PMC6827219 31679514 · DOI
  31. [39]Spurdle AB Greville-Heygate S Antoniou AC Brown M Burke L de la Hoya M Towards controlled terminology for reporting germline cancer susceptibility variants: an ENIGMA report J Med Genet. 2019 56 347 357 10.1136/jmedgenet-2018-105872 30962250 · DOI
  32. [40]den Dunnen JT Describing sequence variants using HGVS nomenclature Methods Mol Biol. 2017 1492 243 251 10.1007/978-1-4939-6442-0_17 27822869 · DOI
  33. [41]Pawliczek P Patel RY Ashmore LR Jackson AR Bizon C Nelson T ClinGen allele registry links information about genetic variants Hum Mutat. 2018 39 1690 1701 10.1002/humu.23637 30311374 PMC6519371 · DOI
  34. [42]Dalgleish R Flicek P Cunningham F Astashyn A Tully RE Proctor G Locus reference genomic sequences: an improved basis for describing human DNA variants Genome Med. 2010 2 24 10.1186/gm145 20398331 PMC2873802 · DOI
  35. [43]Rubin AF Gelman H Lucas N Bajjalieh SM Papenfuss AT Speed TP A statistical framework for analyzing deep mutational scanning data Genome Biol. 2017 18 150 10.1186/s13059-017-1272-5 28784151 PMC5547491 · DOI · Paper page
  36. [44]Lek M Karczewski KJ Minikel EV Samocha KE Banks E Fennell T Analysis of protein-coding genetic variation in 60,706 humans Nature. 2016 536 285 291 10.1038/nature19057 27535533 PMC5018207 · DOI · Paper page
  37. [45]Forbes SA Beare D Boutselakis H Bamford S Bindal N Tate J COSMIC: somatic cancer genetics at high-resolution Nucleic Acids Res. 2017 45 D777 D783 10.1093/nar/gkw1121 27899578 PMC5210583 · DOI · Paper page
  38. [46]Chakravarty D, Gao J, Phillips SM, Kundra R, Zhang H, Wang J, et al. OncoKB: a precision oncology knowledge base. JCO Precis Oncol. 2017;2017. 10.1200/PO.17.00011. PMC5586540 28890946 · DOI
  39. [47]Cancer Genome Atlas Research Network Weinstein JN Collisson EA Mills GB KRM S Ozenberger BA The Cancer Genome Atlas Pan-Cancer analysis project Nat Genet 2013 45 1113 1120 10.1038/ng.2764 24071849 PMC3919969 · DOI · Paper page
  40. [48]Ghosh R Harrison SM Rehm HL Plon SE Biesecker LG ClinGen Sequence Variant Interpretation Working Group Updated recommendation for the benign stand-alone ACMG/AMP criterion Hum Mutat 2018 39 1525 1530 10.1002/humu.23642 30311383 PMC6188666 · DOI
  41. [49]Giovanni MA Murray MF Genome-first findings require precision phenotyping Genet. Med. 2018 20 1510 1511 10.1038/s41436-018-0026-4 29884840 · DOI
  42. [51]Li MM Datto M Duncavage EJ Kulkarni S Lindeman NI Roy S Standards and guidelines for the interpretation and reporting of sequence variants in cancer: a joint consensus recommendation of the Association for Molecular Pathology, American Society of Clinical Oncology, and College of American Pathologists J Mol Diagn. 2017 19 4 23 10.1016/j.jmoldx.2016.10.002 27993330 PMC5707196 · DOI
  43. [52]Gray VE Hause RJ Luebeck J Shendure J Fowler DM Quantitative missense variant effect prediction using large-scale mutagenesis data Cell Syst. 2018 6 116 124 10.1016/j.cels.2017.11.003 29226803 PMC5799033 · DOI

Cited by

Sorted by citations

Authors
On behalf of the Brotman Baty Institute Mutational Scanning Working Group, Gelman, H., Dines, J. N., Berg, J., Berger, A. H., Brnich, S., Hisama, F. M., James, R. G., Rubin, A. F., Shendure, J., Shirts, B., Fowler, D. M., & Starita, L. M.
Affiliations
  • University of Washington (US)
  • University of North Carolina at Chapel Hill (US)
  • Fred Hutch Cancer Center (US)
  • The University of Melbourne (AU)
  • Howard Hughes Medical Institute (US)
Corresponding author
  • Fowler, Douglas M.
  • Starita, Lea M.
Venue
Genome Medicine
Published
2019-12
Volume
11
Issue
1
Pages
85-85
ISSN
1756-994X (ISSN-L)
OpenAlex
W2995651968
Cited by
81
References
8
Citations by year
2026: 8 · 2025: 14 · 2024: 15 · 2023: 12 · 2022: 10 · 2021: 15 · 2020: 5 · 2019: 1 · 2018: 1
FWCI
4.61
Type
journal article
Language
en
Open access
Locations
  • Genome Medicine (publishedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • Minerva Access (University of Melbourne) (submittedVersion, cc-by)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion)
Funders
National Human Genome Research Institute (HG010461)
Topics
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genomics and Rare Diseases
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
  • Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › BRCA gene mutations in cancer
Keywords
variants of uncertain significance, variant interpretation, ACMG/AMP guidelines, ClinGen, data quality assessment, clinical genomic testing, pathogenicity assessment
MeSH terms
Genetic Testing, Humans, Quality Control, Societies, Medical, Genetic Variation, Gene Library, Guidelines as Topic, Sequence Analysis, DNA, Precision Medicine

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review