A Critical Assessment of Storytelling: Gene Ontology Categories and the Importance of Validating Genomic Scans
Open accessThe DOI matches its Crossref record; 70 of the 70 references it cites were found in a registry or an index.
Abstract
In the age of whole-genome population genetics, so-called genomic scan studies often conclude with a long list of putatively selected loci. These lists are then further scrutinized to annotate these regions by gene function, corresponding biological processes, expression levels, or gene networks. Such annotations are often used to assess and/or verify the validity of the genome scan and the statistical methods that have been used to perform the analyses. Furthermore, these results are frequently considered to validate "true-positives" if the identified regions make biological sense a posteriori. Here, we show that this approach can be potentially misleading. By simulating neutral evolutionary histories, we demonstrate that it is possible not only to obtain an extremely high false-positive rate but also to make biological sense out of the false-positives and construct a sensible biological narrative. Results are compared with a recent polymorphism data set from Drosophila melanogaster.
Overview
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
Claims other papers make about this one
Each is checked against this paper’s own text: does it say what the citing paper says it does?
In the citing paper
“Annotation term enrichment tests are known for their false-positive rates and researcher degrees of freedom when applied in a genome scan context (Pavlidis et al. 2012), allowing significant gene set enrichments and biologically plausible stories to be spun out of noise.”
From The neural crest cell hypothesis: no unified explanation for domestication (2021) · cites this paper as Pavlidis et al. 2012
Citations
Cites
Controlling the False Discovery Rate: A Practical and Powerful Approach to Multiple Testing
Benjamini, Y., & Hochberg, Y. (1995) · Journal of the Royal Statistical Society Series B: Statistical Methodology · doi:10.1111/j.2517-6161.1995.tb02031.x · Cited by 109,482 · cited 2×
“Benjamini-Hochberg false discovery rate (Benjamini and Hochberg 1995) and less conservative than the Bonferroni correction.”
MethodStatistical method for testing the neutral mutation hypothesis by DNA polymorphism.
Tajima, F. (1989) · Genetics · doi:10.1093/genetics/123.3.585 · Cited by 13,941
Gene ontology analysis for RNA-seq: accounting for selection bias
Young, M. D., Wakefield, M. J., Smyth, G. K., & Oshlack, A. (2010) · Genome Biology · doi:10.1186/gb-2010-11-2-r14 · Cited by 7,107
A Map of Recent Positive Selection in the Human Genome
Voight, B. F., Kudaravalli, S., Wen, X., & Pritchard, J. K. (2006) · PLoS Biology · doi:10.1371/journal.pbio.0040072 · Cited by 2,893 · cited 1×
“Itisworth noting that the overlap between lists of candidate genes for positive selection from various studies in the human populations is limited (e.g., Nielsen et al. 2005; Bustamante et al. 2005; Voight et al. 2006; Williamson et al. 2007; see also Oleksyk et al. 2010 for a recent review).”
BackgroundMolecular Signatures of Natural Selection
Nielsen, R. (2005) · Annual Review of Genetics · doi:10.1146/annurev.genet.39.073003.112420 · Cited by 1,641 · cited 2×
“Even for genes with obscure roles, it may not represent a grand challenge to unravel some connections with key genes using literature mining tools such as iHOP (information Hyperlinked Over Proteins, Hoffmann and Valencia 2004, 2005) or pathway knowledge bases such as Reactome (Vastrik et al. 2007).”
Methodg:Profiler—a web-based toolset for functional profiling of gene lists from large-scale experiments
Reimand, J., Kull, M., Peterson, H., Hansen, J., & Vilo, J. (2007) · Nucleic Acids Research · doi:10.1093/nar/gkm226 · Cited by 1,545 · cited 2×
“We used the g:GOSt (Gene Ontology Statistics) module of g:Profiler (Reimand et al. 2007, 2011). g:GOSt performs statistical enrichment analysis to detect Gene Ontology terms, biological pathways, regulatory motifs, microRNAs, protein–protein interactions, or human disease annotations that are…”
MethodWhole-genome resequencing reveals loci under selection during chicken domestication
Rubin, C.-J., Zody, M. C., Eriksson, J., Meadows, J. R. S., Sherwood, E., Webster, M. T., Jiang, L., Ingman, M., Sharpe, T., Ka, S., et al. (2010) · Nature · doi:10.1038/nature08832 · Cited by 1,138 · cited 1×
“Finally, genome scans for positive selection detect candidates as outliers in the distribution of a test statistic (e.g., Kelley et al. 2006; Gu et al. 2009; Rubin et al. 2010).”
BackgroundGenomic scans for selective sweeps using SNP data
Nielsen, R., Williamson, S., Kim, Y., Hubisz, M. J., Clark, A. G., & Bustamante, C. (2005) · Genome Research · doi:10.1101/gr.4252305 · Cited by 1,022 · cited 5×
“Itisworth noting that the overlap between lists of candidate genes for positive selection from various studies in the human populations is limited (e.g., Nielsen et al. 2005; Bustamante et al. 2005; Voight et al. 2006; Williamson et al. 2007; see also Oleksyk et al. 2010 for a recent review).”
BackgroundMethodResultInfluentialThe BioGRID interaction database: 2013 update
Chatr-aryamontri, A., Breitkreutz, B.-J., Heinicke, S., Boucher, L., Winter, A., Stark, C., Nixon, J., Ramage, L., Kolas, N., O’Donnell, L., et al. (2012) · Nucleic Acids Research · doi:10.1093/nar/gks1158 · Cited by 1,017
Interrogating a High-Density SNP Map for Signatures of Natural Selection
Akey, J. M., Zhang, G., Zhang, K., Jin, L., & Shriver, M. D. (2002) · Genome Research · doi:10.1101/gr.631202 · Cited by 964 · cited 1×
“For example, Akey et al. (2002) considered as outliers the top 2.5% of an empirical distribution of F ST values, and Kayser et al. (2003) assumed that candidate loci for positive selection exhibit unusual high R ST and/or ln ( RV ) values.”
BackgroundInfluential
Cited by
Items 201–230 of 230
Erwin, A. A., & Blumenstiel, J. P. (2018) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/342105
Rodrigues, M. F. (2019) · Digital Library of Theses and Dissertations (Universidade de São Paulo) · doi:10.11606/d.41.2019.tde-26112018-153816
Roulin, A. C. (2021) · Peer Community In Genomics · doi:10.24072/pci.genomics.100006
The effect of ascertainment bias on detecting signatures of selection
Willemse, M. (2019)
Gower, D. J., & Zaher, H. (2022) · Cambridge University Press eBooks · doi:10.1017/9781108938891.013
Individual genotype but not phenotype predicts river migration success in Atlantic salmonPreprint
Moccetti, P., Bolland, J. D., Adams, C. E., Rodger, J. R., Honkanen, H. M., Newton, M., Lothian, A. J., Nunn, A. D., & Joyce, D. A. (2023) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.1101/2023.08.15.553252
“Furthermore, given the susceptibility of gene annotation to false positives, it is important to exercise caution when attempting to establish such correlations (Pavlidis et al., 2012).”
BackgroundLu, B., Jin, H., & Fu, J. (2020) · Figshare · doi:10.6084/m9.figshare.13297113
Lu, B., Jin, H., & Fu, J. (2020) · Figshare · doi:10.6084/m9.figshare.13297125
Lu, B., Jin, H., & Fu, J. (2020) · Figshare · doi:10.6084/m9.figshare.13297116
Lu, B., Jin, H., & Fu, J. (2020) · Figshare · doi:10.6084/m9.figshare.13297134
Lu, B., Jin, H., & Fu, J. (2020) · Figshare · doi:10.6084/m9.figshare.13297107
Lu, B., Jin, H., & Fu, J. (2020) · Figshare · doi:10.6084/m9.figshare.13297131
Lu, B., Jin, H., & Fu, J. (2020) · Figshare · doi:10.6084/m9.figshare.13297128
Lu, B., Jin, H., & Fu, J. (2020) · Figshare · doi:10.6084/m9.figshare.13297119
Lu, B., Jin, H., & Fu, J. (2020) · Figshare · doi:10.6084/m9.figshare.13297122
Nosková, A., Bhati, M., Kadri, N. K., Crysnanto, D., Neuenschwander, S., Andreas Hofer, A., & Pausch, H. (2021) · Figshare · doi:10.6084/m9.figshare.14462505
Nosková, A., Bhati, M., Kadri, N. K., Crysnanto, D., Neuenschwander, S., Andreas Hofer, A., & Pausch, H. (2021) · Figshare · doi:10.6084/m9.figshare.14462499
Lu, B., Jin, H., & Fu, J. (2020) · Figshare · doi:10.6084/m9.figshare.13297110
Nosková, A., Bhati, M., Kadri, N. K., Crysnanto, D., Neuenschwander, S., Andreas Hofer, A., & Pausch, H. (2021) · Figshare · doi:10.6084/m9.figshare.14462496
Sebihi, S., Manicki, A., Klopp, C., Gautier, M., Coste, P., Huchet, E., Ortiz‐Zarragoitia, M., Bolliet, V., & Oddou‐Muratorio, S. (2026) · bioRxiv (Cold Spring Harbor Laboratory) · doi:10.64898/2026.02.01.703082
“…of direct functional validation of these genes in Anguilla anguilla , the absence of overlap, and thus of reciprocal support, between the in-situ and experimental sets of outlier genes, and the well-known risk of over-interpretation or “storytelling” in population genomics (Pavlidis et al., 2012).”
Moulistanos, A., Kaitetzidou, E., Minoudi, S., Gkagkavouzis, K., Antonopoulou, E., Triantafyllidis, A., & Papakostas, S. (2026) · Molecular Ecology · doi:10.1111/mec.70307
“…as direct mechanistic evidence linking vgll3 to somatic growth, reproductive maturation, or domestication-related traits, but rather as statistically supported hypotheses that require experimental validation, as cautioned in studies of selection and functional inference (Pavlidis et al. 2012).”
Pratlong, M. (2016) · theses.fr (ABES) · doi:10.70675/2f48e6ddza822z455eza9d5zf10fc679949c · Cited by 3
“sans même invoquer un rôle de la sélection [232].”
Eoche‐Bosy, D. (2016) · theses.fr (ABES) · doi:10.70675/3b37585bzc9b3z4bc5za4c1zd35513003ea3 · Cited by 3
Réponses adaptatives chez Drosophila suzukii, une espèce généraliste envahissante
Olazcuaga, L. (2019) · theses.fr (ABES) · doi:10.70675/0fdb431bz1d8cz4ae5zb22ezee894e331c0e · Cited by 1
Structural Genomic Variation and Its Potential Role in Deer Speciation
Chetabi, F. A., & Shafer, A. (2026) · Molecular Ecology · doi:10.1111/mec.70365 · Cited by 1
Genomic insights into population structure and somatic condition in the European sardine
Caballero‐Huertas, M., Ollé, J., Palmada‐Flores, M., Frigola-Tepe, X., Muñoz, M., & Viñas, J. (2026) · Frontiers in Marine Science · doi:10.3389/fmars.2026.1831949 · Cited by 1
MacPhail, C. S. T., Kess, T., Fleming, I. A., Smith, N., & Bradbury, I. R. (2026) · Evolutionary Applications · doi:10.1111/eva.70318
“We recognize that caution must be used in creating narratives around the interpretation of the functional traits associated with outlier loci due to the complex networks of interaction among genes (Pavlidis et al. 2012).”
Kardos, M., Luikart, G., Bunch, R., Dewey, S., Edwards, W., McWilliam, S., Stephenson, J., Allendorf, F. W., Hogg, J. T., & Kijas, J. (2015) · Data Archiving and Networked Services (DANS) · doi:10.5061/dryad.3f2t2
Metadata
- Authors
- Pavlidis, P., Jensen, J. D., Stephan, W., & Stamatakis, A.
- Affiliations
- Heidelberg Institute for Theoretical Studies (DE)
- École Polytechnique Fédérale de Lausanne (CH)
- Ludwig-Maximilians-Universität München (DE)
- Corresponding author
- Pavlidis, Pavlos
- Venue
- Molecular Biology and Evolution
- Publisher
- Oxford University Press (OUP)
- Published
- 2012-07-12
- Volume
- 29
- Issue
- 10
- Pages
- 3237-3248
- ISSN
- 0737-4038 (ISSN-L)
- 1537-1719
- OpenAlex
- W2096653176
- Cited by
- 221
- References
- 70
- Citations by year
- 2026: 5 · 2025: 6 · 2024: 6 · 2023: 11 · 2022: 14 · 2021: 15 · 2020: 16 · 2019: 21 · 2018: 23 · 2017: 22 · 2016: 23 · 2015: 25 · 2014: 18 · 2013: 14 · 2012: 2
- FWCI
- 11.37
- Type
- journal article
- Language
- en
- Open access
- green
- infoscience.epfl.ch
- Locations
- Molecular Biology and Evolution (publishedVersion)
- PubMed (publishedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion)
- Infoscience (Ecole Polytechnique Fédérale de Lausanne) (submittedVersion, cc-by-nc-nd)
- Topics
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic diversity and population structure
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Genetic Associations and Epidemiology
- Life Sciences › Biochemistry, Genetics and Molecular Biology › Genetics › Evolution and Genetic Dynamics
- Keywords
- genome scan, gene ontology annotation, false positive rate, Drosophila melanogaster, population genetics
- MeSH terms
- Animals, Computer Simulation, Drosophila melanogaster, Genetics, Population, Selection, Genetic, Reproducibility of Results, Genes, Insect, Genomics, Databases, Genetic
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.