Student or educator? Sign up with your school email and get 6 months of Pro free.
CoChat

The DOI matches its Crossref record; 14 of the 15 references it cites were found in a registry or an index; 8 of the 9 sources its claims cite were checked for support.

Gene name errors: Lessons not learned

Open access
Abeysooriya, Mandhri, Soria, Megan, Kasu, Mary Sravya, Ziemann, Mark · 2021 · PLOS Computational Biology

Published version of a preprint

Abstract

Erroneous conversion of gene names into other dates and other data types has been a frustration for computational biologists for years. We hypothesized that such errors in supplementary files might diminish after a report in 2016 highlighting the extent of the problem. To assess this, we performed a scan of supplementary files published in PubMed Central from 2014 to 2020. Overall, gene name errors continued to accumulate unabated in the period after 2016. An improved scanning software we developed identified gene name errors in 30.9% (3,436/11,117) of articles with supplementary Excel gene lists; a figure significantly higher than previously estimated. This is due to gene names being converted not just to dates and floating-point numbers, but also to internal date format (five-digit numbers). These findings further reinforce that spreadsheets are ill-suited to use with large genomic data.

Overview

CoChat Summary

TL;DR

Gene name errors in supplementary Excel files did not decline after a 2016 report; an improved scan found errors in 30.9% (3,436/11,117) of PubMed Central articles with supplementary Excel gene lists from 2014–2020. The higher rate is partly due to detection of five-digit internal date-format conversions, and errors remained stable over the period.

Key findings

  • In the PMC screen of 2014–2020, 166,139 publications were screened; 32,841 had Excel supplementary files, 11,117 had Excel gene lists, and 3,436 publications had confirmed gene name errors (30.9%), involving 5,086 spreadsheets. The proportion affected remained stable (e.g., 30.1% in 2014, 31.4% in 2020).
  • Among 2,160 affected spreadsheet files, Mar-1/1-Mar dates accounted for 1,797 files (83.2%), DD/MM/YYYY for 19 (0.88%), floating-point numbers for 4 (0.18%), and five-digit numbers for 340 (15.7%); when five-digit numbers were formatted as dates, 292 (85.9%) fell in March and September.
  • Across Eukarya, 1,544 gene names from 104 taxa were converted to dates; vertebrates had 1,325 affected genes in 76 taxa, fungi 140 genes in 12 taxa, plants 35 genes in 4 taxa, protists 27 genes in 9 taxa, and metazoa 17 genes in 3 taxa.
  • By organism, the highest affected proportions were M. musculus 38.6% (609/1,577) and H. sapiens 30.5% (2,419/7,936), while lower rates included A. thaliana 14.9%, G. gallus 9.4%, and O. sativa 0.0%. Among journals with ≥50 articles with Excel gene lists, 37 journals accounted for 67.9% of affected publications, and journal impact factor correlated with affected proportion (Pearson p = 0.0052, r = 0.462; Spearman p = 1.95E-04, ρ = 0.589).

Methods

  • Tested Microsoft Excel 365, Google Sheets, LibreOffice v6.4.6.2, and Gnumeric v1.12.46 for converting gene-name strings to dates via opening a text file, pasting data, and typing directly.
  • Downloaded all eukaryotic gene annotation files from Ensembl (Vertebrates v102, Metazoa v49, Plants v49, Fungi v49, Protists v49), imported gene names into Excel, and sorted to count date conversions per taxon.
  • Screened open-access PMC publications from 2014–2020 with “genom*” in the title or abstract; extracted .xls/.xlsx supplementary files; used R/readxl and ssconvert; flagged standard dates, floating-point numbers, and five-digit internal date formats; manually verified suspect files; and used R for summary statistics and two-sided Pearson/Spearman tests.

Limitations

  • The paper states it only screened open-access articles in PMC, so results may not represent paywalled articles; it screened only a subset with “genom*” in the title or abstract, and it states it included only 116,139 (~5.0%) of 3,291,704 PMC articles from 2014–2020. The updated software yielded slightly more false positives but was manually verified; the script only identified vertical gene lists, so horizontal lists were likely missed.
  • The paper states it did not quantitatively examine the hypothesis that the number and size of supplementary gene lists drive the journal/JIF trend.
  • Evident from the text: the screening totals are inconsistent (166,139 reported in Results/Table 3 vs. 116,139 in Limitations), and the JIF association is observational, not causal.

Model-written summary. Check it against the paper before relying on it.

Integrity signals

Registry

Crossref · 10.1371/journal.pcbi.1008984

Cites

14 of 14 references verified0 citation errors · 0 not checkable

Statistics

Nothing to recompute.

Figures

Fig 1 Prevalence of gene name errors in the period 2014–2020. (A) Publications with supplementary Excel gene lists. (B) Publications affected by gene name errors. (C) Proportion of affected publications.
Fig 1 Prevalence of gene name errors in the period 2014–2020. (A) Publications with supplementary Excel gene lists. (B) Publications affected by gene name errors. (C) Proportion of affected publications.CC BY · PubMed Central
Fig 2 A scatterplot of JIF and proportion of articles with supplementary Excel gene lists affected by gene name errors.
Fig 2 A scatterplot of JIF and proportion of articles with supplementary Excel gene lists affected by gene name errors.CC BY · PubMed Central
Fig 3 Gene name errors in supplementary files for three dominant journals in the period 2014–2020.
Fig 3 Gene name errors in supplementary files for three dominant journals in the period 2014–2020.CC BY · PubMed Central

Verification

Claims the paper makes

7 Valid · 3 Not valid · 1 Not checked · 60 Own results and interpretations

31 more claims · 1 with their cited sources checked

Create a free account to see all 71 claims and every source verdict.

See all claims — free account
  • It may state two separate claims as one. 24
  • Probably not a substantial claim. 15
  • The quote only partly states this claim. 1

Create a free account to see these claims.

Self-check

Percentages, sums and reported differences re-computed from the paper’s own numbers.

Each contradiction between two passages listed here was confirmed by an independent check.

3 of 3

Citations

Cites

Show all 15 references

Cited by

See all 39

Metadata

Authors
Abeysooriya, M., Soria, M., Kasu, M. S., & Ziemann, M.
Affiliations
Deakin University (AU)
Corresponding author
Ziemann, Mark
Venue
PLOS Computational Biology
Published
2021-07-30
Volume
17
Issue
7
Pages
e1008984
ISSN
  • 1553-734X (ISSN-L)
  • 1553-7358
OpenAlex
W3183904002
Cited by
39
References
15
Citations by year
2026: 4 · 2025: 8 · 2024: 7 · 2023: 9 · 2022: 5 · 2021: 6
FWCI
6.10
Type
journal article
Language
en
Open access
Locations
  • PLoS Computational Biology (publishedVersion, cc-by)
  • bioRxiv (Cold Spring Harbor Laboratory) (acceptedVersion, cc-by)
  • PubMed Central (publishedVersion, cc-by)
  • PubMed (publishedVersion)
  • DOAJ (DOAJ: Directory of Open Access Journals) (submittedVersion, cc-by-sa)
  • Figshare (submittedVersion, cc-by)
Funders
Monash University
Topics
  • Physical Sciences › Computer Science › Information Systems › Research Data Management Practices
  • Health Sciences › Medicine › Health Informatics › Biomedical Text Mining and Ontologies
  • Social Sciences › Decision Sciences › Information Systems and Management › Scientific Computing and Data Management
Keywords
spreadsheet software, Microsoft Excel, genomic data, data quality, PubMed Central, type conversion
MeSH terms
Genes, Humans, Terminology as Topic, Software, Computational Biology, PubMed, Molecular Sequence Annotation

About these checks

Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.

The claim verdicts this report counts are experimental: their accuracy is not yet measured.

A language model drew the claims from the paper on 2026-10-01, under version 3 of the claim definition (model deepseek-v4.1-flash, prompt extract-v3).

A second model labelled each claim on 2026-10-01 (model jev-1.13-20260917, definition revision gold-guideline-v0.2).

Cited sources are checked with a language model’s help (gpt-6-sol).

Statistics and arithmetic are recomputed, not judged.

Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.

What counts as a claim ›How we measure confidence ›How we check this ›

Are you an author, or do you see a problem with this page? Request a review

How to cite

Cite CoChat for the checks on this page, and the paper for its own findings.

This page
CoChat. (2026). Citation check: Gene name errors: Lessons not learned. https://app.cochat.ai/papers/10.1371/journal.pcbi.1008984
The paper
Abeysooriya, M., Soria, M., Kasu, M. S., & Ziemann, M. (2021). Gene name errors: Lessons not learned. PLOS Computational Biology. https://doi.org/10.1371/journal.pcbi.1008984

Data sources

Bibliographic data: Semantic Scholar, OpenAlex, Crossref.

Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).

Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.