The DOI matches its Crossref record; 7 of the 7 references it cites were found in a registry or an index.
Transformer Architecture and Attention Mechanisms in Genome Data Analysis: A Comprehensive Review
Open accessAbstract
The emergence and rapid development of deep learning, specifically transformer-based architectures and attention mechanisms, have had transformative implications across several domains, including bioinformatics and genome data analysis. The analogous nature of genome sequences to language texts has enabled the application of techniques that have exhibited success in fields ranging from natural language processing to genomic data. This review provides a comprehensive analysis of the most recent advancements in the application of transformer architectures and attention mechanisms to genome and transcriptome data. The focus of this review is on the critical evaluation of these techniques, discussing their advantages and limitations in the context of genome data analysis. With the swift pace of development in deep learning methodologies, it becomes vital to continually assess and reflect on the current standing and future direction of the research. Therefore, this review aims to serve as a timely resource for both seasoned researchers and newcomers, offering a panoramic view of the recent advancements and elucidating the state-of-the-art applications in the field. Furthermore, this review paper serves to highlight potential areas of future investigation by critically evaluating studies from 2019 to 2023, thereby acting as a stepping-stone for further research endeavors.
Overview
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Integrity signals
Registry
Cites
Statistics
Verification
Claims the paper makes
The claims and statistics of this paper haven’t been checked yet.
Run the check — free, no account needed. It reads the open-access text and checks the sources it cites.
Self-check
Percentages, sums and reported differences re-computed from the paper’s own numbers.
The self-check needs the paper’s full text.
Citations
Cites
Swin Transformer: Hierarchical Vision Transformer using Shifted Windows
Liu, Z., Lin, Y., Cao, Y., Hu, H., Wei, Y., Zhang, Z., Lin, S., & Guo, B. (2021) · 2021 IEEE/CVF International Conference on Computer Vision (ICCV) · doi:10.1109/iccv48922.2021.00986 · Cited by 35,534
Language Models are Few-Shot Learners
Brown, T. B., Mann, B., Ryder, N., Subbiah, M., Kaplan, J., Dhariwal, P., Neelakantan, A., Shyam, P., Sastry, G., Askell, A., et al. (2020) · arXiv · doi:10.48550/arxiv.2005.14165 · Cited by 23,372
Review of Deep Learning Algorithms and Architectures
Shrestha, A., & Mahmood, A. (2019) · IEEE Access · doi:10.1109/access.2019.2912200 · Cited by 1,883 · cited 1×
“Deep learning, or deep neural networks (DNNs), employs artificial neural networks with multiple layers, a feature that makes it remarkably capable of learning complex patterns from large datasets [23].”
BackgroundCNN Variants for Computer Vision: History, Architecture, Application, Challenges and Future Scope
Bhatt, D., Patel, C., Talsania, H., Patel, J., Vaghela, R., Pandya, S., Modi, K., & Ghayvat, H. (2021) · Electronics · doi:10.3390/electronics10202470 · Cited by 890
Explainability in transformer models for functional genomics
Clauwaert, J., Menschaert, G., & Waegeman, W. (2021) · Briefings in Bioinformatics · doi:10.1093/bib/bbab060 · Cited by 60
CellVGAE: an unsupervised scRNA-seq analysis workflow with graph attention networks
Buterez, D., Bica, I., Tariq, I., Andrés-Terré, H., & Liò, P. (2022) · Bioinformatics · doi:10.1093/bioinformatics/btab804 · Cited by 44
Li, Q., Cheng, X., Song, C., & Liu, T. (2023) · Symmetry · doi:10.3390/sym15030731 · Cited by 20 · cited 1×
“[36] proposed an ensemble deep learning model called m6A-BERT-Stacking to detect m6A sites in various tissues of three species.”
Background
Cited by
The Dark Side of Dataset Scaling: Evaluating Racial Classification in Multimodal Models
Birhane, A., Dehdashtian, S., Prabhu, V., & Boddeti, V. (2024) · The 2024 ACM Conference on Fairness, Accountability, and Transparency · doi:10.1145/3630106.3658968 · Cited by 28
Wong, D. R., Hill, A. S., & Moccia, R. (2025) · Bioinformatics · doi:10.1093/bioinformatics/btaf317 · Cited by 27
Abugabah, A., Shukla, P. K., Shukla, P. K., & Pandey, A. (2025) · BioData Mining · doi:10.1186/s13040-025-00487-0 · Cited by 11
Transformers meets neoantigen detection: a systematic literature review
Machaca, V., Goyzueta, V., Cruz, M. G., Sejje, E., Pilco, L. M., López, J., & Túpac, Y. (2024) · Journal of Integrative Bioinformatics · doi:10.1515/jib-2023-0043 · Cited by 5
Metadata
- Authors
- Choi, S. R., & Lee, M.
- Venue
- Biology
- Publisher
- MDPI AG
- Published
- 2023-07-22
- Volume
- 12
- Issue
- 7
- Pages
- 1033
- ISSN
- 2079-7737 (ISSN-L)
- OpenAlex
- W4385201870
- Cited by
- 235
- References
- 7
- FWCI
- 17.56
- Type
- journal article
- Language
- en
- Open access
- gold
About these checks
Registry, retraction, Cites and statistics results are computed, not judged, with one exception: a printed reference that no index lists is read once by a model before it counts as a citation error. Claims are extracted by a model and kept only when their quote appears verbatim in the text; each cited source is then checked, with a model’s help, for whether it says what the claim relies on. Those verdicts can be wrong — read the claim’s quote and the cited source before relying on one.
Statistics and arithmetic are recomputed, not judged.
Confidence bands are shown only for fields calibrated on our annotated test set. None is calibrated yet, so no band is shown.
What counts as a claim ›How we measure confidence ›How we check this ›
Are you an author, or do you see a problem with this page? Request a review
How to cite
Cite CoChat for the checks on this page, and the paper for its own findings.
- This page
- CoChat. (2026). Citation check: Transformer Architecture and Attention Mechanisms in Genome Data Analysis: A Comprehensive Review. https://app.cochat.ai/papers/10.3390/biology12071033
- The paper
- Choi, S. R., & Lee, M. (2023). Transformer Architecture and Attention Mechanisms in Genome Data Analysis: A Comprehensive Review. Biology. https://doi.org/10.3390/biology12071033
Data sources
Bibliographic data: Semantic Scholar, OpenAlex, Crossref.
Contains information from the Semantic Scholar Academic Graph Datasets, made available under the ODC Attribution License (ODC-BY 1.0).
Semantic Scholar’s data is described in: Kinney, R., et al. (2023). The Semantic Scholar Open Data Platform. arXiv:2301.10140.