DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome

Ji, Yanrong; Zhou, Zhihan; Liu, Han; Davuluri, Ramana V

doi:10.1093/bioinformatics/btab083

DNABERT: pre-trained Bidirectional Encoder Representations from Transformers model for DNA-language in genome

Motivation Deciphering the language of non-coding DNA is one of the fundamental problems in genome research. Gene regulatory code is highly complex due to the existence of polysemy and distant semantic relationship, which previous informatics methods often fail to capture especially in data-scarc…