Rao, Roshan

Evolutionary-scale prediction of atomic level protein structure with a language model

Lin, Z., Akin, H., Rao, R., Hie, B., Zhu, Z., Lu, W., Smetanin, N., Verkuil, R., Kabeli, O., Shmueli, Y., et al. (2022) · Science

Protein Structure and DynamicsMachine Learning in Bioinformatics

Cited by 5,990

Simulating 500 million years of evolution with a language model

Hayes, T., Rao, R., Akin, H., Sofroniew, N. J., Oktay, D., Lin, Z., Verkuil, R., Tran, V. Q., Deaton, J., Wiggert, M., et al. (2025) · Science

Protein Structure and DynamicsMachine Learning in Bioinformatics

Cited by 937

Evaluating Protein Transfer Learning with TAPE

Rao, R., Bhattacharya, N., Thomas, N., Duan, Y., Chen, X., Canny, J., Abbeel, P., & Song, Y. S. (2019) · bioRxiv (Cold Spring Harbor Laboratory)

Machine Learning in BioinformaticsProtein Structure and Dynamics

Cited by 719

Language models enable zero-shot prediction of the effects of mutations on protein function

Meier, J., Rao, R., Verkuil, R., Liu, J., Sercu, T., & Rives, A. (2021) · bioRxiv (Cold Spring Harbor Laboratory)

Machine Learning in BioinformaticsProtein Structure and Dynamics

Cited by 635

MSA Transformer

Rao, R., Liu, J., Verkuil, R., Meier, J., Canny, J. F., Abbeel, P., Sercu, T., & Rives, A. (2021) · bioRxiv (Cold Spring Harbor Laboratory)

Machine Learning in BioinformaticsProtein Structure and Dynamics

Cited by 350

Transformer protein language models are unsupervised structure learners

Rao, R., Meier, J., Sercu, T., Ovchinnikov, S., & Rives, A. (2020) · bioRxiv (Cold Spring Harbor Laboratory)

Protein Structure and DynamicsMachine Learning in Bioinformatics

Cited by 341

End-to-end learning of multiple sequence alignments with differentiable Smith–Waterman

Petti, S., Bhattacharya, N., Rao, R., Dauparas, J., Thomas, N., Zhou, J., Rush, A. M., Koo, P., & Ovchinnikov, S. (2023) · Bioinformatics

Protein Structure and DynamicsMachine Learning in Bioinformatics

Cited by 54

Interpreting Potts and Transformer Protein Models Through the Lens of Simplified Attention

Bhattacharya, N., Thomas, N., Rao, R., Dauparas, J., Koo, P. K., Baker, D., Song, Y. S., & Ovchinnikov, S. (2021) · Biocomputing 2022

Machine Learning in BioinformaticsProtein Structure and Dynamics

Cited by 20

Quality and Relevance Metrics for Selection of Multimodal Pretraining Data

Rao, R., Rao, S., Nouri, E., Dey, D., Celikyilmaz, A., & Dolan, B. (2020) · 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops (CVPRW)

Multimodal Machine Learning ApplicationsDomain Adaptation and Few-Shot Learning

Cited by 6