Loukas, Andreas

On the Relationship between Self-Attention and Convolutional Layers

Cordonnier, J.-B., Loukas, A., & Jaggi, M. (2019) · arXiv

Advanced Neural Network ApplicationsVisual Attention and Saliency Detection

Cited by 354

Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depth

Dong, Y., Cordonnier, J.-B., & Loukas, A. (2021) · arXiv

Topic ModelingAdvanced Neural Network Applications

Cited by 195

Exploring “dark-matter” protein folds using deep learning

Harteveld, Z., Van Hall-Beauvais, A., Morozova, I., Southern, J., Goverde, C., Georgeon, S., Rosset, S., Defferrard, M., Loukas, A., Vandergheynst, P., et al. (2024) · Cell Systems

Protein Structure and DynamicsRNA and protein synthesis mechanisms

Cited by 13

Exploring “dark matter” protein folds using deep learning

Harteveld, Z., Van Hall-Beauvais, A., Morozova, I., Southern, J., Goverde, C., Georgeon, S., Rosset, S., Defferrard, M., Loukas, A., Vandergheynst, P., et al. (2023) · Cell Systems

Protein Structure and DynamicsRNA and protein synthesis mechanisms

Cited by 13