Cordonnier, Jean-Baptiste

Sparsified SGD with Memory

Stich, S. U., Cordonnier, J.-B., & Jaggi, M. (2018) · arXiv

Stochastic Gradient Optimization TechniquesDistributed Control Multi-Agent Systems

Cited by 508

On the Relationship between Self-Attention and Convolutional Layers

Cordonnier, J.-B., Loukas, A., & Jaggi, M. (2019) · arXiv

Advanced Neural Network ApplicationsVisual Attention and Saliency Detection

Cited by 354

Attention is Not All You Need: Pure Attention Loses Rank Doubly Exponentially with Depth

Dong, Y., Cordonnier, J.-B., & Loukas, A. (2021) · arXiv

Topic ModelingAdvanced Neural Network Applications

Cited by 195