Jayakumar, Siddhant M.

Scaling Language Models: Methods, Analysis & Insights from Training Gopher

Rae, J. W., Borgeaud, S., Cai, T., Millican, K., Hoffmann, J., Song, F., Aslanides, J., Henderson, S., Ring, R., Young, S., et al. (2021) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 235

Compressive Transformers for Long-Range Sequence Modelling

Rae, J. W., Potapenko, A., Jayakumar, S. M., & Lillicrap, T. P. (2019) · arXiv

Topic ModelingNatural Language Processing Techniques

Cited by 205

Stabilizing Transformers for Reinforcement Learning

Parisotto, E., Song, H. F., Rae, J. W., Pascanu, R., Gulcehre, C., Jayakumar, S. M., Jaderberg, M., Kaufman, R. L., Clark, A., Noury, S., et al. (2019) · arXiv

Reinforcement Learning in RoboticsDomain Adaptation and Few-Shot Learning

Cited by 199

Meta-learning of Sequential Strategies

Ortega, P. A., Wang, J. X., Rowland, M., Genewein, T., Kurth-Nelson, Z., Pascanu, R., Heess, N., Veness, J., Pritzel, A., Sprechmann, P., et al. (2019) · arXiv

Reinforcement Learning in RoboticsDomain Adaptation and Few-Shot Learning

Cited by 47