GQA: Training Generalized Multi-Query Transformer Models from Multi-Head Checkpoints

Ainslie, Joshua, Lee-Thorp, James, de Jong, Michiel · arXiv · 2023