Transformers generalize differently from information stored in context vs in weights

Chan, Stephanie C. Y., Dasgupta, Ishita, Kim, Junkyung · arXiv · 2022