Improving Few-Shot Performance of Language Models via Nearest Neighbor Calibration

Nie, Feng; Chen, Meixi; Zhang, Zhirui; Cheng, Xu

doi:10.48550/arxiv.2212.02216

Improving Few-Shot Performance of Language Models via Nearest Neighbor Calibration

Pre-trained language models (PLMs) have exhibited remarkable few-shot learning capabilities when provided a few examples in a natural language prompt as demonstrations of test instances, i.e., in-context learning. However, the performance of in-context learning is susceptible to the choice of pro…