Reward Collapse in Aligning Large Language Models

Song, Ziang, Cai, Tianle, Lee, Jason D. · arXiv · 2023