Goal Misgeneralization: Why Correct Specifications Aren't Enough For Correct Goals

Shah, Rohin, Varma, Vikrant, Kumar, Ramana · arXiv · 2022