Should There Be a Three-Strikes Rule Against Pure Discovery Learning?