Exploring the impact of low-rank adaptation on the performance, efficiency, and regularization of RLHF

Sun, Simeng, Gupta, Dhawal, Iyyer, Mohit · arXiv · 2023