Training LLMs to Self-Correct via RL
Aviral Kumar, Vincent Zhuang, Rishabh Agarwal, et al.
SCoRe is a multi-turn online RL method that significantly improves LLM self-correction using only self-generated data, achieving state-of-the-art gains on MATH and HumanEval.