LSPD

A Reinforcement Learning Perspective on OPD: Least-Squares Policy Distillation for Sample-Efficient LLM Reasoning

LSPD recasts on-policy distillation as KL-regularized RL, using least-squares matching and replay to improve s…