Beyond On-Policy vs. Off-Policy: At What Level Should LLM Agent Distillation Follow the Student?
Distilling interactive LLM agents requires choosing between teacher-generated demonstrations and student-generated experience, corresponding broadly to off-policy and on-policy distillation.
The arXiv coding-agent research feed release records 2610.31918v1 for arXiv.
