MOPD: how frontier labs merge RL experts into one model and how to do it using TRL
One of the post-training techniques that keeps showing up in this year's tech reports is Multi-Teacher On-Policy Distillation (MOPD).
The Hugging Face page documents the sergiopaniego update.
