Thinking of ACE? We Can Do It with Fewer Tokens
Topic - Edition
Hugging Face
Hugging Face Journal Club: Direct On-Policy Distillation
The Hugging Face research team discusses the paper "Weak-to-Strong Generalization via Direct On-Policy Distillation" which proposes a cheap way to transfer the benefits of reinforcement learning from small models to…