Build efficient agents with knowledge distillation on Amazon SageMaker AI
One way to make an agentic application more efficient is to use a smaller model, which is faster to respond and more cost-effective to host.
The catch is quality: a smaller model usually falls short on the task, which is why the larger one was chosen in the first place.