Notatki do odcinka
The largest inference saving is rarely a cheaper model. It is sending each request to the smallest model that can answer it well, and governing that routing decision as a platform control with an owner and an evaluation set.
Strona: bradshaw.cloud

