News Summary

• N Nvidia has released NeMo Switchyard, an open source model router.
• It sits between an application and a pool of language models and decides, per request or per turn, which model should handle a particular task.
• The aim is to maximize efficiency by picking the right model for the right task.
• pushing frontier-level models to do simple tasks that much smaller or cheaper models could handle is not only inefficient, but also costly for enterprise customers.
• This comes at a time when enterprise customers are already grappling with rising costs that can quickly spiral out of control as they increasingly adopt AI.