Introducing Seldon Core 2.9 and MLServer 1.7: Enhanced Autoscaling, Streaming, and Usability

May we introduce you to our newest update, Seldon Core 2.9! This release is packed with updates that make deploying and scaling ML easier and more flexible than ever, including improvements to autoscaling, support for streamed results for GenAI models, and various other usability improvements described in more detail below. Also tested alongside a new […]

Introducing Seldon Core 2.9 and MLServer 1.7: Enhanced Autoscaling, Streaming, and Usability Read More »