Summary

The gateway can now attach opt-in session and trace identifiers to JSON logs, send per-deployment SSE heartbeats, and enforce configurable output-token limits by key, team, or model. The release also exposes routing groups as virtual models and improves MCP timeouts, tracing, and provider cost accounting.

Why it matters

These controls address the operational problems that emerge when teams run multiple model providers and long-lived agent or application streams through a shared gateway.

Sources