AI Daily
Brief
Explore
Review
Sync offline
◐
← Explore
TAG
#rate limits
Stories connected through a shared idea, actor, technology or theme.
24 Aug
LiteLLM v1.98.0 adds gateway observability and control features
The gateway can now attach opt-in session and trace identifiers to JSON logs, send per-deployment SSE heartbeats, and enforce configurable output-token limits by key, team, or model. The release also exposes routing groups as virtual models and improves MCP timeouts, tracing, and provider cost accounting.
→