← Explore

TAG

#litellm

Stories connected through a shared idea, actor, technology or theme.

LiteLLM makes signed gateway images explicit in its 1.103.2 releaseThe release provides a pinned public key and verification commands for checking LiteLLM container signatures before deployment. It also backports several proxy and Anthropic integration fixes into the stable 1.103 branch.→LiteLLM 1.104 release candidate tightens gateway accounting and maskingThe release adds cached image-input pricing and repairs accounting paths involving MCP grants and Redis budget pipelines. It also masks streamed output more reliably and updates the Langfuse integration to its fourth SDK generation.→LiteLLM 1.103 dev release tightens MCP admission, guardrails and spend controlsLiteLLM 1.103.0-dev.1 requires admission for delegated MCP OAuth and adds post-call guardrail support for background Responses and streaming flows. It also bounds tool and guardrail index operations against spend-log budgets, improves timeout logging, fixes reasoning translation and documents signed-container verification.→LiteLLM release candidate adds signed gateway images and Agent Skills discoveryThe release signs Docker images with Cosign and documents verification, adds an Agent Skills well-known index and exposes routed-model and session-savings information for Claude Code and Codex. It also adds customer-managed KMS support for virtual keys stored in AWS Secrets Manager.→LiteLLM adds streaming guardrail pipelines and stronger agent gateway controlsThe release runs post-call guardrail pipelines on streaming responses, applies stream text rewrites and redacts provider keys from passthrough errors. It also scopes emulated file search, adds support for running the Pi coding agent through the proxy and introduces opt-in per-server MCP OAuth relay discovery.→LiteLLM 1.100.0 expands gateway integrations and security controlsThe release adds per-team New Relic trace routing, Grounding with Bing Search, native Vertex AI Interactions API support and Entra ID/OAuth authentication across Azure AI Foundry routes. It also introduces vector-store upload security controls and updates MCP, A2A, routing, cost and provider handling.→LiteLLM v1.98.0 adds gateway observability and control featuresThe gateway can now attach opt-in session and trace identifiers to JSON logs, send per-deployment SSE heartbeats, and enforce configurable output-token limits by key, team, or model. The release also exposes routing groups as virtual models and improves MCP timeouts, tracing, and provider cost accounting.→