Install
https://github.com/BerriAI/litellm
- 6articles · 30d
- 1+ week agolatest article
- Aug 19, 2026earliest in window
- 17%with images
- 245avg words
- Science & Technology 6
- Software Dev. 6
- Computers & Electronics 5
- Internet & Telecom 1
Please confirm you are human
This browser or connection looks automated. Press and continuously hold the control for 3 seconds to enable Google-hosted web results and, when separately allowed, AI-assisted answers.
A successful check enables 100 search requests. Interactive access does not authorize scraping, systematic collection, or reuse of search output.
News
CLF AI Gateway
1+ week, 15+ hour ago (109+ words) LiteLLM CLF AI Gateway is an OpenAI-compatible gateway that serves open-weight models. It is an independent service and is not affiliated with Cloudflare; for Cloudflare's own inference product see Cloudflare Workers AI Sample Usage - Streaming Every model on the gateway…...
v1.100.0 - Access Group Budgets, Together AI Sync & Custom Router Tiers
1+ week, 16+ hour ago (373+ words) PyPI and Docker artifacts for this release were built from different SHAs, but are expected to be functionally the same. PyPI was built from 10631eb and Docker from e4f2526. GET /spend/logs is capped at the 10,000 most recent rows. The endpoint used…...
QwenCloud and Qwen AI Platform (Qwen models)
1+ week, 5+ day ago (170+ words) Alibaba unified its model platform brands (DashScope, Bailian, Model Studio) under QwenCloud outside mainland China and Qwen AI Platform in mainland China. LiteLLM routes both brands through its existing DashScope implementation, and the legacy dashscope/ prefix keeps working as an…...
v1.97.1 - Docker-Only Maintenance Release
1+ week, 5+ day ago (239+ words) This release also does not move the latest tag. The current stable line is v1.99.0. The litellm, litellm-database and litellm-non_root variants are all published at this tag on both GHCR and Docker Hub, each cosign-signed as usual. v1.97.1 is a maintenance patch…...
API Stability Policy
2+ week, 5+ day ago (192+ words) This page defines which parts of the LiteLLM Proxy HTTP API are a public contract we work to preserve, and which parts are private and may change at any time. Every endpoint that appears in the proxy's OpenAPI spec is…...
Valkey - Vector Store
3+ week, 5+ day ago (874+ words) Search documents you have already indexed in Valkey through LiteLLM's unified vector store API, so that any virtual key can run retrieval against your datastore without ever holding your Valkey credentials. LiteLLM only reads from Valkey; building and loading the…...