{"full_name":"BerriAI/litellm","owner":"BerriAI","name":"litellm","url":"https://github.com/BerriAI/litellm","description":"The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]","homepage":"https://docs.litellm.ai/docs/","topics":[],"language":"Python","license":"NOASSERTION","avatar":"https://avatars.githubusercontent.com/u/121462774?v=4","created_at":"2023-07-27T00:09:52Z","pushed_at":"2026-11-10T09:32:10Z","metrics":{"stars":63023,"forks":13148,"watchers":237,"issues":14012,"prs":35299,"releases":1000,"issues_open":null,"issues_closed":null,"prs_open":null,"prs_closed":null,"prs_merged":null,"discussions":668},"growth":{"day":{"stars":70,"forks":20,"base_day":"2026-11-09"},"week":{"stars":459,"forks":211,"base_day":"2026-11-03"}},"history":{"dates":["2026-10-19","2026-10-20","2026-10-21","2026-10-22","2026-10-23","2026-10-24","2026-10-25","2026-10-26","2026-10-27","2026-10-28","2026-10-29","2026-10-30","2026-10-31","2026-11-01","2026-11-02","2026-11-03","2026-11-04","2026-11-09","2026-11-10"],"stars":[61293,61329,61393,61444,61578,61666,61741,61827,61912,61968,62080,62170,62246,62322,62396,62564,62636,62953,63023],"forks":[12365,12382,12418,12432,12481,12520,12550,12576,12612,12636,12707,12735,12787,12822,12856,12937,12982,13128,13148],"watchers":[239,239,240,240,240,239,238,238,238,233,234,234,234,236,236,237,236,237,237],"issues_open":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null],"prs_open":[null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null,null]},"boards":{},"same_owner":[],"issues":[{"number":47826,"title":"[SECURITY] litellm 1.107.0 compromised (PyPI removed; Docker latest/main-stable removed): cook.pth credential stealer + sitecustomize RCE loader, built from lookalike repo Berri-AI/litellm","comments":34,"created_at":"2026-10-21T12:06:41Z"},{"number":31263,"title":"LiteLLM Rust Migration - the fastest and litest AI Gateway (sub 1ms overheads)","comments":33,"created_at":"2026-06-25T02:11:17Z"},{"number":30484,"title":"LiteLLM Stability Sprint Roadmap","comments":26,"created_at":"2026-06-15T21:35:41Z"},{"number":39057,"title":"Design intent: on cache hits, spend is zeroed but token columns replay the original usage — which basis should token reports aggregate?","comments":26,"created_at":"2026-09-01T02:40:29Z"},{"number":18686,"title":"I WISH LITELLM HAD - Models, Providers, Endpoints requests","comments":23,"created_at":"2026-01-06T05:17:07Z"},{"number":26672,"title":"[Bug]: Budget enforcement bypassed in v1.82.3 for key/user max_budget despite spend exceeding max_budget","comments":21,"created_at":"2026-04-28T06:18:11Z"},{"number":25762,"title":"[Feature]: unlimited SSO Login with Standard Plan","comments":20,"created_at":"2026-04-15T08:22:32Z"},{"number":9753,"title":"Notice: Deprecation of the Prisma Python client","comments":20,"created_at":"2025-04-04T14:49:46Z"}],"discussions":[{"number":50654,"title":"LiteLLM enabling in-depth analysis of agentic behaviours","comments":0,"category":"Show and tell","created_at":"2026-11-08T21:27:35Z"},{"number":50640,"title":"Counting tokens per customer when your API calls models through LiteLLM","comments":0,"category":"Show and tell","created_at":"2026-11-08T18:13:52Z"},{"number":50533,"title":"models not available","comments":0,"category":"General","created_at":"2026-11-07T13:55:10Z"},{"number":50524,"title":"Late usage evidence versus permission for another request: ARQUÍA-EVAL-001","comments":0,"category":"Show and tell","created_at":"2026-11-07T11:25:04Z"},{"number":50438,"title":"We stress-tested LiteLLM spend limits: what held, what slipped, and 4 related issues","comments":0,"category":"General","created_at":"2026-11-06T19:29:03Z"},{"number":50203,"title":"POST /v1/skills with custom_llm_provider=litellm_proxy ignores `version`, never sets latest_version","comments":1,"category":"Q&A","created_at":"2026-11-05T10:17:13Z"},{"number":50019,"title":"Enterprise MCP Gateway – Secretless Agent Identity, Token Exchange and Downstream Authorization","comments":4,"category":"Q&A","created_at":"2026-11-04T06:39:46Z"},{"number":49837,"title":"ArtiGram: a free gallery for interactive artifacts, with a remote MCP server","comments":0,"category":"Show and tell","created_at":"2026-11-03T08:16:48Z"}],"latest_release":{"name":"1.108.3 (LTS)","tag":"v1.108.3","published_at":"2026-11-07T22:29:58Z","body":"> [!TIP]\n> The `lts` image tag always points to the latest LTS release. Pull `ghcr.io/berriai/litellm:lts` to stay on the newest LTS patch\n\n## Verify this release\n\n```bash\ncosign verify \\\n  --key https://raw.githubusercontent.com/BerriAI/litellm/e82a3c646908ba0a6ee0beddc4310d7a6cac4065/cosign.pub \\\n  ghcr.io/berriai/litellm:v1.108.3\n```\n\nSame command for `litellm-database`, `litellm-non_root` and the `docker.io/litellm/*` images\n\n## What's new in 1.108.3 (LTS)\n\n11 PRs. 3 fixed. No action needed to upgrade\n\n### Changes\n\n- **AWS Bedrock:** Fixed every request failing on a Bedrock deployment with `api_base: \"\"`, which answered 500 or 400 (#50449)\n- **MCP:** Fixed tool results over 1 MiB failing with `SSE stream ended without a response`, broken since v1.103.0 (#47034)\n- **Guardrails:** Fixed model-level `post_call` guardrails checking each response twice and calling the moderation provider twice (#50463)\n\n---\n\nBackport #50484 · Backport #50487 · [Full changelog](https://github.com/BerriAI/litellm/compare/v1.108.2...v1.108.3)\n"},"readme":true,"readme_zh":false,"news":[{"title":"Tell HN: Litellm 1.82.7 and 1.82.8 on PyPI are compromised","url":"https://github.com/BerriAI/litellm/issues/24512","hn":"https://news.ycombinator.com/item?id=47501426","source":"Hacker News","lang":"en","date":"2026-03-24","points":938,"comments":500},{"title":"Malicious litellm_init.pth in litellm 1.82.8 PyPI package – credential stealer","url":"https://github.com/BerriAI/litellm/issues/24512","hn":"https://news.ycombinator.com/item?id=47501729","source":"Hacker News","lang":"en","date":"2026-03-24","points":739,"comments":1},{"title":"Show HN: liteLLM Proxy Server: 50+ LLM Models, Error Handling, Caching","url":"https://github.com/BerriAI/litellm/blob/main/cookbook/proxy-server/readme.md","hn":"https://news.ycombinator.com/item?id=37095542","source":"Hacker News","lang":"en","date":"2023-08-12","points":140,"comments":34},{"title":"Show HN: Litellm – Simple library to standardize OpenAI, Cohere, Azure LLM I/O","url":"https://github.com/BerriAI/litellm","hn":"https://news.ycombinator.com/item?id=36887711","source":"Hacker News","lang":"en","date":"2023-07-27","points":62,"comments":17},{"title":"Show HN: A modern C++20 AI SDK (GPT‑4o, Claude 3.5, tool‑calling)","url":"https://news.ycombinator.com/item?id=44412726","hn":"https://news.ycombinator.com/item?id=44412726","source":"Hacker News","lang":"en","date":"2025-06-29","points":56,"comments":6},{"title":"LiteLLM Python SDK Proxy Server LLM Gateway Call 100 LLM APIs in OpenAI Format","url":"https://github.com/BerriAI/litellm","hn":"https://news.ycombinator.com/item?id=44674162","source":"Hacker News","lang":"en","date":"2025-07-24","points":5,"comments":0},{"title":"Litellm 1.107.0 on PYPI Compromised","url":"https://github.com/BerriAI/litellm/issues/47826","hn":"https://news.ycombinator.com/item?id=50180845","source":"Hacker News","lang":"en","date":"2026-10-21","points":3,"comments":0},{"title":"LiteLLM Agent Platform: Run Claude Code/Codex On-Prem Sandboxes and Vaults","url":"https://github.com/BerriAI/litellm-agent-platform","hn":"https://news.ycombinator.com/item?id=48155595","source":"Hacker News","lang":"en","date":"2026-05-16","points":3,"comments":0},{"title":"Popular AI tool LiteLLM says unrevoked key allowed hackers to target users","url":"https://therecord.media/litellm-hackers-ai-malware","source":"The Record from Recorded Future News","lang":"en","date":"2026-10-26"},{"title":"LiteLLM traces supply chain attack to a GitHub key nobody revoked","url":"https://cryptobriefing.com/litellm-supply-chain-attack-exposed-github-key/","source":"Crypto Briefing","lang":"en","date":"2026-10-26"},{"title":"LiteLLM 1.107.0 是如何被投毒的：响应体中的一个令牌，以及将其留存下来的日志","url":"https://news.google.com/rss/articles/CBMiigFBVV95cUxQWEhnaHB6N1ljR0NlRnlCaktMVGFJeTZXREQ2Tm4zSWIzdlZaWUtEUlp4VWRQa2dYdVRGQzh2bzZyM3R0aUNJQ19naFBtSlJjdWVlLXUwSnJ4LXkyWHBBcHFxNGNWbHVzMWJsQ0c4ZVpuZ2l0T3h3Y2prZVdXdk4wRFk4LURjbVFBUVE?oc=5","source":"OrcaRouter","lang":"zh","date":"2026-10-30"},{"title":"LiteLLM主密钥泄露致部署链路遭入侵 恶意版本流入PyPI和Docker Hub","url":"https://news.google.com/rss/articles/CBMiugFBVV95cUxPUHQ3VkRsX19DME5LZ0o0bkZQcnhDQ3JDYjV0YU9UMVpUeHJRdm1RMEE5TjVlQ0NHSWc4anhrenEyaU5feEE3S2FZREtOdEhqc1Nyc3g2TXJnMXg2ZlBIY0RSZlZDYlFQdlJZdkNjTkkyZlhmWHg5N2pTbWtNdkJtS29xYU9sX2pJX2ktY280Z0tlLVBWOTRHY0Q1RlF1MFRGY1B2eEpZUmgzUHdkZnJjRGZ2Z0NjS2cwdGc?oc=5","source":"디지털투데이","lang":"zh","date":"2026-10-24"},{"title":"泄露的 LiteLLM 主密钥让攻击者劫持发布流程，发布恶意软件包","url":"https://news.google.com/rss/articles/CBMizAFBVV95cUxNWXhZN2Z2Szh5VUFQRkczWXFQdEZsR0JsRk0xcjRBRG9IVnNyVlYyN2lZRmdaTHdGQjkxa1NhTEtZbkJzeXhrczFwLU9zaVV5TnVETW1GLXV3ZXRpV3hjSlV6ZlRMUFc4elMzbkE3UE91U3QyRG85aWFwTjNlNE1abEhVZjNwLXl4REllamkzT2pyQTdwS1FJVHMtRUJhVTlHSTlvWFhQbEJiX3NHVWlBMXB4Wm9EVWVjMUJuUHJ0NUlOVU53bFp0ZWkyRHU?oc=5","source":"news.lavx.hu","lang":"zh","date":"2026-10-24"},{"title":"PyPI遭投毒！LiteLLM用户Python启动就中招，个人凭证秒泄露","url":"https://news.google.com/rss/articles/CBMiSEFVX3lxTE9PRkJjbzdnbUtBazh5bnp2b19FZUpFOGdMQU1COHJqWU9lQkpmc0hfdmhyelJraGtOWDBfZDBZTUZjckhtbEpmQQ?oc=5","source":"智源社区","lang":"zh","date":"2026-03-27"},{"title":"LiteLLM 供应链攻击事件始末| 慢雾SlowMist发布于币安广场","url":"https://news.google.com/rss/articles/CBMiaEFVX3lxTE1xSU9rOVp1TzRMNGZ1ZTdzempvOW9DeDJKM3RTczJZQWJrQ0JCUkdSa01HdmlBT3o3NWtvYVJLSHpYbUFKTktfWm43Y2NvUVd1V05UekV5RUlwaGUzOGl6LWJRN3E2VURr?oc=5","source":"Binance","lang":"zh","date":"2026-03-25"}],"stale":false,"snapshot_at":"2026-11-10T09:35:25Z","history_start":"2026-09-06"}