其他人工智能NOASSERTION
Repository dossier
BerriAI/litellm
The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]
Brief / README 摘要
查看原文Open Source AI Gateway for 100+ LLMs. Self-hosted. Enterprise-ready. Call any LLM in OpenAI format. LiteLLM is an open source AI Gateway that gives you a single, unified interface to call 100+ LLM providers — OpenAI, Anthropic, Gemini, Bedrock, Azure, and more — using the OpenAI format. Use it as a Python SDK for direct library integration, or deploy the AI Gateway (Proxy Server) as a centralized service for your team or organization. *Jump to LiteLLM Proxy (LLM Gateway) Docs *Jump to Supported LLM Providers Managing LLM calls across providers gets complicated fast — different SDKs, auth patte…
Topics / 标签
01
浏览全部相关推荐
CLI proxy that reduces LLM token consumption by 60-90% on common dev commands. Single Rust binary, zero dependencies
其他人工智能更新于 2026-10-25
An open-source long-horizon SuperAgent harness that researches, codes, and creates. With the help of sandboxes, memories, tools, skill, subagents and message gateway, it handles different levels of tasks that could take minutes to hours.
其他人工智能更新于 2026-10-25
A high-throughput and memory-efficient inference and serving engine for LLMs
其他人工智能更新于 2026-10-25
User-friendly AI Interface (Supports Ollama, OpenAI API, ...)
其他人工智能更新于 2026-10-25