BerriAI/litellm

The fastest, litest AI Gateway. Rust core with Python SDK. Call 100+ LLM APIs in OpenAI (or native) format with cost tracking, guardrails, load balancing, and logging [Bedrock, Azure, OpenAI, Anthropic, OpenAI, VertexAI, vLLM, Nvidia NIM]

语言：Python · GitHub 星标：62,818 · Fork：13,066

话题：ai-gateway · anthropic · azure-openai · bedrock · gateway · langchain · litellm · llm

在 GitHub 上查看原仓库