Python SDK, Proxy Server (AI Gateway) to call 100+ LLM APIs in OpenAI (or native) format, with cost tracking, guardrails, loadbalancing and logging. [Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, HuggingFace, VLLM, NVIDIA NIM]
Embed a live health badge in a README or docs page.
[](https://www.ai-tools-scout.com/projects/litellm)See how this project stacks up against other interface tools.
Get the fastest-growing projects, useful MCP servers, and technical reads in one weekly email.