liteLLM
One OpenAI-style interface for 100+ LLM providers, with spend tracking
Launched 39 months agolitellm.ai
Do you work on liteLLM?
This listing is unclaimed. Claim it for free to edit the details, add screenshots and reply to reviews.
1 / 3
About liteLLM
liteLLM is an open source LLM gateway for developers who use more than one model provider. It accepts calls in the OpenAI format and routes them to Bedrock, Azure, OpenAI, Vertex AI, Cohere, Anthropic and 100+ other providers. It ships as a Python SDK and a FastAPI proxy server, with load balancing, spend tracking, rate limiting, fallback routing, logging and error tracking. Teams can switch providers and enforce budgets without changing application code. The project has 50K+ GitHub stars and a seed round from Y Combinator.
Reviews
From people who have used it. One review per person, checked by a human.
No reviews yet. Be the first to say something useful.
