LiteLLM
Click to visit website
About
LiteLLM offers a unified API that acts as a proxy server, managing authentication, load balancing, and spend tracking across over 100 large language models (LLMs). It provides integrations with various platforms including Azure OpenAI, Vertex AI, and Bedrock, all formatted in OpenAI style. Users can choose between a free open-source deployment or subscribe to enterprise solutions for added features. The tool boasts over 90,000 Docker pulls, 20 million requests served, and 99% uptime, showcasing its reliability and scalability for managing diverse AI integrations.
Platform
Task
Features
• robust performance metrics
• integrates with azure openai, vertex ai, and bedrock
• spend tracking across 100+ llms
• load balancing across multiple llms
• proxy server for managing auth
Pricing Plans
Open Source
Free Plan• 100+ LLM Provider Integrations
• Langfuse, Langsmith, OTEL Logging
• Virtual Keys, Budgets, Teams
• Load Balancing, RPM/TPM limits
Enterprise Basic
USD250.00 / per month• Everything in Open Source
• Prometheus Metrics
• LLM Guardrails
• JWT Auth, SSO, Audit Logs
Average Rating: 0.0
Average Rating: 0.0
5 Stars:
0 Ratings
4 Stars:
0 Ratings
3 Stars:
0 Ratings
2 Stars:
0 Ratings
1 Star:
0 Ratings
User Ratings
No ratings available.
Sign In to Rate this Tool
Alternatives
Lamatic.ai
A managed platform offering a GenAI API, integrating workflows with a GraphQL interface for easy development and deployment.
View Details
LiteLLM
Unified API for managing 100+ LLMs with auth, load balancing, and expense tracking.
View Details
Release AI
AI tool for tracking and documenting API changes, generating release notes to enhance collaboration.
View Details
Related Tools
Dify AI
An open-source platform to build Generative AI applications with workflows and custom agents.
View Details
Featured Tools
TiramAi
Create user personas and user stories quickly with TiramAi's AI-powered solutions.
View Details
Dezyn
Interactive architectural diagram tool with AI-powered features for flowcharts and cloud architectures.
View Details
SayIntentions.AI
The Future of AI for Aviation Simulation. Experience Immersion Like Never Before! - AI Air Traffic Control - AI CabinCrews - AI TourGuides - AI Mentors
View Details
AI Math Solver
A powerful AI tool for solving complex math problems with step-by-step explanations and support for photo upload.
View Details
Sherloq
A collaborative SQL management platform for data teams, enabling efficient query sharing and organization.
View Details
AutoKT
Automate and enhance your documentation with AI-driven solutions for knowledge transfer.
View Details