LiteLLM
Click to visit website
About
LiteLLM is a unified API that serves as a proxy server to manage authentication, load balancing, and spending tracking across over 100 language models (LLMs) including Azure OpenAI, Vertex AI, and Bedrock. It offers both an open-source solution and enterprise options for organizations looking to integrate these models efficiently. Key features include the ability to add models, track expenses, create virtual keys, and set budgeting limits. LiteLLM has achieved significant traction with over 90,000 docker pulls, 20 million requests served, and maintains 99% uptime with the support of 200+ contributors.
Platform
Task
Features
• load balancing
• spend tracking
• auth management
• open source and enterprise options
• proxy server for 100+ llms
• unified api
Pricing Plans
Open Source
Free Plan• 100+ LLM Provider Integrations
• Langfuse, Langsmith, OTEL Logging
• Virtual Keys, Budgets, Teams
• Load Balancing, RPM/TPM limits
Enterprise Basic
USD250.00 / per month• Everything in Open Source
• Prometheus Metrics
• LLM Guardrails
• JWT Auth, SSO, Audit Logs
Average Rating: 0.0
Average Rating: 0.0
5 Stars:
0 Ratings
4 Stars:
0 Ratings
3 Stars:
0 Ratings
2 Stars:
0 Ratings
1 Star:
0 Ratings
User Ratings
No ratings available.
Sign In to Rate this Tool
Alternatives
Lamatic.ai
A managed platform offering a GenAI API, integrating workflows with a GraphQL interface for easy development and deployment.
View Details
LiteLLM
Unified API for managing multiple LLMs with support for authentication and load balancing.
View Details
Release AI
AI tool for tracking and documenting API changes, generating release notes to enhance collaboration.
View Details
Related Tools
Operação Serenata de Amor
An open-source AI tool to audit public spending and enhance government transparency.
View Details
Captum
Model interpretability library for PyTorch designed to understand and explain neural network decisions.
View DetailsHorovod
A distributed deep learning training framework for TensorFlow, Keras, PyTorch, and Apache MXNet.
View DetailsFeatured Tools
TiramAi
Create user personas and user stories quickly with TiramAi's AI-powered solutions.
View Details
Dezyn
Interactive architectural diagram tool with AI-powered features for flowcharts and cloud architectures.
View Details
SayIntentions.AI
The Future of AI for Aviation Simulation. Experience Immersion Like Never Before! - AI Air Traffic Control - AI CabinCrews - AI TourGuides - AI Mentors
View Details
AI Math Solver
A powerful AI tool for solving complex math problems with step-by-step explanations and support for photo upload.
View Details
Sherloq
A collaborative SQL management platform for data teams, enabling efficient query sharing and organization.
View Details
AutoKT
Automate and enhance your documentation with AI-driven solutions for knowledge transfer.
View Details