LiteLLM
LLM Gateway (OpenAI Proxy) to manage authentication, loadbalancing, and spend tracking across 100+ LLMs. All in the OpenAI format.
Has a Python SDK.
Amazon Bedrock, Azure, OpenAI, VertexAI, Cohere, Anthropic, Sagemaker, Hugging Face, Replicate, Groq
Videos:
https://youtu.be/nQCOTzS5oU0?si=rhS-DC-f40Un5tza
Related in the catalogue
Open Web UI
openwebui.comRun AI on your own terms. Connect any model, extend with code, protect what matters—without compromise.
The Unified Interface for LLMs.
openrouter.aiOpenRouter continuously monitors the health and availability of AI providers to ensure maximum uptime for your applications. We track response times, error rates, and availability across all providers in real-time, and route based on this feedback.
Open source ChatGPT-alternative that runs 100% offline - Jan
jan.aiAI-Interface Open Source Software MSTY LM Studio
LM Studio - Discover, download, and run local LLMs
lmstudio.aiYour local AI toolkit.