What is Litellm?
LiteLLM is an open-source LLM Gateway to manage authentication, loadbalancing, and spend tracking across 100+ LLMs. All in the OpenAI format.
Litellm
Deploy LiteLLM proxy on Moltern for unified LLM API with 100+ models, load balancing, fallbacks, and standardized OpenAI-compatible interface.
Service catalog docs