liteLLM
LiteLLM is an open source LLM gateway that standardizes the APIs of 100+ big language model providers like OpenAI, Anthropic, Google, and others into a unified format. It simplifies model access, cost tracking, load balancing, and failover, and has been used by companies like Netflix for enterprise applications. The open source version is free and the enterprise version offers premium support.