model-hotel

Model-hotel is a multi-provider AI gateway designed to provide users with a unified OpenAI compatible endpoint to manage multiple LLM providers, whether they are cloud services or self-hosted. It is capable of automatically discovering models and automatically switching to the next provider when a provider experiences quota shortages or failures, without requiring any changes on the client side.

This tool supports multiple providers, including Anthropic, AWS Bedrock, Azure AI Foundry, and others, and allows adding custom endpoints. All providers' API keys are stored using AES-256-GCM encryption, ensuring security.