TiyGate
The lightweight Rust AI gateway uses an embedded management console to uniformly manage multi-vendor LLM access, virtual model routing, API keys, request logs, usage analysis and failover.
TiyGate is an open source AI gateway written in Rust for individuals and teams who use multiple LLM service providers, subscription packages, protocols or API keys at the same time. It sits between applications and upstream service providers (OpenAI, Anthropic, Bedrock, Gemini, and OpenAI-Compatible services), unifying decentralized model access, routing policies, logging, and statistics into a single stable control surface. If you encounter these problems, TiyGate can solve them directly: 1. It also switches back and forth between multiple subscription plans-after connecting to multiple service providers, they are used according to policies through the unified gateway. 2. Model configurations are also frequently changed due to the instability of service providers-virtual models can automatically switch and recover disaster tolerance among multiple service providers/multiple models based on priority, weight, throughput, delay and other policies. 3. I am still scratching my head for unexplained request failures-capturing detailed request and response logs between clients gateway service providers in real time for easy playback and troubleshooting. 4. I am still worried about the usage statistics of different service providers and API Keys-aggregating multi-dimensional statistics such as service providers, models, and API Keys to view usage data in a unified manner.
