coai

Next Gen Multi-tenant AI One-Stop Solution. Builtin Admin & Billing System. Enterprise-Grade Unified LLM Gateway Support for 200+ Models And 35+ Providers, Load Balacing w/ Priority-base Routing, Cost Management, Chat Share, Cloud Sync, Credit/Subscription Billing, All File Parsing, Web Search, Built-in Model Cache. Maintained by coaidev on GitHub, where it has earned 9,237 stars from the community.

It's actively developed around ai-gateway, api, chat, and is a solid reference for anyone building with these tools.