lanarky

The web framework for building LLM microservices [deprecated]. Maintained by ajndkr on GitHub, where it has earned 991 stars from the community.

It's actively developed around deprecated-repo, fastapi, llmops, and is a solid reference for anyone building with these tools.