lanarky

The web framework for building LLM microservices [deprecated]. Maintained by ajndkr on GitHub, where it has earned 993 stars from the community.

It's actively developed around fastapi, python3, web, and is a solid reference for anyone building with these tools.