llama-api

An OpenAI-like LLaMA inference API. Maintained by c0sogi on GitHub, where it has earned 113 stars from the community.

It's actively developed around api, exllama, fastapi, and is a solid reference for anyone building with these tools.