llm-api

Run any Large Language Model behind a unified API. Maintained by 1b5d on GitHub, where it has earned 169 stars from the community.

It's actively developed around chatgpt, gptq, huggingface, and is a solid reference for anyone building with these tools.