langport

Langport is a language model inference service. Maintained by vtuber-plan on GitHub, where it has earned 94 stars from the community.

It's actively developed around api, chatgpt, chatgpt-api, and is a solid reference for anyone building with these tools.