aigc_serving

aigc_serving lightweight and efficient Language service model reasoning. Maintained by ssbuild on GitHub, where it has earned 24 stars from the community.

It's actively developed around inference, llm, aigc-serving, and is a solid reference for anyone building with these tools.