cnllm

Python toolkit for Chinese LLMs, with flexible batch capacity, structured real-time visulization and automated accumulation for streaming, and explicit feedback on vendor-native parameter validation. Maintained by kanchengw on GitHub, where it has earned 172 stars from the community.

It's actively developed around ai, api, api-wrapper, and is a solid reference for anyone building with these tools.