api-for-open-llm

Openai style api for open large language models, using LLMs just as chatgpt! Support for LLaMA, LLaMA-2, BLOOM, Falcon, Baichuan, Qwen, Xverse, SqlCoder, CodeLLaMA, ChatGLM, ChatGLM2, ChatGLM3 etc.. Maintained by xusenlinzy on GitHub, where it has earned 2,458 stars from the community.

It's actively developed around baichuan, chatglm, code-llama, and is a solid reference for anyone building with these tools.