gpt_server

gpt_serverLLMs、Embedding、Reranker、ASR、TTS、、。. Maintained by shell-nlp on GitHub, where it has earned 253 stars from the community.

It's actively developed around asr, embedding, fastchat, and is a solid reference for anyone building with these tools.