openai_trtllm

OpenAI compatible API for TensorRT LLM triton backend. Maintained by npuichigo on GitHub, where it has earned 221 stars from the community.

It's actively developed around langchain, llm, openai-api, and is a solid reference for anyone building with these tools.