Back to projects
AI & ML

openai_trtllm by npuichigo

View on GitHub
OpenAI compatible API for TensorRT LLM triton backend. Maintained by npuichigo on GitHub, where it has earned 221 stars from the community.
npuichigo
npuichigo
Maintainer
221 stars
30 forks
6 watchers

Install

pip install openai_trtllm

Languages

Rust95%
Last updated2y ago
LicenseMIT

Latest versions

0.2.1↗0.2.0↗

More LangChain projects

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.