< cd ../gallery
[AI & ML]
ask-poddy
Ask Poddy: Run Open Source LLMs and Embeddings as OpenAI-Compatible Serverless Endpoints (Tutorial)
@blib-la
maintainer
★ 11 stars
# README
Ask Poddy: Run Open Source LLMs and Embeddings as OpenAI-Compatible Serverless Endpoints (Tutorial). Maintained by blib-la on GitHub, where it has earned 11 stars from the community.
It's actively developed around embedding, endpoint, infinity, and is a solid reference for anyone building with these tools.
# tags
# install
npm install ask-poddymore vLLM repos
