< cd ../gallery
[AI & ML]
llm-server
Open-source LLM server (OpenAI, Ollama, Groq, Anthropic) with support for HTTP, Streaming, Agents, RAG (Deprecated check out Orchestra) ->
@mifunedev
maintainer
★ 33 stars
# README
Open-source LLM server (OpenAI, Ollama, Groq, Anthropic) with support for HTTP, Streaming, Agents, RAG (Deprecated check out Orchestra) ->. Maintained by mifunedev on GitHub, where it has earned 33 stars from the community.
It's actively developed around ai, anthropic, bedrock, and is a solid reference for anyone building with these tools.
# tags
# install
npm install llm-servermore Ollama repos
