Back to projects
AI & ML

llm-server

Open-source LLM server (OpenAI, Ollama, Groq, Anthropic) with support for HTTP, Streaming, Agents, RAG (Deprecated check out Orchestra) ->
mifunedev
mifunedev
Maintainer
33 stars
Go to website ↗View on GitHub
llm-server repository preview
About this project
Open-source LLM server (OpenAI, Ollama, Groq, Anthropic) with support for HTTP, Streaming, Agents, RAG (Deprecated check out Orchestra) ->. Maintained by mifunedev on GitHub, where it has earned 33 stars from the community.
It's actively developed around ai, anthropic, bedrock, and is a solid reference for anyone building with these tools.
Tags
Install
npm install llm-server
Languages
Last updated1 year ago
License
More LangChain projects
L
Made with LangChain
RSSLLMmadewithwhat

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.