Back to projects
AI & ML
prompt-cache by messkan
Cut LLM costs by up to 80% and unlock sub-millisecond responses with intelligent semantic caching.A drop-in, provider-agnostic LLM proxy written in Go with sub-millisecond response. Maintained by messkan on GitHub, where it has earned 264 stars from the community.
Install
go get github.com/messkan/prompt-cacheMore LangChain projects
AI & ML
Building Go applications with LLMs through composability. Maintained by hupe1980 on GitHub, where it has earned 117 stars from the community.
H
2y agoAI & ML
A friendly API and abstractions for developing AI applications. Maintained by tech1024 on GitHub, where it has earned 80 stars from the community.
T
1y agoAI & ML
This is the Go language implementation of microsoft/TypeChat. Maintained by johnmai-dev on GitHub, where it has earned 35 stars from the community.
J
3y ago