DevTools

serge

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API.

serge-chat

Maintainer

5.7k stars

Go to website ↗View on GitHub

About this project

A web interface for chatting with Alpaca through llama.cpp. Fully dockerized, with an easy to use API. Maintained by serge-chat on GitHub, where it has earned 5,724 stars from the community.

It's actively developed around alpaca, docker, fastapi, and is a solid reference for anyone building with these tools.