gpt_server by shell-nlp

Make Discord your LLM frontend - Supports any OpenAI compatible API (OpenRouter, Ollama and more). Maintained by jakobdylanc on GitHub, where it has earned 826 stars from the community.

Reliable and Efficient Semantic Prompt Caching with vCache. Maintained by vcache-project on GitHub, where it has earned 76 stars from the community.

A CPU Realtime VLM in 500M. Surpassed Moondream2 and SmolVLM. Training from scratch with ease. Maintained by lucasjinreal on GitHub, where it has earned 256 stars from the community.