TinyLLM by jasonacox

RESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more. Maintained by apocas on GitHub, where it has earned 512 stars from the community.

A modern web interface for managing and interacting with vLLM servers (www.github.com/vllm-project/vllm). Supports both GPU and CPU modes, with special optimizations for macOS Apple Silicon and enterprise deployment on OpenShift/Kubernetes. Maintained by micytao on GitHub, where it has earned 506 stars from the community.

Low latency JSON generation using LLMs. Maintained by varunshenoy on GitHub, where it has earned 396 stars from the community.