hermes by cloudpilot-ai

htop for your LLM inference cluster. Maintained by InfraWhisperer on GitHub, where it has earned 17 stars from the community.

vllm. Maintained by gameofdimension on GitHub, where it has earned 31 stars from the community.

General Information, model certifications, and benchmarks for nm-vllm enterprise distributions. Maintained by neuralmagic on GitHub, where it has earned 11 stars from the community.