< cd ../gallery
TokenPowerBench: Benchmarking the power consumption of LLM inference across engines and deployment configurations. Maintained by chenxuniu on GitHub, where it has earned 15 stars from the community.
# install
pip install tokenpowerbenchmore vLLM repos
AI & ML
A hybrid router that uses Spot GPU instances to reduce costs and Serverless GPUs for making Cold Starts faster. Maintained by Tandemn-Labs on GitHub, where it has earned 27 stars from the community.
7mo ago
AI & ML
Benchmark OpenAI-compatible AI endpoints and AI Accelerators in a reproducible structured way. Maintained by flexaihq on GitHub, where it has earned 12 stars from the community.
7mo ago
AI & ML
nano-vllmmoeSpeculative Decoding. Maintained by banfeb on GitHub, where it has earned 11 stars from the community.
4mo ago
