< cd ../gallery
LLM Performance Testing | K6 + Grafana + InfluxDB | A tiny toolkit for load testing and benchmarking OpenAI-like inference endpoints using K6 + Grafana + InfluxDB. Maintained by 0xnyn on GitHub, where it has earned 13 stars from the community.
# install
npm install periscopemore vLLM repos
AI & ML
AI hardware fit calculator for LLM, embedding, reranker, OCR and VLM workloads — VRAM, throughput, licensing and multi-GPU planning. Maintained by jaeseok614 on GitHub, where it has earned 13 stars from the community.
8w ago
AI & ML
A web-based memory usage and performance calculator for Huggingface GGUF models. Maintained by gdevenyi on GitHub, where it has earned 27 stars from the community.
3mo ago
AI & ML
A comprehensive toolkit for deploying production-ready Generative AI infrastructure on Amazon EKS. Includes pre-configured components for: AI Gateway (LiteLLM) LLM Serving (vLLM, SGLang, Ollama) Vector Databases, Embedding Models (TEI) Observability (Langfuse, Phoenix) etc. Fast-track your GenAI deployment with Kubernetes. Maintained by aws-samples on GitHub, where it has earned 91 stars from the community.
2mo ago
