< cd ../gallery
[AI & ML]
GPTQModel by ModelCloud
LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang. Maintained by ModelCloud on GitHub, where it has earned 1,222 stars from the community.
# install
pip install gptqmodelmore FastAPI repos
AI & ML
Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints. Maintained by SearchSavior on GitHub, where it has earned 498 stars from the community.
2mo ago
AI & ML
Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU. Maintained by MakazhanAlpamys on GitHub, where it has earned 586 stars from the community.
8w ago
AI & ML
High-performance Inference and Deployment Toolkit for LLMs and VLMs based on PaddlePaddle. Maintained by PaddlePaddle on GitHub, where it has earned 3,703 stars from the community.
2mo ago
