< cd ../gallery
[AI & ML]
TorchSpec by lightseekorg
A PyTorch native library for training speculative decoding models. Maintained by lightseekorg on GitHub, where it has earned 219 stars from the community.
more vLLM repos
AI & ML
Official implementation for Text Generation Beyond Discrete Token Sampling. Maintained by EvanZhuang on GitHub, where it has earned 26 stars from the community.
1y ago
AI & ML
Nano vLLM with vLLM v1's request scheduling strategy and chunked prefill. Maintained by slwang-ustc on GitHub, where it has earned 95 stars from the community.
8mo ago
AI & ML
Python package for LLM compression. Maintained by FujitsuResearch on GitHub, where it has earned 398 stars from the community.
2mo ago
