< cd ../gallery

[AI & ML]

ElasticMM by hpdps-group

ElasticMM: Elastic and Efficient MLLM Serving System. Maintained by hpdps-group on GitHub, where it has earned 44 stars from the community.

maintainer

★ 44 stars

2 forks

2 watchers

# install

pip install elasticmm

# tags

Python Ai Infra Inference Llm Mllm

languages

last commit5mo ago

license—

latest versions

more vLLM repos

Benchmark OpenAI-compatible AI endpoints and AI Accelerators in a reproducible structured way. Maintained by flexaihq on GitHub, where it has earned 12 stars from the community.

@flexaihq7mo ago

nano-vllmmoeSpeculative Decoding. Maintained by banfeb on GitHub, where it has earned 11 stars from the community.

Official implementation for Text Generation Beyond Discrete Token Sampling. Maintained by EvanZhuang on GitHub, where it has earned 26 stars from the community.

@EvanZhuang1y ago