< cd ../gallery
[AI & ML]
LitServe
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling.
@Lightning-AI
maintainer
★ 3.9k stars
# README
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling. Maintained by Lightning-AI on GitHub, where it has earned 3,923 stars from the community.
It's actively developed around ai, api, serving, and is a solid reference for anyone building with these tools.
# tags
# install
npm install LitServemore FastAPI repos
