< cd ../gallery
[AI & ML]

LitServe by Lightning-AI

go to website ↗github
A minimal Python framework for building custom AI inference servers with full control over logic, batching, and scaling. Maintained by Lightning-AI on GitHub, where it has earned 3,923 stars from the community.
Lightning-AI
@Lightning-AI
maintainer
★ 3.9k stars
294 forks
26 watchers

# install

pip install litserve

languages

Python100%
last commit2mo ago
licenseApache-2.0

more FastAPI repos

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.