< cd ../gallery
[AI & ML]

LLMWebCrawler by Aavache

github
A Web Crawler based on LLMs implemented with Ray and Huggingface. The embeddings are saved into a vector database for fast clustering and retrieval. Use it for your RAG. Maintained by Aavache on GitHub, where it has earned 104 stars from the community.
Aavache
@Aavache
maintainer
★ 104 stars
12 forks
2 watchers

# install

pip install llmwebcrawler

languages

Python100%
last commit2y ago
license—

more FastAPI repos

Ask MadeWithWhat

AI answers may contain mistakes — please double-check important details.