opp-lens

Distributed scraping and semantic deduplication engine using Sentence Transformers and Atlas Vector Search. Maintained by manaskng on GitHub, where it has earned 35 stars from the community.

It's actively developed around distributed-systems, docker, embeddings, and is a solid reference for anyone building with these tools.