Distributed-Multi-User-Scrapy-System-with-a-Web-UI

Django based application that allows creating, deploying and running Scrapy spiders in a distributed manner. Maintained by aaldaber on GitHub, where it has earned 111 stars from the community.

It's actively developed around scrapy, rabbitmq, mongodb, and is a solid reference for anyone building with these tools.