< cd ../gallery

[DevTools]

crawlee by apify

go to website ↗github

Crawlee—A web scraping and browser automation library for Node.js to build reliable crawlers. In JavaScript and TypeScript. Extract data for AI, LLMs, RAG, or GPTs. Download HTML, PDF, JPG, PNG, and other files from websites. Works with Puppeteer, Playwright, Cheerio, JSDOM, and raw HTTP. Both headful and headless mode. With proxy rotation. Maintained by apify on GitHub, where it has earned 24,703 stars from the community.

maintainer

★ 24.7k stars

1.5k forks

131 watchers

# install

npm install crawlee

# tags

TypeScript Apify Automation Crawler Crawling

languages

TypeScript57.632%

MDX33.553%

JavaScript6.898%

CSS1.065%

Dockerfile0.826%

Python0.024%

HTML0.002%

last commit3mo ago

licenseApache-2.0

more Express repos

The Monorepo Platform that amplifies both developers and AI agents. Nx optimizes your builds, scales your CI, and fixes failed PRs automatically. Ship in half the time. Maintained by nrwl on GitHub, where it has earned 29,394 stars from the community.

An express.js middleware for validator.js. Maintained by express-validator on GitHub, where it has earned 6,233 stars from the community.

@express-validator3d ago

A progressive Node.js framework for building efficient, scalable, and enterprise-grade server-side applications with TypeScript/JavaScript. Maintained by nestjs on GitHub, where it has earned 76,320 stars from the community.