Apify Technologies s.r.o. · Data collection & crawling
Open-source crawling and scraping library for Node.js/TypeScript and Python that unifies HTTP and headless-browser crawlers with queues, proxies, fingerprints and storage
Scrapy developers (maintained with Zyte) · Data collection & crawling
In-depth entry
Mature open-source Python framework for writing crawlers (spiders) that fetch pages asynchronously, extract structured items and export them through pipelines