Scrapy
Scrapy developers (maintained with Zyte) · Data collection & crawling
Mature open-source Python framework for writing crawlers (spiders) that fetch pages asynchronously, extract structured items and export them through pipelines
BSD-3-ClauseOpen sourceFreeLocalSelf-hostedNov 2, 2026