4 tools
Webrecorder · Web archiving
Webrecorder's browser-based web archiving system, available hosted or self-hosted, that crawls sites with real browsers into signed WACZ files replayable with ReplayWeb.page
Apify Technologies s.r.o. · Data collection & crawling
Open-source crawling and scraping library for Node.js/TypeScript and Python that unifies HTTP and headless-browser crawlers with queues, proxies, fingerprints and storage
Microsoft · Testing & QA
Microsoft's browser automation and end-to-end testing framework driving Chromium, Firefox and WebKit from one API in TypeScript, Python, Java and .NET
Scrapy developers (maintained with Zyte) · Data collection & crawling
Mature open-source Python framework for writing crawlers (spiders) that fetch pages asynchronously, extract structured items and export them through pipelines
Page 1 of 1
Share this view: /tools?category=data-collection-crawling&exec=cloud&source=open-source