Common Crawl
Common Crawl Foundation · Web archiving
Nonprofit open repository of petabyte-scale web crawl data since 2008, published as WARC, WAT and WET files on AWS Open Data with URL and columnar indexes
MixedFreeNov 2, 2026
Directory
2 tools
Results
Dask
Dask developers (open-source community) · Distributed & parallel computing
Python library for parallel and distributed computing that scales pandas, NumPy and custom task graphs from a laptop to a cluster
BSD-3-ClauseOpen sourceFreeLocalSelf-hostedNov 2, 2026
Page 1 of 1
Share this view: /tools?tag=parquet&iface=web&pricing=free