Common Crawl
Common Crawl Foundation · Web archiving
Nonprofit open repository of petabyte-scale web crawl data since 2008, published as WARC, WAT and WET files on AWS Open Data with URL and columnar indexes
MixedFreeNov 2, 2026
Directory
3 tools
Results
Dask
Dask developers (open-source community) · Distributed & parallel computing
Python library for parallel and distributed computing that scales pandas, NumPy and custom task graphs from a laptop to a cluster
BSD-3-ClauseOpen sourceFreeLocalSelf-hostedNov 2, 2026
MinIO (AIStor)
MinIO, Inc. · Backup & recovery
S3-compatible object storage server; the AGPL community edition was archived in April 2026 and succeeded by MinIO's AIStor Free and AIStor Enterprise editions
MixedFreeEnterpriseSelf-hostedRenamedBroken
Page 1 of 1
Share this view: /tools?use=query-parquet-files&iface=web&pricing=free