Common Crawl
Common Crawl Foundation · Web archiving
Nonprofit open repository of petabyte-scale web crawl data since 2008, published as WARC, WAT and WET files on AWS Open Data with URL and columnar indexes
MixedFreeNov 2, 2026
Directory
3 tools
Results
Dask
Dask developers (open-source community) · Distributed & parallel computing
Python library for parallel and distributed computing that scales pandas, NumPy and custom task graphs from a laptop to a cluster
BSD-3-ClauseOpen sourceFreeLocalSelf-hostedNov 2, 2026
Databento
Databento, Inc. · Market & fundamentals data
Usage-priced market data platform with normalized order-book (MBO/MBP), trades, OHLCV and reference schemas for futures, options and equities, delivered via historical, live and batch APIs in the DBN format
MixedUsage-basedPaidNov 2, 2026
Page 1 of 1
Share this view: /tools?tag=parquet&iface=web