Common Crawl
Common Crawl Foundation · Web archiving
Nonprofit open repository of petabyte-scale web crawl data since 2008, published as WARC, WAT and WET files on AWS Open Data with URL and columnar indexes
5 tools
Common Crawl Foundation · Web archiving
Nonprofit open repository of petabyte-scale web crawl data since 2008, published as WARC, WAT and WET files on AWS Open Data with URL and columnar indexes
Dask developers (open-source community) · Distributed & parallel computing
Python library for parallel and distributed computing that scales pandas, NumPy and custom task graphs from a laptop to a cluster
Databento, Inc. · Market & fundamentals data
Usage-priced market data platform with normalized order-book (MBO/MBP), trades, OHLCV and reference schemas for futures, options and equities, delivered via historical, live and batch APIs in the DBN format
FirstRate Data LLC · Market & fundamentals data
Vendor of historical intraday market data (1-minute to daily bars, tick and options) for US stocks, ETFs, futures, indices, crypto and FX, delivered as zipped CSV bundles under a perpetual licence
MinIO, Inc. · Backup & recovery
S3-compatible object storage server; the AGPL community edition was archived in April 2026 and succeeded by MinIO's AIStor Free and AIStor Enterprise editions
Page 1 of 1
Share this view: /tools?use=query-parquet-files&iface=web