Common Crawl
Common Crawl Foundation · Web archiving
Nonprofit open repository of petabyte-scale web crawl data since 2008, published as WARC, WAT and WET files on AWS Open Data with URL and columnar indexes
4 tools
Common Crawl Foundation · Web archiving
Nonprofit open repository of petabyte-scale web crawl data since 2008, published as WARC, WAT and WET files on AWS Open Data with URL and columnar indexes
Dask developers (open-source community) · Distributed & parallel computing
Python library for parallel and distributed computing that scales pandas, NumPy and custom task graphs from a laptop to a cluster
Databento, Inc. · Market & fundamentals data
Usage-priced market data platform with normalized order-book (MBO/MBP), trades, OHLCV and reference schemas for futures, options and equities, delivered via historical, live and batch APIs in the DBN format
FirstRate Data LLC · Market & fundamentals data
Vendor of historical intraday market data (1-minute to daily bars, tick and options) for US stocks, ETFs, futures, indices, crypto and FX, delivered as zipped CSV bundles under a perpetual licence
Page 1 of 1
Share this view: /tools?use=query-parquet-files&exec=cloud&iface=web