Apache Arrow
Apache Software Foundation · Data catalogs & formats
Language-independent columnar in-memory format and libraries that let DuckDB, Polars, pandas, Spark and databases exchange tables without copying
9 tools
Apache Software Foundation · Data catalogs & formats
Language-independent columnar in-memory format and libraries that let DuckDB, Polars, pandas, Spark and databases exchange tables without copying
Apache Software Foundation · Analytical engines & OLAP
Extensible Rust query engine built on Apache Arrow offering SQL and DataFrame APIs, Parquet readers and an optimizer for embedding in data systems
Apache Software Foundation · Analytical engines & OLAP
Distributed data processing engine with DataFrame and SQL APIs in Python, Scala, Java and R, plus structured streaming and MLlib
ClickHouse, Inc. · Analytical engines & OLAP
Open-source columnar OLAP database server for fast aggregations over billions of rows, with MergeTree storage, SQL and a managed ClickHouse Cloud
Dask developers (open-source community) · Distributed & parallel computing
Python library for parallel and distributed computing that scales pandas, NumPy and custom task graphs from a laptop to a cluster
DuckDB Foundation / DuckDB Labs · Analytical engines & OLAP
In-process analytical SQL database that queries Parquet, CSV and Arrow data directly from Python, R, Node or the CLI
GeoPandas developers (NumFOCUS affiliated) · GIS & mapping
Python library extending pandas with geometry columns, spatial operations, reprojection, spatial joins and file I/O for vector geodata
Polars (Ritchie Vink and contributors) · DataFrames & array computing
Rust-based DataFrame library with Python, Rust, Node and R bindings offering lazy query optimization, multithreading and Arrow-native memory
Trino Software Foundation · Analytical engines & OLAP
Distributed SQL query engine that federates queries across data lakes, warehouses and databases through connectors, formerly PrestoSQL
Page 1 of 1
Share this view: /tools?tag=parquet&os=macos&source=open-source