Apache DataFusion
Apache Software Foundation · Analytical engines & OLAP
Extensible Rust query engine built on Apache Arrow offering SQL and DataFrame APIs, Parquet readers and an optimizer for embedding in data systems
6 tools
Apache Software Foundation · Analytical engines & OLAP
Extensible Rust query engine built on Apache Arrow offering SQL and DataFrame APIs, Parquet readers and an optimizer for embedding in data systems
Apache Software Foundation · Data catalogs & formats
Open table format for data lakes that adds ACID snapshots, schema and partition evolution and time travel over Parquet, ORC or Avro files
Apache Software Foundation · Analytical engines & OLAP
Distributed data processing engine with DataFrame and SQL APIs in Python, Scala, Java and R, plus structured streaming and MLlib
Dask developers (open-source community) · Distributed & parallel computing
Python library for parallel and distributed computing that scales pandas, NumPy and custom task graphs from a laptop to a cluster
Delta Lake project (Linux Foundation; created by Databricks) · Data catalogs & formats
Open table format with a transaction log over Parquet files, created by Databricks and hosted by the Linux Foundation, with Spark, Rust and Python implementations
Trino Software Foundation · Analytical engines & OLAP
Distributed SQL query engine that federates queries across data lakes, warehouses and databases through connectors, formerly PrestoSQL
Page 1 of 1
Share this view: /tools?use=query-parquet-files&iface=library&depth=standard