Directory

Open table format for data lakes that adds ACID snapshots, schema and partition evolution and time travel over Parquet, ORC or Avro files

Distributed data processing engine with DataFrame and SQL APIs in Python, Scala, Java and R, plus structured streaming and MLlib

Open-source columnar OLAP database server for fast aggregations over billions of rows, with MergeTree storage, SQL and a managed ClickHouse Cloud

Python library for parallel and distributed computing that scales pandas, NumPy and custom task graphs from a laptop to a cluster

Open table format with a transaction log over Parquet files, created by Databricks and hosted by the Linux Foundation, with Spark, Rust and Python implementations

In-process analytical SQL database that queries Parquet, CSV and Arrow data directly from Python, R, Node or the CLI

S3-compatible object storage server; the AGPL community edition was archived in April 2026 and succeeded by MinIO's AIStor Free and AIStor Enterprise editions

General-purpose, dynamically typed programming language with a large standard library and the dominant ecosystem for data science and machine learning

Distributed SQL query engine that federates queries across data lakes, warehouses and databases through connectors, formerly PrestoSQL