Apache Arrow
Apache Software Foundation · Data catalogs & formats
Language-independent columnar in-memory format and libraries that let DuckDB, Polars, pandas, Spark and databases exchange tables without copying
Catalogs, table formats and metadata management.
5 tools
Filter in directory →Apache Software Foundation · Data catalogs & formats
Language-independent columnar in-memory format and libraries that let DuckDB, Polars, pandas, Spark and databases exchange tables without copying
Apache Software Foundation · Data catalogs & formats
Open columnar file format for analytical data with compression, encodings and statistics, readable by nearly every data engine and library
Delta Lake project (Linux Foundation; created by Databricks) · Data catalogs & formats
Open table format with a transaction log over Parquet files, created by Databricks and hosted by the Linux Foundation, with Spark, Rust and Python implementations
Apache Software Foundation · Data catalogs & formats
Open table format for data lakes that adds ACID snapshots, schema and partition evolution and time travel over Parquet, ORC or Avro files
MinIO, Inc. · Backup & recovery
S3-compatible object storage server; the AGPL community edition was archived in April 2026 and succeeded by MinIO's AIStor Free and AIStor Enterprise editions