Apache Arrow
Apache Software Foundation · Data catalogs & formats
Language-independent columnar in-memory format and libraries that let DuckDB, Polars, pandas, Spark and databases exchange tables without copying
11 tools
Apache Software Foundation · Data catalogs & formats
Language-independent columnar in-memory format and libraries that let DuckDB, Polars, pandas, Spark and databases exchange tables without copying
Apache Software Foundation · Messaging & queues
Distributed event streaming platform with durable, partitioned, replayable logs, Kafka Connect connectors and Kafka Streams processing
ClickHouse, Inc. · Analytical engines & OLAP
Open-source columnar OLAP database server for fast aggregations over billions of rows, with MergeTree storage, SQL and a managed ClickHouse Cloud
DuckDB Foundation / DuckDB Labs · Analytical engines & OLAP
In-process analytical SQL database that queries Parquet, CSV and Arrow data directly from Python, R, Node or the CLI
Zilliz / LF AI & Data Foundation · Vector databases
Open-source vector database from Zilliz with Lite, Standalone and Distributed deployments, many index types and GPU acceleration
OpenSearch Software Foundation (Linux Foundation) · Vector databases
Apache-2.0 search and analytics suite forked from Elasticsearch and Kibana, governed by the OpenSearch Software Foundation
Microsoft · Testing & QA
Microsoft's browser automation and end-to-end testing framework driving Chromium, Firefox and WebKit from one API in TypeScript, Python, Java and .NET
Polars (Ritchie Vink and contributors) · DataFrames & array computing
Rust-based DataFrame library with Python, Rust, Node and R bindings offering lazy query optimization, multithreading and Arrow-native memory
Qdrant Solutions GmbH · Vector databases
Open-source vector search engine written in Rust with filterable HNSW indexes, sparse and multi-vector support, REST/gRPC APIs and a managed cloud
Supabase Inc. · Relational databases
Open-source backend platform built around a dedicated PostgreSQL database with auto-generated APIs, authentication, file storage, realtime subscriptions and edge functions
Typesense, Inc. · Vector databases
GPL-licensed in-memory search engine in C++ offering typo-tolerant instant search, faceting, vector and hybrid search, with Typesense Cloud hosting
Page 1 of 1
Share this view: /tools?category=data&iface=sdk&source=open-source