Directory

Python workflow orchestrator for scheduling and monitoring DAGs of tasks, with hundreds of provider packages and managed offerings from several clouds

Open table format for data lakes that adds ACID snapshots, schema and partition evolution and time travel over Parquet, ORC or Avro files

Distributed event streaming platform with durable, partitioned, replayable logs, Kafka Connect connectors and Kafka Streams processing

Distributed data processing engine with DataFrame and SQL APIs in Python, Scala, Java and R, plus structured streaming and MLlib

Apache-licensed BI web application with SQL Lab, a no-code chart builder, dashboards and connectors to any SQLAlchemy-compatible database

Self-hosted, open-source web archiving tool that saves URLs as HTML, PDF, screenshot, WARC, readable text and media snapshots with a web UI and CLI

Webrecorder's browser-based web archiving system, available hosted or self-hosted, that crawls sites with real browsers into signed WACZ files replayable with ReplayWeb.page

Open-source embedding database with a minimal Python and JavaScript API, usable in-process, as a server or through Chroma Cloud

Open-source columnar OLAP database server for fast aggregations over billions of rows, with MergeTree storage, SQL and a managed ClickHouse Cloud

Asset-oriented Python orchestrator that models pipelines as software-defined data assets with lineage, checks and a hosted Dagster+ option

Open-source vector database from Zilliz with Lite, Standalone and Distributed deployments, many index types and GPU acceleration

Lightweight Go messaging system with core pub/sub and request-reply plus JetStream persistence, key-value and object stores; a CNCF project

Apache-2.0 search and analytics suite forked from Elasticsearch and Kibana, governed by the OpenSearch Software Foundation

PostgreSQL extension adding vector types, distance operators and HNSW/IVFFlat indexes for similarity search inside the database

Open-source object-relational database server with a large extension ecosystem (PostGIS, pgvector, TimescaleDB) and broad SQL coverage

Python workflow orchestration library and server where decorated functions become observable, retryable flows, with Prefect Cloud as hosted option

Open-source vector search engine written in Rust with filterable HNSW indexes, sparse and multi-vector support, REST/gRPC APIs and a managed cloud

Open-source message broker in Erlang supporting AMQP 0-9-1 and 1.0, MQTT, STOMP and Streams, with routing, acknowledgements and quorum queues

Open-source backend platform built around a dedicated PostgreSQL database with auto-generated APIs, authentication, file storage, realtime subscriptions and edge functions

Distributed SQL query engine that federates queries across data lakes, warehouses and databases through connectors, formerly PrestoSQL

GPL-licensed in-memory search engine in C++ offering typo-tolerant instant search, faceting, vector and hybrid search, with Typesense Cloud hosting