Directory

Python workflow orchestrator for scheduling and monitoring DAGs of tasks, with hundreds of provider packages and managed offerings from several clouds

Distributed event streaming platform with durable, partitioned, replayable logs, Kafka Connect connectors and Kafka Streams processing

Distributed data processing engine with DataFrame and SQL APIs in Python, Scala, Java and R, plus structured streaming and MLlib

Asset-oriented Python orchestrator that models pipelines as software-defined data assets with lineage, checks and a hosted Dagster+ option

SQL-first transformation framework that compiles templated models, tests and documentation into warehouse tables; open-source Core plus a commercial platform

Python workflow orchestration library and server where decorated functions become observable, retryable flows, with Prefect Cloud as hosted option