Directory

Distributed data processing engine with DataFrame and SQL APIs in Python, Scala, Java and R, plus structured streaming and MLlib

Open-source embedding database with a minimal Python and JavaScript API, usable in-process, as a server or through Chroma Cloud

Open-source node-based interface and inference engine for diffusion and other generative models (image, video, audio, 3D), runnable locally with desktop apps or as a hosted cloud

Open-source crawling and scraping library for Node.js/TypeScript and Python that unifies HTTP and headless-browser crawlers with queues, proxies, fingerprints and storage

Open-source Python framework for role-based multi-agent crews and event-driven flows, with a commercial enterprise console for deploying, monitoring and triggering automations

Asset-oriented Python orchestrator that models pipelines as software-defined data assets with lineage, checks and a hosted Dagster+ option

Python library for parallel and distributed computing that scales pandas, NumPy and custom task graphs from a laptop to a cluster

SQL-first transformation framework that compiles templated models, tests and documentation into warehouse tables; open-source Core plus a commercial platform

Python web framework for building HTTP APIs from type-annotated functions, with automatic validation through Pydantic and generated OpenAPI documentation

Programmatic trading and market-data access to Interactive Brokers accounts through the TWS API, the REST-based Web API and FIX

Python library for NumPy-style array computing with composable transformations (jit, grad, vmap, shard_map) compiled through XLA to CPU, GPU and TPU

Open-source Python and JavaScript framework whose create_agent harness builds tool-using agents on the LangGraph runtime with swappable model providers and middleware

Low-level orchestration framework and runtime for stateful, long-running agents expressed as graphs, with durable execution, checkpointing, human-in-the-loop and streaming

Open-source Python framework for retrieval-augmented agents over your data, with connectors, indexes, query engines and event-driven workflows, alongside the commercial LlamaParse document platform

Reactive Python notebook stored as a plain .py file that re-runs dependent cells automatically and doubles as a script or web app

Python static site generator for project documentation that builds a navigable site from Markdown files and a single YAML configuration

Lightweight open-source Python and TypeScript framework for agents, handoffs, guardrails, sessions and tracing, defaulting to OpenAI's Responses API with adapters for other providers

Microsoft's browser automation and end-to-end testing framework driving Chromium, Firefox and WebKit from one API in TypeScript, Python, Java and .NET

Rust-based DataFrame library with Python, Rust, Node and R bindings offering lazy query optimization, multithreading and Arrow-native memory

Python workflow orchestration library and server where decorated functions become observable, retryable flows, with Prefect Cloud as hosted option

Open-source computational notebook ecosystem: the .ipynb format, kernels for Python, R and Julia, JupyterLab and Notebook interfaces and JupyterHub

Python testing framework with plain assert statements, fixtures, parametrization and a large plugin ecosystem, the de facto standard for Python test suites

General-purpose, dynamically typed programming language with a large standard library and the dominant ecosystem for data science and machine learning

Open-source deep-learning framework with eager tensors, autograd, torch.compile and distributed training, governed by the PyTorch Foundation and the base of most LLM tooling