Data engineering & databases

Python library for parallel and distributed computing that scales pandas, NumPy and custom task graphs from a laptop to a cluster

Search API for AI agents built on Exa's own web index, offering search, page contents, deep research and asynchronous agent endpoints with Python and JavaScript SDKs

Python library for extracting validated structured data from LLM responses using Pydantic models, with automatic retries, streaming partials and support for many providers

Prefix-style API from Jina AI that converts any public URL into LLM-ready Markdown (r.jina.ai) or returns web search results with content (s.jina.ai), with open-source server code

Self-hostable BI tool with a no-code question builder, SQL editor, dashboards and embedding; AGPL open-source edition plus commercial Pro and Enterprise

Node.js job queue that uses PostgreSQL tables and SKIP LOCKED for reliable background jobs, scheduling and retries without a separate broker

PostgreSQL extension for time-series data adding hypertables, compression and continuous aggregates, from the company now named Tiger Data

Declarative Python visualization library that compiles concise chart specifications to Vega-Lite JSON for interactive, grammar-of-graphics plots

Python workflow orchestrator for scheduling and monitoring DAGs of tasks, with hundreds of provider packages and managed offerings from several clouds

Apache-licensed BI web application with SQL Lab, a no-code chart builder, dashboards and connectors to any SQLAlchemy-compatible database

Open-source embedding database with a minimal Python and JavaScript API, usable in-process, as a server or through Chroma Cloud

TypeScript ORM with SQL-like query builder, schema defined in code, migrations through Drizzle Kit, and support for PostgreSQL, MySQL and SQLite drivers

Rust search engine for application search-as-you-type with typo tolerance, faceting and hybrid semantic search; MIT core plus BSL enterprise parts

S3-compatible object storage server; the AGPL community edition was archived in April 2026 and succeeded by MinIO's AIStor Free and AIStor Enterprise editions

Document database storing BSON documents with a rich aggregation pipeline, available as a source-available Community Server or the managed Atlas service

Native property-graph database queried with Cypher, offered as a GPL community edition, a commercial enterprise edition and the AuraDB cloud service

Lightweight Python library for declaring and validating DataFrame schemas for pandas, Polars, PySpark and other backends, with type-hint style models

Open-source message broker in Erlang supporting AMQP 0-9-1 and 1.0, MQTT, STOMP and Streams, with routing, acknowledgements and quorum queues

Redis-backed job and message queue for Node.js (with a Python port) offering workers, flows, rate limiting, repeatable jobs and a commercial Pro tier

Microsoft's business-intelligence suite: free Windows Power BI Desktop for modeling and reports, and the Power BI service in Microsoft Fabric for sharing

Foundational Python library for n-dimensional arrays, vectorized math, linear algebra, random numbers and the array API used by the scientific stack

JavaScript data notebooks and the open-source Observable Framework static-site generator for data apps, from the maintainers of D3 and Plot

Python workflow orchestration library and server where decorated functions become observable, retryable flows, with Prefect Cloud as hosted option

Distributed SQL query engine that federates queries across data lakes, warehouses and databases through connectors, formerly PrestoSQL