Directory

Cloud platform and marketplace for running web-scraping and automation programs (Actors), with storages, proxies, scheduling, an API and an MCP server for agents

Nonprofit open repository of petabyte-scale web crawl data since 2008, published as WARC, WAT and WET files on AWS Open Data with URL and columnar indexes

SQL-first transformation framework that compiles templated models, tests and documentation into warehouse tables; open-source Core plus a commercial platform

Distributed search and analytics engine on Apache Lucene with full-text, aggregations, vector search and ES|QL; triple-licensed AGPL, SSPL and Elastic License

Web data API that scrapes, crawls, maps and searches websites and returns clean Markdown or structured JSON for LLM pipelines, with an AGPL-licensed self-hostable core

Dashboarding and alerting platform that visualizes metrics, logs and traces from Prometheus, SQL databases and dozens of other data sources

Prefix-style API from Jina AI that converts any public URL into LLM-ready Markdown (r.jina.ai) or returns web search results with content (s.jina.ai), with open-source server code

Rust search engine for application search-as-you-type with typo tolerance, faceting and hybrid semantic search; MIT core plus BSL enterprise parts

Self-hostable BI tool with a no-code question builder, SQL editor, dashboards and embedding; AGPL open-source edition plus commercial Pro and Enterprise

S3-compatible object storage server; the AGPL community edition was archived in April 2026 and succeeded by MinIO's AIStor Free and AIStor Enterprise editions

Oracle's widely deployed open-source relational database server, offered as a GPL community edition and commercial enterprise and cloud editions

Native property-graph database queried with Cypher, offered as a GPL community edition, a commercial enterprise edition and the AuraDB cloud service

Serverless PostgreSQL service with separated storage and compute, instant database branching and scale-to-zero, now part of Databricks

In-memory key-value data store used as cache, message broker and database, with data structures, Pub/Sub, Streams and, since Redis 8, built-in JSON, search and time-series modules

PostgreSQL extension for time-series data adding hypertables, compression and continuous aggregates, from the company now named Tiger Data

Open-source vector database in Go with pluggable vectorizer modules, hybrid BM25 and vector search, multi-tenancy and a managed cloud