Directory

Cloud platform and marketplace for running web-scraping and automation programs (Actors), with storages, proxies, scheduling, an API and an MCP server for agents

Nonprofit open repository of petabyte-scale web crawl data since 2008, published as WARC, WAT and WET files on AWS Open Data with URL and columnar indexes

SQL-first transformation framework that compiles templated models, tests and documentation into warehouse tables; open-source Core plus a commercial platform

Distributed search and analytics engine on Apache Lucene with full-text, aggregations, vector search and ES|QL; triple-licensed AGPL, SSPL and Elastic License

Web data API that scrapes, crawls, maps and searches websites and returns clean Markdown or structured JSON for LLM pipelines, with an AGPL-licensed self-hostable core

Dashboarding and alerting platform that visualizes metrics, logs and traces from Prometheus, SQL databases and dozens of other data sources

Prefix-style API from Jina AI that converts any public URL into LLM-ready Markdown (r.jina.ai) or returns web search results with content (s.jina.ai), with open-source server code

Rust search engine for application search-as-you-type with typo tolerance, faceting and hybrid semantic search; MIT core plus BSL enterprise parts

Self-hostable BI tool with a no-code question builder, SQL editor, dashboards and embedding; AGPL open-source edition plus commercial Pro and Enterprise

S3-compatible object storage server; the AGPL community edition was archived in April 2026 and succeeded by MinIO's AIStor Free and AIStor Enterprise editions

Native property-graph database queried with Cypher, offered as a GPL community edition, a commercial enterprise edition and the AuraDB cloud service

Serverless PostgreSQL service with separated storage and compute, instant database branching and scale-to-zero, now part of Databricks

JavaScript data notebooks and the open-source Observable Framework static-site generator for data apps, from the maintainers of D3 and Plot