Directory

Language-independent columnar in-memory format and libraries that let DuckDB, Polars, pandas, Spark and databases exchange tables without copying

Distributed event streaming platform with durable, partitioned, replayable logs, Kafka Connect connectors and Kafka Streams processing

Cloud platform and marketplace for running web-scraping and automation programs (Actors), with storages, proxies, scheduling, an API and an MCP server for agents

Web data platform combining residential, datacenter and ISP proxy networks with unblocking, SERP and scraper APIs, remote browsers, ready-made datasets and an MCP server

Open-source columnar OLAP database server for fast aggregations over billions of rows, with MergeTree storage, SQL and a managed ClickHouse Cloud

In-process analytical SQL database that queries Parquet, CSV and Arrow data directly from Python, R, Node or the CLI

Distributed search and analytics engine on Apache Lucene with full-text, aggregations, vector search and ES|QL; triple-licensed AGPL, SSPL and Elastic License

Search API for AI agents built on Exa's own web index, offering search, page contents, deep research and asynchronous agent endpoints with Python and JavaScript SDKs

Web data API that scrapes, crawls, maps and searches websites and returns clean Markdown or structured JSON for LLM pipelines, with an AGPL-licensed self-hostable core

Rust search engine for application search-as-you-type with typo tolerance, faceting and hybrid semantic search; MIT core plus BSL enterprise parts

Open-source vector database from Zilliz with Lite, Standalone and Distributed deployments, many index types and GPU acceleration

Serverless PostgreSQL service with separated storage and compute, instant database branching and scale-to-zero, now part of Databricks

Apache-2.0 search and analytics suite forked from Elasticsearch and Kibana, governed by the OpenSearch Software Foundation

Fully managed, proprietary vector database service with serverless indexes, namespaces, metadata filtering and integrated embedding and reranking

Microsoft's browser automation and end-to-end testing framework driving Chromium, Firefox and WebKit from one API in TypeScript, Python, Java and .NET

Rust-based DataFrame library with Python, Rust, Node and R bindings offering lazy query optimization, multithreading and Arrow-native memory

Open-source vector search engine written in Rust with filterable HNSW indexes, sparse and multi-vector support, REST/gRPC APIs and a managed cloud

Web scraping API with anti-bot bypass, JavaScript rendering, cloud browsers, screenshots, AI extraction and a crawler, billed in credits per request

API that returns live search-engine result pages from Google and other engines as structured JSON, with localization, device and search-type parameters

Open-source backend platform built around a dedicated PostgreSQL database with auto-generated APIs, authentication, file storage, realtime subscriptions and edge functions

Web search, extraction, crawling and research API designed for LLM agents, returning concise source content with SDKs, framework integrations and a hosted MCP server

GPL-licensed in-memory search engine in C++ offering typo-tolerant instant search, faceting, vector and hybrid search, with Typesense Cloud hosting

Open-source vector database in Go with pluggable vectorizer modules, hybrid BM25 and vector search, multi-tenancy and a managed cloud

Web-data company behind Scrapy offering Zyte API for ban-resistant fetching, browser rendering and automatic extraction, plus Scrapy Cloud for hosting spiders