Directory

Cloud platform and marketplace for running web-scraping and automation programs (Actors), with storages, proxies, scheduling, an API and an MCP server for agents

Nonprofit open repository of petabyte-scale web crawl data since 2008, published as WARC, WAT and WET files on AWS Open Data with URL and columnar indexes

Web data API that scrapes, crawls, maps and searches websites and returns clean Markdown or structured JSON for LLM pipelines, with an AGPL-licensed self-hostable core

Dashboarding and alerting platform that visualizes metrics, logs and traces from Prometheus, SQL databases and dozens of other data sources

Prefix-style API from Jina AI that converts any public URL into LLM-ready Markdown (r.jina.ai) or returns web search results with content (s.jina.ai), with open-source server code

Self-hostable BI tool with a no-code question builder, SQL editor, dashboards and embedding; AGPL open-source edition plus commercial Pro and Enterprise

Serverless PostgreSQL service with separated storage and compute, instant database branching and scale-to-zero, now part of Databricks

JavaScript data notebooks and the open-source Observable Framework static-site generator for data apps, from the maintainers of D3 and Plot

MIT-licensed interactive charting libraries for Python (plotly.py), JavaScript (plotly.js) and R, plus the Dash framework for analytical web apps