arXiv (independent non-profit, formerly hosted by Cornell University) · Research dissemination
Free, moderated open-access preprint server for physics, mathematics, computer science, statistics, quantitative finance, economics and related fields, with an open API and bulk access
Web data platform combining residential, datacenter and ISP proxy networks with unblocking, SERP and scraper APIs, remote browsers, ready-made datasets and an MCP server
Membership organization that registers DOIs for scholarly content and exposes the metadata through a free public REST API, content negotiation and the paid Metadata Plus service
Search API for AI agents built on Exa's own web index, offering search, page contents, deep research and asynchronous agent endpoints with Python and JavaScript SDKs
Firecrawl (formerly Mendable) · Data collection & crawling
In-depth entry
Web data API that scrapes, crawls, maps and searches websites and returns clean Markdown or structured JSON for LLM pipelines, with an AGPL-licensed self-hostable core
Prefix-style API from Jina AI that converts any public URL into LLM-ready Markdown (r.jina.ai) or returns web search results with content (s.jina.ai), with open-source server code
API that returns live search-engine result pages from Google and other engines as structured JSON, with localization, device and search-type parameters
Tavily (Alpha AI Technologies Inc.) · Search & web-data APIs
In-depth entry
Web search, extraction, crawling and research API designed for LLM agents, returning concise source content with SDKs, framework integrations and a hosted MCP server
ProprietaryFreemiumUsage-basedNov 2, 2026
Page 1 of 1
Share this view: /tools?use=search-the-web-programmatically&os=web