Directory

Cloud platform and marketplace for running web-scraping and automation programs (Actors), with storages, proxies, scheduling, an API and an MCP server for agents

Open-source embedding database with a minimal Python and JavaScript API, usable in-process, as a server or through Chroma Cloud

Anthropic's developer platform for the Claude models: Messages API, tool use, structured outputs, prompt caching, batch processing and Managed Agents, plus cloud availability

Enterprise-focused model provider with Command generation, Embed and Rerank retrieval models, Aya multilingual research models, the North agent platform and private or dedicated deployment options

Open-source node-based interface and inference engine for diffusion and other generative models (image, video, audio, 3D), runnable locally with desktop apps or as a hosted cloud

Hosted voice AI platform: text-to-speech and speech-to-text models, voice cloning, dubbing, music and sound effects, a voice-agent builder and a REST API with Python and TypeScript SDKs

Open-source software that pools several Apple Silicon Macs (and Linux hosts) into one local inference cluster, sharding large models across devices with MLX

Google's developer API for the Gemini model family, keyed from Google AI Studio, with function calling, Search grounding, Live API, image and video generation and a free tier

Low-latency hosted inference API for open-weight models on Groq's LPU hardware, OpenAI-compatible, with speech-to-text, text-to-speech, tool use and batch tiers

Hosting platform for open models, datasets and Spaces demo apps built on git repositories and Xet storage, with Inference Providers, Endpoints, Jobs and an open-source Python client and CLI

Open-source LLM observability and evaluation platform: tracing, LLM-as-judge and human evals, prompt management, datasets and cost dashboards, self-hostable or as Langfuse Cloud

Low-level orchestration framework and runtime for stateful, long-running agents expressed as graphs, with durable execution, checkpointing, human-in-the-loop and streaming

LangChain's hosted platform for tracing, evaluating and deploying LLM applications and agents, with prompt tooling, an LLM gateway and cloud, hybrid or self-hosted options

Open-source Python SDK and self-hosted AI gateway that calls 100+ LLM providers in the OpenAI format, with routing, fallbacks, virtual keys, budgets, spend tracking and logging callbacks

C/C++ inference engine for LLMs and vision-language models with GGUF quantized weights, Metal, CUDA, Vulkan and other backends, a CLI and an OpenAI-compatible server

Open-source Python framework for retrieval-augmented agents over your data, with connectors, indexes, query engines and event-driven workflows, alongside the commercial LlamaParse document platform

Proprietary desktop app for discovering, downloading and running local LLMs with llama.cpp and MLX engines, a chat UI, an OpenAI-compatible server, CLI, SDKs and a headless daemon

Open-source vector database from Zilliz with Lite, Standalone and Distributed deployments, many index types and GPU acceleration

French model provider offering open-weight and proprietary models through the Studio API, OCR and speech models, the Vibe agent for productivity and coding, and self-deployment options

Python package and CLI for running, serving, quantizing and fine-tuning large language models on Apple Silicon with MLX

Open JSON-RPC standard for connecting AI applications to tools, data and prompts through servers, now stewarded under the Linux Foundation with SDKs in many languages

Open-source runtime and model manager for running open-weight LLMs locally on macOS, Windows and Linux, with a REST API, OpenAI- and Anthropic-compatible endpoints and optional cloud models

OpenAI's hosted developer platform: Responses and Chat Completions APIs, Realtime voice, embeddings, images, audio, fine-tuning, evals and managed agents

Unified API gateway to hundreds of models from many providers with automatic fallbacks, credit-based pass-through billing, BYOK, free models and data-policy routing