Langfuse (part of ClickHouse, Inc. since January 2026) · Prompting, evaluation & observability
In-depth entry
Open-source LLM observability and evaluation platform: tracing, LLM-as-judge and human evals, prompt management, datasets and cost dashboards, self-hostable or as Langfuse Cloud
LangChain, Inc. · Agent frameworks & orchestration
In-depth entry
Low-level orchestration framework and runtime for stateful, long-running agents expressed as graphs, with durable execution, checkpointing, human-in-the-loop and streaming
LangChain, Inc. · Prompting, evaluation & observability
LangChain's hosted platform for tracing, evaluating and deploying LLM applications and agents, with prompt tooling, an LLM gateway and cloud, hybrid or self-hosted options
LlamaIndex, Inc. · Agent frameworks & orchestration
Open-source Python framework for retrieval-augmented agents over your data, with connectors, indexes, query engines and event-driven workflows, alongside the commercial LlamaParse document platform
Element Labs, Inc. · Local LLM inference & serving
In-depth entry
Proprietary desktop app for discovering, downloading and running local LLMs with llama.cpp and MLX engines, a chat UI, an OpenAI-compatible server, CLI, SDKs and a headless daemon
Microsoft's public cloud with virtual machines, AKS, Azure Functions, Cosmos DB, Azure Database for PostgreSQL, Entra ID identity and Microsoft Foundry for hosted AI models
French model provider offering open-weight and proprietary models through the Studio API, OCR and speech models, the Vibe agent for productivity and coding, and self-deployment options
Open-source runtime and model manager for running open-weight LLMs locally on macOS, Windows and Linux, with a REST API, OpenAI- and Anthropic-compatible endpoints and optional cloud models
Lightweight open-source Python and TypeScript framework for agents, handoffs, guardrails, sessions and tracing, defaulting to OpenAI's Responses API with adapters for other providers
Unified API gateway to hundreds of models from many providers with automatic fallbacks, credit-based pass-through billing, BYOK, free models and data-policy routing
Ray project (Anyscale and contributors) · Distributed & parallel computing
In-depth entry
Open-source Python framework for distributing tasks, actors and ML workloads across a cluster, with libraries for data processing, training, tuning, serving and reinforcement learning
Scite LLC (Research Solutions) · Literature discovery & review
Citation-analysis platform whose Smart Citations show whether later papers support, contrast or merely mention a claim, with an AI assistant and reference checking
Tavily (Alpha AI Technologies Inc.) · Search & web-data APIs
In-depth entry
Web search, extraction, crawling and research API designed for LLM agents, returning concise source content with SDKs, framework integrations and a hosted MCP server
Cloud platform for open-source models: serverless and dedicated inference, fine-tuning, GPU clusters, batch jobs and code sandboxes behind an OpenAI-compatible API
Commercial terminal built in Rust that groups output into blocks, adds an IDE-style input editor and integrates AI agents for command generation and debugging
ML experiment tracking, sweeps, artifacts and model registry plus Weave for LLM tracing and evaluation, now sold by CoreWeave within its Forge platform with a free academic tier