Jason Liu and contributors (567 Labs) · Agent frameworks & orchestration
Python library for extracting validated structured data from LLM responses using Pydantic models, with automatic retries, streaming partials and support for many providers
Prefix-style API from Jina AI that converts any public URL into LLM-ready Markdown (r.jina.ai) or returns web search results with content (s.jina.ai), with open-source server code
Keycloak project (CNCF incubating, originated at Red Hat) · Identity & access
Open-source identity and access management server providing single sign-on with OpenID Connect, OAuth 2.0 and SAML, user federation and fine-grained authorization
LangChain, Inc. · Agent frameworks & orchestration
Open-source Python and JavaScript framework whose create_agent harness builds tool-using agents on the LangGraph runtime with swappable model providers and middleware
Langfuse (part of ClickHouse, Inc. since January 2026) · Prompting, evaluation & observability
In-depth entry
Open-source LLM observability and evaluation platform: tracing, LLM-as-judge and human evals, prompt management, datasets and cost dashboards, self-hostable or as Langfuse Cloud
LangChain, Inc. · Agent frameworks & orchestration
In-depth entry
Low-level orchestration framework and runtime for stateful, long-running agents expressed as graphs, with durable execution, checkpointing, human-in-the-loop and streaming
Open-source functional programming language and interactive theorem prover with dependent types, the Mathlib mathematics library and VS Code tooling, stewarded by the Lean FRO
Open-source Python SDK and self-hosted AI gateway that calls 100+ LLM providers in the OpenAI format, with routing, fallbacks, virtual keys, budgets, spend tracking and logging callbacks
ggml-org (Georgi Gerganov and contributors) · Local LLM inference & serving
In-depth entry
C/C++ inference engine for LLMs and vision-language models with GGUF quantized weights, Metal, CUDA, Vulkan and other backends, a CLI and an OpenAI-compatible server
LlamaIndex, Inc. · Agent frameworks & orchestration
Open-source Python framework for retrieval-augmented agents over your data, with connectors, indexes, query engines and event-driven workflows, alongside the commercial LlamaParse document platform