7 tools
Sebastián Ramírez (tiangolo) and FastAPI contributors · API development & tooling
Python web framework for building HTTP APIs from type-annotated functions, with automatic validation through Pydantic and generated OpenAPI documentation
BerriAI · Prompting, evaluation & observability
Open-source Python SDK and self-hosted AI gateway that calls 100+ LLM providers in the OpenAI format, with routing, fallbacks, virtual keys, budgets, spend tracking and logging callbacks
ggml-org (Georgi Gerganov and contributors) · Local LLM inference & serving
C/C++ inference engine for LLMs and vision-language models with GGUF quantized weights, Metal, CUDA, Vulkan and other backends, a CLI and an OpenAI-compatible server
Model Context Protocol, a Series of LF Projects, LLC (originated by Anthropic) · Agent frameworks & orchestration
Open JSON-RPC standard for connecting AI applications to tools, data and prompts through servers, now stewarded under the Linux Foundation with SDKs in many languages
Ollama · Local LLM inference & serving
Open-source runtime and model manager for running open-weight LLMs locally on macOS, Windows and Linux, with a REST API, OpenAI- and Anthropic-compatible endpoints and optional cloud models
Qdrant Solutions GmbH · Vector databases
Open-source vector search engine written in Rust with filterable HNSW indexes, sparse and multi-vector support, REST/gRPC APIs and a managed cloud
vLLM project (originated at UC Berkeley Sky Computing Lab) · Local LLM inference & serving
High-throughput LLM inference and serving engine with PagedAttention, continuous batching, quantization and an OpenAI-compatible server for GPU and accelerator clusters
Page 1 of 1
Share this view: /tools?tag=api&pricing=open-source&depth=deep