Open-source Python SDK and self-hosted AI gateway that calls 100+ LLM providers in the OpenAI format, with routing, fallbacks, virtual keys, budgets, spend tracking and logging callbacks
Open-source runtime and model manager for running open-weight LLMs locally on macOS, Windows and Linux, with a REST API, OpenAI- and Anthropic-compatible endpoints and optional cloud models
MITOpen sourceFreeLocalSelf-hostedNov 2, 2026
Page 1 of 1
Share this view: /tools?use=serve-models&exec=self-hosted&pricing=enterprise