Self-Hosted Agent Infrastructure

Running LLM agents on hardware you control: a coding agent, the protocol that connects it to tools, frameworks for multi-step workflows, local or hosted model access through one interface, observability, and the plumbing (process supervision, reverse proxy, tunnel, secrets) that keeps it reachable and safe.

14 tools · updated Nov 2, 2026 · compare the first four

Tools in this collection

1. 1
   CC

   Claude Code

   Anthropic · Coding agents & AI IDEs

   In-depth entry

   Terminal-native coding agent that reads a repository, runs commands and edits files under instruction.

   ProprietaryPaidUsage-basedLocalNov 2, 2026
2. 2
   MC

   Model Context Protocol

   Model Context Protocol, a Series of LF Projects, LLC (originated by Anthropic) · Agent frameworks & orchestration

   In-depth entry

   Open standard for exposing tools and data to agents; servers can run locally on the same machine.

   Open sourceOpen sourceFreeLocalSelf-hostedNov 2, 2026
3. 3
   L

   LangGraph

   LangChain, Inc. · Agent frameworks & orchestration

   In-depth entry

   Graph-based orchestration for stateful, resumable agent workflows.

   MITOpen sourceFreeLocalSelf-hostedNov 2, 2026
4. 4
   PA

   Pydantic AI

   Pydantic Services Inc. · Agent frameworks & orchestration

   Typed, minimal agent framework for Python with structured outputs.

   MITOpen sourceFreeLocalSelf-hostedNov 2, 2026
5. 5
   L

   LiteLLM

   BerriAI · Prompting, evaluation & observability

   In-depth entry

   One OpenAI-compatible interface in front of hosted and local models, with budgets and keys.

   MITOpen sourceFreeLocalSelf-hostedNov 2, 2026
6. 6
   O

   Ollama

   Ollama · Local LLM inference & serving

   In-depth entry

   Local model serving for the parts of a workflow that should not leave the machine.

   MITOpen sourceFreeLocalSelf-hostedNov 2, 2026
7. 7
   V

   vLLM

   vLLM project (originated at UC Berkeley Sky Computing Lab) · Local LLM inference & serving

   In-depth entry

   High-throughput serving when a GPU server is available.

   Apache-2.0Open sourceFreeSelf-hostedNov 2, 2026
8. 8
   L

   Langfuse

   Langfuse (part of ClickHouse, Inc. since January 2026) · Prompting, evaluation & observability

   In-depth entry

   Self-hostable tracing, evaluation and cost tracking for LLM applications.

   MITOpen sourceFreemiumSelf-hostedNov 2, 2026
9. 9
   P

   promptfoo

   Promptfoo, Inc. · Prompting, evaluation & observability

   Test prompts and agents like code, in CI.

   MITOpen sourceFreeLocalSelf-hostedBroken
10. 10
    P

    PM2

    Keymetrics (Unitech) · Infrastructure & provisioning

    In-depth entry

    Keeps long-running Node processes and workers alive.

    AGPL-3.0-onlyOpen sourceFreeLocalSelf-hostedNov 2, 2026
11. 11
    C

    Caddy

    Caddy project (sponsored by ZeroSSL) · Reverse proxies & web servers

    In-depth entry

    Reverse proxy with automatic HTTPS in front of every service.

    Apache-2.0Open sourceFreeSelf-hostedNov 2, 2026
12. 12
    W

    WireGuard

    WireGuard project (Jason A. Donenfeld) · Tunneling & remote access

    In-depth entry

    The tunnel between a public gateway and private machines.

    GPL-2.0-onlyOpen sourceFreeLocalSelf-hostedNov 2, 2026
13. 13
    T

    Tailscale

    Tailscale Inc. · Tunneling & remote access

    In-depth entry

    Zero-configuration mesh networking when WireGuard by hand is too much.

    BSD-3-ClauseFreemiumPaidLocalNov 2, 2026
14. 14
    1

    1Password

    AgileBits Inc. (1Password) · Secrets management

    In-depth entry

    Secrets and API keys kept out of configuration files and prompts.

    ProprietaryPaidEnterpriseLocalNov 2, 2026