Tools · SPBoucher
Menu

Directory

4 tools

Results

DSPy

Stanford NLP and the DSPy community · Prompting, evaluation & observability

Python framework for programming language-model pipelines with typed signatures and modules, then optimizing prompts and weights automatically against a metric

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

LangSmith

LangChain, Inc. · Prompting, evaluation & observability

LangChain's hosted platform for tracing, evaluating and deploying LLM applications and agents, with prompt tooling, an LLM gateway and cloud, hybrid or self-hosted options

ProprietaryFreemiumPaidSelf-hostedNov 2, 2026

LiteLLM

BerriAI · Prompting, evaluation & observability

In-depth entry

Open-source Python SDK and self-hosted AI gateway that calls 100+ LLM providers in the OpenAI format, with routing, fallbacks, virtual keys, budgets, spend tracking and logging callbacks

MITOpen sourceFreeLocalSelf-hostedNov 2, 2026

OpenRouter

OpenRouter, Inc. · Model providers & APIs

Unified API gateway to hundreds of models from many providers with automatic fallbacks, credit-based pass-through billing, BYOK, free models and data-policy routing

ProprietaryFreemiumUsage-basedBroken

Page 1 of 1

Share this view: /tools?category=llm-ops&use=build-agents