DSPy
Stanford NLP and the DSPy community · Prompting, evaluation & observability
Python framework for programming language-model pipelines with typed signatures and modules, then optimizing prompts and weights automatically against a metric
3 tools
Stanford NLP and the DSPy community · Prompting, evaluation & observability
Python framework for programming language-model pipelines with typed signatures and modules, then optimizing prompts and weights automatically against a metric
Langfuse (part of ClickHouse, Inc. since January 2026) · Prompting, evaluation & observability
Open-source LLM observability and evaluation platform: tracing, LLM-as-judge and human evals, prompt management, datasets and cost dashboards, self-hostable or as Langfuse Cloud
Pydantic Services Inc. · Agent frameworks & orchestration
Type-safe Python agent framework from the Pydantic team with validated structured outputs, dependency injection, swappable model providers, MCP, durable execution and evals
Page 1 of 1
Share this view: /tools?use=evaluate-llm-apps&exec=self-hosted&source=open-source