Tools · SPBoucher
Menu

Directory

6 tools

Results

Braintrust

Braintrust Data, Inc. · Prompting, evaluation & observability

Hosted observability and evaluation platform for AI agents with tracing, experiments, pattern detection, a CLI, MCP access and an AI assistant (Loop) that analyzes traces and builds evals

MixedFreemiumPaidNov 2, 2026

LangSmith

LangChain, Inc. · Prompting, evaluation & observability

LangChain's hosted platform for tracing, evaluating and deploying LLM applications and agents, with prompt tooling, an LLM gateway and cloud, hybrid or self-hosted options

ProprietaryFreemiumPaidSelf-hostedNov 2, 2026

OpenSearch

OpenSearch Software Foundation (Linux Foundation) · Vector databases

Apache-2.0 search and analytics suite forked from Elasticsearch and Kibana, governed by the OpenSearch Software Foundation

Apache-2.0Open sourceFreeSelf-hostedBroken

Prometheus

Prometheus Authors / Cloud Native Computing Foundation · Monitoring & observability

Pull-based metrics monitoring system and time-series database with the PromQL query language, service discovery and the Alertmanager component

Apache-2.0Open sourceFreeSelf-hostedBroken

Uptime Kuma

Louis Lam (open-source project) · Monitoring & observability

Self-hosted uptime monitor with HTTP, TCP, DNS, ping and keyword checks, many notification channels and public status pages

MITOpen sourceFreeSelf-hostedBroken

Weights & Biases

CoreWeave · Training & fine-tuning

ML experiment tracking, sweeps, artifacts and model registry plus Weave for LLM tracing and evaluation, now sold by CoreWeave within its Forge platform with a free academic tier

MITFreemiumPaidSelf-hostedBroken

Page 1 of 1

Share this view: /tools?tag=monitoring&iface=web&depth=standard