LangWatch

Open-source LLM observability and evaluation platform with built-in fine-tuning support.

Overview

LangWatch offers end-to-end tracing, automated evaluations, and dataset management for LLM apps, all self-hostable or available as a cloud tier. It includes a built-in playground and supports structured logging for complex agent workflows and tool executions.

Best for

• Privacy-first observability
• Self-hosted eval pipelines
• Agent workflow debugging

Trade-offs

What XeroHack pre-wires

When you pick LangWatch in the interview, the engine emits these files into your scaffold:

• langwatch.init()
• OpenTelemetry instrumentation
• Self-hosted Docker setup