Helicone

API gateway and observability layer for LLMs with caching, cost tracking, and prompt analytics.

Overview

Helicone sits between your app and LLM providers, automatically logging requests, responses, latency, and costs. It provides a real-time dashboard, request caching to cut expenses, and a playground to compare model performance across prompts.

Best for

• cost monitoring
• API proxy logging
• model A/B testing

Trade-offs

What XeroHack pre-wires

When you pick Helicone in the interview, the engine emits these files into your scaffold:

• reverse proxy setup
• token usage dashboards
• prompt caching rules