Model gateways

LiteLLM

Open-source SDK to call 100+ LLM APIs with OpenAI-compatible format.

Overview

LiteLLM is the de facto open-source gateway for routing requests to any model provider, self-hosted or managed. It offers cost tracking, load balancing, and fallbacks, making it essential for hackathon teams that want to switch models or run local backends without rewriting code.

Best for

Teams running local models or mixing providers
Cost control and fallback strategies during demos
Hackathons wanting zero vendor lock-in on the model layer

Trade-offs

vs OpenRouter

LiteLLM for self-hosted control and local model support; OpenRouter for managed simplicity and single-API access to many models.

What XeroHack pre-wires

When you pick LiteLLM in the interview, the engine emits these files into your scaffold:

LiteLLM proxy config
Model fallback chains
Cost logging middleware

Coupon

No active coupon for this tool right now. Sign in to be notified when one is available.