Promptfoo

CLI-first prompt testing, evaluation, and prompt management platform for LLM apps.

Overview

Promptfoo provides a developer-friendly CLI and GitHub Actions integration to run systematic evaluations against your prompts and LLM outputs. It supports red-teaming, cost tracking, and multi-model comparison out of the box, making it ideal for iterative prompt engineering without heavy platform dependencies.

Best for

• rapid prompt iteration
• CI/CD prompt regression testing
• red-teaming safety checks

Trade-offs

What XeroHack pre-wires

When you pick Promptfoo in the interview, the engine emits these files into your scaffold:

• npx promptfoo@latest init
• GitHub Actions prompt regression workflow