Test Driven PROMPT Engineering: Using Promptfoo to COMPARE Prompts, LLMs, and Providers.
Express desired model behaviour as explicit test cases and output assertions. Offline evaluation is not a per-item runtime guard; recording-era cost/latency ratios are not general claims.
About this selection
T03-L03: See file-based Promptfoo cases, assertions and uncached comparisons. The 2023 demonstration compares two OpenAI model configurations; follow the book's pinned setup, critical-case rules and human review. Its small cost and speed examples are historical, not production guarantees. T05-L02: See how explicit test cases and assertions make model outputs checkable. This developer-oriented Promptfoo example evaluates outputs offline; keep the book's runtime checks on every item. Its cost and speed comparisons are historical examples. T16-L03: See repeatable cases and explicit assertions turn model comparisons into checks you can rerun. This optional technical illustration does not require replacing the book's spreadsheet with Promptfoo; cost and speed ratios are historical.
Linked by topic; a curriculum association does not certify the full video. Check the source date and compare technical instructions with current official documentation.