Test prompt configurations with inline YAML examples

Simple Test is a promptfoo example configuration that demonstrates how to set up and run prompt evaluation tests using YAML with inline test definitions. It provides a working template for testing AI prompts with the flexibility to switch between inline YAML tests and external CSV test files.

Use Simple Test when you're learning promptfoo's testing capabilities and need a minimal working example to understand the basic configuration structure. Use it as a starting point before building more complex evaluation workflows.

This is a learning example that demonstrates basic configuration structure with inline tests and CSV test input alternatives.

You provide a YAML configuration file with inline test definitions or reference an external CSV file containing test cases. The configuration specifies the prompts to evaluate and the test scenarios to run against them.

You receive test execution results from promptfoo's evaluation engine, showing how your prompts perform against the defined test cases.

Initialize the example in your local environment:

npx promptfoo@latest init --example simple-test
cd simple-test

Run the test suite with the default inline YAML tests:

promptfoo eval

Alternatively, switch to CSV-based test input by editing the configuration to set tests: tests.csv, then run:

promptfoo eval --tests tests.csv

Simple Test is designed for those who are new to promptfoo and want to understand the fundamentals of prompt testing. It provides an entry point for learning the basic configuration structure.