Multi-step prompt sequences for complex AI workflows.
99 tools found
Promptfoo starting point for comparing Claude and GPT models side by side on your own test cases.
A promptfoo workflow that evaluates GPT-4o model behavior across different temperature settings.
Promptfoo example that compares OpenAI GPT-5.4, Anthropic Claude Sonnet 4.6, and Google Gemini 3.1 Pro Preview on riddle-solving tasks with cost, latency, and
A promptfoo workflow that benchmarks Llama and GPT models side-by-side by running identical prompts through both APIs and comparing their outputs.
A Promptfoo example comparing GPT-5.4 against GPT-5.4 Mini on riddles and reasoning tasks, checking cost, latency, and answer quality.
Dynamically generate prompt test variables at runtime using JavaScript or Python scripts that access test context.
A promptfoo example wiring OpenAI's streaming API into an HTTP provider - and showing why promptfoo itself doesn't recommend streaming for evals.
Promptfoo example testing the conversation-relevance assertion, which catches a chatbot drifting off-topic mid-conversation.
Promptfoo max-score assertion for objective, weighted output selection - deterministic, no extra LLM calls.
Verify LLM outputs against real-time web search results using promptfoo's search-rubric assertion.
A promptfoo example that demonstrates how to have an LLM grade its own output according to predefined expectations, with configuration via YAML or CSV test
Automatically detect and classify hate speech in text using Hugging Face models to moderate content and protect online communities.
