4,026 tools found
A Promptfoo example collecting human feedback via Slack to compare against AI responses, using Promptfoo's slack provider.
Evaluate Strands Agents SDK workflows with promptfoo using custom tools, multi-provider support, and assertion-based testing for AI agent responses.
A promptfoo example testing conversational AI agents via OpenAI's Responses API against 31 simulated airline-booking personas.
Benchmark workflow comparing OpenAI and Azure OpenAI using GPT-5-mini to measure speed, cost, and output differences between the two services.
Promptfoo example evaluating Cerebras's fast inference API - model comparison, JSON schema structured output, and function-calling tool use.
Bare promptfoo scaffold for benchmarking Cohere models - init/eval/view flow ready for your own test cases and assertions.
Promptfoo example accessing models through CometAPI's unified OpenAI-compatible interface, using gpt-5-mini on geography questions.
Custom JavaScript provider example for promptfoo that demonstrates how to build and test custom API providers using .mjs modules with CSV test cases.
A TypeScript custom API provider example for promptfoo that demonstrates how to build and test custom providers with CSV test cases and prompt evaluation
A Promptfoo example testing Databricks Foundation Model APIs, with text generation, cost tracking, and a vision-model config variant.
Promptfoo example comparing fal.ai image-generation models side by side across 7 creative prompts with fixed seeds for reproducibility.
Example demonstrating how to build custom Go-based providers for promptfoo, with two implementations sharing OpenAI client code and side-by-side comparison.
