4,052 tools found
Two promptfoo examples for local Ollama models: comparing uncensored vs standard Llama models, and testing function calling on a small 1B model.
Promptfoo example evaluating the OpenAI Agents Python SDK end to end - multi-agent handoffs, sandboxed tools, and trace assertions.
Promptfoo example building a stateful D&D Dungeon Master agent with the OpenAI Agents SDK, evaluating tool use, rules correctness and tone with tracing.
A Promptfoo example testing OpenAI's audio-capable models on speech-to-text input and speech-to-speech output.
A promptfoo example for setting up and running OpenAI chat evaluations with included configuration files.
Promptfoo example driving OpenAI Agent Builder ChatKit workflows through Playwright browser automation, including stateful multi-turn conversations.
Promptfoo example comparing external-YAML versus inline function definitions for OpenAI function calling, side by side in one working config.
Promptfoo example comparing OpenAI's GPT Image 2, 1.5, 1 and 1 Mini side by side on quality, size and per-image cost for text-to-image generation.
Promptfoo example testing OpenAI's Responses API MCP tool integration - remote servers, auth headers, and approval workflows.
Promptfoo example for testing OpenAI's Realtime API: multi-turn voice/text conversations, function calling, and audio.
Promptfoo example set covering OpenAI's Responses API - structured output, function calling, reasoning models, MCP, and more.
Promptfoo example testing OpenAI tool/function-calling with a weather tool, validating call structure and arguments.
