3,603 tools found
A promptfoo example comparing OpenAI's Sora-2 and Sora-2 Pro video generation models.
A promptfoo example asserting on OpenTelemetry trace spans - counts, durations, and error rates for a RAG agent.
A Promptfoo example tracing a Python LLM provider's internals via OpenTelemetry, exporting spans in protobuf format for span-level eval assertions.
Compare DeepSeek R1, GPT-4.1 Mini, and Claude 4 Sonnet on joke-telling using the AI/ML API provider in promptfoo.
Automatically probe OpenAI's DALL-E for jailbreaks using promptfoo's iterative red-team retry loop.
Run a CSV-based eval and an automated red team against DeepSeek R1 0528 via OpenRouter using promptfoo.
A promptfoo example testing both text (Llama 4 Scout) and image (SDXL) generation through the Replicate provider.
Promptfoo config comparing five FLUX and Stable Diffusion XL image models on Replicate across eight photography and art genres.
A promptfoo example comparing GPT-4.1-mini against Llama 2 70B Chat via Replicate's OpenAI-compatible Lifeboat proxy.
A promptfoo example moderating GPT-5-mini output with LlamaGuard 3 and 4 via Replicate, including category-specific checks.
A promptfoo evaluation of Replicate-hosted Llama 4 Scout (17B, mixture-of-experts) against Llama 3 8B across seven topics.
Drive promptfoo test cases from CSV or Excel files, including JSON style fields for translation prompts.
