3,719 tools found
A promptfoo example wiring a custom Python provider to OpenAI, with config values loaded from YAML, JS, and Python files.
Promptfoo example comparing QuiverAI's Arrow SVG models across text-to-SVG, image vectorization, and a GPT Image-2 pipeline, LLM-judged.
Promptfoo example testing Replicate's full range: Llama 3 text generation and Stable Diffusion XL image generation.
Promptfoo example comparing FLUX and SDXL image models on Replicate across quality, style, cost, and speed.
Minimal promptfoo scaffold for evaluating models across OpenAI and Replicate providers together.
Promptfoo example moderating content with Meta's LlamaGuard 3/4 models across 14 safety categories on Replicate.
Promptfoo example running Meta Llama 4 Scout mixture-of-experts model via Replicate, compared against Llama 3.
A minimal quickstart testing the Replicate provider in promptfoo with a fast hello-world model.
Promptfoo example building a custom Ruby provider for OpenAI and validating output with custom Ruby assertions.
Promptfoo example running a fully local, offline LLM eval with Transformers.js - no API keys required.
Promptfoo examples for TrueFoundry AI Gateway - multi-provider model comparison, MCP tool use, embeddings.
Compares IBM Granite, Meta Llama, and Mistral models available through IBM watsonx.ai in promptfoo.
