Multi-step prompt sequences for complex AI workflows.
99 tools found
Route promptfoo eval traffic through a self-hosted Helicone AI Gateway for unified, load-balanced multi-provider access.
Compare LangChain LCEL chains against LLM providers using Promptfoo to validate prompt pipelines and output parsers before production.
Built-in OpenTelemetry tracing for promptfoo LLM evaluations, capturing GenAI semantic conventions and provider spans across OpenAI, Anthropic, Azure OpenAI
Import AI evaluation test cases from SharePoint CSV files using Azure AD certificate authentication for enterprise test management.
A Promptfoo example collecting human feedback via Slack to compare against AI responses, using Promptfoo's slack provider.
Compare OpenAI and Azure OpenAI side-by-side to benchmark speed, cost, and output quality differences using identical models.
Configures CometAPI's OpenAI-compatible interface in promptfoo to access multiple language models.
Promptfoo example for writing a custom Python provider that calls OpenAI, with config loaded from external files.
Promptfoo example comparing QuiverAI's Arrow SVG models across text-to-SVG, image vectorization, and a GPT Image-2 pipeline, LLM-judged.
Promptfoo example building a custom Ruby provider for OpenAI and validating output with custom Ruby assertions.
Promptfoo examples for TrueFoundry AI Gateway - multi-provider model comparison, MCP tool use, embeddings.
A cookbook guide to building a GPT-5.1 coding agent with the Agents SDK that scaffolds, edits, and iterates on a codebase.
