1,210 tools found
A promptfoo RAG eval example that intentionally includes unsupported facts to show both passing and failing metrics.
An example evaluating CrewAI multi-agent performance with Promptfoo, including a note on real-LLM output reliability.
Test AI-generated code safely in isolated Docker sandboxes before deployment, validating outputs in controlled environments.
Compare LangChain LCEL chains against LLM providers using Promptfoo to validate prompt pipelines and output parsers before production.
Promptfoo example for Langfuse prompt management with labels: deploy, A/B test, and roll back prompts without code changes.
The JavaScript OpenTelemetry tracing example for Promptfoo, tracing provider internals and validating tool-call trajectories.
Promptfoo example evaluating PydanticAI agents with structured-output validation and multiple assertion types.
Compare OpenAI and Azure OpenAI side-by-side to benchmark speed, cost, and output quality differences using identical models.
Promptfoo example evaluating Cerebras high-performance inference API - model comparison, structured JSON, tool use.
Create custom TypeScript API providers for prompt testing with CSV test cases and structured output validation.
Go provider template for promptfoo that demonstrates how to build, structure, and compare multiple AI provider implementations in a single module.
Promptfoo example workflow demonstrating how to configure and evaluate prompts using the Groq AI provider with environment-based API key authentication.
