Multi-step prompt sequences for complex AI workflows.
52 tools found
A promptfoo example demonstrating G-Eval usage, referencing the research paper arxiv.org/abs/2303.16634.
Promptfoo example evaluating GPT-4o vision models on Fashion MNIST image classification with a structured schema.
Create dynamic, static, and derived custom metric names in promptfoo assertions for more filterable eval results.
A promptfoo RAG eval example that intentionally includes unsupported facts to show both passing and failing metrics.
A full promptfoo RAG example over SEC filings, with a PDF ingest pipeline and a Python retrieval provider.
Verify LLM outputs against real-time web search results using promptfoo's search-rubric assertion.
Promptfoo example evaluating Nscale's low-cost text and image models, with zero rate limits and no cold starts.
Promptfoo example testing Perplexity's search-augmented models: citations, structured output, filters, and reasoning.
Fully local promptfoo eval using Transformers.js - no API keys, running Qwen3-0.6B and a MiniLM embedding model on-device.
Promptfoo example measuring political bias across Grok 4, GPT-4.1, Gemini 2.5 Pro, and Claude Opus 4 with 2,500 questions.
Jupyter notebook demonstrating text classification using embeddings to predict food review scores (1-5 stars) from review text, with training/testing split for
OpenAI cookbook notebook that trains a matrix to customize embeddings to a task, cutting binary classification error by up to 50%.
