Multi-step prompt sequences for complex AI workflows.
31 tools found
Enables LLMs to interact with external tools via the Model Context Protocol, executing tool calls and integrating results back into conversations.
Evaluation framework for testing LLM function and tool calling capabilities using promptfoo, enabling systematic assessment of model tool-use performance.
CLI and library for evaluating and red-teaming LLM applications with automated testing, model comparison, and security vulnerability scanning.
Example workflow demonstrating Vercel AI Gateway integration to access multiple AI providers through a single unified API endpoint.
Promptfoo workflow for evaluating and comparing fal.ai image generation models side-by-side with reproducible test cases.
Provider Litellm is a promptfoo example demonstrating how to integrate and test LiteLLM as a provider for multi-model LLM workflows and evaluations.
Ruby provider for promptfoo that integrates OpenAI API with custom logic, token tracking, and Ruby-based assertions for LLM evaluation workflows.
A prompt workflow that combines OpenAI function calling with Google Places API and user profiles to deliver personalized, location-based venue recommendations.
Leverage OpenAPI specs to enable LLMs to call REST APIs, automating complex tasks and data interactions through intelligent function invocation.
Advanced guide to optimizing OpenAI prompt caching for up to 80% latency reduction and 90% cost savings through prefix stabilization and cache-hit measurement.
Jupyter notebook demonstrating function calling with Azure OpenAI service for GPT-4 and GPT-3.5-turbo models.
Transcribe audio files to text using Azure OpenAI's Whisper model. Example shows setup and usage.
