1,210 tools found
A promptfoo example for evaluating OpenAI's MCP tool integration, including auth and approval workflows.
Promptfoo example for testing OpenAI's Realtime API: multi-turn voice/text conversations, function calling, and audio.
A promptfoo example for testing OpenAI tool-calling accuracy against the Chat Completions API.
A Promptfoo example tracing a Python LLM provider's internals via OpenTelemetry, exporting spans in protobuf format for span-level eval assertions.
Compare DeepSeek R1, GPT-4.1 Mini, and Claude 4 Sonnet on joke-telling using the AI/ML API provider in promptfoo.
Run a CSV-based eval and an automated red team against DeepSeek R1 0528 via OpenRouter using promptfoo.
Run prompt evaluation tests using YAML configurations with inline or CSV test cases for rapid validation.
Extract structured data and interact with web pages via AgentQL queries or natural language.
LlamaIndex tool letting an agent create and iteratively edit a structured, Pydantic-modeled artifact in-memory.
Deploy LlamaIndex agents to Amazon Bedrock AgentCore Runtime with managed compute and memory.
Run agent-generated Python code securely and fast via Azure Dynamic Sessions Pool.
ChatGPT Plugin Tool loads ChatGPT manifest files, allowing Agents to interact with plugins via OpenAPI specs.
