Integrate MLflow AI Gateway with Promptfoo
Prompt workflow example demonstrating MLflow AI Gateway integration as an LLM provider in promptfoo for governed model access and testing.
Why it matters
Leverage MLflow AI Gateway as a provider within promptfoo for enhanced LLM testing and evaluation. Streamline your MLOps pipeline by integrating powerful AI governance with your prompt development process.
Outcomes
What it gets done
Configure promptfoo to use MLflow AI Gateway.
Test and evaluate LLM responses through the MLflow provider.
Integrate AI governance into your prompt testing framework.
Automate LLM provider selection and management.
Install
Add it to your toolbox
Run in your project directory:
curl -fsSL https://spark.entire.vc/get/pfoo-provider-mlflow-gateway | bash Capabilities
What this chain does
Writes source code or scripts from a description.
Traces errors to their root cause and suggests fixes.
Analyzes code for bugs, style issues, and improvements.
Overview
Provider Mlflow Gateway
What it does
This is a configuration example that demonstrates how to set up MLflow AI Gateway as an LLM provider within promptfoo. It shows the integration pattern needed to route prompt evaluation requests through MLflow's governance layer instead of calling models directly.
How it connects
Use this example when you need to test prompts against models accessed through MLflow AI Gateway, particularly in enterprise environments where AI governance, access control, and centralized model management are required.
Source README
This example demonstrates how to use MLflow AI Gateway as an LLM provider in promptfoo.
Discussion
Questions & comments · 0
Sign In Sign in to leave a comment.