Run AI Tests Using Google Sheets as Data Source

This promptfoo integration enables you to run LLM prompt evaluation tests using test cases stored in Google Sheets. Instead of maintaining test cases in local configuration files, you can reference a Google Sheets URL in your promptfooconfig.yaml file. It supports both public sheets (no authentication required) and private sheets with authenticated access.

Use this integration when you need to reference test cases from Google Sheets, when you want to work with test data in a familiar spreadsheet interface, or when you're managing test suites that benefit from spreadsheet filtering and sorting. Use it when test cases change frequently and you want to update them in a spreadsheet format.

Do NOT use this when you need version control for test cases (spreadsheets lack git history), or when you require millisecond-level performance for CI/CD pipelines where network latency to fetch sheets would add overhead.

You provide a Google Sheets URL in your promptfooconfig.yaml file. You also need an OPENAI_API_KEY environment variable set for the LLM provider.

After running the evaluation, you can view results by running npx promptfoo view.

Google Sheets: The core integration for storing and reading test cases. Public sheets work without additional packages. Private sheet access requires the @googleapis/sheets npm package for authentication.

OpenAI: The example uses OpenAI as the LLM provider for prompt evaluation, configured via the OPENAI_API_KEY environment variable.

promptfoo: The underlying evaluation framework that orchestrates the test runs and result visualization.

Initialize the example:

npx promptfoo@latest init --example integration-google-sheets
cd integration-google-sheets

For private sheets or to write results back to Google Sheets, install the authenticated dependency:

npm install promptfoo @googleapis/sheets

Duplicate the Google Sheet referenced in promptfooconfig.yaml and replace the URL with your own. Then run the evaluation:

npx promptfoo eval

View results with npx promptfoo view.

This integration is for users who want to reference Google Sheets as a source for test cases in their promptfoo evaluations. It's useful when working with test data in spreadsheet format and when you need to support both public and private sheet access.