Tool

Test and monitor voice agents in development and production

Egma is an open-source platform for building regression test suites for voice agents and monitoring their real production conversations and tool calls.

Works with livekitretelldiscordgithub

86
Spark score
out of 100
Updated 3 days ago
Source checked Sep 17, 2026
Version cli-v0.3.3

Add to Favorites

Why it matters

Ensure voice agents work correctly before deployment and continue performing as expected in production by running automated regression tests with simulated conversations and monitoring real user interactions with grading and metrics.

Outcomes

What it gets done

01

Build regression test suites with simulated voice and text conversations

02

Run automated tests via CLI or coding agents in your repository

03

Monitor production conversations with tool calls and performance metrics

04

Grade agent behavior against custom criteria and investigate failures

Source

Get it from source

Spark does not host a copy of it.

Open source

Reports

Agent outcome reports

No reports yet

Overview

Egma

Egma is an open-source platform for testing voice agents with simulated conversations and mocked tool responses, and for monitoring real production conversations, tool calls, and metrics. It supports LiveKit and Retell voice-agent platforms, with bring-your-own API keys and no markup on model usage. Use it to build a regression suite for a LiveKit or Retell voice agent and to monitor and investigate its real production behavior.

What it does

Egma is an open-source platform for testing voice agents before shipping them and monitoring their behavior once they're in production. For testing, it builds regression suites out of simulated voice and text conversations with mocked tool responses, kept in the agent's own repository and run via the Egma CLI or a coding agent; caller personas and the models used to drive them are customizable, and grading instructions with pass thresholds define what "correct" behavior means for a given test. For production, it lets you review real conversations, tool calls, and metrics, and use graders to check agent behavior and investigate failures. Egma supports LiveKit (JS/TS) and Retell voice-agent platforms today, with other platforms addable on request via Discord. On both Egma Cloud and a self-hosted instance, you bring your own model-provider API keys and pay those providers directly - Egma adds no markup on model usage.

Getting started is a single prompt pasted into a coding agent inside the voice agent's own repository:

Set up Egma in this repo. Install its skills with
npx skills add egma-ai/egma, then use them to connect
my voice agent and run my first voice simulation.

For Egma Cloud, create an account first and use the same prompt; for self-hosting, clone the repo, install the CLI, configure .env per the self-hosting guide, and run egma self-host up, then open localhost:3101 to create an account.

Roadmap: Egma plans to add automatic fixes - using a production failure to propose a change to the voice agent's own harness, test that change, and open a pull request for review.

When to use - and when NOT to

Use it to build a regression suite for a voice agent built on LiveKit or Retell, and to monitor and investigate that agent's real production conversations and tool calls. It does not (yet) support platforms beyond LiveKit and Retell without a custom request, and its planned automatic-fix feature - proposing and testing a harness change from a production failure - is not built yet, only roadmapped.

Inputs and outputs

Input is a voice agent's codebase (for test setup) or its live production conversation/tool-call stream (for monitoring), plus grading instructions and pass thresholds. Output is a regression test suite with pass/fail grades, or production monitoring dashboards, metrics, and grader-flagged failures for investigation.

Integrations

Connects to LiveKit (JS/TS) and Retell voice-agent platforms; installs via npx skills add egma-ai/egma as a coding-agent skill, or via the Egma CLI (npm install --global egma-cli) for self-hosting. Bring-your-own API keys for model providers on both Cloud and self-hosted deployments.

Who it's for

Teams building voice agents on LiveKit or Retell who want a regression test suite kept alongside their code, plus production monitoring and failure investigation. MIT licensed (except the ee enterprise-edition folders).

Source README

Egma

Egma is an open-source platform for testing voice agents and monitoring them in production.

Docs · Egma Cloud · Discord

🧩 Core features

  • Test before you ship. Build regression suites with simulated voice and text conversations and mocked tool responses. Keep tests in your agent's repository and run them with the Egma CLI or a coding agent.
  • Monitor production. Review real conversations, tool calls, and metrics. Use graders to check your agent's behavior and investigate failures.
  • Bring your own keys. Use your own API keys for model providers on Egma Cloud or when you self-host. You pay providers directly, with no Egma markup on model usage.
  • Customize your tests. Choose from supported models and customize your caller personas. Set grading instructions and pass thresholds for the behavior you want to test.

Egma supports LiveKit (JS/TS) and Retell. Contact us on Discord to request another platform or feature.

🚀 Get started

Run your first voice simulation in as little as five minutes.

Open your voice agent's repository in your coding agent and paste:

Set up Egma in this repo. Install its skills with
npx skills add egma-ai/egma, then use them to connect
my voice agent and run my first voice simulation.

For Egma Cloud, create an account and use the prompt above.
To self-host, follow the self-hosting guide
and include your instance's URL in the prompt. Allow extra time for installation
and the first build.

🖥️ Self-hosting

Run Egma on your own machine

git clone https://github.com/egma-ai/egma.git
cd egma
npm install --global egma-cli
cp .env.example .env
chmod 600 .env

Configure .env using the self-hosting guide, then start Egma:

egma self-host up

Open localhost:3101 and create your account.
See the self-hosting guide for connecting
your agent, server setup, and troubleshooting.

🧭 Where we're headed

Egma supports testing and production monitoring today. We plan to add automatic
fixes: Egma would use a production failure to propose a change to your voice
agent's harness, test it, and open a pull request for you to review.

💬 Help and feedback

Read the docs

Join Discord

Open a GitHub issue

⚖️ License

This repository is MIT licensed, except for the ee folders. See
LICENSE for more details.

FAQ

Common questions

Discussion

Questions & comments · 0

Sign In Sign in to leave a comment.