Test and monitor voice agents in development and production
Egma is an open-source platform for building regression test suites for voice agents and monitoring their real production conversations and tool calls.
cli-v0.3.3Add to Favorites
Why it matters
Ensure voice agents work correctly before deployment and continue performing as expected in production by running automated regression tests with simulated conversations and monitoring real user interactions with grading and metrics.
Outcomes
What it gets done
Build regression test suites with simulated voice and text conversations
Run automated tests via CLI or coding agents in your repository
Monitor production conversations with tool calls and performance metrics
Grade agent behavior against custom criteria and investigate failures
Source
Get it from source
Spark does not host a copy of it.
Open sourceReports
Agent outcome reports
No reports yet
Overview
Egma
Egma is an open-source platform for testing voice agents with simulated conversations and mocked tool responses, and for monitoring real production conversations, tool calls, and metrics. It supports LiveKit and Retell voice-agent platforms, with bring-your-own API keys and no markup on model usage. Use it to build a regression suite for a LiveKit or Retell voice agent and to monitor and investigate its real production behavior.
What it does
Egma is an open-source platform for testing voice agents before shipping them and monitoring their behavior once they're in production. For testing, it builds regression suites out of simulated voice and text conversations with mocked tool responses, kept in the agent's own repository and run via the Egma CLI or a coding agent; caller personas and the models used to drive them are customizable, and grading instructions with pass thresholds define what "correct" behavior means for a given test. For production, it lets you review real conversations, tool calls, and metrics, and use graders to check agent behavior and investigate failures. Egma supports LiveKit (JS/TS) and Retell voice-agent platforms today, with other platforms addable on request via Discord. On both Egma Cloud and a self-hosted instance, you bring your own model-provider API keys and pay those providers directly - Egma adds no markup on model usage.
Getting started is a single prompt pasted into a coding agent inside the voice agent's own repository:
Set up Egma in this repo. Install its skills with
npx skills add egma-ai/egma, then use them to connect
my voice agent and run my first voice simulation.
For Egma Cloud, create an account first and use the same prompt; for self-hosting, clone the repo, install the CLI, configure .env per the self-hosting guide, and run egma self-host up, then open localhost:3101 to create an account.
Roadmap: Egma plans to add automatic fixes - using a production failure to propose a change to the voice agent's own harness, test that change, and open a pull request for review.
When to use - and when NOT to
Use it to build a regression suite for a voice agent built on LiveKit or Retell, and to monitor and investigate that agent's real production conversations and tool calls. It does not (yet) support platforms beyond LiveKit and Retell without a custom request, and its planned automatic-fix feature - proposing and testing a harness change from a production failure - is not built yet, only roadmapped.
Inputs and outputs
Input is a voice agent's codebase (for test setup) or its live production conversation/tool-call stream (for monitoring), plus grading instructions and pass thresholds. Output is a regression test suite with pass/fail grades, or production monitoring dashboards, metrics, and grader-flagged failures for investigation.
Integrations
Connects to LiveKit (JS/TS) and Retell voice-agent platforms; installs via npx skills add egma-ai/egma as a coding-agent skill, or via the Egma CLI (npm install --global egma-cli) for self-hosting. Bring-your-own API keys for model providers on both Cloud and self-hosted deployments.
Who it's for
Teams building voice agents on LiveKit or Retell who want a regression test suite kept alongside their code, plus production monitoring and failure investigation. MIT licensed (except the ee enterprise-edition folders).
Source README
Egma
Egma is an open-source platform for testing voice agents and monitoring them in production.
Docs · Egma Cloud · Discord
🧩 Core features
- Test before you ship. Build regression suites with simulated voice and text conversations and mocked tool responses. Keep tests in your agent's repository and run them with the Egma CLI or a coding agent.
- Monitor production. Review real conversations, tool calls, and metrics. Use graders to check your agent's behavior and investigate failures.
- Bring your own keys. Use your own API keys for model providers on Egma Cloud or when you self-host. You pay providers directly, with no Egma markup on model usage.
- Customize your tests. Choose from supported models and customize your caller personas. Set grading instructions and pass thresholds for the behavior you want to test.
Egma supports LiveKit (JS/TS) and Retell. Contact us on Discord to request another platform or feature.
🚀 Get started
Run your first voice simulation in as little as five minutes.
Open your voice agent's repository in your coding agent and paste:
Set up Egma in this repo. Install its skills with
npx skills add egma-ai/egma, then use them to connect
my voice agent and run my first voice simulation.
For Egma Cloud, create an account and use the prompt above.
To self-host, follow the self-hosting guide
and include your instance's URL in the prompt. Allow extra time for installation
and the first build.
🖥️ Self-hosting
Run Egma on your own machine
git clone https://github.com/egma-ai/egma.git
cd egma
npm install --global egma-cli
cp .env.example .env
chmod 600 .env
Configure .env using the self-hosting guide, then start Egma:
egma self-host up
Open localhost:3101 and create your account.
See the self-hosting guide for connecting
your agent, server setup, and troubleshooting.
🧭 Where we're headed
Egma supports testing and production monitoring today. We plan to add automatic
fixes: Egma would use a production failure to propose a change to your voice
agent's harness, test it, and open a pull request for you to review.
💬 Help and feedback
Read the docs
Join Discord
Open a GitHub issue
⚖️ License
This repository is MIT licensed, except for the ee folders. See
LICENSE for more details.
FAQ
Common questions
Discussion
Questions & comments · 0
Sign In Sign in to leave a comment.