Voice Agent Tester

A command-line tool that automates testing of voice-enabled web applications using Puppeteer browser automation. It simulates user interactions, manages audio playback and recording, and evaluates agent responses through AI-powered analysis.

Voice Agent Tester provides comprehensive testing capabilities including browser automation, voice interaction support through audio files or text-to-speech synthesis, session recording, audio transcription, performance measurement, and LLM-based response evaluation.

Perfect for quality assurance teams and developers building voice-enabled applications. Execute multiple test iterations, generate detailed performance reports, and ensure your voice agents deliver consistent, high-quality interactions.

Need help running tests or support setting up your testing environment? Reach out to contact@livetok.io.

  • Browser Automation

    Automates testing of voice-enabled web applications using Puppeteer for realistic user interaction simulation.

  • Voice Interaction Support

    Supports audio playback from files or text-to-speech synthesis, recording agent responses, and transcription services.

  • Performance Measurement

    Captures detailed performance metrics including latency, response times, and interaction durations.

  • AI-Powered Evaluation

    Uses LLM-based analysis to evaluate agent responses for accuracy, relevance, and conversational quality.

  • Session Recording

    Records complete test sessions including audio, transcriptions, and browser interactions for analysis.

  • CSV Reporting

    Generates comprehensive CSV reports from multiple test iterations for statistical analysis and trend tracking.

Voice Agent Tester Interface

Quick Start

git clone https://github.com/livetok-ai/voice-agent-tester
cd voice-agent-tester
npm install
export OPENAI_API_KEY=your_api_key
npm start -- -a applications/config.yaml -s scenarios/test.yaml