---
name: dialt-evals
description: Build and refine a hosted Dialt eval suite for a voice agent, validate its cases with Dialt Smart in text, then evaluate in voice.
---

# Build a Dialt eval suite

Follow the [eval guide](https://dev.dialt.com/docs/api/evals/) for authoring, API usage, preflight, billing and result interpretation. This skill owns the workflow below; the guide and its linked API contract own execution details.

## Design the suite

Create a small hosted suite covering the agent's important successful journeys and consequential edge cases. The system under test is each case's `target` and its controlled conversation partner is the `simulator`; to evaluate a simulated customer or patient instead, make that persona the target ([targets and simulators](https://dev.dialt.com/docs/api/evals/#roles)). Derive expected outcomes from its business requirements and tool contracts. Use mock tools unless the user requests a different setup.

## Validate in text with Dialt Smart

Start with one text attempt per case using Dialt Smart. Inspect transcripts, tool evidence, caller coverage and verdicts, including passes. Distinguish case-design, caller/harness, grading and agent failures.

Correct genuine design defects and rerun affected cases until the criteria pass with the intended challenges exercised. Never weaken valid requirements to make Smart pass. Stop and report unresolved cases when progress stalls or the user's budget is exhausted.

## Evaluate in voice

Freeze validated cases, then run in voice on the requested models, defaulting to Dialt Fast. Keep simulators, fixtures, criteria and limits fixed across comparisons, and read simulator adherence beside each one. Investigate speech and timing failures separately. For requested agent improvements, preserve before/after versions and rerun the same evals.

## Deliver through Dialt

Link hosted results and recordings with a brief findings summary; use the case playground for a live demo. Keep reproducible definitions locally. Build additional UI only when requested.