A voice estate that only works in clean English is a pilot, not a deployment. Mid-sentence code-switching, regional accent, and a bad line are the normal case on our deployments, not the edge case, and an agent that degrades on any of them fails in front of a paying customer.
Building our own evaluation set from the calls our voice deployments actually handle – code-switched, accented, on ordinary telephony – and holding the Vakyam stack against it. Turn latency is a first-class requirement in that set, not something measured after accuracy.
What we do not know yet
- Whether one multilingual model beats routing to per-language models once language detection is counted in the latency budget.
- How far accuracy degrades on real telephony against benchmark audio.
- What a fair public scorecard for an Indic voice agent would even contain.