HyperAIHyperAI

Command Palette

Search for a command to run...

5 days ago
Text-to-Speech

NVIDIA Magpie TTS Unlocks Open Weights for Real-Time Multilingual Voice Agents

NVIDIA has released an updated open-weight version of its Magpie Multilingual Text-to-Speech model, engineered to resolve latency bottlenecks and linguistic scalability in production voice AI. The 364-million-parameter model now supports twelve languages, expanding its baseline capabilities with Modern Standard Arabic, Korean, and Brazilian Portuguese alongside existing coverage in English, Spanish, French, German, Italian, Vietnamese, Mandarin, Hindi, and Japanese. To address the critical latency budget in conversational AI, the architecture implements a frame-stacking decoder combined with a local transformer. This dual approach halves the number of decoding iterations while preserving natural prosody, delivering a Time to First Audio measurement as low as 32 milliseconds on NVIDIA B200 hardware. Even under concurrent workloads of 64 simultaneous streams, the model sustains a throughput exceeding 300 times real-time playback speed, enabling end-to-end conversational latency to remain comfortably below the 200-millisecond threshold required for natural dialogue. Quality enhancements accompany the speed improvements, with reduced character error rates and improved speaker similarity metrics across French, Spanish, and German. The open-weight release, distributed via Hugging Face, grants developers full infrastructure control. By deploying through the NVIDIA NIM containerized inference stack on-premise, organizations can enforce strict data residency, fine-tune domain-specific terminology, and independently optimize automatic speech recognition and large language model components without relying on closed third-party APIs. Magpie integrates directly into the newly published Nemotron Voice Agent Developer Example, which provides a production-ready reference implementation for cascaded voice architectures. This framework demonstrates how purpose-built speech and reasoning modules can be coordinated to build always-on multilingual assistants, enterprise copilots, and automated support systems. Developers are encouraged to configure inference parameters such as classifier-free guidance scaling and temperature thresholds to balance text adherence with generative flexibility. The update positions NVIDIA Magpie as a foundational, deployable component for the next generation of low-latency, multilingual voice applications.

Related Links