ElevenLabs Unveils Dubbing v2: AI Voice Cloning for 90+ Languages

ElevenLabs is pushing the boundaries of content localization with the release of Dubbing v2, a sophisticated AI-powered voice cloning and dubbing solution. This new iteration promises to support over 90 languages, enabling creators, marketing teams, and studios to reach global audiences with unprecedented fidelity. The core innovation lies in its audio-to-audio processing approach, which moves beyond simple text transcription to capture and replicate the original speaker's emotional expression, tone, and delivery style across linguistic barriers.

Details: Preserving Nuance and Identity

The Dubbing v2 model is engineered to meticulously reproduce the original audio's expressiveness, rather than just translating text. This means that the emotional depth, authentic tone, and even the precise duration of the original speech are maintained in the localized version. A key feature is automatic voice cloning, which generates dubbed audio using a clone of the original speaker's voice for every translation. This process retains the speaker's unique identity, pitch, and timbre without requiring manual intervention, ensuring a consistent and recognizable voice across different languages. The system also intelligently adapts expressions and meanings to suit the target language, making the final output sound natural and engaging to local listeners.

A Leap in Automated Localization

ElevenLabs highlights Dubbing v2 as a significant breakthrough, offering a high-quality, fully automated dubbing experience that eliminates the need for complex workflows. The platform supports source audio, source text, and target text inputs, with the entire process—translation, voice cloning, dubbing, and synchronization—handled automatically. This end-to-end automation is designed to streamline production for creators, marketers, and studios, reducing both time and cost associated with traditional dubbing methods. The system's ability to directly process original audio, rather than relying on transcribed text, is central to its success in preserving the original performance's integrity.

Global Reach and Accessibility

With support for over 90 languages, Dubbing v2 aims to make global content distribution more accessible than ever. Each dubbed segment is generated using a clone of the original speaker's voice, preserving characteristic vocal traits, pitch, and timbre. The platform also features built-in synchronization logic, ensuring that the dubbed audio aligns perfectly with the timing of the original recording. This precision in synchronization, combined with the audio-to-audio model's ability to capture original expressiveness, results in a dubbing quality that is described as "close to human." This advancement is particularly beneficial for content creators looking to expand their reach without compromising the authenticity of their message.

Tailored Solutions for Different Needs

ElevenLabs offers different tiers of service to cater to various user needs. Dubbing is presented as a one-click solution for creators, marketing teams, and collaborative groups, allowing them to upload content, select target languages, and receive natural-sounding dubs with minimal setup. For studios and media organizations with broadcast-level requirements, ElevenProductions Dubbing offers a more curated experience, involving human translation, professional casting, and mixing, with Dubbing v2 handling the audio processing. This tiered approach ensures that both individual creators and large enterprises can leverage the power of AI dubbing effectively.

Pricing and Future Implications

ElevenLabs provides a range of pricing plans, including a free tier that offers 10,000 credits per month, alongside paid options like Creator ($22/month) and Professional ($99/month), with additional credits available for purchase. These plans detail included minutes for automatic dubbing and extra costs per minute, with Dubbing v2 minutes priced higher than the older Dubbing v1 (which is still available with and without watermarks at lower rates). The company's focus on high-fidelity, automated localization aligns with the growing global demand for digital content and the increasing need for efficient, cost-effective ways to adapt that content for diverse audiences. As AI-generated content continues to proliferate, tools like Dubbing v2 will play a crucial role in ensuring clear communication and authentic representation across cultures.