Dubformer Introduces Emotion Transfer

Dubformer, a startup specializing in dubbing for the media industry, has launched Emotion Transfer, a dubbing technology that delivers highly emotional and expressive voiceover, regardless of voice or timbre, reproducing the emotional dynamics of speech, such as pitch, volume, and speed.

Dubformer's Emotion Transfer technology transfers emotions and intonations instead of just replicating voice and timbre, making voice overs as expressive as the original performance.

Emotion Transfer separates the elements of speech that convey emotion, such as pitch, volume, and speed, from those related to the timbre, which is unique to each individual voice, and transfers them. It processes each phrase individually, using the original voice as a reference to capture the emotional essence of the performance. The technology cannot operate beyond the specific content it is used to process, nor does it use actor data for training. Emotion Transfer is capable of translating 20 languages into English, German, Spanish, and French.

"Until now, AI dubbing has struggled to capture the emotional nuances that human voice actors bring to their performances. With Emotion Transfer, we elevate the entire AI dubbing process by focusing on the emotions behind each phrase, enhancing the expressiveness of the output. By transferring emotional dynamics instead of cloning voices, we're able to create a result that's both more engaging and true to the original performance. This approach represents a significant leap in AI dubbing technology," said Anton Dvorkovich, Dubformer's CEO and founder, in a statement.