Mildew speaks authentic Chinese, the mouth shape and card points are almost perfect, netizens: The dubbing era is over?
Reported by the Heart of the Machine
Editor: Chen Ping
"The era of dubbing movies is coming to an end. 」
The development of AI has made many people say that their jobs have been robbed, and they used to be artists and programmers...... Now the voice actor is also going to lose his job? There was a female singer Mildew (Taylor Swift) who showed off Chinese and sketch actor Cai Ming speaking English at the Spit Conference. Now another voice-over research is going viral, Pipio, a video automatic AI voice-over tool from Pipio, an AI video production platform.
Pipio officially says that the tool can quickly translate the video while preserving the original sound, and in addition, Pipio can seamlessly match the speaker's lip movements to the new language.
Free trial address: https://www.pipio.ai/video-dubbing
How it works, we have a sneak peek.
Canadian rapper Drake freely switches between Chinese, almost without the tone of early translated films, and the lip shape can match.
Source: https://twitter.com/LinusEkenstam/status/1772380020574400571
Video Links: https://mp.weixin.qq.com/s?__biz=MzA3MzI4MjgzMw==&mid=2650912509&idx=3&sn=19b37634ff553666f9ca2da9b806dcba&chksm=84e47283b393fb951e7baa1c18d40828431b29fbb776eee5612f6c32dbdb4387a65dc9c533e2&token=1273782883&lang=zh_CN#rd
Mildew spoke Chinese again: the mouth shape and stuck points were perfect, and the voice was slightly defective but already very good.
Video Links: https://mp.weixin.qq.com/s?__biz=MzA3MzI4MjgzMw==&mid=2650912509&idx=3&sn=19b37634ff553666f9ca2da9b806dcba&chksm=84e47283b393fb951e7baa1c18d40828431b29fbb776eee5612f6c32dbdb4387a65dc9c533e2&token=1273782883&lang=zh_CN#rd
When compared to other voice-over tools, Pipio has the following advantages:
33% improvement in lip matching;
Zero loss of video resolution;
Higher fidelity in language translation;
Fast translation time;
More than 40 languages are supported.
For example, in the video below, the video on the left has noticeable artifacts, while the video on the right has higher fidelity:
Source: https://twitter.com/LinusEkenstam/status/1772380024336777493
Seeing this, netizens couldn't help but sigh that the "StarCraft" he had seen was all in Korean, and he was willing to spend money to translate Korean into English if he could, and said that it was not far off for all YouTube videos to adopt this technology.
Pipio 介绍
According to public information, Pipio was founded in 2020 and is headquartered in Washington, D.C., and the company's founders are Mike Bittner (and CEO) and Bernardt Duvenhage.
As a team focused on content creation, Pipio's mission is to make video production easy for everyone. They want creators to focus on content development rather than the cost and process of video production.
Pipiio's main goals include:
Empowering users through storytelling: At Pipio, they provide a platform for users to create compelling stories that touch, inspire, and connect with people around the world. They help users bring stories to life.
Streamlining video production: Whether users want to create a simple newsletter or a feature-length film, Pipio wants to harness the power of AI to speed up the process and open up new, limitless creative options.
Finally, Pipio CEO Bittner personally hired online, "We are looking for a talented full-stack engineer to join our innovation team at Pipio. If you have experience using video editing tools or machine learning, welcome to join. 」