laitimes

YouTube introduces AI intelligent dubbing function: let foreigners around the world "speak" to speak Chinese

AI Era Network reported on June 27 (WeChat subscription: AI Era Network) 丨Google's video website YouTube is testing an artificial intelligence dubbing function called "Aloud" (AI loud speaking, AI+Aloud compound words), which can directly translate the speech content of the characters in the video into the languages of other countries and regions.

YouTube introduces AI intelligent dubbing function: let foreigners around the world "speak" to speak Chinese

For example, we're watching a Vlog video on YouTube from an American blogger who naturally speaks with an American English accent, and this new feature allows the American to "speak" the words directly transferred to the Chinese AI voiceover.

YouTube introduces AI intelligent dubbing function: let foreigners around the world "speak" to speak Chinese

AI Era learned from the official blog that although YouTube currently provides the function of voice to subtitles and supports real-time translation of subtitles in dozens of languages around the world, it will be easier to attract views if the characters in the film can directly speak the native language of the viewer.

YouTube introduces AI intelligent dubbing function: let foreigners around the world "speak" to speak Chinese

It is understood that the "Aloud" function is created by an innovative technical group under Google, through artificial intelligence speech recognition technology, first convert the content spoken by the characters in the film into translated text subtitles, and then convert the text into AI-generated voice for content broadcasting, and can achieve that the speed of the characters and their dubbing are almost the same.

YouTube introduces AI intelligent dubbing function: let foreigners around the world "speak" to speak Chinese

In addition, YouTube also allows the content creator of the video to edit, proofread and adjust the details for the generated AI voiceover, and can select the various languages that need to be generated to present it in the front of the viewer's app.

This seems to mean that some low-end voice actors are also in the time to be replaced by AI. During the current closed beta period, this function temporarily only supports videos with original English voices, and automatically generates AI dubbing in Spanish and Portuguese. It is expected that more languages will be supported soon.

[This article is from 丨AI Era Network丨WeChat subscription account with the same name, welcome to search and follow]

Read on