laitimes

Virtual humans are using their talents to say goodbye to you

Author | Lingzi County

Do you have such memories at the Spring Festival dinner table in your childhood, when you are full of wine and dinner, playing with a rare little friend on the side, and suddenly hear the adults calling your name: Come, show everyone a show!

Now that you have become an adult, you may no longer want to treat children like this. Even when you see a child being named and unwillingly and can't refuse, you will still have a trace of sympathy in your heart, but you just feel that it is not good to destroy the atmosphere.

"Why don't you let the AI perform a show?" You can say that this year.

01 New talent of AI painters

Singing this song "Passing through the Human World" is Xia Yubing. Li Di, CEO of Xiaoice, introduced in the CCTV "Dialogue" column, "This song should be the highest-tech artificial intelligence song synthesis in the world so far." If you close your eyes and listen, the modification of the singing method, and the pause between sentences are very natural, it is really difficult to distinguish that this song is from AI.

The versatile Xia Yubing, as soon as she appeared, caused the amazement of netizens: "This is the ceiling of virtual people!"

Xia Yubing does not only exist in this video, as an AI being incubated by the artificial intelligence framework of Xiaoice company, she graduated from the Central Academy of Fine Arts in 2019, and after practicing different painting genres, she chose to specialize in Chinese landscape painting. Her work is being exhibited at the China Pavilion at Expo Dubai.

Although there is only one at a time, it seems that no matter how many you ask her to draw, she will not reject you. After all, one of the characteristics of AI is "high concurrency", which can complete many tasks at the same time. After the painting, she will also make a comment from her own point of view.

Virtual humans are using their talents to say goodbye to you

02 AI singers who have learned the national singing method, waiting for you to formulate a New Year's song

Chen Shuiruo is another member of the Xiaoice framework. She is a singer who has recently learned ethnic singing, so come and listen to her learn to sing Li Yugang's "Huaxia". Li Yugang listened to it and said, "It's so nice!" Chen Shuiruo and Li Yugang also sang a song, which was posted on the Xinhua Daily Telegraph: "Three-dimensional virtual sister dream linkage Li Yugang cover sings "Huaxia", Chinese New Year's Eve congratulations on the New Year!"

Virtual humans are using their talents to say goodbye to you

Chen Shuiruo does not exist only in this video. She and two other AI singers, He Chang and Chen Ziyu, entered the "NetEase Tianyin" mini program. Everyone enters the mini program, enters the object of the blessing, the blessing language, and can generate a song. You can also change the accompaniment, change the lyrics, change the singer according to your own wishes, and finally make a unique blessing song.

Virtual humans are using their talents to say goodbye to you

AI beings like Chen Shuiruo and Xia Yubing, who have their own images and singing voices, as well as the ability to interpret songs, and even content creation and art criticism capabilities, are generated by the framework of Xiaoice.

The general technical principle behind this is to create a facial feature that does not exist before through the Xiaoice company's neural network rendering technology, and then replace the facial feature into the video template and make a series of controls on the expression. This way you can see the same voice in the video, similar to the breathing, mouth shape, blinking, and eyebrow raising of a real person. According to the content of the actual video, you can also adjust the video template, such as changes in actions, expressions and expressions.

Xiaoice company, the first step of AI to create a face has the highest degree of industrialization. It also avoids the misuse of real faces. Other common virtual human video techniques usually require finding a real person to shoot, and then replacing it with a virtual person's head, or using a real person for motion capture. This approach is either costly or the dependence on real people is still large.

03 Make virtual humans rich and diverse

Behind the entry into the Mini Program to get a piece of AI singing is the technical accumulation and thinking of the Xiaoice team for many years.

Initially, the Xiaoice team realized the importance of emotional intelligence to ARTIFICIAL intelligence and began exploring conversational experiences that can provide accompaniment; in 2017, Xiaoice proposed the concept of AI Creation. At the ninth generation Xiaoice conference in 2021, the Xiaoice team shared the complete process of artificial intelligence creation for the first time, which includes three parts: content generation, deduction, and content packaging.

In the future, these AI singers will accompany people in more diverse forms. A few days ago, Xiaoice announced a strategic partnership with Sing Bar Technology. Relying on the Xiaoice framework, Sing Bar Technology will upgrade the terminal product experience. Singers such as Chen Shuiruo, He Chang, Chen Ziyu and other singers will be stationed in the smart TV singing bar application of the member enterprises of the Sing Bar Group, and accompany users in the scene of work and life. This means that in different places such as carry-on devices, living rooms, and smart cars, AI singers can appear and accompany people.

Virtual humans are using their talents to say goodbye to you

Xiaoice and the artificial intelligence musicians within her framework

The creative ability not only increases the richness of AI beings as a virtual subject, becoming part of its personality, but also allows AI beings to present different characteristics.

This year, all kinds of beautiful virtual people often appear in front of our eyes. Xiaoice team believes that the virtual person of the future will not only have a shape, "sentient beings are a very unique existence for human society, and when we humans think that the other party can communicate emotionally with us, everything will be different." 」 Li Di said in the "Dialogue" column.

As sentient beings, human beings will use music and painting different art forms to express themselves, and when AI has this ability, people will also interact with it as "sentient creatures".

Xiaoice company, we are in the very early and primitive stages of virtual people. "The world needs far more virtual humans than we think today, and far outnumbers a few top virtual stars. This is a huge unprecedented era."

This article is the original article of Geek Park, please contact Geek Jun WeChat geekparker for reprint

Read on