laitimes

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

Produced | Sanyan Finance

The author | Dapeng

"What? Such a living big girl is not a real person? ”

The following video is from

Everyday Treasure App

A few days ago, the video of Tsinghua virtual student Hua Zhibing singing songs became popular on the Internet, and Hua Zhibing in the video was a girl with a clear eyebrow. She sat cross-legged, holding the guitar and singing without emotion, no different from a real person. As soon as the video was sent, it attracted the amazement of many netizens.

Hua Zhibing singing video was accused of overturning, just changed a personal face?

Xiaoice company has already explained

Recently, some netizens found that the prototype of the video is a B station video, but the face and voice have been replaced by AI. Before many netizens thought that the whole video was made by AI.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

The matter has once again aroused heated discussion. Many netizens think that Hua Zhibing has overturned, saying that it is AI synthesis, in fact, it is a change of face.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?
Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

Some netizens believe that changing the face is not counted, that is, the beauty is opened, and the sound is filtered.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?
Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

In fact, in the early days of the video's release, Xiaoice company explained the video.

On the short video platform, Xiaoice company song is generated by the artificial intelligence Xiaoice framework X Studio, the human biological feature is generated and placed by the Xiaoice framework X Avatar, and the body expression training and video are derived from the caviar sauce of the Xiaoice team members.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

On Weibo, Xiaoice company also posted an explanation. The text clearly mentions that the body and movements of the characters in the video, including playing and singing with a guitar in hand, are derived from the original video template recorded by Xiaoice team member Caviar Sauce.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

This afternoon, Xiaoice Company once again issued a note that the limb video template in Huazhibing's singing video comes from Xiaoice team member caviar sauce, which is clear from the beginning, the original video has been retained on the B station, and the above sources are also noted in the on-site press conference and video.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

Xiaoice also said that the technology used in Hua zhibing's singing video is not just AI face change. This technology realizes the complete virtual generation of non-existent face and sound technology, thereby achieving more accurate visual interactive content; the previous technology can only achieve face replacement between real humans, and the accuracy is insufficient to achieve content-level video production.

Who is Caviar? Xiaoice the singer became a member of the team?

Prior to the original video, the videos released by Caviar Sauce were mostly singing, occasionally interspersed with several vlog videos about travel.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?
Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

Several of the latest videos released by Caviar Sauce are also played and sung.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

From these points of view, caviar is like a singer or a music lover.

On September 28, Caviar explained the "Huazhi Bing Singing Video", saying that the video was the first project he participated in after joining the Xiaoice team.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

On September 29, Caviar again posted an explanation, saying that the video was one of the contents of the work of the Xiaoice team it participated in.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

Moreover, on September 22, Caviar posted a photo on its Weibo that Xiaoice the scene of the press conference.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

Through the Weibo content of Caviar Sauce, it is certain that she has indeed participated in some of the work of the Xiaoice, but whether she has a technical background or not, there is no trace of what she has done before.

Sanyan Finance also consulted with caviar and Xiaoice, when caviar joined the Xiaoice team, and what was mainly responsible.

As of press time, caviar itself and Xiaoice have not replied. Judging from the current public information, the "work result" of caviar sauce is to contribute a singing video.

Since Xiaoice company and caviar sauce have been explained in the early days of the video release, why are they still questioned by a large number of netizens?

Media reports are inaccurate

Audiences get information in fragments

Expectations are too high to lead to misunderstandings

Sanyan Finance watched the whole video of the scene of the ninth generation of the Xiaoice Conference.

At the press conference, the speaker introduced the short video packaging pipeline Xiaoice, including the second and third dimensions, and the second dimension realized the full-link artificial intelligence from text generation to short video generation, without manual participation; the three-dimensional aspect has not yet opened the full pipeline artificial intelligence, but has realized the entire link from biological feature generation to short video generation, and can produce short video content according to a certain capacity.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

The speaker introduced, "The face we saw never appeared in reality, not deepfake, and its singing, acting, and all artificial intelligence generation, just put it in a template for a human action video." You can see the fusion of its emotions and songs, the emotions conveyed in its eyes. ”

The speaker also mentioned that the expectation that the template for human body movements will not be needed next year is an important task for Xiaoice company to develop in a closed manner next year.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

Sanyan Finance and Economics found that the video of Hua Zhibing singing on the spot at the press conference on September 22 indicated the source, but various press releases did not mention it, so only the on-site and people watching the press conference knew.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

On September 27, Xiaoice Company separately released a video of Huazhi Bing singing, indicating the source. However, when some media published the relevant reports of the video, the text manuscript also did not explain that the material came from caviar. Moreover, the phrase "all human biological characteristics are completed by artificial intelligence, and the limbs are trained by team members" is extremely misleading, so it has caused misunderstanding among netizens.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

Some netizens said that after watching the news, they thought it was all AI modeling, and the result was a change of face.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

Some netizens also believe that there is actually no deception in the Huazhibing incident. Because the expected management is not done well, most netizens are fragmented channels to learn, see a living girl in the video, said that it is artificial intelligence, naturally think that the whole person is created from 0. After that, I found that just by changing my face and changing my voice, I would feel cheated.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

Hua Zhibing and Tsinghua Department

"I've been interested in literature and art since I was born, Xiaoice AI scientists not only gave me faces and voices, but also taught me composition. In addition, based on the 'Enlightenment 2.0' model, I can also write poetry and paint. ”

This is Hua Zhibing's self-introduction.

On June 3, Hua Zhibing released his first Weibo post. She claims to be a member of the Zhipu · Ai, Zhiyuan and Xiaoice joint training, and will start a learning and research career in the laboratory of the Department of Computer Science of Tsinghua University.

Tsinghua virtual student Hua Zhibing was accused of overturning the car, just AI face change? Who is Caviar?

On June 15, Tsinghua University held a press conference on the results of the Department of Computer Science "Hua Zhibing", announcing that Hua Zhibing will start her study and research career at Tsinghua University from now on.

Tang Jie, a teacher of Hua Zhibing and a professor and deputy director of the Department of Computer Science of Tsinghua University, introduced that more than 100 people participated in the research and development of the "Huazhibing" project. Among these more than 100 people, there are 70 or 80 Tsinghua students. In the algorithm part, such as converting text into pictures, or generating words from words, many other tasks are completed with the participation of Tsinghua doctoral students and young teachers.

According to the data, Zhipu AI was established in June 2019, and the company belongs to Beijing Zhipu Huazhang Technology Co., Ltd. The actual controller is Tang Jie.

According to the official profile, Zhipu AI is a developer of AI knowledge intelligence technology, which is transformed from the technological achievements of the Knowledge Engineering Laboratory of the Department of Computer Science of Tsinghua University. The chief scientist of Zhipu AI is Tang Jie, professor and deputy director of the Department of Computer Science of Tsinghua University mentioned above.

The financing process shows that Zhipu AI has received two rounds of financing. Among them, on September 14 this year, Zhipu AI obtained a series of financing of more than 100 million yuan, and investors include Dachen Caizhi, Huakong Fund, Jiangmen Venture Capital, Turing Venture Capital, etc.

On July 13, 2020, Microsoft announced that it will spin off Xiaoice and Xiaoice team to become a local Chinese startup, with investors including Hillhouse Capital, Five Source Capital, IDG, etc. Li Di is the CEO of the company. Li Di graduated from Tsinghua University.

Therefore, Hua Zhibing is a native of the "Tsinghua Department".

Be wary of exaggerated propaganda in the field of artificial intelligence

Although the truth of the Huazhibing incident has been clarified, attention should also be paid to the exaggerated publicity in the field of artificial intelligence.

Some companies do not hesitate to exaggerate publicity or technical fraud in order to obtain financing or subsidies.

An Indian startup called Engineer.ai reportedly claims to use AI technology to write code that enables everyone to build and run custom software. But according to the Wall Street Journal quoting a number of executives and employees of the company, the company did not actually use artificial intelligence to build applications, but used AI technology as a cover, and "Indian code farmers" are doing technical work and using fraud to "defraud" financing.

Under the guise of AI, the company also received nearly $30 million in financing, led by Japan's SoftBank.

Google's AI, which was able to make automatic calls, was praised for passing the Turing test, Duplex, with real people behind it in disguise.

Despite this, artificial intelligence is still an area that must be vigorously developed, and it is important that corporate publicity and media reports should be careful to avoid inaccurate expressions that will cause misunderstandings to the public.

Read on