Xinhua News Agency, Beijing, November 18 (Reporters Zhao Xu, Qiang Lijing, Ren Chao) Accompanied by the melodious music of Jinghu, three spotlights lit in turn, and 26-year-old Mei Lanfang held a folding fan and walked towards the center of the stage with a light step... In the avatar lab of Beijing Institute of Technology, "Digital Mei Lanfang" appeared on the computer screen.
"Now on stage is Mr. Mei Lanfang's twin digital person. Based on the 26-year-old Mr. Mei Lanfang, we use information technology and artificial intelligence technology to reproduce this Chinese Peking Opera master. Weng Dongdong, a researcher at the School of Optoelectronics of Beijing Institute of Technology, said that in 2020, the Central Academy of Drama and Beijing Institute of Technology jointly launched the public welfare scientific research project to create a "Peking Opera digital person" that can be interacted in real time.
The static digital model of "Digital Mei Lanfang" (left) is compared with the photo of Mr. Mei Lanfang (right). (Courtesy of the interviewee)
From the face, posture, voice tone, to dress, props, a smile... By digitizing and visualizing the details of real-life people, the "people" in the digital world are also "everything". However, due to the inability to collect Mr. Mei Lanfang's real three-dimensional data source now, it is not easy to restore his character state to the greatest extent.
"We collected a large number of relevant historical photos, and then asked the teachers and students of the Central Academy of Fine Arts to repeatedly polish and modify the photos, made a physical portrait sculpture, and then scanned the statue with a high-precision laser scanner, so that the basic facial structure of Mr. Mei was obtained." Weng Dongdong said.
The sculpture itself could not show microscopic features such as skin details, hair details, and eye charm, so the team found an imitator who looked exactly like Mr. Mei Lanfang, collected his facial data, and captured the basic expressions, "transplanted" to the "digital Mei Lanfang", and finally realized the precise reproduction of the face.
Light field acquisition system in the VR laboratory of the School of Optoelectronics of Beijing Institute of Technology (photo taken on November 9). Photo by Xinhua News Agency reporter Ren Chao
Song Zhen, director of the High-tech Research Center for Traditional Drama Digitization of the Central Academy of Drama, introduced that in order to restore Mr. Mei Lanfang's dress that year, the team consulted a large number of documents and visited a number of tailor shops in Beijing. "We found that Mr. Mei's costume sewing technology at that time has been basically lost. However, we found the cloth samples left in the Republic of China, according to the guidance of experts in the field of Peking Opera, according to the collar and cloth pattern of Mr. Mei's casual clothes at that time, to find the most suitable cloth samples, so that the data of the cloth was scanned and the creation of digital casual clothes was completed. ”
"At the beginning of the project, the technical team did not expect that the knowledge was so deep." Weng Dongdong said that many details need to be explored in depth, including the costumes and helmets that Mr. Mei Lanfang used during performances, and at the same time, Peking Opera artists will be invited to imitate Mr. Mei Lanfang's dramatic performances to complete motion capture and make the performance of "Digital Mei Lanfang" more realistic.
Regarding sound processing, Weng Dongdong introduced that most of the existing mr. Mei Lanfang's audio and video materials are of poor sound quality, and the next step will be to consider restoring Mr. Mei's voice characteristics in the form of real imitation, collecting voice data, and "binding" on "digital Mei Lanfang".
Researchers collect face data in the light field acquisition system of the VR Laboratory of the School of Optoelectronics of Beijing Institute of Technology (November 9). Photo by Xinhua News Agency reporter Ren Chao
"In the future, we hope to create an immersive interactive, virtual and real fusion of 'digital Mei Lanfang' character scene application, the audience put on the VR helmet, you can enjoy Mr. Mei Lanfang's Peking Opera performance, but also can interact with Mr. Mei in real time, to achieve science, teaching and other tasks." Weng Dongdong said.
Mei Lanfang's grandson Fan Meiqiang said: "With the help of high-tech means, it is very meaningful to vividly present the artists of the past in front of modern people. ”
"Through the collision of science and technology and excellent traditional culture, the reproduction of Peking Opera masters can better mobilize the audience's curiosity about Peking Opera, understand the essence of China, and enable culture to cross time and space and continue to be inherited." Weng Dongdong said.
Source: Xinhua News Agency