laitimes

Himalaya used speech synthesis technology to make the late master Shan Tianfang "say" the book again

author:Chinanews.com, Shanghai

Zhongxin Online Haihai News, September 11 (Xiaodong Yu Jun) Today is the third anniversary of the death of Mr. Shan Tianfang, a generation of book critics, and countless people lament that there is no "next decomposition" in the world... However, under the authorization of Beijing Shan Tianfang Art Communication Co., Ltd., Himalaya recently used speech synthesis (TS: Text-to-speech) technology to perfectly restore Mr. Shan's voice, and for the first time interpreted the classics familiar to the audience. Shan Ruilin, the son of Mr. Shan, commented, "Hearing the sound of TTS, there was a sudden burst in my heart, as if my father had returned to this world. ”

Himalaya used speech synthesis technology to make the late master Shan Tianfang "say" the book again

Mr. Shan Tianfang is a famous chinese master of storytelling and the inheritor of national intangible cultural heritage. Since his artistic career for more than half a century, he has recorded and broadcast more than 100 radio and television commentaries, such as "Sui and Tang Dynasty Yanyi", "Three Heroes and Five Righteousnesses", "The Tyrant of the Troubled World", "The Great Hero of the White Eyebrows", etc., totaling more than 12,000 episodes of radio and television commentaries, which have been broadcast on more than 500 radio and television stations across the country, with a program time of about 6,000 hours, and compiled 17 sets of 28 sets of traditional commentary text manuscripts.

Shan Tianfang's commentary is an important symbol of traditional Chinese culture. His fans are all over the country, from the elderly to children. There is a folk saying that "wherever there is well water, listen to Shan Tianfang", even today, if you take a northern taxi, the driver may still be listening to his storytelling program.

Himalaya used speech synthesis technology to make the late master Shan Tianfang "say" the book again

In the "Shan Tianfang Voice AI Reproduction Series Album" launched this time, there are not only martial arts novels that directly hit the tear points, strange people and strange things to express the sorrow and joy of life - Zhao Chenguang's "History of the Demise of jianghu: The Dark Night of Beiping"; there are also documentary literature that conveys the pulse of the times - Chen Tingyi's "Three Brothers of Mao: Three Brothers and the Foundation of the Republic"; there are also popular and strange mystery novels with twists and turns in the storyline - Zijin Chen's "Undocumented Crimes"; and there are also continuations of Shan Lao's unfinished book classic - Gong Baiyu's "Twelve Money Darts"...

The cooperation between Himalaya and Beijing Shan Tian Fang Art Communication Co., Ltd. has a long history, and Himalaya has listed more than 80 albums of Mr. Shan Tian Fang's book reviews, including more than 5,000 voices. These albums have also been loved by users in the Himalayas, and many commentaries have long been at the top of the HimalMa Cross-Talk Book Review Chart, for example, "Gone with the Wind" has been played 2.36 billion times in the Himalayas, and "The Man with the White Eyebrows" has been played as high as 1.97 billion.

In order to pay tribute to the old man and inherit the culture, Himalaya also launched the "Book Picking Up - New Book Appraisal Inheritance Project", hoping to enable more and more book critics and young book critics to participate in the creation of new books and enrich and inherit the intangible cultural heritage of book reviews.

Himalaya used speech synthesis technology to make the late master Shan Tianfang "say" the book again

After three years, I was able to hear the iconic "Cloud Shade Moon" voice again, thanks to the dedicated exploration and research and development of Mr. Shan's voice by the Himalaya Intelligent Speech Lab. In order to maximize the retention of Shan Lao's vigorous, hoarse and unique voice and emotional storytelling tone, the Intelligent Speech Lab has made a lot of efforts. Himalaya also invited professional sound engineers to add soundtracks and sound effects to each "one-style new work", so that listeners can get an immersive experience. With the blessing of senior sound designers, the world in the mouth of the single old man becomes more three-dimensional and vivid.

According to Dr. Lu Heng of the Himalaya Intelligent Speech Laboratory, Himalaya's self-developed TTS front-end text processing analysis module can perform polysyllabic word recognition, prosody prediction and style classification of text with high precision and full automation, and has developed a TTS technology model that can achieve multi-emotion, multi-style and multi-lingual sounds. Not only can it interpret words with different emotions, but it can also automatically distinguish between narration and dialogue, and support English, which greatly enriches the emotions and rhythms that TTS can express. Himalaya has applied for three patents related to TTS speech synthesis, including a technical framework that enables TTS sounds without any original English data to speak English, such as the ability to speak English with Mr. Shan Tianfang's "voice".

Himalaya used speech synthesis technology to make the late master Shan Tianfang "say" the book again

At present, Himalaya has used TTS for the production of a variety of content, helping creators to layout audio, transformation and upgrading. For example, the "Whale Express" album launched by Himalayas and the Beijing News has ranked first in the himalayan news album list for many consecutive weeks. The application of TTS technology will bring users richer and better content. Himalaya will continue to open up the imagination of sound, let technology bless sound, and let sound serve life. (End)

Editor: Yu Jun

Read on