Recently, Tencent Music Entertainment Group (TME) created the first "ROCK N Code, Let Technology Speak" TechME Technology Week was grandly launched. TME technical experts, top scholars in the music industry, excellent technical teams, etc. gathered here to share music scientific and technological achievements and explore cutting-edge music technologies. Among them, Dr. Jiang, the head of Lyra Lab, the first audio and video research laboratory under TME, and his team members shared "Adding SOME AI to Music - Lyra Lab Black Technology Revealed", "Cutting-edge Audio Technology Application" and "Recent Practice of Video AI Technology" which attracted industry attention, and this is also the first blockbuster appearance of Lyra Lab.
Dr. Jiang of Lyra Room Laboratory shared "Add SOME AI to Music- Lyra Laboratory Black Technology Revealed"
Lyra Lab is committed to researching the ai direction related to audio and video, and continues to introduce innovative technologies to enhance the music audio-visual experience of the Group's QQ Music, National K Song and other platforms. The laboratory has been upgraded from the predecessor "Multimedia R&D Center", since its inception, Lyra Laboratory has continuously attacked and innovated, achieved remarkable results in the field of audio and video technology, and has mastered 384 patented technologies, including the champion of the Milex Audio Fingerprint Competition, and many other domestic and foreign audio and video heavyweight awards, and a number of papers have been included in ICASSP, IJCNN, INTERSPEECH and other major international forums.
Introduction to Lyra Laboratories technology
As Zhou Wenjiang, vice president of technology of QQ Music Business Line, shared, "In the name of the romantic seven-stringed piano constellation in the Sky Dome, Lyra Lab not only demonstrates their unremitting pursuit of exploring the 'music starry sky', but also adheres to the mission of science and technology for good, and effectively uses black technologies with temperature such as "listening to songs and reading songs", "cover song recognition", "AI intelligent editing", "video playlists" and other black technologies to provide users with a better music entertainment experience." ”
Today, the black technology of Lyra Labs has been incarnated into various practical functions and applied to various platforms under Tencent Music. In terms of audio, QQ Music "Listening to Songs and Recognizing Songs" has become an "essential artifact" for the majority of music fans to find strange and good songs, and they will no longer miss their favorite songs. As early as the 2019 International Audio Retrieval and Evaluation Competition (MIREX), the technology of "listening to songs and recognizing songs" won the world championship of "Audio Fingerprinting", which is still the leading level in the industry.
In addition, the "intelligent sound repair" of Lyra Lab is equivalent to equipping each user of the national K song with an exclusive "million mixer", allowing users to easily complete the "one-click beautiful sound". When the user completes the singing work, the breakthrough "singing evaluation" technology of the national K song realizes the evaluation of the user from the five dimensions of pitch, rhythm, skill, breath, and even emotion, and has become the user's "voice Bole" and even "singing growth assistant"! These two technologies have effectively reduced the threshold for users to sing K songs and learn to sing, and truly realized the "K songs for all"!
QQ music listening song recognition and national K song intelligent sound repair function
In terms of video, Lyra Labs is also extraordinary. In response to the beauty needs of live broadcasters, Lyra Labs has realized the dual guarantee of beauty and video quality through "smart skin beautification" and "video denoising" technology; and the song vertical video MV is derived from the "AI intelligent editing" technology, which not only realizes the batch conversion of horizontal MV to vertical screen MV, but also ensures the beauty and rhythm of the video after intelligent editing, so that the beautiful music is "seen" by more users.
QQ music song playback video page
In addition, a large number of practical technologies such as AI voice reading, intelligent sound effects, video playlists, and scan MV recognition have been applied to various audio entertainment apps of Tencent Music, and these scientific and technological achievements are inseparable from the efforts and collaboration of professional researchers. It is understood that Lyra Laboratory not only brings together more than 30 researchers and technicians from Tsinghua University, Fudan University, Hong Kong Polytechnic University and other top universities and scientific research institutions at home and abroad. As early as last December, the laboratory cooperated with Professor Xie Lei, a professor at Northwestern Polytechnical University and an expert in the field of artificial intelligence, in the speech synthesis of long audio, providing users with more real and interesting sound audio.
Zhou Wenjiang, vice president of QQ Music Business Line Technology, presented an appointment certificate to Xie Lei, an expert in the field of artificial intelligence at Northwestern Polytechnical University
In this year's 99 public welfare activities, QQ Music launched the first domestic low-frequency public welfare album - "Hearing "Inaudible" Music", which is the use of intelligent audio technology such as "sound companion separation, music generation, accompaniment adaptation, and song synthesis" of Lyra Laboratory, without destroying or changing the melody of the original song, the song was adapted to the hearing range of people with medium and high frequency hearing loss, so that the song perfectly conformed to the hearing range of children with medium and high frequency hearing loss. Let the children with high-frequency hearing loss also harvest warmth and happiness in the melodious music.
Shenzhen Hopu Special Needs Child Development Center High Frequency Hearing Loss Children Listen to Low Frequency Public Welfare Albums
To be good with music technology, it is not only in the warm public welfare, but also in allowing more people to easily enjoy the joy and beauty of music every day, such as QQ Music's newly launched "Hi-Res" high-quality music zone is undoubtedly to provide users with a high-quality listening experience. As high-resolution audio, Hi-Res brings more and more users an immersive music experience with richer details, broader dynamics, and sounds closer to the original information than CD sound quality.
Lyra Lab, in the name of the stars, has an innovative and influential team in the industry, and hopes that more outstanding AI technical talents will join in the future to jointly create a beautiful new experience of music, so that users can feel the rhythm and beauty of music!