Guo Yipu was sent from The Temple of Oufei
Qubits reports | Official account QbitAI
For the first time in history, artificial intelligence technology has been upgraded to the field of complex music creation: symphonies.
The world's first AI symphony variation, "My Motherland and Me", was premiered by the Shenzhen Symphony Orchestra last night, and its producer is the Ping An Artificial Intelligence Research Institute of China.
Previously, you may have known about Google's Magenta, OpenAI's MuseNet, and other music creation AI, which are mainly in a limited range of voices, imitating the style of musicians or singers such as Mozart and Lady Gaga, and creating short musical demos.
But this time, Ping An has broken through the scope of a symphony from a single-melody pop music to a symphony, originally only able to write a small demo melody, this time it can write 7 movements at once, and it is a mature work that can be directly performed.
The whole symphony lasts 12 minutes, you can hear the organ, violin and other sounds, as well as the main melody, accompaniment, drum beat and many different parts, the whole is very rich, the average person can not hear the AI composition, just like the work of professional human musicians.
Lin Daye, music director and chief conductor of the Shenzhen Symphony Orchestra, said passionately before the concert that a special work will be brought to the audience as the opening of this season's concert, and the orchestral work "My Motherland and Me" was composed by AI arrangement and premiered in the world today. Ping An of China has opened up a completely new field and ushered in an era.
"In the past 10 years or even 20 years ago, 3D animation has just entered people's field of vision, and there may be a variety of shortcomings. But after a short period of development, today's 3D animation is very advanced and realistic. Lin Daye further said that the music arranged by artificial intelligence technology is also a starting point today. It is expected that in the next 5-10 years, AI can create symphonic works that will be handed down through the ages. ”
Before the release of this symphony, Ping An had been exploring AI music for two years, and had long been familiar with the creation of popular music, this time choosing the symphony, a complex music basin, which is also a technological breakthrough in AI's artistic creation.
In addition to music, in various artistic fields such as painting and poetry, Ping An's artificial intelligence technology has also accumulated a lot.
Compared with ai companies that focus on industrial landing, Ping An is a financial technology company that is different and prefers to work hard in the spiritual world of human beings.
<h1>AI Narration: Symphonic Variations tell the story of China's century-old modern and contemporary history</h1>
As a variation, this piece was created on the original tune of "My Motherland and Me" and interpreted it in a different way.
Maybe you are not familiar with music theory, and you can't feel the power of AI applications.
Let's start with the content.
The beginning is the melody of "My Motherland and Me", which leads to the glorious history from modern times to our present.
The first variation takes us back to more than a hundred years ago, starting from the Opium War, the Chinese nation has entered a difficult period, the melody has become slow and sad, making you feel as if those ordinary people who have struggled to make a living under oppression are in front of you, repeating the hard years day after day.
Soon after, the tune became exuberant and hopeful, like a spark of sparks, and the oppressed ancestors united to seek to turn themselves into masters.
At the beginning of the second variation, a scream breaks through the sky, and the music becomes the taste of Xintianyou.
Here is the story of Yan'an. A burst of rhythmic and cheerful music shows the scene of male and female teachers working together and struggling together.
After that, the rhythm suddenly became majestic and exciting, the sergeant drum beat intensively, victory came, and new China was founded.
Moving to the third variation, it is a low march, with a tenacious pace, blowing the horn of the war of resistance.
When a series of ups and downs finally passed and the spring of reform and opening up arrived, the symphony also entered the fourth variation. The melodious sound of the violin is like a spring breeze, and multiple voices sing and harmonize, bursting with hope and vitality.
This is followed by the fifth variation, with a sonorous and powerful rhythm and a gradually high tune, echoing the footsteps of the great rejuvenation of the Chinese nation.
The five variations tell the history of the rise of the Chinese nation in the past century. Later, looking back, when the melody of "My Motherland and Me" sounded again, the entire symphony was also completed.
Listening to it as a whole, it is as if watching a revolutionary epic, and people can't help but sigh the hardships of struggle and the joy of achievements. If you are not a music expert, the average person will not be able to hear this song composed by AI, and the content of the music composed by musicians based on experience and professional ability is extremely similar.
<h1>AI Creation: Eight-dimensional self-developed model, which is more difficult than generating language</h1>
So, how did such a song come about by AI?
According to the technical leader of the AI Symphony Variations "My Motherland and Me" track team, behind the AI composition technology is the AVM automatic variation model pioneered by Ping An, which uses language models such as VAE, Transformer, and GPT-2.
First of all, the expert variation rule library is constructed in terms of rhythm, harmony, texture, orchestration, etc. for the training of the basic model. Then, the joint scheme of deep learning and reinforcement learning is adopted, the basic model training is carried out according to the description rules of music creation theory, and the deep learning technology is used to achieve multi-dimensional feature learning and extraction of musical works, and then combined with reinforcement learning technology, the machine can initially grasp the thinking logic of human composition and learn the variation of music.
However, although both language models are used, generating music and generating languages are very different.
The team leader said: "I am talking alone, but music, especially symphony, is like a group of people talking, everyone is talking, who comes first, what is your vocal range, what timbre I produce, this is a very complicated thing." ”
Moreover, AI creation of a symphony, and the creation of a simple melody is different, it needs to consider the theme of the music, development methods, harmony, song style and other eight dimensions, the technical difficulty is even higher.
In terms of data, the technical team introduced that Ping An AI has accumulated six major databases, including a music library of millions of songs, a database of lyric materials containing lyrics, poems, essays and other literary works, an expert rule database containing various composition elements and elements, a two-loud source library of musical instruments and vocals, and a user consumption behavior tracking database for analyzing the emotional feedback of users after hearing music. The creation of this AI symphony variation used more than 700,000 pieces of music for structural training.
With these as a foundation, the AI system can automatically generate corresponding music according to your needs.
At the beginning of the whole generation process, it is necessary to input the original tune of "My Motherland and Me", and then combine the historical events that each variation part needs to express, and enter the corresponding emotional expression needs, such as "sadness" and "cheerfulness", etc., and then the AI can automatically output the finished variation music that can be directly listened to.
Because some melodies in the AI-generated score cannot be played by humans, such as a human hand cannot press two keys that are far away from the piano at the same time, and some keys on the trumpet cannot be pressed at the same time, so in order to achieve the field performance of the music in the later stage, the Ping An Artificial Intelligence Research Institute supplemented by some expert rules in the process of creation to avoid excessive freedom and disorder in the creation of music. For example, it integrates harmony constraints, counterpoint constraints, and song structure constraints, so that AI composition is infinitely close to the original genre, so that the music has playability and inheritance.
<h1>AI Exploration: From AI Composition to Commercialization</h1>
In fact, in terms of AI music, Ping An has accumulated two years, having previously used AI to create popular music works "Youth Memory", which won the first prize of the Global AI Art Competition sponsored by Tsinghua University; he also studied jazz and won the laurel at the International AI Composition Grand Prix held by the Swiss Federal Institute of Technology.
Behind the achievements is Ping An's huge AI talent team.
The person in charge of the technical team said that there are more than 30 algorithm engineers directly involved in the creation of the symphony, and there are two or three hundred support teams, of which a large number of main creative team members understand both algorithms and music. You know, the AI doctor of the Central Conservatory of Music has just started this year, and people who understand AI and music can be said to be very few, and Ping An's talent reserve is really rare.
In the end, any competition is the competition of talents, the reserve of talents, the accumulation of technology, for the boundaries of artificial intelligence technology in the traditional cognition of a large number of applications in the field of industrial manufacturing, to achieve a multi-angle breakthrough, the first step into the field of human ideology, the use of artificial intelligence invisible hand, to achieve the wonderful world of the spiritual world.
Huge talent teams are also creating really usable business value.
Recently, Ping An has applied AI composing technology to the customer acquisition level of the just-concluded "Ping An 920" Financial Life Consumption Festival, providing various interactive projects including AI composition, enriching users' sense of experience through fun activities, attracting users' attention, lowering the threshold for customer acquisition, and strengthening customer acquisition scenarios, thereby enhancing the business value of the core main business.
Customer acquisition is only one of the angles in which AI music assists the development of Ping An's main business. In addition, the development of AI-assisted music and the breakthrough of the industry boundary level may be landed in the fields of music creation and music education in the future, which has fully opened up the imagination space for music as an emotional language expression.
In the next step, the technical team said that in addition to human music, Ping An is also considering extending AI music to biological music such as whales and birds, creating richer results.
In addition to composing music, Ping An has also landed AI in many fields such as writing poetry and painting. For example, with the help of the "Shenbi Xiao'an" mini program, through the identification of the user's uploaded pictures to judge the emotions, combined with the massive poetry database behind it, you can generate modern poetry and ancient poetry that are in line with the picture style.
For example, in this tree under the street lamp at night, Ping An AI gives a poem:
"Willows sandwich the east of the city, and the golden peak is a path."
<h1>AI Breakout: From internal empowerment to external output</h1>
What needs to refresh the impression may not only be the recognition of AI's latest skills.
It is also time to re-recognize the frontier AI technology pioneers, whether it is a global technology giant or a new Internet late-stage show, more and more will focus on this field of tentacles and eyes, artificial intelligence + music has become one of the irreversible development trends in the world.
Ping An, for example, China's first joint-stock insurance company founded in 1988, is now the world's largest integrated financial services group in the financial sector.
However, in addition to the main business of traditional finance, the AI symphony variation specially created to celebrate the 70th anniversary of the founding of New China is the tip of the iceberg of its AI strength.
In the past 10 years, Ping An's investment in the AI field has been a big deal, not only establishing an AI research institute, but also continuing to expand in AI innovation and research for many years. And not long ago at the World Artificial Intelligence Conference, Ping An of China was awarded the qualification for the construction of a new generation of artificial intelligence open innovation platform for inclusive finance by the Ministry of Science and Technology, and the artificial intelligence technology was recognized by the state and successfully promoted to the AI national team.
In terms of underlying technology research, Ping An has deep accumulation in speech semantics, image recognition, structured data modeling, and knowledge graph technology, and has a total of 18,050 various technology patents, and will continue to invest 1% of its revenue in scientific and technological research and development in the future.
At the level of massive data accumulation, Ping An has constructed a multi-domain knowledge graph, for example, at the financial knowledge graph level, which incorporates more than 910 million relationships, 121 million + person entities, 230 million + relationship nodes, and more than 30 million enterprise data; and the medical knowledge graph contains more than 500,000 medical terms, more than 5 million medical relationships, and 10 million + medical evidence.
These rich technical foundations and resources have provided impetus for Ping An's business.
Now, Ping An has applied AI to specific business levels such as medical health, financial risk control, investment, and macroeconomic analysis.
On the one hand, we will promote all-round empowerment of internal business.
For example, at the level of technology-enabled life insurance business, when screening insurance agents, the interview coverage rate of AI interviewers who play an auxiliary role reaches 100%, the accuracy rate of the high-simulation dialogue robot "AskBob" to the agent's consultation is as high as 95%, and the task query and intelligent handling functions cover 90% of the common needs of agents.
Ping An Property & Casualty uses its self-developed AI picture loss determination technology and accurate customer portrait technology to launch the "Trust Compensation" service for car owners with good safe driving behavior, pioneering the realization of a zero-manual operation mode in the background, and shortening the average compensation completion time to 168 seconds.
Ping An Bank has established a smart risk control platform covering the whole process of pre-loan, loan and post-loan, and realized five intelligent applications of intelligent decision-making, intelligent control, intelligent early warning, intelligent management and intelligent lending.
The latest data shows that Ping An Bank's AI voice customer service replacement rate has reached more than 80%, which has greatly improved customer service efficiency.
On the other hand, at the level of external ecological empowerment output, AI technology is also fully integrated into multi-field end-to-end integrated intelligent solutions, relying on this form to export technology to small and medium-sized banks, small and medium-sized insurance companies, financial institutions, medical insurance bureaus and hospitals, and also with the help of smart city business, to provide intelligent services for the government in the three major areas of excellent governance, industrial development and benefit of the people.
Intelligent marketing, intelligent loans, intelligent risk control, intelligent customer service, intelligent flash compensation and other massive intelligent solutions are widely favored by small and medium-sized financial institutions. According to the financial report data, Ping An's OneConnect has reached 3,707 external empowerment enterprises, including 615 banks, 81 insurance companies and 3,011 other non-bank financial institutions.
In addition to landing, the financial technology company also has the emotional side of expanding the boundaries of human technology, and AI creates a symphony, which is exactly the case.
Of course, this integrated financial giant has also quickly integrated into the "tradition" of AI technology companies:
According to the technical team, the Ping An's first AVM automatic variation model used by AI composer will be open sourced early next year.
If you are interested, you will be able to stand on the shoulders of your predecessors and create your own AI symphony.
— Ends —
Sincere recruitment
Qubit is recruiting editors/journalists to work in Zhongguancun, Beijing. Looking forward to talented and enthusiastic students to join us! For related details, please reply to the word "recruitment" on the qubit public account (QbitAI) dialogue interface.
Qubit QbitAI · Headline signed author
վ'ᴗ' ի Tracking new developments in AI technology and products