"Immortal fight, Pangu is here!" Huawei Pangu Model 3.0 was officially released

The big model began to "roll" up.

At the end of last year, ChatGPT threw a "stone" at the long-noisy AI "lake", gaining 100 million users in just 2 months.

When students use it to write papers, programmers let them help generate code, and even I, as a small editor, use ChatGPT to make titles, AI large models are silently integrated into our daily lives like a continuous drizzle.

One stone stirs up a thousand waves

"One stone stirs up a thousand waves." Suddenly, the big domestic models have sprung up. While in March, the office was still discussing whether Baidu's big model was "Wenyan Yixin" or "Wen Xin Yiyan", Alibaba's "Tongyi Qianwen" in April, iFLYTEK's "Spark Cognition" in May, and the Chinese Academy of Sciences' "Zidong Taichu 2.0" swept up again.

Recently, after China Unicom officially announced the "Honghu" big model, China Telecom also claimed that it will release the "TeleChat" big model, and China Mobile's "nine days" 1+N big model is also "ready to move". Even operators have begun to enter the big model, can it be said that the big model track has really become a "battleground" in the Internet field?

Today, Huawei also began to release Pangu Large Model 3.0. Although large models in the industry are emerging one after another, from registering "Pangu" and "PANGU" trademark patents, to refuting rumors that Pangu large models are called "Banggu Chat", Huawei's big model's every move has still attracted the attention of the industry.

In fact, Huawei has been researching large models since 2020, and in April 2021, at the HDC conference two years ago, Huawei released Pangu NLP Large Model 1.0 and Pangu Vision Large Model. At that time, Yu Chengdong, then CEO of HUAWEI CLOUD, also praised the important thing that "HUAWEI CLOUD Pangu model is a very, very, and very shocking product in the AI industry" three times.

The Pangu NLP large model in 2021 is not only the industry's first Chinese model with 100 billion parameters, but also learns more than 40TB of industry text data and 4 million hours of industry voice data in the pre-training stage, with 110 billion parameters. In large models, parameters play an important role. The so-called AI big model is to import massive data into a model with hundreds of millions of parameters, and the machine is finally trained into an artificial intelligence with logical reasoning and analysis capabilities after completing tasks like "cloze". At present, the parameters of large models are at the quadrillion level, and GPT-3 has 175 billion parameters (that is, 175B). Then, in May 2021, the "Pengcheng Pangu" large model with a maximum version parameter of 200 billion was also unveiled, and the Pangu large model in 2021 can really be called "thick and thin".

At the same time, the Pangu Vision (CV) large model in 2021 is also a CV large model with more than 3 billion parameters. At the time of pre-training, 1 billion images are input, which can meet the understanding needs of both underlying image processing and high-level semantics.

Since then, Huawei has successively launched the Pangu Scientific Computing Model, the Pangu Mine Model, the Pangu Meteorological Model, the Pangu Wave Model, and the Pangu Financial OCR Model.

Just one day before Huawei officially released Pangu Model 3.0, another blockbuster news brushed the screen - the research results of HUAWEI CLOUD Pangu Meteorological Model were published in Nature. It is understood that this model is the first AI model whose accuracy exceeds that of traditional numerical prediction methods, and the speed is more than 10,000 times faster than that of traditional numerical prediction. This paper is a regular paper published by Chinese technology companies as a signatory in recent years, and the reviewers of Nature have also highly praised the results. This good news has added a look forward to the release of Pangu Model 3.0.

A thousand calls have come out

"A thousand calls come out". Today, Zhang Pingan, Executive Director of Huawei and CEO of HUAWEI CLOUD, officially released Huawei Pangu Model 3.0. Faced with the current situation of "immortal fighting" of large models, he said: "Since OpenAI released ChatGPT, various large models have emerged one after another. According to incomplete statistics, hundreds of large models have been released worldwide, and more than 80 have been released in China alone. Some large models can write poetry and paint. However, Huawei's Pangu model does not write poetry, only does things, because it must go deep into all walks of life and empower all walks of life to create value. ”

Huawei's basic big models, industry big models, and subdivided scenario big models are divided into L0, L1, and L2 layers. According to Zhang Pingan, Pangu Big Model 3.0 is an industry-oriented large model series, including "5+N+X" three-layer architecture, of which "5" refers to the five basic large models of natural language, vision, multi-modality, prediction and scientific computing at the L0 layer; "N" refers to N industry big models at the L1 layer, and HUAWEI CLOUD can provide industry-wide models trained using industry open data, including government, finance, manufacturing, mining, and meteorology. It can also be based on the industry customer's own data, on the L0 and L1 layers of the Pangu large model, to train its own proprietary large model for customers; "X" means that the L2 layer provides customers with more detailed scenario models and unlimited "X" possibilities, and L2 focuses more on specific industry applications or specific business scenarios such as government hotlines, network assistants, lead drug screening, conveyor belt foreign body detection, typhoon path prediction, etc., to provide customers with "out-of-the-box" model services.

It is worth mentioning that the Pangu large model adopts a complete hierarchical decoupling design, which can quickly adapt and quickly meet the changing needs of the industry. Customers can either load separate datasets for their large models, upgrade the base model separately, or upgrade the capability set separately. Based on the L0 and L1 models, HUAWEI CLOUD also provides customers with a large model industry development kit, which allows customers to have their own exclusive industry models through secondary training on their own data. At the same time, according to the different data security and compliance requirements of customers, Pangu Grand Model also provides diversified deployment forms of public cloud, large model cloud zone, and hybrid cloud.

At present, the Pangu model has played a great value in many industries such as finance, finance, manufacturing, pharmaceutical research and development, coal mining, and railway. In the field of government affairs, HUAWEI CLOUD and Shenzhen Futian District Government Service Data Management Bureau launched Xiaofu, a Futian government smart assistant based on the Pangu government affairs model, which can accurately understand people's consultation intentions, change the traditional one-netcom model, and transform the people's words into the language of government affairs, making cities more loving. In the field of coal mines, the Pangu Mine model has been used in 8 mines across the country, and a large model can cover more than 1,000 subdivision scenarios under the business processes of mining, mining, machinery, transportation, transportation, washing and other business processes of coal mines, so that more coal miners can work on the ground, which can not only make the working environment of coal miners more comfortable, but also greatly reduce safety accidents; In the field of drug development, it turns out that the development of a new drug takes an average of 10 years and costs $1 billion. The Pangu drug molecular model helped the team of Professor Liu Bing of the First Affiliated Hospital of Xi'an Jiaotong University discover the world's first new target and new class of antibiotics in 40 years, shorten the lead drug development cycle to 1 month, and reduce the R&D cost by 70%...

"Pangu was born for the industry, so we must think about the industry and better serve customers from thousands of industries." Zhang Pingan said that the Pangu model should allow every industry, every enterprise and everyone to have their own expert assistants to make the work more efficient and easier. We have always adhered to the strategy of AI for Industries and continued to move forward on the road of deep cultivation of the industry. I firmly believe that big models will reshape industries, and every developer will be a hero who will change the world.

epilogue

In ancient Chinese legends, Pangu brought the chaotic universe to life by "opening up the heavens and the earth". It is hoped that Huawei's Pangu model can also bring a smarter and brighter future to the industry in the trend of artificial intelligence, and create a "new universe"!

END

Author: Gai Beibei Editor/Format: Zhen Qinglan Review: Shu Wenqiong Producer: Liu Qicheng

Three times in a row, spend a little summer together