Artificial intelligence has become an important driving force for a new round of scientific and technological revolution and industrial change. At the recent China Automation Conference, Wang Haifeng, chief technology officer of Baidu and director of the National Engineering Laboratory for Deep Learning Technology and Application, was invited to make a report on the theme of "AI Large Production Platform", explaining how Baidu Flying Propeller and Wenxin Big Model can significantly reduce the application threshold and help AI universal benefits in the AI large-scale production stage.
Baidu CTO Wang Haifeng
As an AI infrastructure platform, the deep learning platform is regarded as an "operating system in the intelligent era" by connecting chips and inheriting applications. Baidu Flying Propeller is the first industry-grade deep learning open source open platform independently developed in mainland China.
Wang Haifeng introduced that Feipao has continued to innovate in the development of core framework, end-to-end adaptive distributed training technology, training and promotion integrated tool chain, hardware adaptation unified solution, modular industry-level model library, etc., which has greatly reduced development, training and deployment costs and improved the efficiency of the whole chain.
Based on the flying propeller, the whole process of deep learning technology research and development has significant standardized, automated and modular industrial large-scale production characteristics, which continues to reduce the application threshold and makes artificial intelligence technology can be applied to all walks of life efficiently and conveniently. At present, Feipao has gathered 4.77 million developers, served 180,000 enterprises and institutions, and created 560,000 models, which have been widely recognized by all sectors of society, and the AI ecosystem is becoming increasingly prosperous.
In addition to actively releasing the value of the platform at the industrial end, Feipao also cooperates with universities and research institutes to help the cultivation of composite AI talents; In terms of hardware ecology, the cooperation between Flying Propeller and hardware partners is also deepening, at present, Flying Propeller has adapted to more than 30 kinds of mainstream chips/IP at home and abroad, and has also launched the manufacturer version of the Flying Propeller framework, construction model library, and development courses to better serve developers and promote ecological prosperity and win-win results.
Based on the flying propeller, Baidu further climbed the technical highland of the pre-training big model, and created a Wenxin industry-level knowledge enhancement model, which can integrate learning from large-scale knowledge and massive data, and continuously reduce the threshold for AI development and application.
If according to the traditional method, for different tasks, such as information extraction, sentiment analysis, question answering, etc., different models need to be trained, which is a decentralized model development mode; The big model is an intensive model development model, which has good versatility and generalization.
Specifically, the big model is the abbreviation of the artificial intelligence pre-training large model, which contains two meanings of pre-training and large model, and the combination of the two has produced a new artificial intelligence model, that is, the model does not need to be fine-tuned after pre-training on a large-scale data set, or only requires a small amount of data fine-tuning, which can directly support various applications. As one of the hot directions of emerging and rapid development in the field of new artificial intelligence infrastructure, the large model has continuously created new highs in parameter scale and model performance in recent years, and gradually consolidated the base of artificial intelligence technology.
Wang Haifeng introduced that under the strong support of the integrated technology of flying paddle training and reasoning, the Baidu Wenxin family has released more than 20 large models, in addition to the basic general model represented by Pengcheng-Baidu Wenxin, it also includes the United Nations network, the state grid developed by Pudong Development - Baidu Wenxin and Pufa - Baidu Wenxin, as well as the aerospace - Baidu Wenxin model jointly developed by China Aerospace. At present, the Wenxin big model has been landed in many industries such as energy, aerospace, agriculture, and banking, realizing efficient production and truly being used by the industry.
Wang Haifeng said that in the broad picture of AI industrial large-scale production in the future, based on the flying propeller platform and the Wenxin big model, the threshold for AI development and application is constantly decreasing, and everyone can become a developer of intelligent applications. Ai large-scale production platform is empowering thousands of industries and benefiting thousands of households.