As artificial intelligence enters the stage of industrial large-scale production, the AI model is accelerating out of the laboratory and gradually achieving a breakthrough in industrial application on a global scale. Since 2020, more and more technology giants and scientific research institutions have participated in it. In December last year, Baidu released the world's first 100-billion-level big model of knowledge enhancement - Pengcheng - Baidu Wenxin big model, and the industry-level knowledge enhancement "Wenxin big model" series of big models were also officially released. Baidu Wenxin Model is promoting the development of AI in China from the aspects of independent technological innovation and accelerating industrial applications.
Why has the AI model ushered in a big explosion in recent years? How can the AI model better adapt to industrial needs in the process of landing? From research and development to landing, what has the Baidu Wenxin model experienced? What kind of whimsy will the technical white use the big model of Wenxin?
Wenxin big model "Technology Tiantuan" debuted, bringing a feast of AI technology full of dry goods!
On April 16, the Baidu Wenxin Big Model Technology Open Day and the Baidu Cognitive AI Creative Competition - AI Creative School Final will be held at the same time, focusing on the technology and landing progress of baidu Wenxin Big Model. Wu Tian, vice president of Baidu Group and deputy director of the National Engineering Research Center for Deep Learning Technology and Application, Wu Hua, chairman of Baidu Technical Committee, Wang Jingdong, chief scientist of Baidu Computer Vision, Yu Youhai, chief architect of Baidu Feipao, Sun Yu, outstanding R&D architect of Baidu, and other technology giants will collectively appear to share insights into the development trend of big model technology, the latest technological breakthroughs and industrial application practices of Wenxin big model, bringing a feast of AI technology full of dry goods for technology enthusiasts. The developers of the creative competition will also bring a fun DEMO based on the Wenxin big model to share the innovation stories in the competition.
"Wenxin Big Model Technology Open Day"
Celebrity guests and schedule
How to watch
The "Wenxin Big Model Technology Open Day" will be held online live, through the following link to make an appointment:
http://wx4bb82cbc6e48b545.mp.weixinhost.com/addon/app-commonapply?a=index&channel_id=1514612829808889856&form_id=1514250345277165568#/
Introduction to the agenda
Wenxin Big Model: A Detailed Explanation of the Knowledge-Enhanced NLP Model
Wu Hua is the chairman of Baidu Technical Committee
The development of pre-trained language model technology has rapidly promoted the great improvement of the effect of various tasks in the field of natural language processing. This report will introduce the development history of Baidu Wenxin big model, share the relevant content of the knowledge-enhanced NLP big model, and share how to introduce multi-heterogeneous information such as knowledge graph, multi-language, and multi-modal on the continuously learnable model framework, and continuously enhance the model capabilities, thereby greatly improving the model effect.
Wenxin Big Model: CV Basic Model and Application
Wang Jingdong is the chief scientist of Baidu computer vision
The essence of the visual basic model is to learn visual knowledge from a large amount of data and integrate it into the model to improve the performance of downstream visual tasks. This report introduces several representative aspects of Baidu's work in the field of visual basic model pre-training and its performance in real business applications. The report will begin with an introduction to pre-trained visual representation learning based on image text and video text weak supervision, which improves search performance for images, videos, and commodity images. Then, self-supervised characterization pretraining will work in both general and vertical domains such as OCR structure and face biopsy. Finally, we will introduce the model miniaturization technology that opens up the landing of the basic model.
Wenxin Big Model: Distributed Training and Flying Propeller-Based Training
High-performance inference
Yu Yuhai, Chief Architect of Baidu Flying Oars
While large models bring improvements in performance, they also bring new challenges to training and inference deployment. Relying on the powerful distributed training ability of Feipao, Wenxin Big Model has evolved iteratively and efficiently, successfully released a series of models with leading scale and effect, and has high-speed inference capabilities on super-large-scale models. This report will introduce the technical challenges and responses of large models to deep learning distributed training, the innovative technologies and overall solutions of Flying Propeller in large model training, and the practical experience in supporting Wenxin Big Model Training, and will introduce the latest progress in high-performance inference of Flying Propeller supporting Wenxin Large Model.
Wenxin· NLP big model tools, platforms and applications
Sun Yu, Outstanding R&D Architect of Baidu
In the era of artificial intelligence, making full use of big data and large models, taking into account the landing cost and deployment efficiency, it is necessary to combine technology and industrial applications. Ernie, the earliest and most widely used knowledge-enhancing NLP model released in wenxin model, has topped the global authoritative list OFUE and SuperGLUE, and has been widely used in finance, communications, enterprise services, Internet and other industries. This report mainly focuses on the NLP big model tools and platforms based on ERNIE, and shares how to make full use of the world's leading ERNIE series big model to improve application effects and create business value through practical application cases.
As an industry-level knowledge enhancement model, Baidu Wenxin Big Model includes NLP (Natural Language Understanding) big model, CV (computer vision) big model, cross-modal big model, not only basic and universal big model, but also a big model for key areas and key tasks, as well as a wealth of tools and platforms. At present, the Wenxin model is not only applied to various products within Baidu on a large scale, but also empowers all walks of life in industry, energy, finance, communications, media, education and other industries through the Feipao open source open platform and Baidu intelligent cloud.
It is based on the solid technical strength and industry empowerment experience of Wenxin Big Model that Baidu launched the Baidu Cognitive AI Creative Competition - AI Creative School in October last year. Regardless of whether you have a programming foundation or not, the ability to build on the Big Model can fully inspire and realize ideas. The virtual life of the metaverse, the AI version of the "anti-fraud App", the continuation of a novel, the magical plants have everything... Nearly 2,000 fantastic ideas have been turned into DEMO and landing solutions because of the Wenxin big model.
On the afternoon of April 16, the final of the AI creative school will officially kick off, and the contestants will conduct the final competition through the live roadshow. At the final scene of ai creative school, you can learn about the latest technological development direction and application value of Baidu AI, harvest the information and knowledge of Wenxin big model, see the interesting DEMO and the story behind it developed based on Wenxin big model, and witness the annual AI creative competition