Generative AI is undoubtedly the absolute new outlet in the tech world in 2023, and it has changed the way people work and productivity in the past to a certain extent. In the fourth quarter of 2023, with the efforts of upstream chip manufacturers and terminal manufacturers such as MediaTek, generative AI mobile phones that support local AI large models, multi-modal capabilities, context-aware interaction and other functions have begun to emerge, so that generative AI is gradually moving towards the general public.
According to market monitor Counterpoint, less than 1% (about 4.2 million) of the 1.17 billion phones shipped in 2023 meet Counterpoint's criteria for defining generative AI phones.
Looking ahead to the future of generative AI phones, Counterpoint is optimistic: it expects the penetration rate of generative AI phones to reach 43% of the market by 2027, and its stock will jump from 4.2 million units to 1.23 billion units.
(Source: Counterpoint's "Generative AI Mobile Phone Industry White Paper")
Of course, behind this optimistic figure, it requires the joint efforts of different participants in the upstream and downstream of the entire industry. In this regard, on May 7, at the MediaTek Dimensity Developer Conference 2024 (MDDC 2024) with the theme of "AI for Everything", in addition to the Dimensity 9300+ flagship 5G generative AI mobile chip, MediaTek also joined hands with ecological partners and developers to bring "Dimensity AI Pioneer Program", "Generative AI Mobile Phone Industry White Paper", "Dimensity AI Development Kit" and other blockbuster plans, blockbuster views and blockbuster technologies, leading the entire end-side generative AI industry forward.
From Dimensity 9300 to 9300+: MediaTek provides strong computing power guarantee for generative AI phones
Launched at the Dimensity Developer Conference, the Dimensity 9300+ continues the all-core CPU architecture and provides strong performance support for flagship phone users and gamers. At the same time, they are also equipped with a new generation of APU 790, which has a built-in hardware-level generative AI engine, and is the first to support AI speculative decoding acceleration technology, Dimensity AI LoRA Fusion 2.0 technology, and 7 billion or even 13 billion generative AI large models on the device side, which can provide users with a more efficient and personalized generative AI experience.
Since its release last year, the Dimensity 9300 has become the first choice for flagship models such as the vivo X100 series and the OPPO Find X7, and has implemented functions such as AI elimination, AI call summarization, and AI assistant to improve users' life efficiency, so that more and more users can experience the convenience brought by generative AI.
Li Yanji, deputy general manager of MediaTek's wireless communication division, further said in an interview after the meeting that MediaTek launched the first mobile phone chip equipped with an AI capability processor as early as 2018, when AI was mainly used in mobile phone computing images. For example, the APU 790 on today's 9300+ is also through the unremitting technical research and development of its APU products, so that it can run different generative AI applications and accelerate the landing of generative AI in the consumer market under the compact mobile phone body space and demanding power consumption requirements.
In addition, with the improvement of the comprehensive performance, AI computing power and process of the mobile phone chip platform, the scale of large model parameters on the mobile phone will continue to grow. On the other hand, the capabilities of SLM small models are also rapidly improving, which is also a favorable trend for the device side, providing the underlying support of the chip for powerful audio and video processing capabilities and multi-language interaction. At present, the Wensheng diagram, Tusheng diagram, and super AI assistant functions on generative AI mobile phones will continue to be upgraded and optimized, and some AI-oriented PC office and creative assistance functions may also be gradually migrated to device mobile phones in the future.
Dimensity AI Development Kit: A one-stop shop for generative AI solutions
The Dimensity 9300/9300+ and Dimensity 8300 powered by the 7th generation APUs provide powerful hardware performance support for generative AI applications. However, in addition to the problem of hardware computing power, there are also problems such as a wide variety of large models, long development cycles, and great difficulty for developers. In this regard, MediaTek has brought the Dimensity AI Development Kit to provide developers with a one-stop solution for terminal generative AI application development, covering smart phones, smart cars, Internet of Things, personal PCs and other smart terminal devices.
The Dimensity AI Development Kit includes fast and efficient GenAI best practices, which can accelerate the deployment of large models on the terminal through advanced model quantization, model compilation, and model inference technologies, reducing the time that could take weeks to just one day. GenAI Model Hub, which covers the world's mainstream large models, provides developers with abundant large model resources, greatly reducing the difficulty and complexity of model deployment. GenAI optimization technology, which efficiently improves performance, has introduced a number of the industry's latest and fastest software optimization technologies, which can significantly improve the generation speed of AI applications and greatly reduce the demand for storage space. Neuron Studio's one-stop visual development environment can provide developers with one-stop visual development tools, breaking the limitations of the traditional code development environment.
The four modules on the Dimensity AI Development Kit meet the core needs of developers for "fast, complete, strong, and easy", effectively reducing the difficulty and cycle of developing generative AI applications.
MediaTek is the first to offer developers a complete toolchain such as the Dimensity AI Development Kit on the device side, as well as other consumer devices. At present, dozens of partners such as Alibaba Cloud Tongyi Qianwen, Cocos, Honor of Kings, Huya Live, Kugou Music, Meitu, WeSing, RWKV, Soul, Tencent AI Lab, Xiaohongshu and other partners have participated in the event. At the Dimensity Developer Conference, we experienced the generative AI applications they brought to the conference, such as super AI assistants, content creation, games and e-sports, live streaming, music, social networking, and so on.
In the generative AI mobile phone ecosystem, MediaTek plays a leading role in both the tool chain and the implementation of related applications, promoting the development of the entire industry. Li Yanji said in an interview that in the future, with the continuous enhancement of MediaTek's chip capabilities, the continuous evolution of new generative AI technologies, and the feedback from developers, MediaTek will continue to evolve and improve the entire tool chain.
Form a generative AI ecosystem and become the definer of the industry!
In the development process of generative AI mobile phones, it is inseparable from the close cooperation of OEM mobile phone manufacturers, large model manufacturers, developers and chip manufacturers.
At this Dimensity Developer Conference, MediaTek, together with Alibaba Cloud, Baichuan Intelligence, Transsion, 01000, OPPO, Honor, vivo, and Xiaomi, launched the "Dimensity AI Pioneer Program", which will provide global developers with development resources, technical support and business opportunities from MediaTek and industrial ecological partners.
At the same time, MediaTek and Counterpoint, together with Alibaba Cloud Tongyi Qianwen, Baichuan Model, Huya, Kugou Music, Zero One Everything, OPPO, Soul, Tencent AI Lab, Tencent Mixed Yuan, vivo, etc., jointly released the "Generative AI Mobile Phone Industry White Paper", jointly defining the concept and typical characteristics of "generative AI mobile phones".
We see that in the Dimensity AI Pioneer Program and the "Generative AI Mobile Phone Industry White Paper", MediaTek connects the majority of OEM mobile phone manufacturers, large model manufacturers, developers and other different ecological participants to open up the ecological link from the bottom layer of the chip to the system, model to application, which not only provides strong technical and resource support for the industry, but also allows different participants in the ecological link to have a more adequate and efficient communication platform with other members, so as to create the technology, solutions and products required by the market to achieve empowerment and sustainable development. Accelerate generative AI from a technical concept to an industry trend, and then gradually integrate it into our lives and work.
MediaTek is transforming from a chip manufacturer that provides software and hardware products and services for the industry to a definer and initiator of the generative AI industry, which is not only due to MediaTek's current leading and mature generative AI chip solutions in the mobile phone industry, but also as a leader in the smartphone market.
According to data released by market research institute Counterpoint, from the third quarter of 2020 to the fourth quarter of 2023, MediaTek has ranked first in the global smartphone SoC chip market shipments for 14 consecutive quarters, and is deeply recognized by OEM mobile phone manufacturers and loved by users. With shipments and market affirmation, MediaTek can have enough strength and volume to build a generative AI ecosystem with OEM mobile phone manufacturers, large model manufacturers, and developers, and MediaTek's "circle of friends" is also accelerating its expansion.
Of course, MediaTek not only focuses on promoting the development of generative AI, but also launched a fully upgraded "Star Speed Engine" at the Dimensity Developer Conference, with the help of adaptive technology and hardware ray tracing technology software development kit, it can provide OEMs, game engine vendors, game developers with a series of game experience enhancement solutions such as performance management, ray tracing effect optimization, network monitoring, etc., to help the industry and users create a more realistic and smooth picture, faster touch and network response, and longer battery life Dimensity gaming experience.
Summary:
As mentioned in the "Generative AI Mobile Phone Industry White Paper", the rapid increase in the scale of generative AI mobile phones is also an explosive growth in the demand for peak AI computing power, and generative AI mobile phones are inseparable from chip computing power and the support of chip manufacturers behind it.
For MediaTek, generative AI is a new outlet and a new challenge. Therefore, while doing a good job in the performance of the Dimensity chip platform and the Dimensity AI development kit to provide professional software and hardware support for the industry, MediaTek's huge lineup of full-dimensional ecological partners displayed at MDDC, as well as numerous landing functions and applications, also shows that MediaTek has become a leader in the generative AI mobile phone market.
Next, let's continue to pay attention to MediaTek and its partners to continue to make the generative AI ecosystem bigger and stronger!