The successful deployment of the Tongyi Qianwen model on MediaTek Dimensity chips marks the official entry of the end-side model into the commercialization stage. This breakthrough is due to the in-depth cooperation between MediaTek and Alibaba Cloud, and the two sides have realized the adaptation of Tongyi Qianwen's 1.8 billion and 4 billion parameter large models on flagship chips such as Dimensity 9300. Through chip-level optimization, Tongyi Qianwen can smoothly run multiple rounds of AI conversations in an offline environment, with a CPU usage of only about 30% and a RAM occupation of less than 2GB. This means that users don't need to be connected to the Internet to interact with their phones smoothly and naturally, and get assistant-level services.
The commercialization of the device-side large model will bring revolutionary changes to the way smartphones interact. Users can say their needs to their phones anytime, anywhere, and the AI assistant powered by the Dimensity chip and Tongyi model will automatically build and execute the task. For example, if a user can verbally say "help me plan a route from home to work", the AI assistant will comprehensively consider real-time road conditions, transportation, travel preferences and other factors to plan the optimal route and navigate. For another example, if a user says, "I want to travel to Thailand, help me make an itinerary", the AI assistant will recommend attractions, hotels, and transportation according to the user's time, budget, interests, etc., and generate a personalized travel plan.
The powerful natural language understanding and generation capabilities of the Tongyi Qianwen model enable users to interact with their mobile phones in the most natural way. Traditional interaction methods such as touch and voice assistants are often limited by fixed instructions and scenarios. On the other hand, Tongyi Qianwen can accurately understand the user's intentions and conduct multiple rounds of conversations according to the context to provide personalized services. Users don't need to memorize complex instructions and keywords, they only need to express their needs in everyday language, and the phone can "read" and give intelligent responses. This will greatly lower the threshold for smartphone use, making it easy for everyone to enjoy the convenience brought by AI.
The adaptation of Tongyi Qianwen on MediaTek chips has also brought a broad space for innovation to terminal manufacturers and developers. Traditional mobile AI applications often rely on the computing power of the cloud, which is limited by network bandwidth and latency. The device-side deployment of Tongyi Qianwen makes the mobile phone have more powerful local intelligence. Manufacturers can develop various innovative applications on this basis, such as smart schedule management, personal health assistants, smart photo albums, etc. Developers can also use the APIs provided by Tongyi Qianwen to create applications based on multimodal interaction, such as voice-controlled games, visual Q&A, etc. The device-side model will give birth to a new application ecology and inject new vitality into the mobile phone industry.
As the world's largest smartphone chip manufacturer, MediaTek plays a key role in the development of end-to-end AI. In recent years, MediaTek has continued to make efforts in 5G chips and flagship chips, and has launched the Dimensity series of high-end chips to counter Qualcomm's Snapdragon chips. The Dimensity chip not only achieves industry-leading performance and power consumption, but also integrates an AI-specific APU unit. It is thanks to the powerful computing power and energy efficiency of the Dimensity chip that the device-side deployment of Tongyi Qianwen is possible. It is foreseeable that with MediaTek's continuous breakthroughs in chip technology and architecture, the capabilities of device-side AI will be further improved.
The successful deployment of Tongyi Qianwen on MediaTek Dimensity chips is a milestone event in the development of end-side AI. It marks the transition of large models from the cloud to the terminal, from the laboratory to commercialization. This breakthrough will not only reshape the way mobile phones interact, but also bring new growth points to the entire mobile phone industry. Users will enjoy smarter, more natural, and more personalized services, and vendors and developers will also usher in new opportunities for innovation. As a leader in end-to-end AI, MediaTek is working with industry partners to accelerate the intelligent process of smartphones and make AI benefit everyone.