The cockpit is the most intuitive embodiment that allows users to perceive the level of intelligence of the car, and it is also the user's first impression of the intelligent car. For the development of automobiles, new technologies such as chips, AI technology, operating systems, human-computer interaction, cloud services, and big data are rapidly "getting on the car" as never before, and are first concentrated on the cockpit. As an interdisciplinary and diversified product, the intelligent cockpit has a more complex industrial and service ecology, and OEMs, suppliers, new car-making forces and technology companies are all involved in the overall situation of the intelligent cockpit.
It is in such a chess game involving many parties to "join the vertical and horizontal", a thousand-mile horse is galloping forward.
SenseTime is considered to be the largest AI software company in Asia. By building a general artificial intelligence infrastructure unprecedented in the industry and promoting the mass production of multi-functional ultra-high-precision AI models, SenseTime has helped more than 2,400 customers from all walks of life to obtain better experiences and technology upgrades.
Under the background that smart cars are gradually becoming a key hub for smart cities, smart travel and smart life, SenseTime has stepped into the jianghu of smart cars across the "shadow" of Maxima.
Image source: SenseTime
Rooted in six years, the results are remarkable
SenseTime's smart car business has a very high starting point.
As early as 2016, SenseTime began to develop the Absolute Shadow Intelligent Vehicle Platform, and in 2017, it became a strategic partner with Honda, the world's top automaker, to provide it with AI technology related to autonomous driving.
By 2022, with the opportunity of AI original technology breaking the red line of industrial applications, SenseTime, which has successively realized scene verification and large-scale landing in the fields of smart business, smart city, and smart life, will continue to migrate its accumulated AI technology and engineering capabilities to the automotive field.
Up to now, SenseTime has cooperated with more than 30 automobile companies and has been selected as a supplier of more than 50 models. In the next few years, more than 20 million cars will be equipped with the technology of The Shadow.
At the recently concluded Gaz Automotive 2021 Automotive Intelligent Cockpit and User Experience Conference, Xu Liang, vice president of the intelligent cabin of SenseTime's Mobile Intelligence Business Group, delivered a keynote speech on "AI-Enabled Cockpit - General Vision Technology System Innovation", highlighting how SenseTime's vision relies on the newly released new generation of universal visual technology system "Shusheng" (INTERN) to bring more imagination space to the intelligent cockpit of the car.
Xu Liang, Vice President of Smart Cabin of SenseTime Mobile Intelligence Business Group
"Shusheng" expands the infinite boundaries of the cockpit
Because the car is on the move, the perceived data it generates is much higher than in other areas in terms of data volume and data quality. Smart cars are a huge source of mobile data production. How to use this data efficiently, SenseTime has come up with its own solution.
In November 2021, Shanghai Artificial Intelligence Laboratory and SenseTime jointly released a new generation of general vision technology system "Shusheng" (INTERN), which is equipped with SenseCore SenseTime AI device, with the help of large devices, the computing power and algorithm accuracy of the system have been greatly improved. It is reported that "Shusheng" can achieve more accuracy than CLIP based on complete downstream data with only 10% of the data.
With the blessing of SenseTime's AI device, SenseAuto Smart Car Platform, an independent brand of intelligent car platform that can input voice, images, text, and 3D point clouds of lidar, and complete various tasks, SenseAuto Smart Car Platform, came into being.
The shadow redefines the intelligent cockpit, transforming the human-machine interaction interface in the cockpit from passive interaction to active interaction, while new experiences such as child safety seat detection, pet mode, virtual companion, digital person, intelligent photography, health detection, and automatic driving door will be on the bus in large quantities.
It is worth mentioning that based on advanced computer vision algorithms, SenseTime recently released a new cabin occupant health detection system at the Guangzhou Auto Show, which can measure the user's current heart rate, heart rate variability, blood oxygen saturation, blood pressure and respiratory rate as soon as 15 seconds, and the accuracy of the measurement results is close to the level of medical-specific equipment.
We can foresee that while providing cockpit solutions by leveraging SenseTime's underlying efficient algorithm production hub, we can also leverage the innovations and advantages of different industries to the cockpit, bring more and more rich functions, and continuously expand the application boundaries and scenarios of smart cars.
The upper energy full stack breakthrough, the lower can empower hundreds of industries
SenseTime has created an innovative cockpit for smart cars in a "horizontal and vertical" manner, "one vertical" refers to a full-stack solution that can provide intelligent driving and intelligent cockpits, and "one horizontal" refers to providing basic software and hardware facilities to depots and partners to empower different OEMs.
At the same time, SenseTime also hopes to expand the core technical capabilities of AI to the upstream and downstream of the full-link and complete supply chain, empower partners, reduce innovation costs, shorten the R&D cycle, open up diverse needs, bring new intelligent experiences to end consumers, and truly achieve symbiosis and win-win with the automotive industry and ecology.
SenseTime will rely on its own advantages to bring three aspects of assistance to OEMs and suppliers.
First: Help SenseTime's ecosystem partners and customers dig deeper into the value of vehicle-aware data. From the perspective of computing power, the computing power of smart cars is a hundred times that of smart city visual perception terminals, and dozens of times that of smart phones. As a mobile data production source, the key to the car is how to tap the value behind this data through artificial intelligence algorithms, and this is what SenseTime is best at - efficiently structure all kinds of videos, images, and 3D unstructured data.
Second: the improvement of the five major advantages, connecting the smart car and SenseTime smart industry ecology to achieve service output. SenseTime has been deeply engaged in the field of artificial intelligence for many years, and it has accumulated five major advantages, one of which is Thattime's AI large device, which has high computing power, efficient CPU and a large number of algorithm models; second, rich experience in system adaptation and performance optimization, and has advanced cores in camera adaptation, SOC adaptation, and vehicle calibration; third, strict quality system, continuous ability certification construction has obtained a number of domestic and foreign quality certifications; fourth, a complete test verification system. In addition to the professional laboratory test, it has accumulated 30,000+ kilometers of road test mileage; fifth, SenseTime attaches great importance to data security and protection, and fully protects user privacy.
Third: To achieve a win-win situation between SenseTime and the automotive industry and ecology. In addition to the previously mentioned SenseTime, it has worked with more than 30 automotive companies and has been selected as a supplier of more than 50 models. According to the latest news, SenseTime has signed a contract with Nanjing FAW to integrate a number of advanced intelligent technologies into the mass production models of FAW Group's Hongqi brand.
The original product on the bus is just a starting point
SenseTime has found an opportunity for China's auto industry to lead the world in a certain track, and it is willing to cooperate with many parties to lead the future together.
At present, SenseTime has received great attention in the capital market, and Zhou Xiaoying, CEO of Gaz Automobile, believes that this is mainly due to the power of science and technology. When SenseTime is making progress in various fields, the operating system of the car machine is also constantly iterating, if you look at the long river of history, in fact, mankind is in the fourth scientific and technological revolution.
She further said that the metaverse, digital people and associated systems discussed in the field of science and technology will greatly change the relationship between people and the world, as well as the way humans live and live scenarios. It is precisely because new technology has a greater fault-tolerant market in China that so many car companies are willing to actively embrace and apply new technologies, so that it has the opportunity to iterate.
At a time when supply chain relationships are constantly being redefined, each iteration of technology brings users a new experience, and the launch of technological products is only a starting point. It has to have the opportunity to iterate by getting on the car, so only by getting on more cars can iterate into better products and discover more use scenarios. This is the value generated by the new supply chain network and the value of SenseTime products.