On March 23, at Huawei's 2023 spring new product conference, the latest generation of intelligent cockpit system - HUAWEI HarmonyOS 3 was released.
The upgrade of HarmonyOS 3 is mainly based on core functions such as super desktop, smart car finding, PC dual-screen collaboration, and HUD height adaptive adjustment.
HarmonyOS 3 core information
1. The super desktop function supports the mobile phone ecological application to seamlessly board the car, so that the use scenarios of the vehicle can be further expanded and the coverage is more comprehensive, so that the vehicle truly becomes a multi-functional mobile space.
2. The intelligent car search function uses the innovative "intelligent identification of parking space number", "high-precision latitude and longitude positioning of the basement", "floor recognition" and "information desensitization" and other functional points to better observe the parking environment of the vehicle during the parking process, and accurately obtain the parking location, parking space number and parking floor and other information of the vehicle.
3. HUD supports height adaptive adjustment, the camera in the car will actively identify the user's eye position, quickly adjust the HUD to the best height, so as to project important driving information such as speed and navigation on the front windshield of the main driver, reduce actions such as turning or lowering the head when driving, and ensure driving safety.
4. Xiaoyi supports wake-up and directly says, no need to wake up Xiaoyi every time. At the same time, Xiaoyi supports users to issue 5 instructions in one go, and multiple intentions can be done at once.
5. PC dual-screen collaboration function, cockpit screen can be used as a mirror or extended display of PC screen, keyboard and mouse can freely travel between dual screens, users can perform document processing, edit videos, etc. in the car.
How about Super Desktop?
As cars gradually become people's "third space", we spend more and more time in the car, and car owners want to be able to use the mobile APP on the car machine.
The super desktop function can support the mobile phone head application to seamlessly and directly to the car machine, and the mobile phone application becomes part of the car machine application. Most applications on Huawei phones can be used on the vehicle to support more usage scenarios such as entertainment, office, and education.
When driving, you can completely get rid of the mobile phone, and will no longer affect driving safety because you look down at the mobile phone. Super Desktop can also control the opening and closing of the car boarding application through the voice system, and can also call the hardware functions of the car machine, including the car GPS, microphone and speaker, and the front/rear camera of the car machine.
Super Desktop relies on the HarmonyOS ecosystem, integrates the capabilities of HarmonyOS, and has rich applications with parallel vision. Through the adaptive layout of the car machine, the mobile application becomes a part of the car application, and the mobile phone application can be seamlessly switched to the car machine on the car.
Smart car hunting is useful
I believe that everyone has the experience of looking for a car in the parking lot, the author himself has lost the car several times, sometimes it takes an hour to find it, what's more, after looking for half a day, I found that even the parking lot was wrong, so there is a vehicle positioning has become the rigid need for parking in large cities, and the general positioning can only cover the approximate location, not accurate to the floor, and this time HarmonyOS 3 solves this pain point.
When using, you only need to turn on the "smart car finding" function in the car machine, the vehicle can accurately identify the parking location and floor of the vehicle during the reversing process, without manual recording, it will automatically record the parking space information, and quietly send your parking space information to the AITO APP after leaving the car locked. When returning to the car search, the AITO APP "Smart Car Search" interface will display the precise latitude and longitude of the vehicle parking, four photos of vehicle environmental information [(currently there is no network parking lot can not upload picture information), parking space identification number and vehicle parking floor and other information to accurately locate the location of your vehicle.
Regarding the privacy issues that everyone cares about, the driver parks the car and the P gear, and the system automatically calculates the latitude and longitude position, parking space number environment and automatically shoots the environmental information. After the system desensitizes the information (mainly the license plate information of the surrounding environment and face information), it will be uploaded to the corresponding user's mobile phone when there is a network in the basement, so there is no need to worry about privacy issues.
Gu Huawei officially declared that in the actual parking process of consumers, the printing font, size, and clarity of parking space information in parking lots vary, and even the same parking space has different parking methods, which greatly increases the difficulty of identification. At the beginning of development, R&D engineers used the OCR algorithm with the best performance in general scenarios, but the recognition rate could only achieve 20%, so the commission recognition rate became the biggest difficulty in intelligent car finding.
Finally, the developers introduced Huawei's self-developed OCR AI algorithm optimized for parking lot scenes by integrating video streams such as fisheye cameras and transparent chassis. The intelligent car search feature can automatically determine which frame is most suitable for identification, obtain key frames, eliminate erroneous information, and then perform accurate OCR recognition, so that the accuracy rate jumps from 20% to 90% commercializable level.
Automatically adjusts the HUD height
If it is the author's case of one person and one car, it is really chicken. Because you only need to adjust settings such as HUD once, you don't need to adjust it a second time for a long time, but this feature is extremely useful for those who have only one car in a family and need to drive multiple people in turn.
When the driver is seated and adjusts the seat, the camera will actively identify the user's eye position, complete the eye positioning, and quickly adjust the HUD to the optimal height, so as to project important driving information such as speed and navigation on the front windshield of the main driver, reducing actions such as turning or lowering the head when driving.
In the parking state, when the driver applies the brakes, the HUD will quickly adjust to the optimal height in combination with eye positioning, even if different body shapes and different clothes can get the best visual experience.
During driving, the system will not actively trigger HUD height adaptive adjustment, but users can say "HUD height adaptive adjustment" through Xiaoyi's voice, and Xiaoyi can help users complete HUD height automatic adjustment. In the process of long-term car use, HUD height adaptive adjustment will automatically compare the difference interval between the previous position and the current position each time, if the difference interval is not large, the adaptive adjustment will not be triggered frequently to avoid affecting the consumer experience.
And if you don't need to use the automatic adjustment function, you can also use manual adjustment, which is the same as the HUD function of other vehicles.
Continuous voice conversations
Not being able to talk continuously and waking up the need to wake up words are the two biggest pain points of today's voice control system, although everyone is also actively solving the problem, but there are still some minor problems, and this time HarmonyOS 3 has also optimized this.
After this upgrade, Xiaoyi supports wake-up free direct speaking, without waking Xiaoyi every time, Xiaoyi can understand thousands of different commands, including a variety of common scenarios, which is also in line with the anthropomorphic development direction of future voice interaction as understood by Huawei.
Nowadays, the voice assistants of most car companies support up to 4 intentions in one sentence, and after this OTA upgrade, Xiaoyi, the intelligent voice assistant, supports users to give 5 commands in one breath, such as "close the window", "turn on the air conditioning", "turn on the seat heating", "play music", "navigate to the company", and the recognition speed is very fast, and the recognition rate is also extremely high.
PC dual-screen collaboration
I believe everyone has experience working in the car, right? The two biggest problems when working in the car, one is that the computer has no place to place, the space is cramped, and the other is that there is less screen and low work efficiency, and this time Huawei provides PC dual-screen collaboration function according to these two pain points.
Although some students may not use the PC very often, in fact, most of the work that needs to sit in the office for a long time still has a very high demand for the PC.
Users can form a super terminal between Huawei PC and Harmony cockpit, and the cockpit screen can be used as a mirror or extended display of the PC screen, dual-screen collaborative office, browsing entertainment video websites, and dual-screen clipping, greatly increasing efficiency. In addition, PC keyboard and mouse also support dual-screen sharing.
So after filming the show in the future, you can let the choreographer and director students cut it directly in the car?
In addition, HarmonyOS 3 also provides a new main driver privacy mode, which will be supported on M7 models first. When there are other people in the car, it may be very embarrassing for the same person to see the call notification, historical call history, historical navigation record, destination search record, etc. on their car. Or when lending the vehicle to someone else or driving on behalf of others, there may also be privacy content that needs to be protected.
Turn on the main driver privacy mode, when there are multiple people riding in the car, the car machine will automatically hide personal sensitive information, such as the main driver's historical call records, historical navigation record information, etc., and the incoming call notification is only displayed on the instrument screen.
For the borrowing scenario, when the car owner sets an authorization account for the borrower, the car owner can define the authorization period and scope of the authorization of the authorizer, so that the relationship between the authorized account and the vehicle will be automatically terminated after expiration. At the same time, the data between the accounts is isolated, and the owner cannot see the data of the authorized person, when the car is no longer used, the authorized person can log out of the account and choose to delete all the data of the account.
The system also provides a "guest account", which can be used directly when driving or maintaining the vehicle, and the guest account will be prohibited from viewing the account information of the owner and authorized person, and the dashcam is prohibited.
Editorial summary
HarmonyOS 3 intelligent cockpit will be the icing on the cake of the already good system, has become a more excellent work, whether it is mobile phone/computer interconnection, voice interaction or privacy protection, HarmonyOS 3 has come to the forefront of the industry, in the case of extremely high fluency directly hit the user's pain points, so that users can feel a very high degree of humanized settings, and fall in love with this system, this upgrade, really make HarmonyOS 3 achieve the industry "far ahead".