Panasonic unveiled its augmented reality AR HUD 2.0 system at CES 2022, adding patented eye-tracking technology (ETS) to enhance the AR experience.
The AR HUD 2.0 system is powered by Panasonic's SkipGen2, which utilizes Panasonic's advanced optical technology and is implemented by an infrared camera encapsulated together by AR-HUD and optics, eliminating the need for a separate driver-facing camera. Through ETS, AR images can be more accurately focused on the real world in front of the driver's eyes, improving the realism and presence of the images in the driver's field of vision.
"Panasonic AR HUD 2.0 continues the trend of upward integration of display domains such as clusters and HUDs into central infotainment computing modules," said Andrew Poliak, Panasonic Chief Technology Officer. "By integrating our proprietary eye-tracking technology into the AR HUD, it is possible to understand exactly where the driver is looking through ETS, and then more precisely match and focus the AR image into the real world to improve the fidelity of the image in the driver's field of vision."
By identifying the driver's head position and head movement through ETS technology, the image in the field of view can be dynamically adjusted and compensated, which means that the driver can see the icons superimposed in the AR-HUD without moving the head and changing the line of sight. The driver experience is powered by AI navigation software that matches the changing environment through AR overlays and icons, helping to provide a more intuitive perception of the situation and surroundings.
In addition, this AR-HUD 2.0 system can project large images at a distance of up to 10m, and is also able to identify objects in front of the car and warn the driver by displaying an alarm in the HUD, and if the object is in the HUD view, a red square will be displayed around the identified object. The system also supports driver monitoring functions such as fatigue monitoring and distraction monitoring.
Panasonic released its AR HUD for the first time at CES 2021. Prior to that, the company announced in November 2020 a partnership with Phiar Technologies, developer of space ARTIFICIAL technology and automotive AR navigation platforms, to expand driver safety and navigation support in its automotive solutions.