laitimes

Apple VR headset patent: the main interaction, support eyeball / gesture / face tracking

Recently, the United States Patent and Trademark Office published an Apple patent related to AR/VR headsets, which describes a 3D AR/VR projection scheme equipped with sensors. It is reported that the patent is numbered US 11,217,021 B2 and is called "Display System with Sensors".

Apple VR headset patent: the main interaction, support eyeball / gesture / face tracking

Apple pointed out in the patent that an AR headset can show the user's surrounding environment through a 3D virtual view, and enhance the perception of the real environment through virtual images. Through sensors, AR headsets can capture ambient signals around them, including video, depth information, lighting information, etc., as well as biosignals such as the user's expressions (eyebrows, mouth, chin, etc.), eye movements, gestures, etc. The AR headset system can then adjust the 3D virtual content based on this information.

Simply put, the description in the patent should be a vr headset of some kind of AR video perspective, which is characterized by adjusting the first-person perspective video according to the user's perspective, simulating the human eye to directly view the surrounding effects.

According to the patent, the SENSOR equipped with the AR headset may include one or more cameras, which can be used for positioning in addition to the perspective function.

Read on