On April 18, Tencent Meeting launched the first glasses-free 3D video conferencing solution in China, and debuted a prototype of the video conferencing cabin developed in collaboration with ecological partners.
According to reports, the technology is based on the light field acquisition and 3D reconstruction technology jointly built by Tencent Meeting and Shannon Laboratory, as well as the underlying communication link of Tencent Meeting and the spatial audio technology of the Ethereal Laboratory.
In the actual experience, users at both ends only need to enter the conference cabin, without wearing any auxiliary equipment, and there is no fixed angle limit, the device can automatically track the viewer's eyes, and instantly present a 3D effect, not only can see each other, but also experience the other party's spatial position and movements.
On the receiving end, by analyzing the relative position relationship between participants, and using hair-level 3D reconstruction and high-performance neural rendering technology, we realized real-time modeling and sound field reconstruction of characters, and then cooperated with the glasses-free 3D screen of in-depth customization cooperation with hardware manufacturers to achieve stereo rendering and sound field rendering with moving parallax, creating an immersive call experience for users at their fingertips.
The technology has both binocular parallax and moving parallax, so that viewers can not only experience the three-dimensional sense of the screen, but also see the three-dimensional content from different perspectives by moving left and right.
In the research and development of this technology, Tencent Meeting has made a breakthrough in high-precision real-time scene reconstruction under limited bandwidth, effectively solving the problem of edge jitter, so as to achieve an immersive 3D visual experience with high resolution and high frame rate for users in consumer-grade hardware and network environments.
Leifeng.com