Winter Olympics "black technology"! The new perspective of "time condensation" on the field comes from this scientific research team

2022-02-11 21:24:00

Condensing time, freeze-frame moments, moving perspectives, in the broadcast of a number of sports events at the Beijing Winter Olympics, the free perspective technology brought wonderful moments different from previous competitions for the audience.

At the curling arena and the National Speed Skating Hall, ShanghaiTech University and its company participated in the design of the free view acquisition system, and deployed 64 sets of 4K ultra-high-definition multi-view camera systems in the "Ice Cube". At the National Speed Skating Hall, they deployed 80 sets of 4K Ultra HD multi-view camera systems to photograph speed skaters from all directions and angles.

There are two key technologies for free-view broadcasting: one is the three-dimensional calibration of the camera system, so that the picture taken from each perspective forms a continuity in space, does not jump up and down, so that the perspective can be smoothly switched; the second is based on the neural network rendering (NeRF) free-point of view video generation technology, the computer system automatically generates some virtual pictures according to the broadcast screen, and seamlessly connects with the real scene.

The combination of massive data and deep learning can automate and intelligentize the process of 3D rendering. Because the deployment cost of 4K multi-view cameras is quite high, to minimize the number of devices, the artificial intelligence system generates virtual perspective scenes with fake real views, which can reduce the cost of free-view broadcasting.

Winter Olympics "black technology"! The new perspective of "time condensation" on the field comes from this scientific research team

Footage captured by a 4K Ultra HD multi-view camera system deployed at the speed-skating curve

Project leader Ma Wenguang showed two videos. Only to see that in the curling competition, the picture of the athlete at the moment of throwing the pot will be frozen, as if time condenses; at the same time, the broadcast perspective begins to turn, allowing the audience to see the various angles of the athlete's throwing moment. The highlight of another speed skating video is at the bend, only to see two players crossing the corner, time seems to condense, and at the same time, the viewing angle begins to rotate, from the athlete's front to the back, so that the audience can see the two people's gliding posture and position relationship.

"Cornering is a great opportunity for speed skaters to overtake their opponents, and it is also a place where mistakes are easy to make, so we mainly arrange the free perspective and the 'time condensation' special effect at the corner." Ma Wenguang introduced.

With the advent of the 5G era, this technology will be more and more applied, and mobile clients and smart TV users can independently choose the viewing angle to achieve personalized and immersive smart viewing. In the future, technologies such as artificial intelligence, digital twins, and free perspectives will be applied to application scenarios such as smart venues and smart spectators, which will bring viewers a more interesting viewing experience.

(The original title was "Winter Olympics "Black Technology"!) The new perspective of "time condensation" on the field comes from this scientific research team")

Winter Olympics "black technology"! The new perspective of "time condensation" on the field comes from this scientific research team

Read on

The moment when Li Wenlong and Ren Ziwei handed over the baton was really touching! Seeing Li Wenlong's anxious expression when he fell out, how many people broke through the defense, Ren Ziwei rushed over without hesitation and completed the handover!

Gu Ailing's educational model cannot be copied. 1, the family to give the confidence. It takes at least three to four generations to cultivate an aristocrat. The accumulation of money at the bottom allows children to work hard for their dreams

Former NSW Governor Of Australia Berigicleen gets a new job and will join the Optus management team

#Wu Dajing leads the Chinese relay team to advance to the final #On February 11, Beijing time, the short track competition of the Beijing Winter Olympics entered the men's 500 meters, women's 1000 meters and men's

You don't have to fight more, but the districts, townships, and rural areas are still quite hot, and different businesses should choose different markets In China, China is a traditional and existing multi-level channel market, and the emerging self-media channels are quite hot

Of course, it doesn't need Guo Degang to be funny. Because the Chinese men's football team itself is very funny. Every action is a burden, and every process is one

At the Opening of the New Year, the team wrapped dumplings 🥟 together from selling products to benefiting a group, from using employees to benefiting employees. From selling tangible material products to passing on intangible spiritual products, from giving

System Evolution Strategy 500 Question 148: How to activate the hierarchical relationship of enterprise system evolution? How to activate the hierarchical relationship of enterprise system evolution, first of all, is the activation of the strategic dimension, the traditional meaning

Someone asked Tan Wait (Baidu search engine architect): Looking back on your career, what is the thing that has affected you the most? Tan To say: In 2007, I entered Baidu and began an internship

Most of the time people can't make money is that they don't have a correct understanding of their own abilities, and looking up to themselves will make you miss out on many opportunities for certainty, and the ultimate reason is that the heart is not counted and greedy

Male star playing m-son and team wiping butt? Zhao Liying's new drama started? Zhou Dongyu refused to milk Liu Haocun?

Today, I brushed the vibrato express version before and after the meal and earned more than 20,000 gold coins, which is also a surprise labor fruit for a disabled elderly who has lost the ability to work, and it is useless

Playing Douyin Express Edition, don't spend too much time, easily earn a dollar and two yuan. The TikTok Express Edition has less gold coins. The exchange rate is also high, much better than other software, and I want to be suspicious of pocket money.

Recently trading more and more boring, I feel that I can arrange the time, look at the disk many times do not want to shoot, when staring at the disk, often feel that there is no change, time period, position

Professor Xiang Fengning's team at Shandong University discovered a new mechanism for light signals to regulate plant regeneration

The Central China Agricultural Oilseed Rape team made progress in the functional study of phospholipase and its hydrolysates

Science: The Chinese team unveils the bones of "Pai Daxing", and high-strength new materials are on the way

Women's curling China suffered three consecutive defeats Beijing time On February 11, Beijing Winter Olympics women's curling round robin tournament, Han Yu's Chinese team was stolen for three consecutive innings, and finally lost to the United States 4-8

Insiders: 1. There is a child male singer who has almost no good ending in past relationships, and the woman is to the point of old and dead, including the girlfriend outside the circle who broke up some time ago. 2.

Another big awkward chat live... These four people are really unfamiliar! I don't know why these four people were arranged to chat live together, so that the four people who originally did not have any intersection were alive and hard

#How to live a lonely life with only one person # I am 51 years old this year, and I have lived alone for about 20 years. When I was young, it was the New Year's Holiday, and that was true

Switzerland won gold 🥇 and bronze 🥉 medals in the women's super slalom finals for alpine skiing, and bronze 🥉 in the men's U-shaped track skills final for snowboarding

#What determines a person's future and destiny##Whether people should seriously dress themselves up in middle age#"Women are pleasing to themselves". A woman's face will age over time. At any stage

#Ren Ziwei Sun Long Wu Dajing successfully advanced to the final #【Short Track Speed Skating Men's 500m Preliminary Round Three Chinese players have successfully won the promotion】 February 11, 19:18 Beijing time, Beijing winter

Psychyka has two meanings in Greek, and his aunt says two very different but both interesting things. Butterflies and souls. But if you stop and think about it, butterflies and souls are the difference

Tonight (February 11, Beijing time), the one championship competition will be staged again, and China's Lin Heqin and Chen Rui will play hand in hand! Lin Heqin is the best among Chinese women's players

#Ice and Snow 2022## Li Wenlong fell down Ren Ziwei Relay # Li Wenlong fell, was directly thrown out, looking at the pain of Ren Ziwei for the first time to his teammates to pick up the baton, rising up to catch up with the two athletes

Definitely a bonus! On February 11, Beijing time, in the case of Han Yutong ~ Qu Chunyu and Zhang Yuting in the final of the Chinese women's short track speed skating 1000 meters, China's athletes

The FA has taken a massive pay cut, with 16 clubs opposing it, for reasons here. To put it bluntly, this is a chain of benefit sharing, and the Chinese football industry has long been not a simple sports project

Awkward dancing time for the stars

#Wang Shiyue Liu Xinyu #February 12th Ice Dance Rhythm Dance Competition Group 3 Appearance [Wit]: Warm-up time 20:22-20:28! [Bixin] Appearance time 20:42-