The intelligent guide dog of Xi'an University of Technology, equipped with an offline large model, can lead the blind to cross the road and enter the elevator

Northwestern Polytechnical University has successfully developed an embodied intelligent machine guide dog, which may benefit 8 million visually impaired people in the mainland!

Recently, Professor Li Xuelong's team at Northwestern Polytechnical University has made a technological breakthrough in the field of embodied intelligent machine guide dogs, and has developed a large-scale offline embodied intelligent guide dog by carrying offline large models and applying them to intelligent guide scenes.

Embodied intelligence refers to the ability of an intelligent system or machine to interact with the environment in real time through perception and interaction. Embodied intelligent systems typically have the ability to perceive, cognitive, make decisions, and act, and are able to interact with the environment through sensors and actuators, and make corresponding decisions and actions in response to changes in the environment.

As we all know, guide dogs play the role of eyes for the visually impaired, but in real life, due to various restrictions, the scope and scene of guide dogs are still relatively limited, especially in some public places, there have been some controversies. For example, guide dogs are not allowed to enter the park or get on the subway.

In addition, the number of guide dogs is not large, and it is even a bit difficult to find a dog. For example, according to relevant statistics, the number of guide dogs in the mainland is only about 200, so few reasons are that the training cost of guide dogs is very high, and the elimination rate is also high. Guide dogs need to be able to guide the way to avoid obstacles and distinguish traffic lights, so the requirements for their individuals are extremely high, including physical conditions, personality characteristics, etc., such as excitement, vision, bone conditions, etc., so many dogs are eliminated when they are puppies.

However, there are more than 17 million visually impaired people in the mainland, of which more than 8 million are blind, which shows that these hundreds of guide dogs are really a drop in the bucket. But if the function of a guide dog can be realized through a robot dog, the above problems will be solved.

Let's go back to the guide dog of Western University of Technology, it also has a great advantage, it can be separated from the Internet, that is to say, even if there is no network signal, it can still work normally through the large model carried by itself. The operation of traditional large models requires a large number of computing resources, and it is unrealistic to realize these computing resources on the local machine, and must rely on the network, so if there is no signal, it will not work normally. The use of offline large models can further expand the application scenarios, especially in elevators, underground passages and other spaces with poor or even no signals.

At the same time, it also has strong intelligent dialogue skills, such as asking him for the weather forecast, etc., which can provide a certain degree of emotional companionship for the visually impaired.

At present, this intelligent guide dog has realized intelligent human-computer interaction, intelligent elevator guidance, intelligent street guidance, intelligent indoor guidance and other functions, leading the blind to cross the road, go up the steps, and enter the elevator, it can be said that it has shown the possibility of replacing the traditional guide dog. Although it is still in the laboratory stage, as long as there is a suitable partner, the commercialization of this technology will be very fast.

In short, I hope that the embodied intelligent guide dog can be listed soon, so as to benefit more blind friends, so that they can go out of the house more bravely and enjoy the world.