Scientists Develop AI-Powered Radio Vision for Robots

Scientists have been interested in robots for many years. Scientists are working on the multifaceted uses of robots in modern times. A group of scientists is working on a new type of robot, which can see even through smoke. Work is underway on such a robot at the University of Pennsylvania in the United States.

There, scientists are working on a radio-based sensing system for robots. During tests, it was found that radio waves give robots or autonomous vehicles the ability to see through thick smoke, heavy rain, or at different angles. Such waves can also detect hidden weapons.

Mimicking visual imagery based on radio waves is a rather unusual and unconventional approach for robots and autonomous vehicles. Typically, optical cameras, light detection and ranging (LIDAR) technology and other sensors are used to see robots. However, work is underway to learn about radar, aircraft, ships and weather using radio waves. Mingmin Zhao and his research team at the University of Pennsylvania have developed a potentially powerful way for robots to see using those radio waves.

In the new method, an on-board artificial intelligence system uses the information collected via radio to create a three-dimensional image of the surrounding environment. “We are essentially helping robots to give them superhuman vision. In situations where human eyes or visual sensors cannot, robots can do it. This technology could help future search and rescue robots save people from burning buildings,” said Zhao.

Radio waves, part of the electromagnetic spectrum, are actually a form of light. This spectrum also includes X-rays and gamma rays. A small part of the spectrum is classified as visible light. Radio waves, as light energy, can be reflected from surfaces and objects in a slightly different way than visible light. Professor Zhao and his team have designed the robot in such a way that it can sense the reflection of radio waves.

Radio waves are much longer than visible light waves. This means that they are not blocked by small smoke particles. Scientists are working on this issue with this in mind. Through these waves, robots can see all corners of the surroundings.

“We’ve created an algorithm that gives you an instant and continuous view of the entire space. This can be done without moving any antennas,” said Fabio da Silva, founder and CEO of US company WavSense.

The whole thing is actually similar to how bats use echolocation to determine their location through waves. Some researchers have previously used radio waves to detect various weapons.