女生小视频

Technology

Robot that can perceive its body has self-awareness, claim researchers

The team claims to have given a robot self-awareness of its location in physical space, but others are sceptical

By Chris Stokel-Walker

13 July 2022

Robot arm

A robot has been argued to have developed an awareness of its surroundings

Chen, Lipson, Nisselson, Qin/Columbia Engineering

A robot can create a model of itself to plan how to move and reach a goal 鈥 something its developers say makes it self-aware, though others disagree.

Every robot is trained in some way to do a task, often in a simulation. By seeing what to do, robots can then mimic the task. But they do so unthinkingly, perhaps relying on sensors to try to reduce collision risks, rather than having any understanding of why they are performing the task or a true awareness of where they are within physical space. It means they will often make mistakes 鈥 bashing their arm into an obstacle, for instance 鈥 that humans wouldn’t because they would compensate for changes.

鈥淚t鈥檚 a very essential capability of humans that we normally take for granted,鈥 says at Duke University, North Carolina.

鈥淚鈥檝e been working for quite a while on trying to get machines to understand what they are, not by being programmed to assemble a car or vacuum, but to think about themselves,鈥 says co-author at Columbia University, New York.

Lipson, Chen and their colleagues tried to do that by placing a robot arm in a laboratory where it was surrounded by four cameras at ground level and one camera above it. The cameras fed video images back to a deep neural network, a form of AI, connected to the robot that monitored its movement within the space.

For 3 hours, the robot wriggled randomly and the neural network was fed information about the arm鈥檚 mechanical movement and watched how it responded by seeing where it moved to in the space. This generated 7888 data points 鈥 and the team generated an additional 10,000 data points through a simulation of the robot in a virtual version of its environment. To test how well the AI had learned to predict the robot arm鈥檚 location in space, it generated a cloud-like graphic to show where it 鈥渢hought鈥 the arm should be found as it moved. It was accurate to within 1 per cent, meaning if the workspace was 1 metre wide, the system correctly estimated its position to within 1 centimetre.

If the neural network is considered to be part of the robot itself, this suggests the robot has the ability to work out where it physically is at any given moment.

鈥淭o me, this is the first time in the history of robotics that a robot has been able to create a mental model of itself,鈥 says Lipson. 鈥淚t鈥檚 a small step, but it鈥檚 a sign of things to come.鈥

In their research paper, the researchers describe their robot system as being 鈥3D self-aware鈥 when it comes to planning an action. Lipson believes that a robot that is self-aware in a more general, human sense is 20 to 30 years away. Chen says that full self-awareness will take scientists a long time to achieve. 鈥淚 wouldn鈥檛 say the robot is already [fully] self-aware,鈥 he says.

Others are more cautious 鈥 and potentially sceptical 鈥 about the paper鈥檚 claims of even 3D self-awareness. 鈥淭here is potential for further research to lead to useful applications based on this method, but not self-awareness,鈥 says at the Georgia Institute of Technology. 鈥淭he computer simply matches shape and motion patterns that happen to be in the shape of a robot arm that moves.鈥

at the University of Sheffield, UK, says that following a specified path to complete a goal is easily achieved by robots without self-perception. 鈥淭he robot modelling its trajectory towards the goal is a key first step in creating something resembling self-perception,鈥 he adds.

However, he is uncertain on the information so far published by Lipson, Chen and their colleagues if that self-perception would continue were the neural network-equipped robot moved to completely new locations and had to constantly “learn” to adjust its motion to compensate for new obstacles. 鈥淎 robot continually modelling itself, concurrent with motion, would be the next big step towards a robot with self-perception,鈥 he says.

Science Robotics

Sign up to our weekly newsletter

Receive a weekly dose of discovery in your inbox. We'll also keep you up to date with New 女生小视频 events and special offers.

Sign up
Piano Exit Overlay Banner Mobile Piano Exit Overlay Banner Desktop