Recognizing the Right Tool for the Job
January 21, 2019 | A*STAREstimated reading time: 1 minute
A*STAR researchers working with colleagues in Japan have developed a method by which robots can automatically recognize an object as a potential tool and use it, despite never having seen it before.
For humans, the ability to recognize and use tools is almost instinctive. There are also many examples in which tool use seems hardwired into the brain of animals: some birds and primates use sticks or stones to obtain food, for example. One proposed reason for this neurologically embedded ability to use tools is that the animal’s brain perceives the external object as an extension of its own body. Inspired by this idea, Keng Peng Tee and his colleagues from the A*STAR Institute for Infocomm Research, along with Gowrishankar Ganesh from the CNRS-AIST Joint Robotics Laboratory located in Tsukuba, Japan developed an algorithm that enables robots to recognize, and immediately use tools that they have never seen before.
Previous research by Ganesh has indicated that the human brain recognizes a limb not just by its physical features, but by its functionality. Building on this insight, Ganesh and the A*STAR team proposed that a robot can recognize the potential of a tool by comparing its shape with that of its own hand and arm when used to achieve this same task. They wrote an algorithm based on this idea and tested it by setting a robot the task of moving, without grasping, a disk to a desired end point on a table. This involved the robot either pulling the disk toward itself, pushing it away, or shifting it sideways.
“The robot is programmed with the ability to complete the task by itself, represented by a hand shape template,” explains Tee. “When the task cannot be completed, because its arms aren’t long enough for example, the robot is able to recognize a viable tool by matching the tool shape with the hand shape template.”
Thus, the algorithm enabled the robot to successfully recognize when a task cannot be performed without a tool, to identify an unknown object as a potential tool, and then to use the tool to achieve the task. “Next we will look into automatic learning of the features that represent existing skills, rather than pre-defining hand shape templates,” says Tee.
Suggested Items
Accenture Invests in Sanctuary AI to Bring AI-Powered, Humanoid Robotics to Work Alongside Humans
03/27/2024 | BUSINESS WIREAccenture has made a strategic investment, through Accenture Ventures, in Sanctuary AI, a developer of humanoid general-purpose robots that are powered by AI and can perform a wide variety of work tasks quickly, safely and effectively.
Standards Development Propels the Industry Forward
03/20/2024 | Teresa Rowe, IPC Senior Director, Assembly and Standards TechnologyStandards development task groups will meet face-to-face at IPC APEX EXPO, April 6–11. The technical discussions provide an opportunity to share knowledge, learn from other subject matter experts, and network with others who have similar technical interests. You may remember the urgent need for coffee and the possibility of snagging a cookie or a granola bar to maintain the necessary energy level for these marathon sessions.
Top 5 Robot Trends 2024
02/15/2024 | IFRThe stock of operational robots around the globe hit a new record of about 3.9 million units. This demand is driven by a number of exciting technological innovations. The International Federation of Robotics reports about the top 5 automation trends in 2024:
Joe Russeau: Straddling Work in the Test Lab With Life on the Farm
01/23/2024 | Linda Stepanich, IPCJoe Russeau, president of Precision Analytical Laboratory, Inc. (PAL), has studied chemical residues on electronic assemblies for nearly 30 years. An IPC leader who chairs the 7-11 Test Methods Subcommittee and a member of the 5-32G Residue Task Group and J-STD-004 Task Group, Joe’s expertise lies in the analysis of manufacturing residues on the performance of electronic assemblies. While Joe is an acknowledged leader in the field of chemical electronics and ion chromatography, what really makes his heart sing is his herd of Black Angus cattle and his deep love of cattle farming.
Silicon Mountain Elevates Manufacturing Capabilities with the Introduction of RO1
01/18/2024 | Silicon MountainSilicon Mountain, a leading electronic manufacturing company, proudly announces its latest stride in technological innovation by acquiring the RO1, a cutting-edge cobot robotic arm designed and manufactured in the USA.