Algorithm Tells Robots Where Nearby Humans Are Headed
June 13, 2019 | MITEstimated reading time: 5 minutes
In 2018, researchers at MIT and the auto manufacturer BMW were testing ways in which humans and robots might work in close proximity to assemble car parts. In a replica of a factory floor setting, the team rigged up a robot on rails, designed to deliver parts between work stations. Meanwhile, human workers crossed its path every so often to work at nearby stations.
The robot was programmed to stop momentarily if a person passed by. But the researchers noticed that the robot would often freeze in place, overly cautious, long before a person had crossed its path. If this took place in a real manufacturing setting, such unnecessary pauses could accumulate into significant inefficiencies.
The team traced the problem to a limitation in the robot’s trajectory alignment algorithms used by the robot’s motion predicting software. While they could reasonably predict where a person was headed, due to the poor time alignment the algorithms couldn’t anticipate how long that person spent at any point along their predicted path — and in this case, how long it would take for a person to stop, then double back and cross the robot’s path again.
Now, members of that same MIT team have come up with a solution: an algorithm that accurately aligns partial trajectories in real-time, allowing motion predictors to accurately anticipate the timing of a person’s motion. When they applied the new algorithm to the BMW factory floor experiments, they found that, instead of freezing in place, the robot simply rolled on and was safely out of the way by the time the person walked by again.
“This algorithm builds in components that help a robot understand and monitor stops and overlaps in movement, which are a core part of human motion,” says Julie Shah, associate professor of aeronautics and astronautics at MIT. “This technique is one of the many way we’re working on robots better understanding people.”
Shah and her colleagues, including project lead and graduate student Przemyslaw “Pem” Lasota, will present their results this month at the Robotics: Science and Systems conference in Germany.
Clustered up
To enable robots to predict human movements, researchers typically borrow algorithms from music and speech processing. These algorithms are designed to align two complete time series, or sets of related data, such as an audio track of a musical performance and a scrolling video of that piece’s musical notation.
Researchers have used similar alignment algorithms to sync up real-time and previously recorded measurements of human motion, to predict where a person will be, say, five seconds from now. But unlike music or speech, human motion can be messy and highly variable. Even for repetitive movements, such as reaching across a table to screw in a bolt, one person may move slightly differently each time.
Existing algorithms typically take in streaming motion data, in the form of dots representing the position of a person over time, and compare the trajectory of those dots to a library of common trajectories for the given scenario. An algorithm maps a trajectory in terms of the relative distance between dots.
But Lasota says algorithms that predict trajectories based on distance alone can get easily confused in certain common situations, such as temporary stops, in which a person pauses before continuing on their path. While paused, dots representing the person’s position can bunch up in the same spot.
“When you look at the data, you have a whole bunch of points clustered together when a person is stopped,” Lasota says. “If you’re only looking at the distance between points as your alignment metric, that can be confusing, because they’re all close together, and you don’t have a good idea of which point you have to align to.”
The same goes with overlapping trajectories — instances when a person moves back and forth along a similar path. Lasota says that while a person’s current position may line up with a dot on a reference trajectory, existing algorithms can’t differentiate between whether that position is part of a trajectory heading away, or coming back along the same path.
“You may have points close together in terms of distance, but in terms of time, a person’s position may actually be far from a reference point,” Lasota says.
Page 1 of 2
Suggested Items
NASA Selects First Lunar Instruments for Artemis Astronaut Deployment
03/27/2024 | NASANASA has chosen the first science instruments designed for astronauts to deploy on the surface of the Moon during Artemis III. Once installed near the lunar South Pole, the three instruments will collect valuable scientific data about the lunar environment, the lunar interior, and how to sustain a long-duration human presence on the Moon, which will help prepare NASA to send astronauts to Mars.
Accenture Invests in Sanctuary AI to Bring AI-Powered, Humanoid Robotics to Work Alongside Humans
03/27/2024 | BUSINESS WIREAccenture has made a strategic investment, through Accenture Ventures, in Sanctuary AI, a developer of humanoid general-purpose robots that are powered by AI and can perform a wide variety of work tasks quickly, safely and effectively.
Top 5 Robot Trends 2024
02/15/2024 | IFRThe stock of operational robots around the globe hit a new record of about 3.9 million units. This demand is driven by a number of exciting technological innovations. The International Federation of Robotics reports about the top 5 automation trends in 2024:
Kepler's Humanoid Robot Makes Grand Debut at CES, Heralding a Bold New Chapter in Robotics Innovation
01/04/2024 | PRNewswireFrom January 9-12, 2024, the Kepler series of humanoid robots will be featured at the Consumer Electronics Show (CES) in Las Vegas, NV, at Booth #60840, Venetian Expo, Hall G. The company eagerly anticipates meeting robotics enthusiasts from around the world at this event.
Soft, Elephant Trunk-like Robot for Close Interaction with Humans
11/28/2023 | EPFLAt EPFL's CREATE lab, under the guidance of Josie Hughes, a breakthrough has been made in the realm of soft robotics. Drawing inspiration from the versatile movement of elephant trunks and octopus tentacles, the team introduced the trimmed helicoid — a novel robotic structure that promises greater compliance and control in robotic designs.