Robot Teaches Itself How to Dress People

More than 1 million Americans require daily physical assistance to get dressed because of injury, disease and advanced age. Robots could potentially help, but cloth and the human body are complex.

To help address this need, a robot at the Georgia Institute of Technology is successfully sliding hospital gowns on people’s arms. The machine doesn’t use its eyes as it pulls the cloth. Instead, it relies on the forces it feels as it guides the garment onto a person’s hand, around the elbow and onto the shoulder.

The machine, a PR2, taught itself in one day, by analyzing nearly 11,000 simulated examples of a robot putting a gown onto a human arm. Some of those attempts were flawless. Others were spectacular failures — the simulated robot applied dangerous forces to the arm when the cloth would catch on the person’s hand or elbow.

From these examples, the PR2’s neural network learned to estimate the forces applied to the human. In a sense, the simulations allowed the robot to learn what it feels like to be the human receiving assistance.

“People learn new skills using trial and error. We gave the PR2 the same opportunity,” said Zackory Erickson, the lead Georgia Tech Ph.D. student on the research team. “Doing thousands of trials on a human would have been dangerous, let alone impossibly tedious. But in just one day, using simulations, the robot learned what a person may physically feel while getting dressed.”

The robot also learned to predict the consequences of moving the gown in different ways. Some motions made the gown taut, pulling hard against the person’s body. Other movements slid the gown smoothly along the person’s arm. The robot uses these predictions to select motions that comfortably dress the arm.

After success in simulation, the PR2 attempted to dress people. Participants sat in front of the robot and watched as it held a gown and slid it onto their arms. Rather than vision, the robot used its sense of touch to perform the task based on what it learned about forces during the simulations.

“The key is that the robot is always thinking ahead,” said Charlie Kemp, an associate professor in the Wallace H. Coulter Department of Biomedical Engineering at Georgia Tech and Emory University and the lead faculty member. “It asks itself, ‘if I pull the gown this way, will it cause more or less force on the person’s arm? What would happen if I go that way instead?’”

The researchers varied the robot’s timing and allowed it to think as much as a fifth of a second into the future while strategizing about its next move. Less than that caused the robot to fail more often.

“The more robots can understand about us, the more they’ll be able to help us,” Kemp said. “By predicting the physical implications of their actions, robots can provide assistance that is safer, more comfortable and more effective.”

The robot is currently putting the gown on one arm. The entire process takes about 10 seconds. The team says fully dressing a person is something that is many steps away from this work.

Ph.D. student Henry Clever and Professors Karen Liu and Greg Turk also contributed to the research. Their paper, Deep Haptic Model Predictive Control for Robot-Assisted Dressing, will be presented May 21-25 in Australia during the International Conference on Robotics and Automation (ICRA). The work is part of a larger effort on robot-assisted dressing funded by the National Science Foundation (NSF) and led by Liu.

---

This work was supported in part by NSF award IIS-1514258, AWS Cloud Credits for Research, and the NSF NRT Traineeship DGE-1545287. Any opinions, findings and conclusions or recommendations expressed in this material are those of the authors and do not necessarily reflect the views of the sponsors.

Kemp is a cofounder, a board member, an equity holder, and the CTO of Hello Robot Inc., which is developing products related to this research. This research could affect his personal financial status. The terms of this arrangement have been reviewed and approved by Georgia Tech in accordance with its conflict of interest policies.