Robotics Engineering Colloquium - Bring AI into Physical World through Robotic Hands

Friday, February 24, 2017
2:00 pm to 3:00 pm
Floor/Room #: 
GP 1002

Dr. Yu Sun
  University of South Florida

Bring AI into Physical World through Robotic Hands


Abstract: Computers have tremendous learning capability and have demonstrated superior intelligence in many domains. This talk describes our research effort to bring computer intelligence into the physical world so that robots could perform physically interactive manipulation tasks. Our approach first gives robots the ability to learn manipulation skills by “watching” online instructional videos. After “watching” over 200 instructional videos, a functional object-oriented network (FOON) has been constructed to represent the observed manipulation skills. Using the network, robots can take a high-level task command such as “I want a New England Omelette for breakfast,” decipher the task goal, seek the correct objects to operate on, and generate and execute a sequence of manipulation motions that can deal with physical interactions in a new condition. To best facilitate manipulation motions in the physical world, we also developed new grasping strategies for robots to hold objects with a firm grasp to withstand the disturbance during physical interactions.

Bio: Dr. Yu Sun is an Associate Professor in the Department of Computer Science and Engineering at the University of South Florida and a Visiting Associate Professor at Stanford University. He co-chairs the IEEE RAS Technical Committee on Robotic Hands, Grasping, and Manipulation, and the IEEE-RAS Member Service Committee. He is an Associate Editor of the IEEE Transactions on Robotics.

Dr. Yu Sun received his Ph.D. degree in Computer Science from the University of Utah in 2007, and his B.S. and M.S. degrees in Electrical Engineering from Dalian University of Technology in 1997 and 2000 respectively. He was a Postdoctoral Associate in the School of Computing at the University of Utah from May 2008 to May 2009 and a Postdoctoral Associate at Mitsubishi Electric Research Laboratories (MERL), Cambridge, MA from Dec. 2007 to May 2008.

His research interests include robotics, cyber-physical systems, computer vision, virtual reality, and medical applications. His research works have been reported on the Discovery Science Channel, Bay News 9, and Univision (Spanish).

                                                                                            Friday, February 24, 2017
                                                                                                            2 - 3 pm
                                                                                           60 Prescott Street, GP 1002