RBE Practicum Presentation: Brandon Asencio | Robotics Safety Event Recognition System (RISERS)

Monday, May 1, 2023
12:00 pm to 1:00 pm

RBE Robot Lineup

RBE Practicum Presentation

Brandon Asencio

Robotics Safety Event Recognition System (RISERS)

Monday, May 1st, 2023

12:00 PM - 1:00 PM

Zoom Link: https://wpi.zoom.us/j/93354906654

Abstract: Real time analysis and prevention of administrative control failures around warehouse robotic systems are critical in ensuring worker safety. Machine-generated records of these failures can inform safety strategy decisions for training programs and engineering design. This paper presents a proof-of-concept event recognition system that analyzes human-robot interaction, identifies and documents safety events, and physically affects the operating environment to mitigate risk in real time. The system leverages a layered module design consisting of a visual sensor, detection and pose estimation algorithms for humans and objects, and a 3D visualization library that work together to represent the environment. The system successfully recognizes and produces physical response for two use cases, averaging a 1.09 s response time and 89% accuracy across multiple stress tests. The results validate functional performance while also revealing system limitations. Integration needs and factors affecting system design are evaluated using trade studies. The testing and trade study results show promise for a customized system application to the warehouse environment, particularly in preventing and documenting robotic safety incidents. Future improvements for the system, such as multi-sensor layouts and expansion to ergonomic analyses, are also discussed.


Professor Berk Calli, Worcester Polytechnic Institute (WPI)


Professor  Greg Lewin, Worcester Polytechnic Institute (WPI)

Melissa Hibbard, Amazon Robotics



Robotics Engineering