TY - GEN
T1 - Contextual Recognition Network
T2 - 2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing, UbiComp Companion 2024
AU - Xie, Shengyuan
AU - Meng, Zhjin
AU - Bamdad, Mahdi
AU - Cruz, Francisco
N1 - Publisher Copyright:
© 2024 Copyright held by the owner/author(s).
PY - 2024/10/5
Y1 - 2024/10/5
N2 - With the advancement of deep learning, numerous research initiatives have emerged focusing on enabling robots to identify and retrieve target objects within complex domestic environments. However, current research lacks effective integration of contextual affordances information in robotic systems. This paper introduces an intelligent grasping system to facilitate object prediction and safe policy learning for home-use robots. Particularly, we introduce the Context Recognition Network (CRN) to predict the potential failure likelihood of each action. We develop a grasping system based on DDPG (Deep Deterministic Policy Gradient) as the benchmark. We compare the benchmark's performance with that of the CRN-equipped grasping system. Our results indicate that the CRN-equipped grasping system outperforms DDPG by blocking failure action and instead choosing an appropriate pose based on the object prediction to retrieve the object with fewer computational resources.
AB - With the advancement of deep learning, numerous research initiatives have emerged focusing on enabling robots to identify and retrieve target objects within complex domestic environments. However, current research lacks effective integration of contextual affordances information in robotic systems. This paper introduces an intelligent grasping system to facilitate object prediction and safe policy learning for home-use robots. Particularly, we introduce the Context Recognition Network (CRN) to predict the potential failure likelihood of each action. We develop a grasping system based on DDPG (Deep Deterministic Policy Gradient) as the benchmark. We compare the benchmark's performance with that of the CRN-equipped grasping system. Our results indicate that the CRN-equipped grasping system outperforms DDPG by blocking failure action and instead choosing an appropriate pose based on the object prediction to retrieve the object with fewer computational resources.
KW - complex domestic environments
KW - contextual affordances
KW - deep reinforcement learning
KW - vision
UR - https://www.scopus.com/pages/publications/85206141364
U2 - 10.1145/3675094.3677581
DO - 10.1145/3675094.3677581
M3 - Conference contribution
AN - SCOPUS:85206141364
T3 - UbiComp Companion 2024 - Companion of the 2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing
SP - 41
EP - 45
BT - UbiComp Companion 2024 - Companion of the 2024 ACM International Joint Conference on Pervasive and Ubiquitous Computing
PB - Association for Computing Machinery, Inc
Y2 - 5 October 2024 through 9 October 2024
ER -