TY - JOUR
T1 - How Can LLMs and Knowledge Graphs Contribute to Robot Safety? A Few-Shot Learning Approach
AU - Althobaiti, Abdulrahman
AU - Ayala, Angel
AU - Gao, Jing Ying
AU - Almutairi, Ali
AU - Deghat, Mohammad
AU - Razzak, Imran
AU - Cruz, Francisco
N1 - Publisher Copyright:
© 2024 Australasian Robotics and Automation Association. All rights reserved.
PY - 2024
Y1 - 2024
N2 - Large Language Models (LLMs) are transforming the robotics domain by enabling robots to comprehend and execute natural language instructions. The cornerstone benefits of LLM include processing textual data from technical manuals, instructions, academic papers, and user queries based on the knowledge provided. However, deploying LLM-generated code in robotic systems without safety verification poses significant risks. This paper outlines a safety layer that verifies the code generated by ChatGPT before executing it to control a drone in a simulated environment. The safety layer consists of a fine-tuned GPT-4o model using Few-Shot learning, supported by knowledge graph prompting (KGP). Our approach improves the safety and compliance of robotic actions, ensuring that they adhere to the regulations of drone operations.
AB - Large Language Models (LLMs) are transforming the robotics domain by enabling robots to comprehend and execute natural language instructions. The cornerstone benefits of LLM include processing textual data from technical manuals, instructions, academic papers, and user queries based on the knowledge provided. However, deploying LLM-generated code in robotic systems without safety verification poses significant risks. This paper outlines a safety layer that verifies the code generated by ChatGPT before executing it to control a drone in a simulated environment. The safety layer consists of a fine-tuned GPT-4o model using Few-Shot learning, supported by knowledge graph prompting (KGP). Our approach improves the safety and compliance of robotic actions, ensuring that they adhere to the regulations of drone operations.
UR - https://www.scopus.com/pages/publications/85219535669
M3 - Conference article
AN - SCOPUS:85219535669
SN - 1448-2053
VL - 2024-November
JO - Australasian Conference on Robotics and Automation, ACRA
JF - Australasian Conference on Robotics and Automation, ACRA
T2 - 2024 Australasian Conference on Robotics and Automation, ACRA 2024
Y2 - 27 November 2024 through 29 November 2024
ER -