Comparison Method Q-Learning and SARSA for Simulation of Drone Controller using Reinforcement Learning

Mohamad Hafiz Abu Bakar, Mohamad Hafiz Abu Bakar and Abu Ubaidah Shamsudin, Abu Ubaidah Shamsudin and Ruzairi Abdul Rahim, Ruzairi Abdul Rahim and Zubair Adil Soomro, Zubair Adil Soomro and Andi Adrianshah, Andi Adrianshah (2023) Comparison Method Q-Learning and SARSA for Simulation of Drone Controller using Reinforcement Learning. Journal of Advanced Research in Fluid Mechanics and Thermal Sciences, 30 (3). pp. 69-78. ISSN 2462-1943

[img] Text
J16168_3519c3c49183a6f808613789cd52277b.pdf

Download (474kB)

Abstract

Nowadays, the advancement of drones is also factored in the development of a world surrounded by technologies. One of the aspects emphasized here is the difficulty of controlling the drone, and the system developed is still under full control by the users as well. Reinforcement Learning is used to enable the system to operate automatically, thus drone will learn the next movement based on the interaction between the agent and the environment. Through this study, Q-Learning and State-Action-Reward-StateAction (SARSA) are used in this study and the comparison of results involving both the performance and effectiveness of the system based on the simulation of both methods can be seen through the analysis. A comparison of both Q-learning and State-ActionReward-State-Action (SARSA) based systems in autonomous drone application was performed for evaluation in this study. According to this simulation process is shows that Q-Learning is a better performance and effective to train the system to achieve desire compared with SARSA algorithm for drone controller.

Item Type: Article
Uncontrolled Keywords: Reinforcement Learning (RL); QLearning; SARSA(State-Action-RewardState-Action); drone
Subjects: T Technology > T Technology (General)
Depositing User: Mr. Mohamad Zulkhibri Rahmad
Date Deposited: 03 Jan 2024 01:34
Last Modified: 03 Jan 2024 01:34
URI: http://eprints.uthm.edu.my/id/eprint/10521

Actions (login required)

View Item View Item