Future of Information and Communication Conference (FICC) 2025
28-29 April 2025
Publication Links
IJACSA
Special Issues
Future of Information and Communication Conference (FICC)
Computing Conference
Intelligent Systems Conference (IntelliSys)
Future Technologies Conference (FTC)
International Journal of Advanced Computer Science and Applications(IJACSA), Volume 15 Issue 5, 2024.
Abstract: This paper proposes a new EP-PER-SAC algorithm to solve the problems of slow training speed and low learning efficiency of the SAC (Soft Actor Critic) algorithm in the local path planning of mobile robots by introducing the Priority Experience Replay (PER) strategy and Experience Pool (EP) adjustment technique. This algorithm replaces equal probability random sampling with sampling based on the priority experience to increase the frequency of extracting important samples, thereby improves the stability and convergence speed of model training. On this basis, it requires to continuously monitor the learning progress and exploration rate changes of the robot to dynamically adjust the experience pool, so the robot can adapt effectively to the environment changes and the storage requirements and learning efficiency of the algorithm are balanced. Then, the algorithm's reward and punishment function is improved to reduce the blindness of algorithm training. Finally, experiments are conducted under different obstacle environments to verify the feasibility of the algorithm based on ROS (Robot Operating System) simulation platform and real environment. The results show that the improved EP-PER-SAC algorithm has a shorter path length and faster model convergence speed than the original SAC algorithm and PER-SAC algorithm.
Ruihong Zhou, Caihong Li, Guosheng Zhang, Yaoyu Zhang and Jiajun Liu, “Local Path Planning of Mobile Robots Based on the Improved SAC Algorithm” International Journal of Advanced Computer Science and Applications(IJACSA), 15(5), 2024. http://dx.doi.org/10.14569/IJACSA.2024.01505100
@article{Zhou2024,
title = {Local Path Planning of Mobile Robots Based on the Improved SAC Algorithm},
journal = {International Journal of Advanced Computer Science and Applications},
doi = {10.14569/IJACSA.2024.01505100},
url = {http://dx.doi.org/10.14569/IJACSA.2024.01505100},
year = {2024},
publisher = {The Science and Information Organization},
volume = {15},
number = {5},
author = {Ruihong Zhou and Caihong Li and Guosheng Zhang and Yaoyu Zhang and Jiajun Liu}
}
Copyright Statement: This is an open access article licensed under a Creative Commons Attribution 4.0 International License, which permits unrestricted use, distribution, and reproduction in any medium, even commercially as long as the original work is properly cited.