Research on unmanned delivery path optimization strategy based on reinforcement learning in intelligent logistics system

[1]Yadav, S. (2016). E-Commerce: The Rise and Rise of E-Commerce in India. Splint International Journal of Professionals, 3(10), 23. YadavS. (2016). E-Commerce: The Rise and Rise of E-Commerce in India. Splint International Journal of Professionals, 3(10), 23.Search in Google Scholar

[2]Gao, Y., Chang, D., Fang, T., & Luo, T. (2018). The correlation between logistics industry and other industries: An evaluation of the empirical evidence from China. The Asian Journal of Shipping and Logistics, 34(1), 27-32. GaoY., ChangD., FangT. & LuoT. (2018). The correlation between logistics industry and other industries: An evaluation of the empirical evidence from China. The Asian Journal of Shipping and Logistics, 34(1), 27-32.Search in Google Scholar

[3]Yan, B., Yao, B., & Zhang, C. (2023). Industrial structure, high-quality development of logistics industry and the economy. Plos one, 18(5), e0285229. YanB., YaoB. & ZhangC. (2023). Industrial structure, high-quality development of logistics industry and the economy. Plos one, 18(5), e0285229.Search in Google Scholar

[4]Wu, G. (2021, March). Research on the development path of logistics management innovation in e-commerce environment. In IOP Conference Series: Earth and Environmental Science (Vol. 714, No. 4, p. 042022). IOP Publishing. WuG. (2021, March). Research on the development path of logistics management innovation in e-commerce environment. In IOP Conference Series: Earth and Environmental Science (Vol. 714, No. 4, p. 042022). IOP Publishing.Search in Google Scholar

[5]Issaoui, Y., Khiat, A., Haricha, K., Bahnasse, A., & Ouajji, H. (2022). An advanced system to enhance and optimize delivery operations in a smart logistics environment. IEEE Access, 10, 6175-6193. IssaouiY., KhiatA., HarichaK., BahnasseA. & OuajjiH. (2022). An advanced system to enhance and optimize delivery operations in a smart logistics environment. IEEE Access, 10, 6175-6193.Search in Google Scholar

[6]Yi, M., & Yan, C. Y. (2024). Optimization method for logistics distribution path of unmanned vehicles under vehicle road collaboration. Advances in Transportation Studies. YiM. & YanC. Y. (2024). Optimization method for logistics distribution path of unmanned vehicles under vehicle road collaboration. Advances in Transportation Studies.Search in Google Scholar

[7]Krajcovic, M., Grznar, P., Fusko, M., & Skokan, R. (2018). INTELLIGENT LOGISTICS FOR INTELLIGENT PRODUCTION SYSTEMS. Komunikácie, 20(4). KrajcovicM., GrznarP., FuskoM. & SkokanR. (2018). INTELLIGENT LOGISTICS FOR INTELLIGENT PRODUCTION SYSTEMS. Komunikácie, 20(4).Search in Google Scholar

[8]Li, Y., Liu, M., & Jiang, D. (2022). Application of unmanned aerial vehicles in logistics: a literature review. Sustainability, 14(21), 14473. LiY., LiuM. & JiangD. (2022). Application of unmanned aerial vehicles in logistics: a literature review. Sustainability, 14(21), 14473.Search in Google Scholar

[9]Suanpang, P., & Jamjuntr, P. (2024). Optimizing Last-Mile Delivery By Deep Q-Learning Approach For Autonomous Drone Routing In Smart Logistics. Operational Research in Engineering Sciences: Theory and Applications, 7(2). SuanpangP. & JamjuntrP. (2024). Optimizing Last-Mile Delivery By Deep Q-Learning Approach For Autonomous Drone Routing In Smart Logistics. Operational Research in Engineering Sciences: Theory and Applications, 7(2).Search in Google Scholar

[10]Huang, L. Y., Li, S. Y., Zou, X., Zhao, B. Z., & Li, C. L. (2024). Knowledge-Driven Logistics Transformation: Complex Networks and UAVs in Distribution. Journal of the Knowledge Economy, 1-40. HuangL. Y., LiS. Y., ZouX., ZhaoB. Z. & LiC. L. (2024). Knowledge-Driven Logistics Transformation: Complex Networks and UAVs in Distribution. Journal of the Knowledge Economy, 1-40.Search in Google Scholar

[11]Tang, G., Xiao, T., Du, P., Zhang, P., Liu, K., & Tan, L. (2024). Improved pso-based two-phase logistics uav path planning under dynamic demand and wind conditions. Drones, 8(8), 356. TangG., XiaoT., DuP., ZhangP., LiuK. & TanL. (2024). Improved pso-based two-phase logistics uav path planning under dynamic demand and wind conditions. Drones, 8(8), 356.Search in Google Scholar

[12]Lee, H. W., & Lee, C. S. (2023). Research on logistics of intelligent unmanned aerial vehicle integration system. Journal of Industrial Information Integration, 36, 100534. LeeH. W. & LeeC. S. (2023). Research on logistics of intelligent unmanned aerial vehicle integration system. Journal of Industrial Information Integration, 36, 100534.Search in Google Scholar

[13]Meng, X., & Li, X. (2020). Research on optimization of port logistics distribution path planning based on intelligent group classification algorithm. Journal of Coastal Research, 115(SI), 205-207. MengX. & LiX. (2020). Research on optimization of port logistics distribution path planning based on intelligent group classification algorithm. Journal of Coastal Research, 115(SI), 205-207.Search in Google Scholar

[14]Liu, C., Huang, L., & Dong, Z. (2022). A Two-Stage Approach of Joint Route Planning and Resource Allocation for Multiple UAVs in Unmanned Logistics Distribution. IEEE Access, 10, 113888-113901. LiuC., HuangL. & DongZ. (2022). A Two-Stage Approach of Joint Route Planning and Resource Allocation for Multiple UAVs in Unmanned Logistics Distribution. IEEE Access, 10, 113888-113901.Search in Google Scholar

[15]Shi, J. (2022). Research on Optimization of Cross-Border e-Commerce Logistics Distribution Network in the Context of Artificial Intelligence. Mobile Information Systems, 2022(1), 3022280. ShiJ. (2022). Research on Optimization of Cross-Border e-Commerce Logistics Distribution Network in the Context of Artificial Intelligence. Mobile Information Systems, 2022(1), 3022280.Search in Google Scholar

[16]Zhai, D., Wang, C., Cao, H., Garg, S., Hassan, M. M., & AlQahtani, S. A. (2022). Deep neural network based UAV deployment and dynamic power control for 6G-Envisioned intelligent warehouse logistics system. Future Generation Computer Systems, 137, 164-172. ZhaiD., WangC., CaoH., GargS., HassanM. M. & AlQahtaniS. A. (2022). Deep neural network based UAV deployment and dynamic power control for 6G-Envisioned intelligent warehouse logistics system. Future Generation Computer Systems, 137, 164-172.Search in Google Scholar

[17]Han, Z. (2022, July). Research on logistics AGV vehicle path planning based on improved Q-learning algorithm. In 2022 7th International Conference on Automation, Control and Robotics Engineering (CACRE) (pp. 264-268). IEEE. HanZ. (2022, July). Research on logistics AGV vehicle path planning based on improved Q-learning algorithm. In 2022 7th International Conference on Automation, Control and Robotics Engineering (CACRE) (pp. 264-268). IEEE.Search in Google Scholar

[18]Huo, Q. (2022, October). Multi-objective vehicle path planning based on DQN. In International Conference on Cloud Computing, Performance Computing, and Deep Learning (CCPCDL 2022) (Vol. 12287, pp. 351-357). SPIE. HuoQ. (2022, October). Multi-objective vehicle path planning based on DQN. In International Conference on Cloud Computing, Performance Computing, and Deep Learning (CCPCDL 2022) (Vol. 12287, pp. 351-357). SPIE.Search in Google Scholar

[19]Lee, K. H., & Kim, S. D. (2017). Path Planning of Unmanned Aerial Vehicle based Reinforcement Learning using Deep Q Network under Simulated Environment. Journal of the Semiconductor & Display Technology, 16(3), 127-130. LeeK. H. & KimS. D. (2017). Path Planning of Unmanned Aerial Vehicle based Reinforcement Learning using Deep Q Network under Simulated Environment. Journal of the Semiconductor & Display Technology, 16(3), 127-130.Search in Google Scholar

[20]Wang, X., Ji, J., Liu, Y., & He, Q. (2024). Path Planning of Unmanned Delivery Vehicle Based on Improved Q-learning Algorithm. Journal of System Simulation, 36(5), 1211. WangX., JiJ., LiuY. & HeQ. (2024). Path Planning of Unmanned Delivery Vehicle Based on Improved Q-learning Algorithm. Journal of System Simulation, 36(5), 1211.Search in Google Scholar

[21]Zhang, P., Zhang, C. Y., & Gai, W. L. (2023, April). Research on path planning algorithm of unmanned ground platform based on reinforcement learning. In Third International Conference on Artificial Intelligence and Computer Engineering (ICAICE 2022) (Vol. 12610, pp. 1241-1246). SPIE. ZhangP., ZhangC. Y. & GaiW. L. (2023, April). Research on path planning algorithm of unmanned ground platform based on reinforcement learning. In Third International Conference on Artificial Intelligence and Computer Engineering (ICAICE 2022) (Vol. 12610, pp. 1241-1246). SPIE.Search in Google Scholar

[22]Gu, A., Wang, Z., Ran, Y., Li, M., Li, S., Xun, Q., & Dong, J. (2023, February). Analysis of Path Optimization Problem Based on Reinforcement Learning. In International Conference on Computing, Control and Industrial Engineering (pp. 391-400). Singapore: Springer Nature Singapore. GuA., WangZ., RanY., LiM., LiS., XunQ. & DongJ. (2023, February). Analysis of Path Optimization Problem Based on Reinforcement Learning. In International Conference on Computing, Control and Industrial Engineering (pp. 391-400). Singapore: Springer Nature Singapore.Search in Google Scholar

[23]Ara, S., Akib, M. M. M. K., Oion, M. S. R., Shohel, M. H. R., Ridoy, M. N. F., Kabita, F. A., & Shahiduzzaman, M. (2023, December). Vehicle Routing Problem Solving Using Reinforcement Learning. In 2023 26th International Conference on Computer and Information Technology (ICCIT) (pp. 1-6). IEEE. AraS., AkibM. M. M. K., OionM. S. R., ShohelM. H. R., RidoyM. N. F., KabitaF. A. & ShahiduzzamanM. (2023, December). Vehicle Routing Problem Solving Using Reinforcement Learning. In 2023 26th International Conference on Computer and Information Technology (ICCIT) (pp. 1-6). IEEE.Search in Google Scholar

[24]Ma, K., Liao, S., & Niu, Y. (2024). Connected vehicles’ dynamic route planning based on reinforcement learning. Future Generation Computer Systems, 153, 375-390. MaK., LiaoS. & NiuY. (2024). Connected vehicles’ dynamic route planning based on reinforcement learning. Future Generation Computer Systems, 153, 375-390.Search in Google Scholar

[25]Ren, L., Fan, X., Cui, J., Shen, Z., Lv, Y., & Xiong, G. (2022). A multi-agent reinforcement learning method with route recorders for vehicle routing in supply chain management. IEEE Transactions on Intelligent Transportation Systems, 23(9), 16410-16420. RenL., FanX., CuiJ., ShenZ., LvY. & XiongG. (2022). A multi-agent reinforcement learning method with route recorders for vehicle routing in supply chain management. IEEE Transactions on Intelligent Transportation Systems, 23(9), 16410-16420.Search in Google Scholar

[26]Kuru, K., Ansell, D., Khan, W., & Yetgin, H. (2019). Analysis and optimization of unmanned aerial vehicle swarms in logistics: An intelligent delivery platform. Ieee Access, 7, 15804-15831. KuruK., AnsellD., KhanW. & YetginH. (2019). Analysis and optimization of unmanned aerial vehicle swarms in logistics: An intelligent delivery platform. Ieee Access, 7, 15804-15831.Search in Google Scholar

[27]Kong, F., Li, J., Jiang, B., Wang, H., & Song, H. (2022). Trajectory optimization for drone logistics delivery via attention-based pointer network. IEEE Transactions on Intelligent Transportation Systems, 24(4), 4519-4531. KongF., LiJ., JiangB., WangH. & SongH. (2022). Trajectory optimization for drone logistics delivery via attention-based pointer network. IEEE Transactions on Intelligent Transportation Systems, 24(4), 4519-4531.Search in Google Scholar

[28]Szabó, A. A., Illés, B., & Tóth, Á. B. (2021). Trends in route planning with the tools of intelligent distribution logistics. Advanced Logistic Systems-Theory and Practice, 15(1), 65-86. SzabóA. A., IllésB. & TóthÁ. B. (2021). Trends in route planning with the tools of intelligent distribution logistics. Advanced Logistic Systems-Theory and Practice, 15(1), 65-86.Search in Google Scholar

[29]Li, D., & Chai, T. (2023). Design of an improved intelligent optimization logistics path planning model for the background of the new industrial era. Journal of Industrial and Production Engineering, 40(8), 611-623. LiD. & ChaiT. (2023). Design of an improved intelligent optimization logistics path planning model for the background of the new industrial era. Journal of Industrial and Production Engineering, 40(8), 611-623.Search in Google Scholar

[30]Lee, H. W. (2022). Research on multi-functional logistics intelligent Unmanned Aerial Vehicle. Engineering Applications of Artificial Intelligence, 116, 105341. LeeH. W. (2022). Research on multi-functional logistics intelligent Unmanned Aerial Vehicle. Engineering Applications of Artificial Intelligence, 116, 105341.Search in Google Scholar

[31]Du, P., Shi, Y., Cao, H., Garg, S., Alrashoud, M., & Shukla, P. K. (2024). AI-Enabled Trajectory Optimization of Logistics UAVs With Wind Impacts in Smart Cities. IEEE Transactions on Consumer Electronics. DuP., ShiY., CaoH., GargS., AlrashoudM. & ShuklaP. K. (2024). AI-Enabled Trajectory Optimization of Logistics UAVs With Wind Impacts in Smart Cities. IEEE Transactions on Consumer Electronics.Search in Google Scholar

[32]Yao, J. (2024, September). Path planning for unmanned vehicles based on reinforcement learning. In Proceedings of the 2024 8th International Conference on Big Data and Internet of Things (pp. 205-209). YaoJ. (2024, September). Path planning for unmanned vehicles based on reinforcement learning. In Proceedings of the 2024 8th International Conference on Big Data and Internet of Things (pp. 205-209).Search in Google Scholar

[33]Wang, B., & Jiang, S. (2024, November). Path Planning of Urban Logistics Delivery Unmanned Vehicles Based on Optimized Ant Colony Algorithm. In 2024 6th International Conference on Artificial Intelligence and Computer Applications (ICAICA) (pp. 140-147). IEEE. WangB. & JiangS. (2024, November). Path Planning of Urban Logistics Delivery Unmanned Vehicles Based on Optimized Ant Colony Algorithm. In 2024 6th International Conference on Artificial Intelligence and Computer Applications (ICAICA) (pp. 140-147). IEEE.Search in Google Scholar

[34]Miao, H. (2022). Cold Chain Logistics UAV Path Optimization Enlightenment. Frontiers in Business, Economics and Management, 4(1), 26-30. MiaoH. (2022). Cold Chain Logistics UAV Path Optimization Enlightenment. Frontiers in Business, Economics and Management, 4(1), 26-30.Search in Google Scholar

[35]Song, Q., Zhao, Q., Wang, S., Liu, Q., & Chen, X. (2020). Dynamic path planning for unmanned vehicles based on fuzzy logic and improved ant colony optimization. IEEE Access, 8, 62107-62115. SongQ., ZhaoQ., WangS., LiuQ. & ChenX. (2020). Dynamic path planning for unmanned vehicles based on fuzzy logic and improved ant colony optimization. IEEE Access, 8, 62107-62115.Search in Google Scholar

[36]Deng, M., Yang, Q., & Peng, Y. (2023). A real-time path planning method for urban low-altitude logistics UAVs. Sensors, 23(17), 7472. DengM., YangQ. & PengY. (2023). A real-time path planning method for urban low-altitude logistics UAVs. Sensors, 23(17), 7472.Search in Google Scholar

[37]Gao, J., & Zhen, L. (2023). Intelligent Distribution Transportation Route Planning Considering Traffic Congestion. IEEE Intelligent Transportation Systems Magazine. GaoJ. & ZhenL. (2023). Intelligent Distribution Transportation Route Planning Considering Traffic Congestion. IEEE Intelligent Transportation Systems Magazine.Search in Google Scholar

[38]Sachan Saurabh & Pathak Pushparaj Mani. (2025). Addressing unpredictable movements of dynamic obstacles with deep reinforcement learning to ensure safe navigation for omni-wheeled mobile robot. Proceedings of the Institution of Mechanical Engineers(4), 1267-1293. SaurabhSachan & ManiPathak Pushparaj. (2025). Addressing unpredictable movements of dynamic obstacles with deep reinforcement learning to ensure safe navigation for omni-wheeled mobile robot. Proceedings of the Institution of Mechanical Engineers(4), 1267-1293.Search in Google Scholar

[39]Dwijaraj Paul Chowdhury, Deep Roy & Ujjwal Saha. (2025). Study of Rainfall Occurrence Process by Markov Chain Models and Decision Tree-based Ensemble and Boosting Techniques. Water Resources Management(prepublish), 1-21. ChowdhuryDwijaraj Paul, RoyDeep & SahaUjjwal. (2025). Study of Rainfall Occurrence Process by Markov Chain Models and Decision Tree-based Ensemble and Boosting Techniques. Water Resources Management(prepublish), 1-21.Search in Google Scholar

[40]Fumin Mi, Bingqi Wang & Caiyi Wang. (2022). Research on Logistics Avoidance Strategy of Campus Unmanned Distribution Based on Markov Decision Process. (eds.) MiFumin, WangBingqi & WangCaiyi. (2022). Research on Logistics Avoidance Strategy of Campus Unmanned Distribution Based on Markov Decision Process.(eds.)Search in Google Scholar

[41]Luo Yuan, Qin Qiong, Hu Zhangfang & Zhang Yi. (2023). Path Planning for Unmanned Delivery Robots Based on EWB-GWO Algorithm. Sensors(4), 1867-1867. YuanLuo, QiongQin, ZhangfangHu & YiZhang. (2023). Path Planning for Unmanned Delivery Robots Based on EWB-GWO Algorithm. Sensors(4), 1867-1867.Search in Google Scholar