Skip to main content
placeholder image

Multi-agent deep reinforcement learning for traffic signal control with Nash Equilibrium

Conference Paper


Abstract


  • Traffic signal control is an essential and chal-lenging real-world problem, which aims to alleviate traffic congestion by coordinating vehicles' movements at road in-tersections. Deep reinforcement learning (DRL) combines deep neural networks (DNNs) with a framework of reinforcement learning, which is a promising method for adaptive traffic signal control in complex urban traffic networks. Now, multi-agent deep reinforcement learning (MARL) has the potential to deal with traffic signal control at a large scale. However, current traffic signal control systems still rely heavily on simplified rule- based methods in practice. In this paper, we propose: (1) a MARL algorithm based on Nash Equilibrium and DRL, namely Nash Asynchronous Advantage Actor-Critic (Nash-A3C); (2) an urban simulation environment (SENV) to be essentially close to the real-world scenarios. We apply our method in SENV, obtaining better performance than benchmark traffic signal control methods by 22.1%, which proves that Nash-A3C to be more suitable for large industrial level deployment.

Publication Date


  • 2022

Citation


  • Wei, W., Wu, Q., Wu, J., Du, B., Shen, J., & Li, T. (2022). Multi-agent deep reinforcement learning for traffic signal control with Nash Equilibrium. In 2021 IEEE 23rd International Conference on High Performance Computing and Communications, 7th International Conference on Data Science and Systems, 19th International Conference on Smart City and 7th International Conference on Dependability in Sensor, Cloud and Big Data Systems and Applications, HPCC-DSS-SmartCity-DependSys 2021 (pp. 1435-1442). doi:10.1109/HPCC-DSS-SmartCity-DependSys53884.2021.00215

Scopus Eid


  • 2-s2.0-85132399940

Web Of Science Accession Number


Start Page


  • 1435

End Page


  • 1442

Abstract


  • Traffic signal control is an essential and chal-lenging real-world problem, which aims to alleviate traffic congestion by coordinating vehicles' movements at road in-tersections. Deep reinforcement learning (DRL) combines deep neural networks (DNNs) with a framework of reinforcement learning, which is a promising method for adaptive traffic signal control in complex urban traffic networks. Now, multi-agent deep reinforcement learning (MARL) has the potential to deal with traffic signal control at a large scale. However, current traffic signal control systems still rely heavily on simplified rule- based methods in practice. In this paper, we propose: (1) a MARL algorithm based on Nash Equilibrium and DRL, namely Nash Asynchronous Advantage Actor-Critic (Nash-A3C); (2) an urban simulation environment (SENV) to be essentially close to the real-world scenarios. We apply our method in SENV, obtaining better performance than benchmark traffic signal control methods by 22.1%, which proves that Nash-A3C to be more suitable for large industrial level deployment.

Publication Date


  • 2022

Citation


  • Wei, W., Wu, Q., Wu, J., Du, B., Shen, J., & Li, T. (2022). Multi-agent deep reinforcement learning for traffic signal control with Nash Equilibrium. In 2021 IEEE 23rd International Conference on High Performance Computing and Communications, 7th International Conference on Data Science and Systems, 19th International Conference on Smart City and 7th International Conference on Dependability in Sensor, Cloud and Big Data Systems and Applications, HPCC-DSS-SmartCity-DependSys 2021 (pp. 1435-1442). doi:10.1109/HPCC-DSS-SmartCity-DependSys53884.2021.00215

Scopus Eid


  • 2-s2.0-85132399940

Web Of Science Accession Number


Start Page


  • 1435

End Page


  • 1442