Monte Carlo Tree Search-Based Intersection Signal Optimization Model with Channelized Section Spillover
Abstract
Signal optimization has received significant attentions from the research community. However, during peak hours, the performances of existing models still have room for improvements, especially when channelized section spillover (CSS) occurs. The evolution of CSS is dynamic in nature, not only due to the interactions between traffic flow of different movements, but also because existing CSS influences the queuing process in a channelized section and contributes to new CSS formation at the next cycle. Neglecting such spatial-temporal interaction in current traffic signal optimization procedures may lead to suboptimal results. A Monte Carlo Tree Search-based model is proposed to solve the intersection optimization problem (named MCTS-IO) with explicit modeling of CSS dynamic evolution. The model works in a rolling horizon way. At each decision point, MCTS-IO simulates the intersection by selecting a sequence of phases, and progressively updates the relative preferences of the phases. After all simulations are performed, the phase with the best policy PI is selected. Both the PI and decision space can be customized, which ensures algorithm flexibility. The method is tested against Synchro results with both stable and variable demand, which demonstrates the proposed model is always able to find a solution better than Synchro.
Recommended Citation
H. Qi and X. Hu, "Monte Carlo Tree Search-Based Intersection Signal Optimization Model with Channelized Section Spillover," Transportation Research Part C: Emerging Technologies, vol. 106, pp. 281 - 302, Elsevier Ltd, Sep 2019.
The definitive version is available at https://doi.org/10.1016/j.trc.2019.07.017
Department(s)
Civil, Architectural and Environmental Engineering
Keywords and Phrases
Channelized section spillover; Monte Carlo Tree Search; Signal optimization
International Standard Serial Number (ISSN)
0968-090X
Document Type
Article - Journal
Document Version
Citation
File Type
text
Language(s)
English
Rights
© 2019 Elsevier Ltd, All rights reserved.
Publication Date
01 Sep 2019
Comments
The research was sponsored by Zhejiang province public welfare scientific research project (Grant No. LGF18E080003) and the Key Research and Development Program of China, (No. 2018YFB1600900).