ABSTRACT
The transition from conventional mobility to electromobility largely depends on charging infrastructure availability and optimal placement. This paper examines the optimal placement of charging stations in urban areas. We maximise the charging infrastructure supply over the area and minimise waiting, travel, and charging times while setting budget constraints. Moreover, we include the possibility of charging vehicles at home to obtain a more refined estimation of the actual charging demand throughout the urban area. We formulate the Placement of Charging Stations problem as a non-linear integer optimisation problem that seeks the optimal positions for charging stations and the optimal number of charging piles of different charging types. We design a novel Deep Reinforcement Learning approach to solve the charging station placement problem (PCRL). Extensive experiments on real-world datasets show how the PCRL reduces the waiting and travel time while increasing the benefit of the charging plan compared to five baselines. Compared to the existing infrastructure, we can reduce the waiting time by up to 97% and increase the benefit up to 497%.
Supplemental Material
- 2022. Open Charge Map. Retrieved June 9, 2022 from https://openchargemap.orgGoogle Scholar
- 2022. OpenStreetMap. Retrieved June 9, 2022 from https://openstreetmap.orgGoogle Scholar
- Sangjun Bae, Inmo Jang, Sébastien Gros, Balázs Kulcsár, and Jonas Hellgren. 2022. A Game Approach for Charging Station Placement Based on User Preferences and Crowdedness. IEEE Trans. Intell. Transp. Syst. 23, 4 (2022).Google ScholarDigital Library
- Geoff Boeing. 2017. OSMnx: New Methods for Acquiring, Constructing, Analyzing, and Visualizing Complex Street Networks. Comput. Environ. Urban Syst. 65 (2017).Google Scholar
- Greg Brockman, Vicki Cheung, Ludwig Pettersson, Jonas Schneider, John Schulman, Jie Tang, and Wojciech Zaremba. 2016. OpenAI Gym. arXiv:1606.01540Google Scholar
- Woongchul Choi. 2020. Placement of Charging Infrastructures for EVs using K-Mean Algorithm and its Validation using Real Usage Data. Int. J. of Precis. Eng. and Manuf.-Green Tech. 7 (2020).Google ScholarCross Ref
- Qiushi Cui, Yang Weng, and Chin-Woo Tan. 2019. Electric Vehicle Charging Station Placement Method for Urban Areas. IEEE Trans. Smart Grid 10, 6 (2019).Google ScholarCross Ref
- Bowen Du, Yongxin Tong, Zimu Zhou, Qian Tao, and Wenjun Zhou. 2018. Demand-Aware Charger Planning for Electric Vehicle Sharing. Proceedings of the 24th ACM SIGKDD (2018).Google ScholarDigital Library
- Xiaoying Gan, Haoxiang Zhang, Gai Hang, Zhida Qin, and Haiming Jin. 2020. Fast-Charging Station Deployment Considering Elastic Demand. IEEE Trans. Transp. Electrification 6, 1 (2020).Google ScholarCross Ref
- David L. Greene, Eleftheria Kontou, Brennan Borlaug, Aaron Brooker, and Matteo Muratori. 2020. Public charging infrastructure for plug-in electric vehicles: What is it worth? Transp. Res. D 78 (2020).Google ScholarCross Ref
- Timo Krallmann, Martin Doering, Marek Stess, Timo Graen, and Michael Nolting. 2018. Multi-objective optimization of charging infrastructure to improve suitability of commercial drivers for electric vehicles using real travel data. IEEE EAIS) (2018).Google ScholarCross Ref
- Chen Liu, Ke Deng, Chaojie Li, Jianxin Li, Yanhua Li, and Jun Luo. 2016. The Optimal Distribution of Electric-Vehicle Chargers across a City. IEEE 16th ICDM (2016).Google ScholarCross Ref
- Qi Liu, Jiahao Liu, Weiwei Le, Zhaoxia Guo, and Zhenggang He. 2019. Datadriven intelligent location of public charging stations for electric vehicles. J. Clean. Prod. 232 (2019).Google Scholar
- Qiyu Liu, Yuxiang Zeng, Lei Chen, and Xiuwen Zheng. 2019. Social-Aware Optimal Electric Vehicle Charger Deployment on Road Network. Proceedings of the 27th ACM SIGSPATIAL (2019).Google ScholarDigital Library
- Xuyao Meng, Weige Zhang, Yan Bao, Yian Yan, Ruiming Yuan, Zhen Chen, and JingXin Li. 2020. Sequential construction planning of electric taxi charging stations considering the development of charging demand. J. Clean. Prod. 259 (2020).Google Scholar
- Volodymyr Mnih, Koray Kavukcuoglu, David Silver, Alex Graves, Ioannis Antonoglou, Daan Wierstra, and Martin Riedmiller. 2013. Playing Atari with Deep Reinforcement Learning. arXiv:1312.5602Google Scholar
- Abood Mourad and Martin Hennebel. 2020. The Optimal Deployment of Recharging Stations for Electric Vehicles Based on Mobility Flows and Electric Grid Specifications. IEEE ISGT-Europe (2020).Google ScholarCross Ref
- Antonin Raffin, Ashley Hill, Adam Gleave, Anssi Kanervisto, Maximilian Ernestus, and Noah Dormann. 2021. Stable-Baselines3: Reliable Reinforcement Learning Implementations. J Mach Learn Res 22, 268 (2021).Google Scholar
- Chenxi Sun, Tongxin Li, and Xiaoying Tang. 2021. Data-driven Electric Vehicle Charging Station Placement for Incentivizing Potential Demand. IEEE SmartGridComm (2021).Google ScholarCross Ref
- Felix Tuchnitz, Niklas Ebell, Jonas Schlund, and Marco Pruckner. 2021. Development and Evaluation of a Smart Charging Strategy for an Electric Vehicle Fleet Based on Reinforcement Learning. Appl. Energy 285 (2021).Google Scholar
- Mohammad M. Vazifeh, Hongmou Zhang, Paolo Santi, and Carlo Ratti. 2019. Optimizing the deployment of electric vehicle charging stations using pervasive mobility data. Transp. Res. A 121 (2019).Google Scholar
- Lei Xu, Hasan Ümitcan Yilmaz, Zongfei Wang, Witold-Roger Poganietz, and Patrick Jochem. 2020. Greenhouse gas emissions of electric vehicles in Europe considering different charging strategies. Transp. Res. D 87 (2020).Google Scholar
- Li Zeng, Timo Krallmann, Andrea Fiege, Marek Stess, Timo Graen, and Michael Nolting. 2020. Optimization of future charging infrastructure for commercial electric vehicles using a multi-objective genetic algorithm and real travel data. Evol. Syst. 11 (2020).Google Scholar
- Weijia Zhang, Hao Liu, Fan Wang, Tong Xu, Haoran Xin, Dejing Dou, and Hui Xiong. 2021. Intelligent Electric Vehicle Charging Recommendation Based on Multi-Agent Reinforcement Learning. Proceedings of the WWW (2021).Google ScholarDigital Library
- Zhenli Zhao, Lihui Zhang, Meng Yang, Jianxue Chai, and Songrui Li. 2020. Pricing for private charging pile sharing considering EV consumers based on noncooperative game model. J. Clean. Prod. 254 (2020).Google Scholar
- Simon Árpád Funke, Frances Sprei, Till Gnann, and Patrick Plötz. 2019. How much charging infrastructure do electric vehicles need? A review of the evidence and international comparison. Trans. Res. D 77 (2019).Google Scholar
Index Terms
- Reinforcement Learning-based Placement of Charging Stations in Urban Road Networks
Recommendations
Spatial and Temporal Charging Infrastructure Planning Using Discrete Event Simulation
SIGSIM-PADS '17: Proceedings of the 2017 ACM SIGSIM Conference on Principles of Advanced Discrete SimulationThe switch from gasoline-powered vehicles to electric vehicles (EVs) is an important step to reduce greenhouse gas emissions. To this end, many European countries announced EV stock targets, e.g., Germany aims to have one million EVs on the roads by ...
An Interoperable Reservation System for Public Electric Vehicle Charging Stations: A Case Study in Germany
TESCA'19: Proceedings of the 1st ACM International Workshop on Technology Enablers and Innovative Applications for Smart Cities and CommunitiesAs the number of electric vehicles on the roads increases, new technologies and concepts such as fast/super-fast charging and dynamic pricing are developed and implemented respectively. With those innovations on the rise, reservation of charging ...
Optimal deployment of charging stations for electric vehicular networks
UrbaNe '12: Proceedings of the first workshop on Urban networkingIn a smart city environment, we look at a new, upcoming generation of vehicles running on electric power supplied by on-board batteries. Best recharging options include charging at home, as well as charging at public areas. In this setting, electric ...
Comments