Onsite microgrid generation systems with renewable sources are considered a promising complementary energy supply system for manufacturing plant, especially when outage occurs during which the energy supplied from the grid is not available. Compared to the widely recognized benefits in terms of the resilience improvement when it is used as a backup energy system, the operation along with the electricity grid to support the manufacturing operations in non-emergent mode has been less investigated. In this paper, we propose a joint dynamic decision-making model for the optimal control for both manufacturing system and onsite generation system. Markov Decision Process (MDP) is used to formulate the decision-making model. A neural network integrated reinforcement learning algorithm is proposed to approximately estimate the value function given policy of MDP. A case study based on a manufacturing system as well as a typical onsite microgrid generation system is conducted to validate the proposed MDP model as well as the solution strategy.
W. Hu et al., "Joint Manufacturing and Onsite Microgrid System Control using Markov Decision Process and Neural Network Integrated Reinforcement Learning," Procedia Manufacturing, vol. 39, pp. 1242 - 1249, Elsevier B.V., Aug 2019.
The definitive version is available at https://doi.org/10.1016/j.promfg.2020.01.345
25th International Conference on Production Research Manufacturing Innovation: Cyber Physical Manufacturing, ICPR 2019 (2019: Aug. 9-14, Chicago, IL)
Mathematics and Statistics
Engineering Management and Systems Engineering
Keywords and Phrases
Manufacturing system; Markov Decision Process; Neural network; Onsite generation system; Reinforcement learning
International Standard Serial Number (ISSN)
Article - Conference proceedings
© 2019 The Authors, All rights reserved.
Creative Commons Licensing
This work is licensed under a Creative Commons Attribution-Noncommercial-No Derivative Works 4.0 License.
01 Aug 2019