Optimal Defense and Control of Dynamic Systems Modeled as Cyber-Physical Systems
With the increasing connectivity among computational cyber-connected elements and physical entities, a unified representation that captures the interrelationship between the cyber and the physical systems becomes increasingly important. In this paper, we propose a novel representation for developing cybersecurity schemes for physical systems wherein the cyber system states affect the physical system and vice versa. Subsequently by using this representation, an optimal strategy via Q-learning is derived for the cyber defense in the presence of an attack. Since the cyber system under attack will affect the physical system stability and performance, an optimal controller by using Q-learning is considered for the physical system with uncertain dynamics. As an example, cyber-attacks that increase the network delay and packet losses are considered and the goal of the proposed cyber defense and optimal controller is to thwart the attack and mitigate the performance degradation of the physical system due to increased delays and packet losses. An illustrative example is given where the proposed theory is evaluated on the yaw-channel control of an unmanned aerial vehicle. Simulation results show that on the cyber side, both the attacker and the defender gains their greatest payoff whereas on the physical system side, the optimal controller is able to maintain the linear system in a stable manner when the cyber state vector meets a certain desired criterion.
H. Niu and J. Sarangapani, "Optimal Defense and Control of Dynamic Systems Modeled as Cyber-Physical Systems," Journal of Defense Modeling and Simulation, vol. 12, no. 4, pp. 423 - 438, SAGE Publications, Oct 2015.
The definitive version is available at https://doi.org/10.1177/1548512915594703
Electrical and Computer Engineering
Keywords and Phrases
Computation theory; Controllers; Embedded systems; Linear systems; Network security; Packet loss; System stability; Cyber physical systems (CPSs); Cyber security; Optimal controller; Optimal controls; Optimal strategies; Performance degradation; Uncertain dynamics; Zero-sum game; Computer crime; Cyber-physical systems; Cybersecurity
International Standard Serial Number (ISSN)
Article - Journal
© 2015 The Author(s), All rights reserved.
01 Oct 2015