A Reinforcement Adversarial Framework Targeting Endogenous Functional Safety in ICS: Applied to Tennessee Eastman Process

Xinyi Wu1; Yulong Ding1; Shuang-Hua Yang2

10.1109/ICCAE59995.2024.10569963

2024-03-16

2154-4352

979-8-3503-7016-4

2024 16th International Conference on Computer and Automation Engineering (ICCAE)

14-16 March 2024

Melbourne, Australia

Endogenous Safety and Security (ESS) of Industrial Control Systems (ICS) has gained great attention with the advent of Industry 4.0. However, with rising cyber threats, most current research has focused mainly on cybersecurity aspects. Our study aims to fill this research gap by focusing on the endogenous functional safety of ICS, with a particular emphasis on key control parameters “setpoints”. We propose a reinforcement adversarial framework to investigate the functional security issues arising from unexpected operations and malicious tampering against setpoints. In this framework, a deep reinforcement learning(DRL) agent interacts with a custom input rule model, which serves as both a dynamic validator and an adversary, aiming to explore previously unforeseen behaviors. Explored unexpected behaviors are continuously updated to the input rule model, enhancing system adaptability and robustness. Our study employed the Tennessee Eastman Process as a case study, using the proximal policy optimization(PPO) algorithm with Beta and Gaussian distributions. Our approach exhibited significant advantages in exploration efficiency over baseline methods such as random agents and simulated annealing. These findings underscore DRL's important role in augmenting ICS functional safety, thereby enhancing system resilience and security in Industry 4.0.

第一

EI

1.Department of Computer Science and Engineering, Shenzhen Key Laboratory of Safety and Security for Next Generation of Industrial Internet, Southern University of Science and Technology, Shenzhen, China
2.Department of Computer Science, Shenzhen Key Laboratory of Safety and Security for Next Generation of Industrial Internet, Southern University of Science and Technology, University of Reading Berkshire, UK

Xinyi Wu,Yulong Ding,Shuang-Hua Yang. A Reinforcement Adversarial Framework Targeting Endogenous Functional Safety in ICS: Applied to Tennessee Eastman Process[C],2024.