南方科技大学知识苑(SUSTech KC): Data-Based Approximate Optimal Control for Unknown Nonaffine Systems via Dynamic Feedback

题名	Data-Based Approximate Optimal Control for Unknown Nonaffine Systems via Dynamic Feedback
作者	Jinquan Lin 1; Bo Zhao 2; Derong Liu3
DOI	10.1109/DDCLS58216.2023.10166780
发表日期	2023
ISSN	2767-9853
ISBN	979-8-3503-2106-7
会议录名称	2023 IEEE 12th Data Driven Control and Learning Systems Conference (DDCLS)
页码	1301-1305
会议日期	12-14 May 2023
会议地点	Xiangtan, China
摘要	In this paper, an integral reinforcement learning (IRL)-based approximate optimal control (AOC) method for unknown nonaffine systems is developed by using dynamic feedback. For optimal control problems of nonaffine systems, optimal control policy cannot be expressed explicitly since the input gain matrix is unknown. Therefore, the nonaffine system is transformed into an augmented affine system by introducing a dynamic feedback signal as the virtual control input. Moreover, by designing an appropriate value function for the augmented affine system, the optimal control of augmented affine system is formulated as the AOC for unknown nonaffine systems. Moreover, the IRL method is adopted to derive the approximate solution of Hamilton-Jacobi-Bellman equation via the critic-only structure. Theoretical analysis concludes that the closed-loop system is uniformly ultimately bounded by using the developed IRL-based AOC scheme. An example is utilized to demonstrate the effectiveness of the present approach.
关键词	Adaptive dynamic programming reinforcement learning dynamic feedback data-based control unknown nonaffine systems
学校署名	其他
相关链接	[IEEE记录]
收录类别	CPCI-S ; EI
WOS记录号	WOS:001047443700220
EI入藏号	20233114457427
EI主题词	Adaptive control systems ; Dynamic programming ; Feedback ; Learning systems ; Optimal control systems ; Reinforcement learning
EI分类号	Artificial Intelligence:723.4 ; Control Systems:731.1 ; Optimization Techniques:921.5 ; Systems Science:961
来源库	IEEE
全文链接	https://ieeexplore.ieee.org/stamp/stamp.jsp?tp=&arnumber=10166780
引用统计	被引频次[WOS]：0
成果类型	会议论文
条目标识符	http://sustech.caswiz.com/handle/2SGJ60CL/548993
专题	工学院_系统设计与智能制造学院
作者单位	1.School of Automation, Guangdong University of Technology, Guangzhou, China 2.School of Systems Science, Beijing Normal University, Beijing, China 3.School of System Design and Intelligent Manufacturing, Southern University of Science and Technology, Shenzhen, China
推荐引用方式 GB/T 7714	Jinquan Lin,Bo Zhao,Derong Liu. Data-Based Approximate Optimal Control for Unknown Nonaffine Systems via Dynamic Feedback[C],2023:1301-1305.