Transferring Virtual Surgical Skills to Reality: AI Agents Mastering Surgical Decision-Making in Vascular Interventional Robotics

Mei, Ziyang1; Wei, Jiayi1; Pan, Si1; Wang, Haoyun1; Wu, Dezhi1; Zhao, Yang1,2; Liu, Gang1; Guo, Shuxiang3,4

2024-07-01

10.1109/TMECH.2024.3420954

IEEE-ASME TRANSACTIONS ON MECHATRONICS   影响因子和分区

1083-4435

1941-014X

Vascular interventional surgery offers advantages, such as minimal invasiveness, quick recovery, and low side-effects. Performing automatic guidewire navigation on vascular surgical robots can effectively assist doctors in performing surgery. Deep learning and reinforcement learning methods have been widely used for guidewire navigation tasks. However, the challenge remains in making delivery decisions for complex and extended pathways, with real-time images being the only data source. The development of network architecture, coupled with the formulation of an efficacious training regimen for this network is of significant importance and holds substantial meaning for the advancement of autonomous systems in vascular surgical robots. Therefore, this research proposes a virtual training environment that incorporates real vascular projections to create virtual environment. In this environment, the approach is enhanced by incorporating guidewire tip-to-target distance in the reward function, using real-time images as input states. This article also employs a multiprocess proximal policy optimization algorithm to accelerate training process and a multistage training approach to reduce the training difficulty. Results demonstrate the effectiveness in virtual automated guidewire navigation and improves success rates. This research proposes a method, which generates effective inputs for the reinforcement learning agent, and enables the pretrained agent to accomplish delivery tasks in real-world scenarios.

Guidewire navigation reinforcement learning (RL) reward function vascular interventional surgery

SCI

英语

通讯

Fujian Science and Technology Project[2022I0003] ; Shenzhen Science and Technology Program[JCYJ20220530143217037] ; National Natural Science Foundation of China[52075464]

Automation & Control Systems ; Engineering

Automation & Control Systems ; Engineering, Manufacturing ; Engineering, Electrical & Electronic ; Engineering, Mechanical

WOS:001273001900001

IEEE-INST ELECTRICAL ELECTRONICS ENGINEERS INC

ENGINEERING

Web of Science

1.Xiamen Univ, Xiamen 361102, Peoples R China
2.Xiamen Univ, Dept Shenzhen Res Inst, Shenzhen 518000, Peoples R China
3.Southern Univ Sci & Technol, Dept Elect & Elect Engn, Shenzhen 518055, Peoples R China
4.Beijing Inst Technol, Minist Ind & Informat Technol, Key Lab Convergence Med Engn Syst & Healthcare Tec, Beijing, Peoples R China

Mei, Ziyang,Wei, Jiayi,Pan, Si,et al. Transferring Virtual Surgical Skills to Reality: AI Agents Mastering Surgical Decision-Making in Vascular Interventional Robotics[J]. IEEE-ASME TRANSACTIONS ON MECHATRONICS,2024.

Mei, Ziyang.,Wei, Jiayi.,Pan, Si.,Wang, Haoyun.,Wu, Dezhi.,...&Guo, Shuxiang.(2024).Transferring Virtual Surgical Skills to Reality: AI Agents Mastering Surgical Decision-Making in Vascular Interventional Robotics.IEEE-ASME TRANSACTIONS ON MECHATRONICS.

Mei, Ziyang,et al."Transferring Virtual Surgical Skills to Reality: AI Agents Mastering Surgical Decision-Making in Vascular Interventional Robotics".IEEE-ASME TRANSACTIONS ON MECHATRONICS (2024).