A Zero-Shot Domain Adaptation Framework for Computed Tomography Via Reinforcement Learning and Volume Rendering

Ang Li1; Yongjian Zhao1; Fan Bai1; Jiayi Han2; Max Q.-H. Meng1,3; Li Liu1,3

10.1109/ISBI56570.2024.10635880

2024-05-30

1945-7928

979-8-3503-1334-5

2024 IEEE International Symposium on Biomedical Imaging (ISBI)

27-30 May 2024

Athens, Greece

The Domain gap is an important issue when applying AI-based approaches to clinical use. Many recent approaches introduce domain adaptation (DA) to eliminate the influence of the domain gap. However, these approaches usually require modifications of network weights and losing the ability in the source (training) domain. To perform zero-shot domain adaptation without forgetting the source domain, in this work, we propose a novel reinforcement learning (RL) based framework which modifies the distribution of the input data instead of the weights of the pre-trained model. The RL agent observes the rendering results of the CT volume and uses a look-up table to perform non-linear mapping on the input to the standard distribution without tuning the original model weights. Since the pre-trained weights are fixed, the model can still generalize well on the source domain. Experiments show that the proposed approach dramatically improves the generalization of the proposed model (Dice score from 73.26% to 77.84%) without forgetting the source domain.

其他

1.Department of Electronic Engineering, The Chinese University of Hong Kong, Hong Kong
2.Inspur General Software Co. Ltd., Inspur Group Co. Ltd
3.Department of Electronic and Electrical Engineering, Southern University of Science and Technology

Ang Li,Yongjian Zhao,Fan Bai,et al. A Zero-Shot Domain Adaptation Framework for Computed Tomography Via Reinforcement Learning and Volume Rendering[C],2024.