Clinical Pixel Feature Recalibration Module for Ophthalmic Image Classification

Zhao, JiLu1; Zhang, Xiaoqing1,2; Wu, Xiao1; Zhang, ZhiXuan1; Zhang, Tong1; Li, Heng1; Hu, Yan1; Liu, Jiang1,2

10.1007/978-3-031-44216-2_8

2023

32nd International Conference on Artificial Neural Networks (ICANN)

0302-9743

1611-3349

978-3-031-44215-5

ARTIFICIAL NEURAL NETWORKS AND MACHINE LEARNING, ICANN 2023, PT IV

14257

SEP 26-29, 2023

null,Heraklion,GREECE

GEWERBESTRASSE 11, CHAM, CH-6330, SWITZERLAND

SPRINGER INTERNATIONAL PUBLISHING AG

Ophthalmic image examination has become a commonly-acknowledged way for ocular disease screening and diagnosis. Clinical features extracted from ophthalmic images play different roles in affecting clinicians making diagnosis results, but how to incorporate these clinical features into convolutional neural network (CNN) representations has been less studied. In this paper, we propose a simple yet practical module, Clinical Pixel Feature Recalibration Module (CPF), aiming to exploit the potential of clinical features to improve the ocular disease recognition performance of CNNs. CPF first extracts clinical pixel features from each spatial position of all feature maps by clinical cross-channel pooling, then estimates each spatial position recalibration weight in a pixel-independent clinical fusion. By infusing the relative importance of clinical features into feature maps at the pixel level, CPF is supposed to enhance the representational ability of CNNs. Our CPF is easily inserted into existing CNNs with negligible overhead. We conduct comprehensive experiments on two publicly available ophthalmic image datasets and CIFAR datasets, and the results show the superiority and generation ability of CPF over advanced attention methods. Furthermore, this paper presents an in-depth weight visualization analysis to investigate the inherent behavior of CPF, aiming to improve the interpretability of CNNs in the decision-making process.

Ophthalmic image CPF interpretability attention classification

第一 ; 通讯

英语

EI ; CPCI-S

Computer Science ; Radiology, Nuclear Medicine & Medical Imaging

Computer Science, Artificial Intelligence ; Computer Science, Theory & Methods ; Radiology, Nuclear Medicine & Medical Imaging

WOS:001156953700008

Web of Science

1.Research Institute of Trustworthy Autonomous Systems and Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen; 518055, China
2.Guangdong Provincial Key Laboratory of Brain-Inspired Intelligent Computation, Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen; 518055, China

Zhao, JiLu,Zhang, Xiaoqing,Wu, Xiao,et al. Clinical Pixel Feature Recalibration Module for Ophthalmic Image Classification[C]. GEWERBESTRASSE 11, CHAM, CH-6330, SWITZERLAND:SPRINGER INTERNATIONAL PUBLISHING AG,2023.