A Convolutional-Transformer Network for Crack Segmentation with Boundary Awareness

Huaqi Tao1; Bingxi Liu2; Jinqiang Cui2; Hong Zhang3

10.1109/ICIP49359.2023.10222276

2023

30th IEEE International Conference on Image Processing (ICIP)

1522-4880

978-1-7281-9836-1

2023 IEEE International Conference on Image Processing (ICIP)

86-90

8-11 Oct. 2023

Kuala Lumpur, Malaysia

345 E 47TH ST, NEW YORK, NY 10017 USA

IEEE

Cracks play a crucial role in assessing the safety and durability of manufactured buildings. However, the long and sharp topological features and complex background of cracks make the task of crack segmentation extremely challenging. In this paper, we propose a novel convolutional-transformer network based on encoder-decoder architecture to solve this challenge. Particularly, we designed a Dilated Residual Block (DRB) and a Boundary Awareness Module (BAM). The DRB pays attention to the local detail of cracks and adjusts the feature dimension for other blocks as needed. And the BAM learns the boundary features from the dilated crack label. Furthermore, the DRB is combined with a lightweight transformer that captures global information to serve as an effective encoder. Experimental results show that the proposed network performs better than state-of-the-art algorithms on two typical datasets. Datasets, code, and trained models are available for research at https://github.com/HqiTao/CT-crackseg.

Crack Segmentation Convolutional Neural Network Vision Transformer Deep Learning Application

其他

英语

EI ; CPCI-S

Computer Science

Computer Science, Artificial Intelligence ; Computer Science, Theory & Methods

WOS:001106821000017

20240115301618

Computer vision ; Convolution ; Deep learning ; Learning systems ; Signal encoding

Ergonomics and Human Factors Engineering:461.4 ; Information Theory and Signal Processing:716.1 ; Computer Applications:723.5 ; Vision:741.2

IEEE

1.Guangxi University, Nanning, China
2.Peng Cheng Laboratory, Shenzhen, China
3.Southern University of Science and Technology, Shenzhen, China

Huaqi Tao,Bingxi Liu,Jinqiang Cui,et al. A Convolutional-Transformer Network for Crack Segmentation with Boundary Awareness[C]. 345 E 47TH ST, NEW YORK, NY 10017 USA:IEEE,2023:86-90.