MaskDis R-CNN: An instance segmentation algorithm with adversarial network for herd pigs

Tu, Shuqin1; Zeng, Qiantao1; Liu, Haofeng2; Liang, Yun1; Liu, Xiaolong1; Huang, Lei1; Huang, Zhengxin1

2023-07-01

10.1049/ipr2.12880

IET IMAGE PROCESSING   影响因子和分区

1751-9659

1751-9667

The current instance segmentation method can achieve satisfactory results in common scenarios. However, under the overlap or partial occlusion between targets caused by the complex scenes, accurate segmentation of pigs remains a challenging task. To address the problem, the authors propose an instance segmentation method based on Mask Scoring region-based convolutional neural networks (R-CNN) (MS R-CNN), which creates the adversarial network called MaskDis in the head branch of MS R-CNN. The MaskDis is trained as a discriminator using a generative adversarial network, and the MS R-CNN model is used as a generator during model training. The adversarial training enables the generator to learn context information and features at the pixel level, which effectively improves the segmentation quality under pigs' overlapping or dense occlusions scenes. Experimental conducted on the pig object segmentation dataset show that the proposed approach achieves a precision of 92.03%, a recall of 92.18%, and an F1 score of 0.9210. Compared with the basic MS R-CNN model, the approach achieved a 2.25% improvement in precision and 1.18% improvement in F1 score. Furthermore, the improved approach outperformed advanced instance segmentation methods such as YOLACT, Swin Transformer, YOLOv5-seg, and SOLOv2 on COCO evaluation metrics. These experimental results demonstrate the effectiveness of the proposed approach in instance segmentation of pigs in complex scenes, providing technical support for non-contact pig automatic management.

adversarial networks computer vision image recognition overlapped pigs instance segmentation MaskDis R-CNN

SCI ; EI

英语

其他

National Natural Science Foundation of China["61772209","31600591"] ; Science and Technology Planning Project of Guangdong Province[2019A050510034] ; Guangzhou Key Ramp;D Program Project[2023B03J1363] ; College Students' Innovation and Entrepreneurship Competition[202110564025]

Computer Science ; Engineering ; Imaging Science & Photographic Technology

Computer Science, Artificial Intelligence ; Engineering, Electrical & Electronic ; Imaging Science & Photographic Technology

WOS:001032108900001

WILEY

20233014436382

Complex networks ; Computer vision ; Convolutional neural networks ; Generative adversarial networks ; Image segmentation ; Mammals ; Neural network models

Computer Systems and Equipment:722 ; Artificial Intelligence:723.4 ; Computer Applications:723.5 ; Vision:741.2

Web of Science

1.South China Agr Univ, Coll Math & Informat, 483 Wushan Rd, Guangzhou 510642, Guangdong, Peoples R China
2.Southern Univ Sci & Technol, Dept Comp Sci & Engn, Shenzhen, Peoples R China

Tu, Shuqin,Zeng, Qiantao,Liu, Haofeng,et al. MaskDis R-CNN: An instance segmentation algorithm with adversarial network for herd pigs[J]. IET IMAGE PROCESSING,2023,17:3488-3499.

Tu, Shuqin.,Zeng, Qiantao.,Liu, Haofeng.,Liang, Yun.,Liu, Xiaolong.,...&Huang, Zhengxin.(2023).MaskDis R-CNN: An instance segmentation algorithm with adversarial network for herd pigs.IET IMAGE PROCESSING,17,3488-3499.

Tu, Shuqin,et al."MaskDis R-CNN: An instance segmentation algorithm with adversarial network for herd pigs".IET IMAGE PROCESSING 17(2023):3488-3499.