Point Cloud Segmentation of Breast Ultrasound Regions to be Scanned by Fusing 2D Image Instance Segmentation and Keypoint Detection

Jiyong Tan1; Hui Qin2; Xinxing Chen3; Jiawang Li2; Yuanwei Li2; Bing Li2; Yuquan Leng3; Chenglong Fu3

10.1109/ICARM58088.2023.10218846

2023-07-09

2023 International Conference on Advanced Robotics and Mechatronics (ICARM)

979-8-3503-0018-5

2023 International Conference on Advanced Robotics and Mechatronics (ICARM)

669-674

8-10 July 2023

Sanya, China

Automatic segmentation of the region of interest to be scanned (ROIS) is one of the key tasks to achieve autonomous scanning of ultrasound robots. By analyzing breast ROIS in an unstructured environment, a point cloud segmentation framework for the breast ultrasound ROIS that incorporates 2D image instance segmentation and keypoint detection is proposed. Firstly, 2D image instance segmentation based on the improved SOLOv2 is performed to extract the human torso point cloud in the unstructured environment. Then, based on YOLO-Pose, the keypoints of human body are automatically detected, and the upper and lower lines of breast ROIS are obtained according to the constraint matching relationship between breast ROIS and keypoints, and finally the point cloud of breast ROIS is obtained effectively and accurately. Experiments show that the proposed framework can achieve automatic segmentation of breast ROIS within 2 s.

Point Cloud Compression Torso Image Segmentation Ultrasonic Imaging Mechatronics Breast Task Analysis

通讯

英语

EI

20233814760406

Image enhancement ; Image segmentation ; Medical imaging

Biomedical Engineering:461.1 ; Imaging Techniques:746 ; Ultrasonic Applications:753.3

IEEE

正式出版

1.School of Mechatronics Engineering, Harbin Institute of Technology, Harbin, China
2.Guangdong Medical Rehabilitation Intelligent System Engineering Technology Research Center, Shenzhen, China
3.Department of Mechanical and Energy Engineering, Southern University of Science and Technology, Shenzhen, China

Jiyong Tan,Hui Qin,Xinxing Chen,et al. Point Cloud Segmentation of Breast Ultrasound Regions to be Scanned by Fusing 2D Image Instance Segmentation and Keypoint Detection[C],2023:669-674.