AIP-Net: An anchor-free instance-level human part detection network

Xu，Yuhang1,2; Zhang，Ye1; Leng，Yuquan3; Gao，Qing1

2024-03-07

10.1016/j.neucom.2024.127254

Neurocomputing   影响因子和分区

0925-2312

1872-8286

Human part detection has significant research and application in computer vision fields such as human–robot interaction, motion capture, facial recognition, and human key point detection. However, the current human body part detection method encounters challenges when detecting multi-scale objects and capturing the correlation relationship between human instances and human parts. To address these problems, a new anchor-free instance-level human part detection network (AIP-Net) is proposed. AIP-Net is a “two-level” structure that consists of two lightweight anchor-free detectors: a body detector and a parts detector. AIP-Net gradually focuses the human body on the human part from top to down, effectively avoiding the interference of extraneous background and enhancing the correlation relationship between human instances and body parts. Additionally, we design a body-part multidimensional context (BPMC) model in the parts detector branch to enhance the capability of the network. We trained the AIP-Ne end-to-end and achieved a state-of-the-art (SOTA) performance of 36.2 mean average precision (mAP) on COCO Human Parts Dataset. Moreover, we successfully utilized the AIP-Net in the human–robot interaction(HRI) platform and validated its practicality.

Anchor-free Deep learning Human parts detection Human–robot interaction Top-down

SCI ; EI

英语

其他

COMPUTER SCIENCE

2-s2.0-85182507021

Scopus

1.School of Electronics and Communication Engineering,Shenzhen Campus of Sun Yat-sen University,Shenzhen,518107,China
2.The School of Communications and Information Engineering,Chongqing University of Posts and Telecommunications,Chongqing,400065,China
3.Department of Mechanical and Energy Engineering,Southern University of Science and Technology,Shenzhen,518055,China

Xu，Yuhang,Zhang，Ye,Leng，Yuquan,et al. AIP-Net: An anchor-free instance-level human part detection network[J]. Neurocomputing,2024,573.

Xu，Yuhang,Zhang，Ye,Leng，Yuquan,&Gao，Qing.(2024).AIP-Net: An anchor-free instance-level human part detection network.Neurocomputing,573.

Xu，Yuhang,et al."AIP-Net: An anchor-free instance-level human part detection network".Neurocomputing 573(2024).