End-to-End Model-Based Gait Recognition

Li，Xiang1,2; Makihara，Yasushi2; Xu，Chi1,2; Yagi，Yasushi2; Yu，Shiqi3; Ren，Mingwu1

10.1007/978-3-030-69535-4_1

2021

0302-9743

1611-3349

LECT NOTES ARTIF INT

12624 LNCS

3-20

Most existing gait recognition approaches adopt a two-step procedure: a preprocessing step to extract silhouettes or skeletons followed by recognition. In this paper, we propose an end-to-end model-based gait recognition method. Specifically, we employ a skinned multi-person linear (SMPL) model for human modeling, and estimate its parameters using a pre-trained human mesh recovery (HMR) network. As the pre-trained HMR is not recognition-oriented, we fine-tune it in an end-to-end gait recognition framework. To cope with differences between gait datasets and those used for pre-training the HMR, we introduce a reconstruction loss between the silhouette masks in the gait datasets and the rendered silhouettes from the estimated SMPL model produced by a differentiable renderer. This enables us to adapt the HMR to the gait dataset without supervision using the ground-truth joint locations. Experimental results with the OU-MVLP and CASIA-B datasets demonstrate the state-of-the-art performance of the proposed method for both gait identification and verification scenarios, a direct consequence of the explicitly disentangled pose and shape features produced by the proposed end-to-end model-based framework.

其他

英语

EI

20211310152370

Gait analysis

Biomechanics, Bionics and Biomimetics:461.3 ; Computer Applications:723.5

2-s2.0-85103277868

Scopus

1.Nanjing University of Science and Technology,Nanjing,China
2.Osaka University,Osaka,Japan
3.Southern University of Science and Technology,Shenzhen,China

Li，Xiang,Makihara，Yasushi,Xu，Chi,et al. End-to-End Model-Based Gait Recognition[C],2021:3-20.