TT-LCD: Tensorized-Transformer based Loop Closure Detection for Robotic Visual SLAM on Edge

Chenchen Ding; Hongwei Ren; Zhiru Guo; Minjie Bi; Changhai Man; Tingting Wang; Shuwei Li; Shaobo Luo; Rumin Zhang; Hao Yu

10.1109/ICARM58088.2023.10218828

2023

979-8-3503-0018-5

2023 International Conference on Advanced Robotics and Mechatronics (ICARM)

166-172

8-10 July 2023

Sanya, China

Visual simultaneous localization and mapping (VSLAM) is one of the core technologies in autonomous driving, intelligent robots, metaverse and other fields. Besides, loop closure detection (LCD) is an essential component in VSLAM which can correct the drift and accumulated errors caused by the visual odometry (VO) front-end, and assist robot to build a globally consistent map. Over the years, several deep-learning methods have been proposed to address the task. However, the prior proposed neural network-based LCD models are heavy in model size, and difficult to be deployed on edge devices. In this paper, an LCD module based on the tensorized transformer model called TT-LCD is proposed. To obtain a tensorized transformer model with accuracy-complexity co-awareness which can be effectively deployed, we proposed a construction method for tensor compressed transformer model with tensor-train (TT) decomposition and a differential neural network architecture search (NAS) method for tensor rank selection. Experiments demonstrate that the TT-LCD realizes a model size 6.04 × smaller than uncompressed transformer model, 32.1 × smaller than the VGG model and achieves lower memory cost of about 134M on edge CPU with little loss of accuracy on pre-training dataset but even 2.13% higher average accuracy on NewCollege dataset compared with uncompressed DeiT-based model in LCD task.

Visualization Simultaneous localization and mapping Tensors Costs Image edge detection Neural networks Transformers

第一

EI

20233814760388

Deep learning ; Learning systems ; Network architecture ; Tensors

Ergonomics and Human Factors Engineering:461.4 ; Robot Applications:731.6 ; Algebra:921.1

IEEE

School of Microelectronics, Southern University of Science and Technology, Shenzhen, China

Chenchen Ding,Hongwei Ren,Zhiru Guo,et al. TT-LCD: Tensorized-Transformer based Loop Closure Detection for Robotic Visual SLAM on Edge[C],2023:166-172.