Data Driven Optical Flow Prediction for Improving Direct Method Visual SLAM Systems

Bingqing Selina Wan1; Weinan Chen2; Li He1; Hong Zhang1

10.1109/ROBIO55434.2022.10011968

2022

978-1-6654-8110-6

2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)

1017-1022

5-9 Dec. 2022

Jinghong, China

Direct and keyframe based visual SLAM (simulta-neous localization and mapping) such as LDSO is widely used in robotic systems. In the direct method, the direct point projection method is usually used on the selected pixel points to predict motion and perform frame-to-frame tracking. However, such systems require a large number of keyframes to maintain stable motion tracking, resulting in a larger map size in comparison to feature based or indirect SLAM systems. The maintenance of large map data is a bottleneck to long-track robotic systems. To address this problem, we propose to use a machine learning model to predict the optical flow. An indicator activates the learning model when the direct image alignment method has a bad performance. We design a point selection method that uses the pixel flow map predicted by the model. We implement the proposed method on the LDSO system. We evaluate the system performance by the absolute pose error, the number of selected keyframes, and time consumption. Then we verify the proposed method to ORB-SLAM3. The results show that the proposed method can reduce the number of selected keyframes while producing a comparable performance to the state-of-the-art.

Visualization Simultaneous localization and mapping Tracking Biological system modeling System performance Machine learning Predictive models

第一

IEEE

1.Department of Electrical and Computer Engineering, Southern University of Science and Technology, Shenzhen, China
2.Guangdong University of Technology, Guangzhou, China

Bingqing Selina Wan,Weinan Chen,Li He,et al. Data Driven Optical Flow Prediction for Improving Direct Method Visual SLAM Systems[C],2022:1017-1022.