Semantic Mapping Based on Visual SLAM with Object Model Replacement Visualization for Cleaning Robot

Zirui Wang; Haiou Liao; Zhenzhong Jia; Jing Wu

10.1109/ROBIO55434.2022.10011717

2022

978-1-6654-8110-6

2022 IEEE International Conference on Robotics and Biomimetics (ROBIO)

569-575

5-9 Dec. 2022

Jinghong, China

Cleaning robots have been widely used in our daily life, achieving huge success in the service robot sector. The autonomous movement and decision-making of these robots directly depend on their environmental perception capability, which is implemented using SLAM (simultaneous localization and mapping) technique. In order to achieve better environmental perception and intelligent decision-making, it is necessary to introduce visual SLAM into cleaning robot and take full advantage of visual information to achieve higher-level perception, instead of sticking to current feature point or pixel level perception capability. In this paper, we propose a framework for semantic mapping with object model replacement visualization in indoor scenes for cleaning robot. We use an EKF-based method to fuse wheel odometry and visual odometry, and build a map representation for navigation in the framework. We obtain a semantic map by fusing object detection and point cloud segmentation. We also develop object model replacement for better visualization purposes. Finally, we conduct dataset tests and real experiments to validate our proposed framework.

Visualization Simultaneous localization and mapping Service robots Biological system modeling Semantics Decision making Wheels

第一

IEEE

Department of Mechanical and Energy Engineering, Shenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems; they are also with Guangdong Provincial Key Laboratory of Human-Augmentation and Rehabilitation Robotics in Universities, Southern University of Science and Technology (SUSTech), Shenzhen, China

Zirui Wang,Haiou Liao,Zhenzhong Jia,et al. Semantic Mapping Based on Visual SLAM with Object Model Replacement Visualization for Cleaning Robot[C],2022:569-575.