Multi-View Reconstruction Fusing Ultrasonic Phased Array and Camera for Mobile Robots in Simulation Environment

Ren，Jixiang; Hong，Xiaoping

2024

10.1109/ACCESS.2024.3357117

IEEE Access   影响因子和分区

2169-3536

2169-3536

Distance sensors are important for mobile robots to perceive surrounding environment. Typical sensors like LiDARs and depth cameras have been widely used, yet each has its limitations, such as LiDARs' relatively high cost, depth cameras' limitation to indoor use, and their poor performance in detecting transparent objects directly. On the other hand, ultrasonic phased array that integrates multiple ultrasonic sensors not only enables 3D ranging and imaging, but also provides advantages of strong environmental adaptability, being cost-effective and being able to detect transparent objects. To explore the application of in-air ultrasonic phased arrays for mobile robots, we simulate a 40 kHz $5\times 5$ non-uniform sparse ultrasonic phased array. The simulator emulates the process of phased array transmission and reception, and utilizes algorithms such as beamforming and matched filtering to obtain depth information in three-dimensional space. Then, a multi-view indoor 3D reconstruction method fusing the ultrasonic phased array and a monocular camera is proposed, where two scanning strategies are developed to handle different scenarios. Finally, the method is validated in different Gazebo scenarios and compared with other baseline methods like LiDARs and depth cameras. The experimental results reveal the method's strong performance in terms of accuracy, consistency and completeness.

Phased arrays reconstruction algorithms sensor fusion simulation ultrasonic imaging

SCI ; EI

英语

第一 ; 通讯

2-s2.0-85183627894

Scopus

Southern University of Science and Technology,School of System Design and Intelligent Manufacturing,Shenzhen,518055,China

Ren，Jixiang,Hong，Xiaoping. Multi-View Reconstruction Fusing Ultrasonic Phased Array and Camera for Mobile Robots in Simulation Environment[J]. IEEE Access,2024,12:13860-13869.

Ren，Jixiang,&Hong，Xiaoping.(2024).Multi-View Reconstruction Fusing Ultrasonic Phased Array and Camera for Mobile Robots in Simulation Environment.IEEE Access,12,13860-13869.

Ren，Jixiang,et al."Multi-View Reconstruction Fusing Ultrasonic Phased Array and Camera for Mobile Robots in Simulation Environment".IEEE Access 12(2024):13860-13869.