Foot Vision: A Vision-Based Multi-Functional Sensorized Foot for Quadruped Robots

Shi，Guowei1,2; Yao，Chen1,2; Liu，Xin1,2; Zhao，Yuntian3; Zhu，Zheng1,2; Jia，Zhenzhong1,2

2024-07-01

10.1109/LRA.2024.3408084

IEEE Robotics and Automation Letters   影响因子和分区

2377-3766

—Quadruped robots equipped with sensorless feet can only provide limited information regarding the foot interaction with the surroundings, limiting their off-road exploration capability in unstructured environments. To tackle this problem, we present Foot Vision, an innovative vision-based sensorized foot for quadruped robots. It consists of a compliant ankle, a transparent foot sole with visual markers, and an internal camera. This foot is designed to be low-cost, lightweight, and adaptable to both deformable and rigid terrains. The camera can efficiently track marker displacements to estimate the foot pose. We extract the foot deformation features from the foot pose and develop a learning-based method to reconstruct 6D contact forces leveraging these features. Representative loading tests validate the foot’s ability to accurately (R > 0.95) and dynamically predict contact forces and torques in real-time (100 Hz). Installed on the quadruped robot, the sensorized foot demonstrates its capabilities to perceive 6D contact forces on terrains with varying stiffness and estimate the local inclination of the contact surface. Furthermore, thanks to the transparent foot sole, the in-foot camera can directly identify the terrain types and measure the soil flow distribution. Experimental results confirm that the proposed vision-based sensorized foot can enhance the contact perception capability of legged robots in diverse environments.

deep learning in robotics Legged robots terrain-adaptive sensing vision-based sensorized foot

SCI ; EI

英语

第一 ; 通讯

20242316204012

Deep learning ; End effectors ; Latexes ; Multipurpose robots ; Robot vision

Ergonomics and Human Factors Engineering:461.4 ; Robotics:731.5 ; Robot Applications:731.6 ; Vision:741.2 ; Photographic Equipment:742.2 ; Colloid Chemistry:801.3

2-s2.0-85194855414

Scopus

1.the Shenzhen Key Laboratory of Biomimetic Robotics and Intelligent Systems,Southern University of Science and Technology,Shenzhen,518055,China
2.the Guangdong Provincial Key Laboratory of Human-Augmentation and Rehabilitation Robotics in Universities,Department of Mechanical and Energy Engineering,Southern University of Science and Technology,Shenzhen,518055,China
3.the Institute for Robotics and Intelligent Machines,Georgia Institute of Technology,Atlanta,30332,United States

Shi，Guowei,Yao，Chen,Liu，Xin,et al. Foot Vision: A Vision-Based Multi-Functional Sensorized Foot for Quadruped Robots[J]. IEEE Robotics and Automation Letters,2024,9(7):6720-6727.

Shi，Guowei,Yao，Chen,Liu，Xin,Zhao，Yuntian,Zhu，Zheng,&Jia，Zhenzhong.(2024).Foot Vision: A Vision-Based Multi-Functional Sensorized Foot for Quadruped Robots.IEEE Robotics and Automation Letters,9(7),6720-6727.

Shi，Guowei,et al."Foot Vision: A Vision-Based Multi-Functional Sensorized Foot for Quadruped Robots".IEEE Robotics and Automation Letters 9.7(2024):6720-6727.