Few-Shot Adaptation to Unseen Conditions for Wireless-Based Human Activity Recognition Without Fine-Tuning

Xiaotong Zhang1,2; Qingqiao Hu3,4; Zhen Xiao2; Tao Sun4; Jiaxi Zhang4,5; Jin Zhang1,6; Zhenjiang Li2

2024

10.1109/TMC.2024.3462466

IEEE Transactions on Mobile Computing   影响因子和分区

2161-9875

Wireless-based human activity recognition (WHAR) enables various promising applications. However, since WHAR is sensitive to changes in sensing conditions (e.g., different environments, users, and new activities), trained models often do not work well under new conditions. Recent research uses meta-learning to adapt models. However, they must fine-tune the model, which greatly hinders the widespread adoption of WHAR in practice because model fine-tuning is difficult to automate and requires deep-learning expertise. The fundamental reason for model fine-tuning in existing works is because their goal is to find the mapping relationship between data samples and corresponding activity labels. Since this mapping reflects the intrinsic properties of data in the perceptual scene, it is naturally related to the conditions under which the activity is sensed. To address this problem, we exploit the principle that under the same sensing condition, data of the same activity class are more similar (in a certain latent space) than data of other classes, and this property holds invariant across different conditions. Our main observation is that meta-learning can actually also transform WHAR design into a learning problem that is always under similar conditions, thus decoupling the dependence on sensing conditions. With this capability, general and accurate WHAR can be achieved, avoiding model fine-tuning. In this paper, we implement this idea through two innovative designs in a system called RoMF. Extensive experiments using FMCW, Wi-Fi and acoustic three sensing signals show that it can achieve up to 95.3% accuracy in unseen conditions, including new environments, users and activity classes.

第一

1.Research Institute of Trustworthy Autonomous Systems and the Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, China
2.Department of Computer Science, City University of Hong Kong, Hong Kong, China
3.Department of Computer Science, Stony Brook University, New York, USA
4.Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, China
5.Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Hong Kong, China
6.Peng Cheng Laboratory, Shenzhen, China

Xiaotong Zhang,Qingqiao Hu,Zhen Xiao,et al. Few-Shot Adaptation to Unseen Conditions for Wireless-Based Human Activity Recognition Without Fine-Tuning[J]. IEEE Transactions on Mobile Computing,2024,PP(99).

Xiaotong Zhang.,Qingqiao Hu.,Zhen Xiao.,Tao Sun.,Jiaxi Zhang.,...&Zhenjiang Li.(2024).Few-Shot Adaptation to Unseen Conditions for Wireless-Based Human Activity Recognition Without Fine-Tuning.IEEE Transactions on Mobile Computing,PP(99).

Xiaotong Zhang,et al."Few-Shot Adaptation to Unseen Conditions for Wireless-Based Human Activity Recognition Without Fine-Tuning".IEEE Transactions on Mobile Computing PP.99(2024).