Efficient lower layers parameter decoupling personalized federated learning method of facial expression recognition for home care robots

Zhou，Xu1,2; Li，Jie1,2; Lan，Gongjin3; Ni，Rongrong1,2; Cangelosi，Angelo4; Wang，Jiaxin5; Liu，Xiaofeng1,2

2024-06-01

10.1016/j.inffus.2024.102261

Information Fusion   影响因子和分区

1566-2535

Facial expression recognition (FER) is a crucial and pivotal functionality for home care robots that engage in intimate interactions with human individuals. However, the potential privacy risk associated with home care robots resides in their acquisition of facial information during expression recognition and subsequent data uploading for model updates. Federated learning (FL) can safeguard data privacy while enabling machine learning, yet its application to home care robots poses several challenges, including non-independent and non-identically distributed collected data, limited communication and computation capabilities on the robot side. However, limited research has been conducted in this area. In this paper, we propose a lightweight neural network architecture for the federated FER model on home care robots. We also introduce an efficient and simple lower-layer personalized FL method that optimizes local personalized models by exchanging fewer parameters. Furthermore, we implement a demo on real physical robots NAO to demonstrate how our federated model improves the performance of local FER models in non-IID data settings. The results demonstrate that our approach achieves competitive performance on four simulated non-IID facial expression recognition (FER) datasets, comparable to larger network models and state-of-the-art algorithms. There is an average difference of approximately 3% from the best algorithm results on three datasets, while outperforming the best algorithm by 2% on one dataset. The evaluation of our methods on two real NAO robots shows that the overall performance improvement of our federated model over the locally independent model is about 20% on average. The open-source code is available at https://github.com/zxecho/FESAHR.

Facial expression recognition(FER) Federated learning Home care robot Lightweight deep convolutional neural networks Personalization Privacy preservation

SCI ; EI

英语

其他

2-s2.0-85184658119

Scopus

1.College of Artificial Intelligence and Automation,Hohai University,Changzhou,213000,China
2.The Key Laboratory of Maritime Intelligent Cyberspace Technology,Hohai University,Ministry of Education,Changzhou,213000,China
3.Department of Computer Science and Engineering,Southern University of Science and Technology,Shenzhen,518055,China
4.School of Computer Science,University of Manchester,Manchester,M13 9PL,United Kingdom
5.School of Mechanical Engineering,Hebei University of Technology,Tianjin,300401,China

Zhou，Xu,Li，Jie,Lan，Gongjin,et al. Efficient lower layers parameter decoupling personalized federated learning method of facial expression recognition for home care robots[J]. Information Fusion,2024,106.

Zhou，Xu.,Li，Jie.,Lan，Gongjin.,Ni，Rongrong.,Cangelosi，Angelo.,...&Liu，Xiaofeng.(2024).Efficient lower layers parameter decoupling personalized federated learning method of facial expression recognition for home care robots.Information Fusion,106.

Zhou，Xu,et al."Efficient lower layers parameter decoupling personalized federated learning method of facial expression recognition for home care robots".Information Fusion 106(2024).