TEA-fed: Time-efficient asynchronous federated learning for edge computing

Zhou，Chendi1; Tian，Hao1; Zhang，Hong1; Zhang，Jin2; Dong，Mianxiong3; Jia，Juncheng1

10.1145/3457388.3458655

2021-05-11

Proceedings of the 18th ACM International Conference on Computing Frontiers 2021, CF 2021

30-37

Federated learning (FL) has attracted more and more attention recently. The integration of FL and edge computing makes the edge system more efficient and intelligent. FL usually uses the server to actively select certain edge devices to participate in the global model training. However, the selected edge devices may be stragglers, or even crash during training. Meanwhile, the unselected idle edge devices cannot be fully utilized for training. Therefore, besides the widely studied communication efficiency and data heterogeneity issues in FL, we also take the above time efficiency into consideration, and propose a time-efficient asynchronous federated learning protocol, TEA-Fed, to solve these problems. With TEA-Fed, idle edge devices actively apply for training tasks and participate in model training asynchronously once assigned tasks. Considering that there may be a huge number of edge devices in edge computing, we introduce control parameters to limit the number of devices participating in training the identical model at the same time. Meanwhile, we also introduce caching mechanism and weighted averaging with respect to model staleness in the model aggregation step to reduce the adverse effects of model staleness and further improve the accuracy of the global model. Finally, the experimental results show that the protocol can accelerate the convergence of model training, improve the accuracy, and has robustness to heterogeneous data.

edge computing federated learning machine learning time efficiency

其他

英语

EI

20212110391973

Efficiency ; Tea

Production Engineering:913.1

2-s2.0-85106046429

Scopus

1.Soochow University,Suzhou, Jiangsu,China
2.Southern University of Science and Technology,Shenzhen, Guangdong,China
3.Muroran Institute of Technology,Muroran, Hokkaido,Japan

Zhou，Chendi,Tian，Hao,Zhang，Hong,et al. TEA-fed: Time-efficient asynchronous federated learning for edge computing[C],2021:30-37.