异构边缘计算环境下异步联邦学习的节点分组与分时调度策略

doi:10.11959/j.issn.1000-436x.2023196

Abstract

Abstract:

To overcome the three key challenges of federated learning in heterogeneous edge computing, i.e., edge heterogeneity, data Non-IID, and communication resource constraints, a grouping asynchronous federated learning (FedGA) mechanism was proposed.Edge nodes were divided into multiple groups, each of which performed global updated asynchronously with the global model, while edge nodes within a group communicate with the parameter server through time-sharing communication.Theoretical analysis established a quantitative relationship between the convergence bound of FedGA and the data distribution among the groups.A time-sharing scheduling magic mirror method (MMM) was proposed to optimize the completion time of a single round of model updating within a group.Based on both the theoretical analysis for FedGA and MMM, an effective grouping algorithm was designed for minimizing the overall training completion time.Experimental results demonstrate that the proposed FedGA and MMM can reduce model training time by 30.1%～87.4% compared to the existing state-of-the-art methods.

Key words: edge computing, federated learning, Non-IID, heterogeneity, convergence analysis

CLC Number:

TP301

Qianpiao MA, Qingmin JIA, Jianchun LIU, Hongli XU, Renchao XIE, Tao HUANG. Client grouping and time-sharing scheduling for asynchronous federated learning in heterogeneous edge computing environment[J]. Journal on Communications, 2023, 44(11): 79-93.

Figures/Tables 15

References 25

[1]	彭安妮, 周威, 贾岩 ,等. 物联网操作系统安全研究综述[J]. 通信学报, 2018,39(3): 22-34.
	PENG A N , ZHOU W , JIA Y ,et al. Survey of the Internet of things operating system security[J]. Journal on Communications, 2018,39(3): 22-34.
[2]	谢人超, 廉晓飞, 贾庆民 ,等. 移动边缘计算卸载技术综述[J]. 通信学报, 2018,39(11): 138-155.
	XIE R C , LIAN X F , JIA Q M ,et al. Survey on computation offloading in mobile edge computing[J]. Journal on Communications, 2018,39(11): 138-155.
[3]	MCMAHAN H B , MOORE E , RAMAGE D ,et al. Communication-efficient learning of deep networks from decentralized data[J]. arXiv Preprint,arXiv:1602.05629, 2016.
[4]	LI M , ZHOU L , YANG Z C ,et al. Parameter server for distributed machine learning[C]// Big Learning NIPS Workshop. Massachusetts:MIT Press, 2013: 1-10.
[5]	KONE?NY J , MCMAHAN H B , RAMAGE D ,et al. Federated optimization:distributed machine learning for on-device intelligence[J]. arXiv Preprint,arXiv:1610.02527, 2016.
[6]	WANG S Q , TUOR T , SALONIDIS T ,et al. Adaptive federated learning in resource constrained edge computing systems[J]. IEEE Journal on Selected Areas in Communications, 2019,37(6): 1205-1221.
[7]	MAO Y Y , YOU C S , ZHANG J ,et al. A survey on mobile edge computing:the communication perspective[J]. IEEE Communications Surveys ＆ Tutorials, 2017,19(4): 2322-2358.
[8]	ZHAO Y , LI M , LAI L ,et al. Federated learning with non-IID data[J]. arXiv Preprint,arXiv:1806.00582, 2018.
[9]	XIE C , KOYEJO S , GUPTA I . Asynchronous federated optimization[J]. arXiv Preprint,arXiv:1903.03934, 2019.
[10]	CHEN Y J , NING Y , SLAWSKI M ,et al. Asynchronous online federated learning for edge devices with non-IID data[C]// Proceedings of IEEE International Conference on Big Data (Big Data). Piscataway:IEEE Press, 2021: 15-24.
[11]	CHAI Z , CHEN Y J , ZHAO L ,et al. FedAT:a communication-efficient federated learning method with asynchronous tiers under Non-IID data[J]. arXiv Preprint,arXiv:2010.05958, 2020.
[12]	FEYZMAHDAVIAN H R , AYTEKIN A , JOHANSSON M . A delayed proximal gradient method with linear convergence rate[C]// Proceedings of 2014 IEEE International Workshop on Machine Learning for Signal Processing (MLSP). Piscataway:IEEE Press, 2014: 1-6.
[13]	LUO B , LI X , WANG S Q ,et al. Cost-effective federated learning in mobile edge networks[J]. IEEE Journal on Selected Areas in Communications, 2021,39(12): 3606-3621.
[14]	陶梅霞, 王栋, 孙瑞 ,等. 联邦学习中基于时分多址接入的用户调度策略[J]. 通信学报, 2021,42(6): 16-29.
	TAO M X , WANG D , SUN R ,et al. TDMA-based user scheduling policies for federated learning[J]. Journal on Communications, 2021,42(6): 16-29.
[15]	MA Q P , XU Y , XU H L ,et al. FedSA:a semi-asynchronous federated learning mechanism in heterogeneous edge computing[J]. IEEE Journal on Selected Areas in Communications, 2021,39(12): 3654-3672.
[16]	MORELLI M , KUO C C J , PUN M O . Synchronization techniques for orthogonal frequency division multiple access (OFDMA):a tutorial review[J]. Proceedings of the IEEE, 2007,95(7): 1394-1427.
[17]	NELSON R , KLEINROCK L . Spatial TDMA:a collision-free multihop channel access protocol[J]. IEEE Transactions on Communications, 1985,33(9): 934-944.
[18]	MO X P , XU J . Energy-efficient federated edge learning with joint communication and computation design[J]. Journal of Communications and Information Networks, 2021,6(2): 110-124.
[19]	CHEN M Z , POOR H V , SAAD W ,et al. Convergence time optimization for federated learning over wireless networks[J]. IEEE Transactions on Wireless Communications, 2021,20(4): 2457-2471.
[20]	XU H L , CHEN M , MENG Z Y ,et al. Decentralized machine learning through experience-driven method in edge networks[J]. IEEE Journal on Selected Areas in Communications, 2022,40(2): 515-531.
[21]	BLAZEWICZ J , ECKER K H , PESCH E ,et al. Handbook on scheduling:from theory to practice[M]. Cham: Springer International Publishing, 2019.
[22]	RAPPAPORT T . Wireless communications:principles and practice[J]. Microwave Journal, 2002,45: 128-129.
[23]	LECUN Y , BOTTOU L , BENGIO Y ,et al. Gradient-based learning applied to document recognition[J]. Proceedings of the IEEE, 1998,86(11): 2278-2324.
[24]	KRIZHEVSKY A . Learning multiple layers of features from tiny images[R]. 2009.
[25]	CHAI Z , ALI A , ZAWAD S ,et al. TiFL:a tier-based federated learning system[C]// Proceedings of the 29th International Symposium on High-Performance Parallel and Distributed Computing. New York:ACM Press, 2020: 125-136.

Metrics

Recommended 0

No Suggested Reading articles found!

Client grouping and time-sharing scheduling for asynchronous federated learning in heterogeneous edge computing environment

RichHTML

PDF

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 15

References 25

Related Articles 15

Metrics

Recommended 0

[1]	Dong TANG, Xuwei HUANG, Zhiwei LUO, Sai ZHAO, Gaofei HUANG. Design and optimization for wireless-powered IRS-aided mobile edge computing system [J]. Journal on Communications, 2023, 44(9): 79-92.
[2]	Zhibo QI, Lei DU, Ru HUO, Fan YANG, Tao HUANG. Multi-camera video collaborative analysis method based on edge computing [J]. Journal on Communications, 2023, 44(8): 14-26.
[3]	Zhuo MA, Jiayu JIN, Yilong YANG, Yang LIU, Zuobin YING, Teng LI, Junwei ZHANG. Adaptive federated learning secure aggregation scheme based on threshold homomorphic encryption [J]. Journal on Communications, 2023, 44(7): 76-85.
[4]	Xindi MA, Qinghua LI, Qi JIANG, Zhuo MA, Sheng GAO, Youliang TIAN, Jianfeng MA. Byzantine-robust federated learning over Non-IID data [J]. Journal on Communications, 2023, 44(6): 138-153.
[5]	Jiale ZHANG, Chengcheng ZHU, Xiaobing SUN, Bing CHEN. Membership inference attack and defense method in federated learning based on GAN [J]. Journal on Communications, 2023, 44(5): 193-205.
[6]	Youliang TIAN, Shihong WU, Ta LI, Lindong WANG, Hua ZHOU. Federated learning optimization algorithm based on incentive mechanism [J]. Journal on Communications, 2023, 44(5): 169-180.
[7]	Hui JIANG, Tianliu HE, Min LIU, Sheng SUN, Yuwei WANG. High-performance federated continual learning algorithm for heterogeneous streaming data [J]. Journal on Communications, 2023, 44(5): 123-136.
[8]	Shengxing YU, Zekai CHEN, Zhong CHEN, Ximeng LIU. DAGUARD: distributed backdoor attack defense scheme under federated learning [J]. Journal on Communications, 2023, 44(5): 110-122.
[9]	Kaiju LI, Qiang XU, Hao WANG. Communication-efficient federated learning method via redundant data elimination [J]. Journal on Communications, 2023, 44(5): 79-93.
[10]	Renchao XIE, Wen WEN, Qinqin TANG, Yunlong LIU, Gaochang XIE, Tao HUANG. Survey on rail transit mobile edge computing network security [J]. Journal on Communications, 2023, 44(4): 201-215.
[11]	Xin SUN, Guifu ZHANG, Hongyan XING, Wang Zenghui. Research on intrusion detection for maritime meteorological sensor network based on balancing generative adversarial network [J]. Journal on Communications, 2023, 44(4): 124-136.
[12]	Weifeng LU, Ning LI, Jia XU, Lijie XU, Jian XU. Joint scheduling algorithm for correlative tasks in multi-access edge computing [J]. Journal on Communications, 2023, 44(4): 87-98.
[13]	Xueyong YU, Lixiang QIU, Jianing SONG, Hongbo ZHU. Security communication and energy efficiency optimization strategy in UAV-aided edge computing [J]. Journal on Communications, 2023, 44(3): 45-54.
[14]	Shuxu ZHAO, Ping WEI, Xiaolong WANG. Optimal coalition structure generation strategy in multi-task concurrent edge computing environment [J]. Journal on Communications, 2023, 44(2): 172-184.
[15]	Wei FAN, Cheng PENG, Dali ZHU, Yuqing WANG. Research on intrusion response strategy based on static Bayesian game in mobile edge computing network [J]. Journal on Communications, 2023, 44(2): 70-81.

分布	FedGA	TiFL
IID	0	0
Non-IID	0.191	0.394