面向联合学习的D2D计算任务卸载

doi:10.11959/j.issn.2096-3750.2019.00135

Abstract

Abstract:

Federated learning is a kind of distributed machine learning technique.The factor of communication and computation resource constraints at the edge node is becoming the performance bottleneck.In particular,when different edge node has distinct computation and communication capabilities,the model training performance may degrade severely,thus necessitating the joint communication and computation optimization.To tackle this challenge,a computational task offloading scheme enabled by device-to-device (D2D) communications was proposed,in which different edge node exchanged data samples via D2D communication links to balance the processing capability and task load,in order to minimize the total time delay for machine learning model training.Simulation results show that compared to the benchmark scheme without such D2D task offloading the training speed and efficiency of federated learning has be improved significantly.

Key words: federated learning, mobile edge computing, task offloading, device-to-device communication

CLC Number:

TN929

Xiaoran CAI,Xiaopeng MO,Jie XU. D2D computation task offloading for efficient federated learning[J]. Chinese Journal on Internet of Things, 2019, 3(4): 82-90.

Figures/Tables 7

References 17

[1]	MAO Y Y , YOU C S , ZHANG J ,et al. A survey on mobile edge computing:the communication perspective[J]. IEEE Communications Surveys ＆ Tutorials, 2017,19(4): 2322-2358.
[2]	CAO X W , WANG F , XU J ,et al. Joint computation and communication cooperation for energy-efficient mobile edge computing[J]. IEEE Internet of Things Journal, 2019,6(3): 4188-4200.
[3]	WANG F , XU J , WANG X ,et al. Joint offloading and computing optimization in wireless powered mobile-edge computing systems[J]. IEEE Transactions on Wireless Communications, 2018,17(3): 1784-1797.
[4]	LETAIEF B K , CHEN W , SHI Y M ,et al. The roadmap to 6G:AI empowered wireless networks[J]. IEEE Communications Magazine, 2019,57(8): 84-90.
[5]	ELGAZAR A , HARRAS K , AAZAM M ,et al. Towards intelligent edge storage management:determining and predicting mobile file popularity[C]// IEEE International Conference on Mobile Cloud Computing,Services,and Engineering. IEEE, 2018.
[6]	KONECNY J , BRENDAN M , RAMAGE D ,et al. Federated machine learning:concept and applications[J]. ACM Transactions on Intelligent Systems and Technology, 2019,10(2):12.
[7]	ZHANG J L , TU H D , REN Y J ,et al. An adaptive synchronous parallel strategy for distributed machine learning[J]. IEEE Access, 2018(6): 19222-19230.
[8]	SPRAGUE M R , JALALIRAD A , SCAVUZZO M ,et al. Asynchronous federated learning for geospatial applications[C]// Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer, 2018.
[9]	CHEN J M , MONGA R , BENGIO S ,et al. Revisiting distributed synchronous SGD[C]// International Conference on Learning Representations Workshop Track. Arxiv, 2016.
[10]	WANG S Q , TUOR T , SALONIDIS T ,et al. Adaptive federated learning in resource constrained edge computing systems[J]. IEEE Journal on Selected Areas in Communications, 2019,37(6): 1205-1221.
[11]	WEN W , XU C , YAN F ,et al. TernGrad:ternary gradients to reduce communication in distributed deep learning[C]// Advances in Neural Information Processing Systems. IEEE, 2017.
[12]	LI X Y , ZHU G X , GONG Y ,et al. Wirelessly powered data aggregation for IoT via over-the-air function computation:beamforming and power control[J]. IEEE Transactions on Wireless Communications, 2019,18(7): 3437-3452.
[13]	HU Y C , PATEL M , SABELLA D ,et al. Mobile edge computing—a key technology towards 5G[J]. ETSI White Paper, 2015,11(11): 1-16.
[14]	XU J , CHEN L X , LIU K ,et al. Designing security-aware incentives for computation offloading via device-to-device communication[J]. IEEE Transactions on Wireless Communications, 2018,17(9): 6053-6066.
[15]	LEE S J , TCHA Y , SEO S Y ,et al. Efficient use of multicast and unicast channels for multicast service transmission[J]. IEEE Transactions on Communications, 2011,59(5): 1264-1267.
[16]	HUNGER R . Floating point operations in matrix-vector calculus[M]. Munich: Institute for Circuit Theory and Signal ProcessingPress, 2005.
[17]	LECUN Y , BOTTOU L , BENGIO Y ,et al. Gradient-based learning applied to document recognition[J]. IEEE, 1998,86(11): 2278-2324.

Metrics

Recommended 0

No Suggested Reading articles found!

D2D computation task offloading for efficient federated learning

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 7

References 17

Related Articles 15

Metrics

Recommended 0

[1]	Guanglei GENG, Bo GAO, Ke XIONG, Pingyi FAN, Yang LU, Yuwei WANG. A survey of federated learning for 6G networks [J]. Chinese Journal on Internet of Things, 2023, 7(2): 50-66.
[2]	Yao LIU, Yueyuan HE, Hongjing ZHOU, Chaoliang LI, Chuang LI. Partial computation offloading method based on joint resource allocation for mobile edge computing [J]. Chinese Journal on Internet of Things, 2023, 7(1): 140-148.
[3]	Lin SU, Xiaochao DANG, Zhanjun HAO, Chunrui RU, Xu SHANG. Dynamic adaptive offloading method based on WPT-MEC [J]. Chinese Journal on Internet of Things, 2022, 6(4): 128-138.
[4]	Jiahui GUO, Zhuoyue CHEN, Wei GAO, Xijun WANG, Xinghua SUN, Lin GAO. Clients selection method based on knapsack model in federated learning [J]. Chinese Journal on Internet of Things, 2022, 6(4): 158-168.
[5]	Xian LI, Suzhi BI, Hongru ZENG, Bin LIN, Xiaohui LIN. Collaborative task offloading and resource allocation optimization for intelligent edge devices [J]. Chinese Journal on Internet of Things, 2022, 6(4): 41-52.
[6]	Yingyun GUO, Bo GAO, Zhifei ZHANG, Yu ZHANG, Ke XIONG. An incentive mechanism with bandwidth allocation for federated learning [J]. Chinese Journal on Internet of Things, 2022, 6(4): 82-92.
[7]	Juan FANG, Zhiyuan YE, Mengyuan ZHANG, Jiamei SHI, Ziyi TENG. Research on elite hierarchical task offloading strategy based on reinforcement learning in edge-cloud collaboration scenario [J]. Chinese Journal on Internet of Things, 2022, 6(1): 91-100.
[8]	Xin SU, Su JIANG, Yiqing ZHOU. Research on location privacy protection of mobile terminals for maritime monitoring sensor networks [J]. Chinese Journal on Internet of Things, 2021, 5(4): 26-36.
[9]	Jiahua MA, Xinghua SUN, Wenchao XIA, Xijun WANG, Hongzhou TAN, Hongbo ZHU. Node selection based on label quantity information in federated learning [J]. Chinese Journal on Internet of Things, 2021, 5(4): 46-53.
[10]	Guangming SHI, Yong XIAO, Yingyu LI, Dahua GAO, Xuemei XIE. Semantic communication networking for the intelligence of everything [J]. Chinese Journal on Internet of Things, 2021, 5(2): 26-36.
[11]	Jing LU, Hanlin LI, Lin GAO. Design of task dividing and offloading algorithm in mobile edge computing [J]. Chinese Journal on Internet of Things, 2021, 5(2): 78-86.
[12]	Houhao ZHANG, Hanlin LI, Lin GAO. Hierarchical resource deployment and sharing strategy in mobile edge computing [J]. Chinese Journal on Internet of Things, 2021, 5(1): 11-18.
[13]	Jiequ JI, Kun ZHU, Changyan YI, Ran WANG. Joint task offloading and trajectory optimization for multi-UAV assisted mobile edge computing [J]. Chinese Journal on Internet of Things, 2021, 5(1): 27-35.
[14]	Peng ZHOU,Jincheng XU,Bo YANG. Cross-domain task offloading and computing resource allocation for edge computation in industrial Internet of things [J]. Chinese Journal on Internet of Things, 2020, 4(2): 96-104.
[15]	Pengfei WANG,Boya DI,Lingyang SONG,Zhu HAN. Heterogeneous multi-layer mobile edge computing for 6G [J]. Chinese Journal on Internet of Things, 2020, 4(1): 121-130.