基于强化学习的边缘计算智能电网资源调度算法

doi:10.11959/j.issn.1000-0801.2024005

电信科学 ›› 2024, Vol. 40 ›› Issue (1): 115-122.doi: 10.11959/j.issn.1000-0801.2024005

• 研究与开发 • 上一篇

基于强化学习的边缘计算智能电网资源调度算法

余竞航, 赵一辰, 宋浒

国网江苏省电力有限公司信息通信分公司，江苏南京 210024

修回日期:2023-12-26 出版日期:2024-01-01 发布日期:2024-01-01
作者简介:余竞航（1995- ），男，国网江苏省电力有限公司信息通信分公司工程师，主要研究方向为电力信息技术
赵一辰（1996- ），男，现就职于国网江苏省电力有限公司信息通信分公司，主要研究方向为电力信息技术
宋浒（1986- ），男，博士，国网江苏省电力有限公司信息通信分公司高级工程师，主要研究方向为电力信息技术
基金资助:
国网江苏省电力有限公司科技项目(SGJSXT00XTJS2200433)

Edge computing smart grid resource scheduling algorithm based on reinforcement learning

Jinghang YU, Yichen ZHAO, Hu SONG

Information and Communication Company, State Grid Jiangsu Electric Power Co., Ltd., Nanjing 210024, China

Revised:2023-12-26 Online:2024-01-01 Published:2024-01-01
Supported by:
Science and Technology Project of State Grid Jiangsu Electric Power Co., Ltd.(SGJSXT00XTJS2200433)

摘要/Abstract

摘要：

智能电网是一种能够进行智能管理和优化的电力网络。网络虚拟化技术可以有效提高智能电网的资源利用率和可靠性，从而满足不同用户的差异化需求。在资源有限的情况下，传统的虚拟网络嵌入算法无法根据电力系统的资源使用情况和用户需求来动态调整虚拟资源的分配和映射。为解决这一问题，将边缘计算和虚拟化技术相结合，引入了一种基于强化学习的虚拟网络资源调度算法。仿真结果表明，该虚拟网络资源调度算法在提高电网的可靠性和资源利用率方面优于其他3种调度算法。

关键词: 智能电网, 边缘计算, 虚拟网络嵌入, 资源调度

Abstract:

A smart grid is a power network capable of intelligent management and optimization.Network virtualization technology can effectively improve the resource utilization and reliability of smart grids and meet the differentiated needs of different users.In the case of limited resources, traditional virtual network embedding algorithms cannot dynamically adjust the allocation and mapping of virtual resources according to the resource usage and user needs of the power system.To solve this problem, edge computing and virtualization technology was combined and a virtual network resource scheduling algorithm based on reinforcement learning was introduced.The simulation results show that the proposed virtual resource scheduling algorithm is better than the other three scheduling algorithms in improving power grid reliability and resource utilization.

Key words: smart grid, edge computing, virtual network embedding, resource scheduling

中图分类号:

TP393

余竞航, 赵一辰, 宋浒. 基于强化学习的边缘计算智能电网资源调度算法[J]. 电信科学, 2024, 40(1): 115-122.

Jinghang YU, Yichen ZHAO, Hu SONG. Edge computing smart grid resource scheduling algorithm based on reinforcement learning[J]. Telecommunications Science, 2024, 40(1): 115-122.

图/表 1

参考文献 22

[1]	ZAFAR A , CHE Y B , AHMED M ,et al. Enhancing power generation forecasting in smart grids using hybrid autoencoder long short-term memory machine learning model[J]. IEEE Access, 2023(11): 118521-118537.
[2]	BONDOK A H , MAHMOUD M , BADR M M ,et al. Novel evasion attacks against adversarial training defense for smart grid federated learning[J]. IEEE Access, 2023(11): 112953-112972.
[3]	ALACA O , EKTI A R , WILSON A ,et al. Detection of grid-signal distortions using the spectral correlation function[J]. IEEE Transactions on Smart Grid, 2023,14(6): 4980-4983.
[4]	SIKRI A , SELIM B , KADDOUM G ,et al. RIS-aided wireless sensor network in the presence of impulsive noise and interferers for smart-grid communications[J]. IEEE Communications Letters, 2023,27(9): 2501-2505.
[5]	FRANCES A , RAMIREZ D , UCEDA J . Blackbox small-signal modeling of grid-connected inverters in asymmetrical power grids[J]. IEEE Transactions on Power Electronics, 2023,38(10): 13064-13073.
[6]	HOSSEINZADEHTAHER M , ZARE A , KHAN A ,et al. AI-based technique to enhance transient response and resiliency of power electronic dominated grids via grid-following inverters[J]. IEEE Transactions on Industrial Electronics, 2023,71(3): 2614-2625.
[7]	ZHANG H X , YANG Y J , SHANG B D ,et al. Joint resource allocation and multi-part collaborative task offloading in MEC systems[J]. IEEE Transactions on Vehicular Technology, 2022,71(8): 8877-8890.
[8]	ZHANG P Y , ZHANG Y , KUMAR N ,et al. Dynamic SFC embedding algorithm assisted by federated learning in space-air-ground integrated network resource allocation scenario[J]. IEEE Internet of Things Journal, 2023,10(11): 9308-9318.
[9]	WANG C , LIU L , JIANG C X ,et al. Incorporating distributed DRL into storage resource optimization of space-air-ground integrated wireless communication network[J]. IEEE Journal of Selected Topics in Signal Processing, 2021,16(3): 434-446.
[10]	刘峻朋, 夏玮玮, 刘晗 ,等. 面向电力业务质量保障的 NR-U与Wi-Fi频谱共享[J]. 电信科学, 2023,39(7): 11-22.
	LIU J P , XIA W W , LIU H ,et al. NR-U and Wi-Fi spectrum sharing for quality guaranteeing of power services[J]. Telecommunications Science, 2023,39(07): 11-22.
[11]	郭健 . 基于 SDN 架构的云网融合技术研究与实践[J]. 电信工程技术与标准化, 2022,35(3): 27-32.
	GUO J . Research and practice of cloud network integration technology based on SDN architecture[J]. Telecom Engineering Technics Standardization, 2022,35(3): 27-32.
[12]	李洵, 廖臣, 杨箴 ,等. 基于云计算的电网虚拟化调度系统研究[J]. 电子设计工程, 2019,27(12): 138-141,146.
	LI X , LIAO C , YANG Z ,et al. Research on power grid virtualization scheduling system based on cloud computing[J]. Electronic Design Engineering, 2019,27(12): 138-141,146.
[13]	许广路 . 物联网技术在智能电网中的应用[J]. 科技创新与应用, 2022,12(5): 182-184.
	XU G L . Application of internet of things technology in smart grid[J]. Technology Innovation and Application, 2022,12(5): 182-184.
[14]	刘明月, 涂崎, 汪洋 ,等. 移动云计算卸载技术研究现状及其在电网中的应用[J]. 电力信息与通信技术, 2021,19(1): 49-56.
	LIU M Y , TU Q , WANG Y ,et al. Research on mobile cloud computation offloading technology and its application in power grid[J]. Electric Power Information and Communication Technology, 2021,19(1): 49-56.
[15]	DOU H E , XU Z C , JIANG X ,et al. Mobile edge computing based task offloading and resource allocation in smart grid[C]// Proceedings of the 2021 13th International Conference on Wireless Communications and Signal Processing (WCSP). Piscataway:IEEE Press, 2021: 1-5.
[16]	CAO H T , HU H , QU Z C ,et al. Heuristic solutions of virtual network embedding:a survey[J]. China Communications, 2018,15(3): 186-219.
[17]	MELO M , SARGENTO S , KILLAT U ,et al. Optimal virtual network embedding:energy aware formulation[J]. Computer Networks, 2015(91): 184-195.
[18]	SHANBHAG S , KANDOOR A R , WANG C ,et al. VHub:single-stage virtual network map through hub location[J]. Computer Networks, 2015(77): 169-180.
[19]	HAERI S , TRAJKOVIR? L . Virtual network embedding via Monte Carlo tree search[J]. IEEE Transactions on Cybernetics, 2017,48(2): 510-521.
[20]	DOLATI M , HASSANPOUR S B , GHADERI M ,et al. DeepViNE:Virtual network embedding with deep reinforcement learning[C]// Proceedings of the IEEE INFOCOM 2019-IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). Piscataway:IEEE Press, 2019: 879-885.
[21]	ZHANG P Y , YAO H P , LIU Y J . Virtual network embedding based on computing,network,and storage resource constraints[J]. IEEE Internet of Things Journal, 2017,5(5): 3298-3304.
[22]	YU M L , YI Y , REXFORD J ,et al. Rethinking virtual network embedding:Substrate support for path splitting and migration[J]. ACM SIGCOMM Computer Communication Review, 2008,38(2): 17-29.

基于强化学习的边缘计算智能电网资源调度算法

Edge computing smart grid resource scheduling algorithm based on reinforcement learning

在线阅读

PDF下载

可视化

摘要/Abstract

引用本文

使用本文

图/表 1

参考文献 22

相关文章 15

Metrics

推荐阅读 0

[1]	张儒申, 左扬, 李东奇, 周铭, 胡一伟, 陈晓芳. 5G调度性能优化方案研究与应用[J]. 电信科学, 2023, 39(Z1): 110-117.
[2]	张维庭, 孙呈蕙, 王洪超, 代嘉宁. 算网资源智能适配与融合调度方法[J]. 电信科学, 2023, 39(9): 12-20.
[3]	王淑玲, 孙杰, 王鹏, 杨爱东. 云边协同中的资源调度优化[J]. 电信科学, 2023, 39(2): 163-170.
[4]	彭雪飞, 刘奥辉. 车载边缘计算研究综述[J]. 电信科学, 2023, 39(12): 19-28.
[5]	顾博, 敖婷. 基于MEC的定位技术在车联网中的应用[J]. 电信科学, 2022, 38(Z1): 250-258.
[6]	王帅, 陈丹, 肖羽. 5G行业专网对外服务能力研究[J]. 电信科学, 2022, 38(Z1): 143-148.
[7]	伏玉笋, 唐金辉. 使能未来工厂的5G能力综述[J]. 电信科学, 2022, 38(9): 18-35.
[8]	张天魁, 徐瑜, 刘元玮, 杨鼎成, 任元红. 无人机辅助MEC系统：架构、关键技术与未来挑战[J]. 电信科学, 2022, 38(8): 3-16.
[9]	邓平科, 张同须, 施南翔, 张童, 邵天竺, 郑韶雯. 星算网络——空天地一体化算力融合网络新发展[J]. 电信科学, 2022, 38(6): 71-81.
[10]	邢文娟, 雷波, 赵倩颖. 算力基础设施发展现状与趋势展望[J]. 电信科学, 2022, 38(6): 51-61.
[11]	冯晓丽, 刘晨, 张丽伟, 王晓韵. 基于5G MEC的智慧化园区解决方案[J]. 电信科学, 2022, 38(5): 54-63.
[12]	邹璐珊, 黄晓雯, 杨敬民, 郑艺峰, 张光林, 张文杰. 移动边缘计算中资源分配和定价方法综述[J]. 电信科学, 2022, 38(3): 113-132.
[13]	绳韵, 许晨, 郑光远. 基于NOMA的超密集MEC网络任务卸载和资源分配方案[J]. 电信科学, 2022, 38(2): 35-46.
[14]	刘云毅, 张建敏, 冯晓丽, 张丽伟. 5G MEC系统安全能力部署方案[J]. 电信科学, 2022, 38(11): 143-152.
[15]	陈瑞凤, 李君, 徐春婕, 程清波, 吕晓军. 5G在铁路智能车站中的应用[J]. 电信科学, 2021, 37(7): 86-95.