基于深度强化学习的物联网智能路由策略

doi:10.11959/j.issn.2096-3750.2019.00097

Abstract

Abstract:

At the era of the Internet of things,networking mode that connects everything would bring tremendous increase in the data volume and challenge the traditional routing protocols.The limitations of the existing routing protocols was analyzed when facing the data explosion and then the routing selection problem was re-modeled as a Markov decision process.On this basis,the deep reinforcement learning technique was utilized to choose the next-hop router for data transmission task in order to shorten the transmission path length while network congestion was avoided.The simulation results demonstrate that the congestion probability can be reduced significantly and the network throughput can be enhanced by the proposed strategy.

Key words: deep reinforcement learning, routing, Internet of things, network congestion

CLC Number:

TN915

Ruijin DING,Feifei GAO,Ling XING. Intelligent routing strategy in the Internet of things based on deep reinforcement learning[J]. Chinese Journal on Internet of Things, 2019, 3(2): 56-63.

Figures/Tables 8

References 15

[1]	孙其博, 刘杰, 黎羴 ,等. 物联网:概念、架构与关键技术研究综述[J]. 北京:北京邮电大学学报, 2010,33(3): 1-9.
	SUN Q B , LIU J , LI S ,et al. Internet of things:summarize on concepts,architecture and key technology problem[J]. Beijing:Journal of Beijing University of Posts and Telecommunications, 2010,33(3): 1-9.
[2]	LIU V , PARKS A , TALLA V ,et al. Ambient backscatter:wireless communication out of thin air[C]// ACM SIGCOMM Computer Communication Review. ACM, 2013，43(4): 39-50.
[3]	QIAN J , GAO F , WANG G ,et al. Noncoherent detections for ambient backscatter system[J]. IEEE Transactions on Wireless Communications, 2017,16(3): 1412-1422.
[4]	NORDRUM A . The Internet of fewer things[J]. IEEE Spectrum, 2016,53(10): 12-13.
[5]	QIAN J , PARKS A N , SMITH J R ,et al. IoT communications with M-PSK modulated ambient backscatter:algorithm,analysis and implementation[J]. IEEE Internet of Things Journal, 2019,6(1): 844-855.
[6]	FORTZ B , THORUP M . Internet traffic engineering by optimizing OSPF weights[J]. IEEE INFOCOM, 2000,2(3): 519-528.
[7]	HEDRICK C L . Routing information protocol[R]. 1988.
[8]	FORTZ B , THORUP M . Optimizing OSPF/IS-IS weights in a changing world[J]. IEEE Journal on Selected Areas in Communications, 2002,20(4): 756-767.
[9]	GRIFFIN T G , SHEPHERD F B , WILFONG G . The stable paths problem and interdomain routing[J]. IEEE/ACM Transactions on Networking (ToN), 2002,10(2): 232-243.
[10]	孙志军, 薛磊, 许阳明 ,等. 深度学习研究综述[J]. 计算机应用研究, 2012,29(8): 2806-2810.
	SUN Z J , XUE L , XU Y M ,et al. Overview of deep learning[J]. Application Research of Computers, 2012,29(8): 2806-2810.
[11]	KATO N , FADLULLAH Z M , MAO B ,et al. The deep learning vision for heterogeneous network traffic control:proposal,challenges and future perspective[J]. IEEE Wireless Communications, 2017,24(3): 146-153.
[12]	TANG F , MAO B , FADLULLAH Z M ,et al. On removing routing protocol from future wireless networks:a real-time deep learning approach for intelligent traffic control[J]. IEEE Wireless Communications, 2018,25(1): 154-160.
[13]	高阳, 陈世福, 陆鑫 . 强化学习研究综述[J]. 自动化学报, 2004,30(1): 86-100.
	GAO Y , CHEN S F , LU X . Research on reinforcement learning technology:a review[J]. ACTA Automatica Sinica, 2004,30(1): 86-100.
[14]	MNIH V , KAVUKCUOGLU K , SILVER D ,et al. Human-level control through deep reinforcement learning[J]. Nature, 2015,518(7540):529.
[15]	BOYAN J A , LITTMAN M L . Packet routing in dynamically changing networks:a reinforcement learning approach[C]// Advances in Neural Information Processing Systems. Morgan Kaufmann Publishers Inc, 1994: 671-678.

Metrics

Recommended 0

No Suggested Reading articles found!

方法	神经网络数目
本文算法	1
参考文献[12]不考虑回传	16
参考文献[12]考虑回传	∞

Intelligent routing strategy in the Internet of things based on deep reinforcement learning

RichHTML

PDF下载

Knowledge

Abstract

Cite this article

share this article

Figures/Tables 8

References 15

Related Articles 15

Metrics

Recommended 0

[1]	Jing WU, Sheng LI, Jing ZHANG, Ming XIN, Ruowen TAO, Zhou ZHOU, Lijia PAN, Yi SHI. New flexible sensor for the internet of things [J]. Chinese Journal on Internet of Things, 2023, 7(2): 1-14.
[2]	Guanglei GENG, Bo GAO, Ke XIONG, Pingyi FAN, Yang LU, Yuwei WANG. A survey of federated learning for 6G networks [J]. Chinese Journal on Internet of Things, 2023, 7(2): 50-66.
[3]	Nongyu WEI, Zilong JIANG, Fangjiong CHEN. AODV protocol for acoustic-radio integrated network based on location information and energy balance [J]. Chinese Journal on Internet of Things, 2023, 7(1): 27-36.
[4]	Cenhuishan LIAO, Junyan CHEN, Guanping LIANG, Xiaolan XIE, Xiaoye LU. Quality of service optimization algorithm based on deep reinforcement learning in software defined network [J]. Chinese Journal on Internet of Things, 2023, 7(1): 73-82.
[5]	Bin SHEN, Yinbo LI, Xiaowei LIANG. Spectrum access control for cognitive internet of things users based on enhanced weighted centroid localization [J]. Chinese Journal on Internet of Things, 2023, 7(1): 93-108.
[6]	Jun SUN, Shangweikang ZHAO. Energy-saving computation offloading scheme based on Sarsa algorithm in industrial internet of things [J]. Chinese Journal on Internet of Things, 2022, 6(3): 82-90.
[7]	Zaichen ZHANG, Xiaohu YOU, Jian DANG, Liang WU, Bingcheng ZHU, Ji CHEN, Lei WANG. Optical wireless communication and internet of things [J]. Chinese Journal on Internet of Things, 2022, 6(3): 1-13.
[8]	Nuo HUANG, Weijie LIU, Chen GONG. Industrial IoT oriented petahertz communication [J]. Chinese Journal on Internet of Things, 2022, 6(3): 37-46.
[9]	Zihui LUO, Chengling JIANG, Liang LIU, Xiaolong ZHENG, Huadong MA. Research on deep reinforcement learning based intelligent shop scheduling method [J]. Chinese Journal on Internet of Things, 2022, 6(1): 53-64.
[10]	Wei WANG, Renqian GU, Li3 PENG, Jijun ZHAO, Zhongcheng WEI, Cunxi CHANG. Robust optimization of air based relay for internet of things based on UAV [J]. Chinese Journal on Internet of Things, 2022, 6(1): 101-112.
[11]	Mingjuan WU, Shuyi CHEN, Haitao LIU. Study of international standard ISO/IEC 30144: 2020 applied in intelligent substation auxiliary monitoring [J]. Chinese Journal on Internet of Things, 2022, 6(1): 123-132.
[12]	Hao JIANG, Hongming CHEN, Yilong CAO, Haoyang CUI. Comparison of MIMO based on high capacity LPWAN technology TurMass^TM and LoRa [J]. Chinese Journal on Internet of Things, 2021, 5(4): 54-61.
[13]	Zhongcheng WEI, Xinqiu ZHANG, Bin LIAN, Wei WANG, Jijun ZHAO. A survey on Wi-Fi signal based identification technology [J]. Chinese Journal on Internet of Things, 2021, 5(4): 107-119.
[14]	Yinghai XIE, Yu ZHANG. Electricity meter area identification technology based on channel coding theory [J]. Chinese Journal on Internet of Things, 2021, 5(4): 137-144.
[15]	Yiyang HU, Lina QI. Channel estimation method of massive MIMO-OFDM system based on adaptive compressed sensing [J]. Chinese Journal on Internet of Things, 2021, 5(3): 78-85.