Telecommunications Science ›› 2020, Vol. 36 ›› Issue (12): 65-76.doi: 10.11959/j.issn.1000-0801.2020308

• Research and Development • Previous Articles     Next Articles

An adaptive video stream transmission control method for wireless heterogeneous networks based on A3C

Zhiqiang LUO,Wei WANG,Xiaorong ZHU   

  1. School of Communication and Information Engineering,Nanjing University of Posts and Telecommunications,Nanjing 210003,China
  • Revised:2020-12-02 Online:2020-12-20 Published:2020-12-23

Abstract:

The adaptive bit rate (ABR) algorithm has become the focus research in video transmission.However,due to the characteristics of 5G wireless heterogeneous networks,such as large fluctuation of channel bandwidth and obvious differences between different networks,the adaptive video stream transmission with multi-terminal cooperation was faced with great challenges.An adaptive video stream transmission control method based on deep reinforcement learning was proposed.First of all,a video stream dynamic programming model was established to jointly optimize the transmission rate and diversion strategy.Since the solution of this optimization problem depended on accurate channel estimation,dynamically changing channel state was difficult to achieve.Therefore,the dynamic programming problem was improved to reinforcement learning task,and the A3C algorithm was used to dynamically determine the video bit rate and diversion strategy.Finally,the simulation was carried out according to the measured network data,and compared with the traditional optimization method,the method proposed better improved the user QoE.

Key words: wireless heterogeneous network, A3C, rate adaptation, multi-terminal cooperation, QoE

CLC Number: 

No Suggested Reading articles found!