Journal on Communications ›› 2021, Vol. 42 ›› Issue (9): 205-217.doi: 10.11959/j.issn.1000-436x.2021178

• Comprehensive Reviews • Previous Articles     Next Articles

Survey on reinforcement learning based adaptive bit rate algorithm for mobile video streaming services

Li’na DU1,2, Li ZHUO1,2, Shuo YANG1,2, Jiafeng LI1,2, Jing ZHANG1,2   

  1. 1 Beijing Key Laboratory of Computational Intelligence and Intelligent System, Beijing University of Technology, Beijing 100124, China
    2 Information Department, Beijing University of Technology, Beijing 100124, China
  • Revised:2021-06-10 Online:2021-09-25 Published:2021-09-01
  • Supported by:
    The National Natural Science Foundation of China(61531006);Beijing Municipal Education Commission Cooperation Beijing Natural Science Foundation(KZ201910005007)

Abstract:

In recent years, with the continuous release of HTTP adaptive streaming (HAS) video datasets and network trace datasets, the machine learning methods, such as deep learning and reinforcement learning, have been continuously applied to adaptive bit rate (ABR) algorithms, which obtain the optimal strategy of rate control through interactive learning, and achieve superior performance that surpasses the traditional heuristic methods.Based on the analysis of the research difficulties of ABR algorithms, the research advances of ABR algorithms based on reinforcement learning (including deep reinforcement learning) was investigated.Furthermore, several representative HAS video datasets and network trace datasets were summarized, the evaluation metrics of the performance were depicted.Finally, the existing problems and the future tendency of ABR research were discussed.

Key words: reinforcement learning, ABR algorithm, QoE, deep learning, deep reinforcement learning

CLC Number: 

No Suggested Reading articles found!