Abstract:

Currently, network traffic scheduling strategy cannot be intelligent and on-demand, especially in the congestion caused by sudden network failures and escort scenarios of high-value services.They cannot guarantee latency-sensitive service experience on demand.The delay-sensitive attribute requirements of different network traffic were analyzed and studied, and the internal correlation between the behavior characteristics of varying network traffic and its delay sensitivity requirements was explored.Then, AI technology was used to learn this inherent relationship and construct its mapping relationship, realizing a traffic scheduling technical solution based on the intelligent awareness of delay-sensitive traffic.At the same time, considering the practical issues of interpretability and deploy-ability of AI models, reinforcement learning (RL) technology was used to prune and optimize the interpretable decision tree model, which improved the robustness of the model and made model lighter and easier to implement in equipment deployment.Through experiments by the collected real network traffic, the decision tree model optimized by reinforcement learning could improve the awareness accuracy by 1.75% in a single inference case, and the inference performance was improved by about 30%.The experiment also proved that using micro-statistical features for multiple inferences could help improve the model accuracy; in all experiments, the scale of the decision tree model optimized by RL was reduced by about 60.0%～87.2%, and the Saras had better optimization performance than Q-learning.

Key words: traffic analysis, traffic scheduling, delay-sensitive attribute, reinforcement learning, decision tree