Journal on Communications ›› 2013, Vol. 34 ›› Issue (11): 1-7.doi: 10.3969/j.issn.1000-436x.2013.11.001

• academic paper •     Next Articles

Dynamic channel selection in unknown environment based on graphical game and multi-Q learning

Fang-wei LI,Yong-chuan TANG,Jiang ZHU   

  1. Chongqing Key Lab of Mobile Communications Technology gqing University of Posts and Telecommunications, Chongqing 400065, China
  • Online:2013-11-25 Published:2017-06-23
  • Supported by:
    The National Natural Science Foundation of China;The National Natural Science Foundation of China;The Key Project of Chinese Ministry of Education;The Natural Science Foundation of Chongqing Science and Technology Commission;The Science and Technology Research Project of Chongqing Education Commission

Abstract:

For the problem of dynamic channel selection in unknown distributed environment without a priori knowledge and information exchange, multi-Q learning was proposed. The dynamic channel selection problem was formulated the existence of pure strategy Nash equilibrium in graphical game was proved. At the same time, the pure strategy Nash equi-librium was proved to be global optimal solution. Simulation results show that multi-Q learning achieves high system capacity and utility of users in the graphical game are determined mainly by the degree of the node without direct relationship to the number of users.

Key words: dynamic channel selection, graphical game, multi-Q learning, pure strategy Nash equilibrium

No Suggested Reading articles found!