A Q-learning-Based Dynamic Spectrum Allocation Algorithm

DOI

10.2991/iccsee.2013.195How to use a DOI?

Keywords

cognitive radio, Q-learning, dynamic spectrum allocation, channel and power selection, autonomy

Abstract

Contraposing the status of spectrum resources is tension and spectrum utilization is low, the dynamic spectrum allocation technology is studied. Due to lack of central control entity in distributed cognitive networks, cognitive users need to select channel and power for communication intellective. Based on the intelligence of Q-learning, we proposed an improved dynamic spectrum allocation algorithm. The state space, action space and reward function of the algorithm are built in the paper, and the agents are guided to perform actions through designing the reward function. The algorithm gives fully autonomy selective to cognitive users. This strengthened the dynamic management of spectrum resources. We also did many experiments. Numerical simulation results show that the proposed algorithm can not only realize the autonomy of channel and power allocation, but also improve system throughput compared to others. It boosts spectrum utilization effectively.

Copyright

© 2013, the Authors. Published by Atlantis Press.

Open Access

This is an open access article distributed under the CC BY-NC license (http://creativecommons.org/licenses/by-nc/4.0/).

Download article (PDF)

TY  - CONF
AU  - Chunying Lv
AU  - Jiyang Wang
AU  - Fei Yu
AU  - Hui Dai
PY  - 2013/03
DA  - 2013/03
TI  - A Q-learning-Based Dynamic Spectrum Allocation Algorithm
BT  - Proceedings of the 2nd International Conference on Computer Science and Electronics Engineering (ICCSEE 2013)
PB  - Atlantis Press
SP  - 771
EP  - 775
SN  - 1951-6851
UR  - https://doi.org/10.2991/iccsee.2013.195
DO  - 10.2991/iccsee.2013.195
ID  - Lv2013/03
ER  -