Spectrum management of cognitive radio using multi-agent reinforcement learning
Cheng Wu,Kaushik R. Chowdhury,Marco Di Felice,Waleed Meleis +3 more
- pp 1705-1712
Reads0
Chats0
TLDR
This paper introduces a multi-agent reinforcement learning approach based spectrum management that uses value functions to evaluate the desirability of choosing different transmission parameters, and enables efficient assignment of spectrums and transmit powers by maximizing long-term reward.Abstract:
Wireless cognitive radio (CR) is a newly emerging paradigm that attempts to opportunistically transmit in licensed frequencies, without affecting the pre-assigned users of these bands. To enable this functionality, such a radio must predict its operational parameters, such as transmit power and spectrum. These tasks, collectively called spectrum management, is difficult to achieve in a dynamic distributed environment, in which CR users may only take local decisions, and react to the environmental changes. In this paper, we introduce a multi-agent reinforcement learning approach based spectrum management. Our approach uses value functions to evaluate the desirability of choosing different transmission parameters, and enables efficient assignment of spectrums and transmit powers by maximizing long-term reward. We then investigate various real-world scenarios, and compare the communication performance using different sets of learning parameters. We also apply Kanerva-based function approximation to improve our approach's ability to handle large cognitive radio networks and evaluate its effect on communication performance. We conclude that our reinforcement learning based spectrum management can significantly reduce the interference to the licensed users, while maintaining a high probability of successful transmissions in a cognitive radio ad hoc network.read more
Citations
More filters
Book
Principles Of Cognitive Radio
TL;DR: 1. The concept of cognitive radio, capacity of cognitiveRadio networks, and Propagation issues for cognitive radio: a review.
Journal ArticleDOI
A Deterministic Improved Q-Learning for Path Planning of a Mobile Robot
TL;DR: The proposed deterministic Q-learning with a presumed knowledge about the distance from the current state to both the next state and the goal is provided, and the proposed algorithm stores the Q-value for the best possible action at a state and thus saves significant storage.
Journal ArticleDOI
Decision Making in Multiagent Systems: A Survey
TL;DR: This survey investigates state-of-the-art work within the past five years on cooperative MAS decision making models, including Markov decision processes, game theory, swarm intelligence, and graph theoretic models, and algorithms that result in optimal and suboptimal sequences of actions.
Journal ArticleDOI
Learning and Reasoning in Cognitive Radio Networks
TL;DR: Insight is provided into the mechanisms for obtaining and inferring knowledge that clearly set apart the cognitive radio networks from other wireless solutions.
References
More filters
Book
Reinforcement Learning: An Introduction
TL;DR: This book provides a clear and simple account of the key ideas and algorithms of reinforcement learning, which ranges from the history of the field's intellectual foundations to the most recent developments and applications.
Journal ArticleDOI
Cognitive radio: brain-empowered wireless communications
TL;DR: Following the discussion of interference temperature as a new metric for the quantification and management of interference, the paper addresses three fundamental cognitive tasks: radio-scene analysis, channel-state estimation and predictive modeling, and the emergent behavior of cognitive radio.
Book
Introduction to Reinforcement Learning
TL;DR: In Reinforcement Learning, Richard Sutton and Andrew Barto provide a clear and simple account of the key ideas and algorithms of reinforcement learning.
Journal ArticleDOI
NeXt generation/dynamic spectrum access/cognitive radio wireless networks: a survey
TL;DR: The novel functionalities and current research challenges of the xG networks are explained in detail, and a brief overview of the cognitive radio technology is provided and the xg network architecture is introduced.