Deep Reinforcement Learning-Based Task Scheduling in IoT Edge Computing
TLDR
Simulation results show that the proposed DRL-based task scheduling algorithm outperforms the existing methods in the literature in terms of the average task satisfaction degree and success ratio.Abstract:
Edge computing (EC) has recently emerged as a promising paradigm that supports resource-hungry Internet of Things (IoT) applications with low latency services at the network edge. However, the limited capacity of computing resources at the edge server poses great challenges for scheduling application tasks. In this paper, a task scheduling problem is studied in the EC scenario, and multiple tasks are scheduled to virtual machines (VMs) configured at the edge server by maximizing the long-term task satisfaction degree (LTSD). The problem is formulated as a Markov decision process (MDP) for which the state, action, state transition, and reward are designed. We leverage deep reinforcement learning (DRL) to solve both time scheduling (i.e., the task execution order) and resource allocation (i.e., which VM the task is assigned to), considering the diversity of the tasks and the heterogeneity of available resources. A policy-based REINFORCE algorithm is proposed for the task scheduling problem, and a fully-connected neural network (FCN) is utilized to extract the features. Simulation results show that the proposed DRL-based task scheduling algorithm outperforms the existing methods in the literature in terms of the average task satisfaction degree and success ratio.read more
Citations
More filters
Journal ArticleDOI
Federated Learning in Edge Computing: A Systematic Survey
TL;DR: A systematic survey of the literature on the implementation of FL in EC environments with a taxonomy to identify advanced solutions and other open problems is provided to help researchers better understand the connection between FL and EC enabling technologies and concepts.
Journal ArticleDOI
Quasi oppositional Aquila optimizer-based task scheduling approach in an IoT enabled cloud environment
Mani Kandan,Anbazhagan Krishnamurthy,S. Arunmozhi Selvi,Mohamed Yacin Sikkandar,Mohamed Abdelkader Aboamer,T. Tamilvizhi +5 more
Journal ArticleDOI
The Frontiers of Deep Reinforcement Learning for Resource Management in Future Wireless HetNets: Techniques, Challenges, and Research Directions
TL;DR: A systematic in-depth, and comprehensive survey of the applications of DRL techniques in RRAM for next generation wireless networks to guide and stimulate more research endeavors towards building efficient and fine-grained DRL-based RRAM schemes for future wireless networks.
Journal ArticleDOI
AI-based Fog and Edge Computing: A Systematic Review, Taxonomy and Future Directions
Sundas Iftikhar,Sukhpal Singh Gill,Chenghao Song,Minxian Xu,Mohammad Sadegh Aslanpour,Adel Nadjaran Toosi,Junhui Du,Huaming Wu,Shreya Ghosh,Deepraj Chowdhury,Muhammed Golec,Mohit Kumar,Ahmed M. Abdelmoniem,Felix Cuadrado,Blesson Varghese,Omer Rana,Schahram Dustdar,Steve Uhlig +17 more
TL;DR: In this article , the role of AI/ML algorithms and the challenges in the applicability of these algorithms for resource management in fog/edge computing environments are analyzed using a systematic literature review (SLR).
Posted ContentDOI
Deep Reinforcement Learning for Radio Resource Allocation and Management in Next Generation Heterogeneous Wireless Networks: A Survey
TL;DR: A systematic in-depth, and comprehensive survey of the applications of DRL techniques in RRAM for next generation wireless networks to guide and stimulate more research endeavors towards building efficient and fine-grained DRL-based RRAM schemes for future wireless networks.
References
More filters
Book
Reinforcement Learning: An Introduction
TL;DR: This book provides a clear and simple account of the key ideas and algorithms of reinforcement learning, which ranges from the history of the field's intellectual foundations to the most recent developments and applications.
Proceedings Article
Policy Gradient Methods for Reinforcement Learning with Function Approximation
TL;DR: This paper proves for the first time that a version of policy iteration with arbitrary differentiable function approximation is convergent to a locally optimal policy.
Journal ArticleDOI
Edge Computing: Vision and Challenges
TL;DR: The definition of edge computing is introduced, followed by several case studies, ranging from cloud offloading to smart home and city, as well as collaborative edge to materialize the concept of edge Computing.
Journal ArticleDOI
A Survey on Internet of Things: Architecture, Enabling Technologies, Security and Privacy, and Applications
TL;DR: The relationship between cyber-physical systems and IoT, both of which play important roles in realizing an intelligent cyber- physical world, are explored and existing architectures, enabling technologies, and security and privacy issues in IoT are presented to enhance the understanding of the state of the art IoT development.
Journal ArticleDOI
Mobile Edge Computing: A Survey
TL;DR: The definition of MEC, its advantages, architectures, and application areas are provided; where the security and privacy issues and related existing solutions are also discussed.