Designing an adaptive production control system using reinforcement learning
Reads0
Chats0
TLDR
This paper addresses the design of RL to create an adaptive production control system by the real-world example of order dispatching in a complex job shop, and examines the performance of the state, action, and reward function RL design.Abstract:
Modern production systems face enormous challenges due to rising customer requirements resulting in complex production systems. The operational efficiency in the competitive industry is ensured by an adequate production control system that manages all operations in order to optimize key performance indicators. Currently, control systems are mostly based on static and model-based heuristics, requiring significant human domain knowledge and, hence, do not match the dynamic environment of manufacturing companies. Data-driven reinforcement learning (RL) showed compelling results in applications such as board and computer games as well as first production applications. This paper addresses the design of RL to create an adaptive production control system by the real-world example of order dispatching in a complex job shop. As RL algorithms are “black box” approaches, they inherently prohibit a comprehensive understanding. Furthermore, the experience with advanced RL algorithms is still limited to single successful applications, which limits the transferability of results. In this paper, we examine the performance of the state, action, and reward function RL design. When analyzing the results, we identify robust RL designs. This makes RL an advantageous control system for highly dynamic and complex production systems, mainly when domain knowledge is limited.read more
Citations
More filters
Journal ArticleDOI
A Survey on AI-Driven Digital Twins in Industry 4.0: Smart Manufacturing and Advanced Robotics
TL;DR: In this paper, a survey comprehensively reviews over 300 manuscripts on AI-driven DT technologies of Industry 4.0 used over the past five years and summarizes their general developments and the current state of AI-integration in the fields of smart manufacturing and advanced robotics.
Journal ArticleDOI
Deep reinforcement learning in production systems: a systematic literature review
Marcel Panzer,Benedict Bender +1 more
TL;DR: Shortening product development cycles and fully customisable products pose major challenges for production systems as mentioned in this paper, and these not only have to cope with an increased product diversity but also enable h.....
Journal ArticleDOI
Dynamic job shop scheduling based on deep reinforcement learning for multi-agent manufacturing systems
TL;DR: In this article , a multi-agent manufacturing system based on deep reinforcement learning (DRL) is presented, which integrates the self-organization mechanism and self-learning strategy.
Journal ArticleDOI
Human-centred design in industry 4.0: case study review and opportunities for future research
TL;DR: In this article, a systematic literature review on human-centred design in industry 4.0 is presented. But the authors do not consider the impact of human-centered design on the entire value chain.
Journal ArticleDOI
A dynamic clustering technique based on deep reinforcement learning for Internet of vehicles
Abida Sharif,Jianping Li,Muhammad Asim Saleem,Gunasekaran Manogran,Seifedine Kadry,Abdul Basit,Muhammad Attique Khan +6 more
TL;DR: In this paper, an actor-critic based deep reinforcement learning framework (AC-DRL) is proposed to efficiently select the cluster head (CH) for managing the resources of the network considering the noisy nature of IoV environment.
References
More filters
Book
Simulation Modeling and Analysis
Averill M. Law,W. David Kelton +1 more
TL;DR: The text is designed for a one-term or two-quarter course in simulation offered in departments of industrial engineering, business, computer science and operations research.
Posted Content
Proximal Policy Optimization Algorithms
TL;DR: A new family of policy gradient methods for reinforcement learning, which alternate between sampling data through interaction with the environment, and optimizing a "surrogate" objective function using stochastic gradient ascent, are proposed.
Posted Content
Playing Atari with Deep Reinforcement Learning
Volodymyr Mnih,Koray Kavukcuoglu,David Silver,Alex Graves,Ioannis Antonoglou,Daan Wierstra,Martin Riedmiller +6 more
TL;DR: This work presents the first deep learning model to successfully learn control policies directly from high-dimensional sensory input using reinforcement learning, which outperforms all previous approaches on six of the games and surpasses a human expert on three of them.
Journal ArticleDOI
Simple Statistical Gradient-Following Algorithms for Connectionist Reinforcement Learning
TL;DR: This article presents a general class of associative reinforcement learning algorithms for connectionist networks containing stochastic units that are shown to make weight adjustments in a direction that lies along the gradient of expected reinforcement in both immediate-reinforcement tasks and certain limited forms of delayed-reInforcement tasks, and they do this without explicitly computing gradient estimates.
Journal ArticleDOI
Mastering the game of Go without human knowledge
David Silver,Julian Schrittwieser,Karen Simonyan,Ioannis Antonoglou,Aja Huang,Arthur Guez,Thomas Hubert,Lucas Baker,Matthew Lai,Adrian Bolton,Yutian Chen,Timothy P. Lillicrap,Fan Hui,Laurent Sifre,George van den Driessche,Thore Graepel,Demis Hassabis +16 more
TL;DR: An algorithm based solely on reinforcement learning is introduced, without human data, guidance or domain knowledge beyond game rules, that achieves superhuman performance, winning 100–0 against the previously published, champion-defeating AlphaGo.