Journal ArticleDOI
A DQN-based intelligent control method for heavy haul trains on long steep downhill section
Reads0
Chats0
TLDR
An intelligent control method based on the Deep-Q-Network (DQN) algorithm for the heavy haul train running on the long and steep downhill section to enhance the train operation performance in regard to the operational safety, maintenance costs and running efficiency.Abstract:
The cyclic air braking strategy on the long and steep downhill section is one of the biggest challenges for heavy haul railway lines in China. To deal with this problem, this paper presents an intelligent control method based on the Deep-Q-Network (DQN) algorithm for the heavy haul train running on the long and steep downhill section. The aim of the optimal train control problem in the paper is to enhance the train operation performance in regard to the operational safety, maintenance costs and running efficiency. In the train control model, the characteristics of the heavy haul train, the speed limits and constraints on the air-refilling time of the train pipe are taken into consideration. Then the train control process on the long and steep downhill section is described as a Markov decision process for the application of the reinforcement learning (RL) technique. Further, the critical elements of RL are designed and an intelligent control method on the basis of the DQN algorithm is developed to address the optimal train control problem in this paper. Finally, experimental simulations are carried out with the actual data of the Shuozhou-Huanghua Line such that the effectiveness and robustness of the proposed DQN-based control method are verified.read more
Citations
More filters
Journal ArticleDOI
Trajectory Optimization for High-Speed Trains via a Mixed Integer Linear Programming Approach
TL;DR: In this article , a trajectory optimization approach for high-speed trains to reduce traction energy consumption and increase riding comfort is proposed, which can also achieve energy-saving effects by optimizing the operation time between stations.
Journal ArticleDOI
A cooperative collision-avoidance control methodology for virtual coupling trains.
TL;DR: Wang et al. as discussed by the authors proposed a cooperative collision-avoidance control methodology, which can enhance the operation efficiency on the premise of ensuring the safety, and a cooperative control model is further proposed and is formulated as a Markov decision process.
Journal ArticleDOI
Trajectory Optimization for High-Speed Trains via a Mixed Integer Linear Programming Approach
TL;DR: In this article , a trajectory optimization approach for high-speed trains to reduce traction energy consumption and increase riding comfort is proposed, which can also achieve energy-saving effects by optimizing the operation time between stations.
Journal ArticleDOI
Optimized Control of Virtual Coupling at Junctions: A Cooperative Game-Based Approach
TL;DR: This paper compares the strategy for train coupling at junctions generated by the proposed method with two naive strategies and unimproved particle swarm optimization and shows that the operation time was reduced by using the proposed cooperative game-based optimization approach.
Journal ArticleDOI
Adversarial Training Lattice LSTM for Named Entity Recognition of Rail Fault Texts
TL;DR: In this article , a novel adversarial training-based Lattice LSTM model called AT-Lattice is proposed to address the problem of latent information in the massive textual data (text records).
References
More filters
Book
Reinforcement Learning: An Introduction
TL;DR: This book provides a clear and simple account of the key ideas and algorithms of reinforcement learning, which ranges from the history of the field's intellectual foundations to the most recent developments and applications.
Journal ArticleDOI
Human-level control through deep reinforcement learning
Volodymyr Mnih,Koray Kavukcuoglu,David Silver,Andrei Rusu,Joel Veness,Marc G. Bellemare,Alex Graves,Martin Riedmiller,Andreas K. Fidjeland,Georg Ostrovski,Stig Petersen,Charles Beattie,Amir Sadik,Ioannis Antonoglou,Helen King,Dharshan Kumaran,Daan Wierstra,Shane Legg,Demis Hassabis +18 more
TL;DR: This work bridges the divide between high-dimensional sensory inputs and actions, resulting in the first artificial agent that is capable of learning to excel at a diverse array of challenging tasks.
Journal ArticleDOI
Deep Reinforcement Learning: A Brief Survey
TL;DR: Deep reinforcement learning (DRL) is poised to revolutionize the field of artificial intelligence (AI) and represents a step toward building autonomous systems with a higher-level understanding of the visual world as discussed by the authors.
Journal ArticleDOI
A brief survey of deep reinforcement learning
TL;DR: This survey will cover central algorithms in deep RL, including the deep Q-network (DQN), trust region policy optimization (TRPO), and asynchronous advantage actor critic, and highlight the unique advantages of deep neural networks, focusing on visual understanding via RL.
Journal ArticleDOI
Energy-efficient operation of rail vehicles
TL;DR: An analytical process that computes the optimal operating successions of a rail vehicle to minimize energy consumption and sees the major application of the proposed algorithms in fully or partially automated Train Control Systems.