A Reinforcement Learning Approach to Health Aware Control Strategy
Mayank Shekhar Jha,Philippe Weber,Didier Theilliol,Jean-Christophe Ponsart,Didier Maquin +4 more
- pp 171-176
TLDR
In this article, reinforcement learning based approach is used to learn an optimal control policy in face of component degradation by integrating global system transition data (generated by an analytical model that mimics the real system) and RUL predictions.Abstract:
Health-aware control (HAC) has emerged as one of the domains where control synthesis is sought based upon the failure prognostics of system/component or the Remaining Useful Life (RUL) predictions of critical components The fact that mathematical dynamic (transition) models of RUL are rarely available, makes it difficult for RUL information to be incorporated into the control paradigm A novel framework for health aware control is presented in this paper where reinforcement learning based approach is used to learn an optimal control policy in face of component degradation by integrating global system transition data (generated by an analytical model that mimics the real system) and RUL predictions The RUL predictions generated at each step, is tracked to a desired value of RUL The latter is integrated within a cost function which is maximized to learn the optimal control The proposed method is studied using simulation of a DC motor and shaft wearread more
Citations
More filters
Reinforcement Learning and Adaptive Dynamic Programming for Feedback Control
TL;DR: A transversal view through microfluidics theory and applications, covering different kinds of phenomena, from continuous to multiphase flow, and a vision of two phasemicrofluidic phenomena is given through nonlinear analyses applied to experimental time series.
Journal ArticleDOI
A Systematic Guide for Predicting Remaining Useful Life with Machine Learning
Tarek Berghout,Mohamed Benbouzid +1 more
TL;DR: A review-based study uses step-by-step guidelines to help determine the appropriate solution for any specific type of driven data and uses these guidelines to determine learning model limitations, reconstruction challenges, and future prospects.
Proceedings ArticleDOI
Remaining Useful Life Prediction for Liquid Propulsion Rocket Engine Combustion Chamber
TL;DR: In this article, the authors deal with an automatic estimation of the remaining useful life of a liquid propulsion rocket engine (LPRE) combustion chamber with the cracking of the internal wall due to the thermo-mechanical stress considered as one of the major degradation modes.
Journal ArticleDOI
Reinforcement learning for predictive maintenance: a systematic technical review
Journal ArticleDOI
Quo Vadis Machine Learning-Based Systems Condition Prognosis?—A Perspective
Mohamed Benbouzid,Tarek Berghout +1 more
TL;DR: In this article , a perspective paper describes the challenges and future directions of data-driven prognostics and health management and provides future directions based on a relevant state-of-the-art review.
References
More filters
Journal ArticleDOI
Human-level control through deep reinforcement learning
Volodymyr Mnih,Koray Kavukcuoglu,David Silver,Andrei Rusu,Joel Veness,Marc G. Bellemare,Alex Graves,Martin Riedmiller,Andreas K. Fidjeland,Georg Ostrovski,Stig Petersen,Charles Beattie,Amir Sadik,Ioannis Antonoglou,Helen King,Dharshan Kumaran,Daan Wierstra,Shane Legg,Demis Hassabis +18 more
TL;DR: This work bridges the divide between high-dimensional sensory inputs and actions, resulting in the first artificial agent that is capable of learning to excel at a diverse array of challenging tasks.
Book
Markov Decision Processes: Discrete Stochastic Dynamic Programming
TL;DR: Puterman as discussed by the authors provides a uniquely up-to-date, unified, and rigorous treatment of the theoretical, computational, and applied research on Markov decision process models, focusing primarily on infinite horizon discrete time models and models with discrete time spaces while also examining models with arbitrary state spaces, finite horizon models, and continuous time discrete state models.
Journal ArticleDOI
Reinforcement learning and adaptive dynamic programming for feedback control
Frank L. Lewis,Draguna Vrabie +1 more
TL;DR: This work describes mathematical formulations for reinforcement learning and a practical implementation method known as adaptive dynamic programming that give insight into the design of controllers for man-made engineered systems that both learn and exhibit optimal behavior.
Journal ArticleDOI
Wear models and predictive equations: their form and content
H.C. Meng,Kenneth C. Ludema +1 more
TL;DR: Most wear models and equations in the literature were analyzed as to origin, content and applicability as discussed by the authors, and no single predictive equation or group of limited equations could be found for general and practical use.
Journal ArticleDOI
Model-Based Prognostics With Concurrent Damage Progression Processes
Matthew Daigle,Kai Goebel +1 more
TL;DR: A model-based prognostics methodology that consists of a joint state-parameter estimation problem, in which the state of a system along with parameters describing the damage progression are estimated, followed by a prediction problem, which is propagated forward in time to predict end of life and remaining useful life.