Proceedings ArticleDOI
Optimal directed control of discrete event systems with linear temporal logic constraints
Ami Sakakibara,Sasinee Pruekprasert,Toshimitsu Ushio +2 more
- pp 1-8
TLDR
A novel optimal directed control problem where the selection of the controllable event at each state is determined so as to maximize the worst-case value of the mean payoffs of controlled behaviors subject to a given linear temporal logic control specification.Abstract:
We consider a quantitative discrete event system modeled by a weighted automaton, where a weight assigned to each transition represents a cost by the occurrence of the transition. An optimal directed controller selects at most one controllable event at each state to optimize director's cost of the controlled discrete event system. On the other hand, linear temporal logic is often used to specify the qualitatively desired behavior of a discrete event system. In this paper, we formulate a novel optimal directed control problem where the selection of the controllable event at each state is determined so as to maximize the worst-case value of the mean payoffs of controlled behaviors subject to a given linear temporal logic control specification. We propose a design method using a two-player game automaton whose players are the director and the product automaton. The former aims to maximize the worst-case value of the generated behaviors while the latter wants to minimize it. Under this situation, we use the concept of a best response and provide an algorithm to compute an optimal director. Then, we apply the proposed algorithm to a control problem of an AGV.read more
Citations
More filters
Proceedings of the 16th international conference on Tools and Algorithms for the Construction and Analysis of Systems
Javier Esparza,Rupak Majumdar +1 more
TL;DR: The third international workshop tacas 97 enschede the netherlands (TACAS 1997) as mentioned in this paper was held in the Netherlands in 1997, where the authors presented tools and algorithms for the construction and analysis of systems.
Proceedings ArticleDOI
Learning an Optimal Control Policy for a Markov Decision Process Under Linear Temporal Logic Specifications
Masaki Hiromoto,Toshimitsu Ushio +1 more
TL;DR: A reinforcement learning (RL) based method for design of an optimal control policy by which the controlled MDP satisfies the control specification with probability 1 and minimizes an expected discounted sum of the control costs.
References
More filters
Model checking
TL;DR: Model checking tools, created by both academic and industrial teams, have resulted in an entirely novel approach to verification and test case generation that often enables engineers in the electronics industry to design complex systems with considerable assurance regarding the correctness of their initial designs.
Book
Principles of Model Checking
TL;DR: Principles of Model Checking offers a comprehensive introduction to model checking that is not only a text suitable for classroom use but also a valuable reference for researchers and practitioners in the field.
Book
Introduction to Discrete Event Systems
TL;DR: This edition includes recent research results pertaining to the diagnosis of discrete event systems, decentralized supervisory control, and interval-based timed automata and hybrid automata models.
Journal ArticleDOI
Supervisory control of a class of discrete event processes
Peter J. Ramadge,W. M. Wonham +1 more
TL;DR: In this paper, the control of a class of discrete event processes, i.e., processes that are discrete, asynchronous and possibly non-deterministic, is studied. And the existence problem for a supervisor is reduced to finding the largest controllable language contained in a given legal language, where the control process is described as the generator of a formal language, while the supervisor is constructed from the grammar of a specified target language that incorporates the desired closed-loop system behavior.
Journal ArticleDOI
Positional strategies for mean payoff games
A. Ehrenfeucht,Jan Mycielski +1 more
TL;DR: In this article, the authors studied games of perfect information in which two players move alternately along the edges of a finite directed graph with weights attached to its edges, and one player wants to maximize and the other wants to minimize some means of the encountered weights.
Related Papers (5)
Optimal supervision of discrete event systems in a temporal logic framework
D. Ionescu,Jing-Yue Lin +1 more
A generalized temporal logic approach for control problems of a class of nondeterministic discrete event systems
J.-Y. Lin,D. Ionescu +1 more