S
Steven I. Marcus
Researcher at University of Maryland, College Park
Publications - 222
Citations - 7406
Steven I. Marcus is an academic researcher from University of Maryland, College Park. The author has contributed to research in topics: Markov decision process & Markov process. The author has an hindex of 46, co-authored 220 publications receiving 6994 citations. Previous affiliations of Steven I. Marcus include University of Kentucky & University of Texas at Austin.
Papers
More filters
Journal ArticleDOI
Discrete-time controlled Markov processes with average cost criterion: a survey
Aristotle Arapostathis,Vivek S. Borkar,E. Fernandez-Gaucherand,Mrinal K. Ghosh,Steven I. Marcus +4 more
TL;DR: A survey of the average cost control problem for discrete-time Markov processes can be found in this paper, where the authors have attempted to put together a comprehensive account of the considerable research on this problem over the past three decades.
Journal ArticleDOI
Optimal control of switching diffusions with application to flexible manufacturing systems
TL;DR: In this paper, the existence of a homogeneous Markov nonrandomized optimal policy is established by a convex analytic method using a controlled switching diffusion model to study the hierarchical control of flexible manufacturing systems.
Journal ArticleDOI
Ergodic Control of Switching Diffusions
TL;DR: In this paper, the authors study the ergodic control problem of switching diffusions representing a typical hybrid system that arises in numerous applications such as fault-tolerant control systems, flexible manufacturing systems, etc.
Book ChapterDOI
Risk Sensitive Markov Decision Processes
Steven I. Marcus,E. Fernandez-Gaucherand,Daniel Hernández-Hernández,Stefano Coraluppi,P.J. Fard +4 more
TL;DR: Risk-sensitive control is an area of significant current interest in stochastic control theory, whereby the generalization of the classical, risk-neutral approach seeks to minimize an exponential of the sum of costs that depends not only on the expected cost, but on higher order moments as well.
Book
Simulation-Based Algorithms for Markov Decision Processes
TL;DR: The self-contained approach of this book will appeal not only to researchers in MDPs, stochastic modeling, and control, and simulation but will be a valuable source of tuition and reference for students of control and operations research.