Showing papers on "Hidden Markov model published in 1980"
12 citations
TL;DR: The purpose of this paper is to provide a unique specification of the value vectors as well as an anticycling rule which avoids parsing the transition probability matrices into their subchains.
Abstract: We consider the Policy Iteration Algorithm for undiscounted Markov Renewal Programs. Previous specifications of the policy evaluation part of this algorithm all required the analysis of the chain structure for each policy generated. The purpose of this paper is to provide a unique specification of the value vectors as well as an anticycling rule which avoids parsing the transition probability matrices into their subchains.
6 citations
TL;DR: In this paper, necessary and sufficient conditions are given for a certain class of homogeneous multicomponent Gaussian generalized stochastic fields to possess a Markov property equivalent to Nelson's.
Abstract: Necessary and sufficient conditions are given for a certain class of homogeneous multicomponent Gaussian generalized stochastic fields to possess a Markov property equivalent to Nelson's. The class of Markov fields so characterized has as a subclass the class of Markov fields which lead by Nelson's Reconstruction Theorem to some covariant (free) quantum fields.
4 citations