A system modeled as a Markov chain with probabilities
Stationarity of the transition probabilities in the Markov chain formulation of owner
... C70 probabilities estimated using non-stationary transition matrices are shown to approach a steady state after a relatively short ...payment probabilities are almost identical to those estimated under a ...
21
Logistic Regression Models for Higher Order Transition Probabilities of Markov Chain for Analyzing the Occurrences of Daily Rainfall Data
... transition probabilities, Markov chain, ML estimation, LR test, AIC, BIC, daily rainfall occurrences ...A Markov chain model is constructed for describing transition ...
13
COMPLEXITY OF EMBEDDED CHAIN ALGORITHM FOR COMPUTING STEADY STATE PROBABILITIES OF MARKOV CHAIN
... embedded Markov chains for computing steady state probabilities is ...queuing system is presented in the last ...the system performance and generation of Kolmogorov-Chapman equations ...
8
Discrete time Markov chains with interval probabilities
... 5. Calculating distributions at further steps In this section we describe and compare methods to calculate sets of distributions corresponding to further steps of an imprecise Markov chain. The methods ...
16
Hitting times and probabilities for imprecise Markov chains
... and probabilities for imprecise Markov ...imprecise Markov chain might be defined: as a set of precise, homoge- neous Markov chains; as a set of precise but general (non- Markovian) ...
11
A Markov-chain based model for a bike-sharing system
... - CHAIN MODEL FOR A BIKE - SHARING SYSTEM In this paper we are interested in discrete-time, finite-state, homogeneous Markov ...A Markov chain with n states is completely described by ...
6
Tests of Markov Order and Homogeneity in a Markov Chain
... three-state Markov chain (MC) model for analyzing the progress of patient’s health ...any Markov order m, where m refers to the number of time points back in history that has to be considered when ...
30
Solidarity and ergodic properties of semi-Markov transition probabilities
... transition probabilities pertaining to an irreducible class all have the same abscissa of convergence, a fact that permits the definition of a-recurrence and leads to a result for a-recurrent processes that ...
126
Markov Chains. Chapter Introduction. Specifying a Markov Chain
... R. A. Howard 1 provides us with a picturesque description of a Markov chain as a frog jumping on a set of lily pads. The frog starts on one of the pads and then jumps from lily pad to lily pad with the ...
66
On the Markov Chain Binomial Model
... 0 1 N N N N is the number of sequences that begin with the occurrence of state 0 (that is, failure), and ij de- notes the total number of transitions from state i to state j observed within the N sequences. Since ...
5
Generalizations of Markov Chain Discretizations
... Continuous-Time Markov Chains In continuous-time Markov chains, the time parameter t i is 0 or any positive real ...the system at time t = ...the system evolves over time, we are therefore ...
26
Automated compositional Markov chain generation for a plain-old telephone system
... In summary, the inuence of the time that elapses between two phone calls is deci- sive for the transient behaviour of the system. If we change the distribution of IdleDelay such that the variance is increased, the ...
31
On the switch Markov chain for perfect matchings
... the Markov chain, in which which a fair coin is flipped at each ...loop probabilities, which are at least 1/n, are sufficient to avoid the introduction of the lazy ...
32
One-dimensional Bargaining with Markov Recognition Probabilities
... specific system of equations and prove that for each value of the discount factor below one there is a unique bargaining ...recognition probabilities and a deterministically rotating scheme of ...
28
Preliminary System Safety Analysis with Limited Markov Chain Generation
... mechanisms. Markov chains have much greater expressive ...the Markov chain from a higher level description, such as a stochastic Petri net (Ajmone Marsan et ...the Markov chain in an ...
7
Dissipative control of a three species food chain stochastic system with a hidden Markov chain
... food chain system which is formulated as stochastic differential equations with regime switching represented by a hidden Markov ...hidden Markov chain through the observable solution of ...
22
Markov Chain Mixing Times.
... a Markov basis, the stationary distribution π to which the simple walk converges is uniform on ...a system of linear inequalities then the latter can be checked efficiently with matrix- vector ...
125
A Markov chain model for contagion
... Chavez-Demoulin and McGill [ 5 ], Bacry et al. [ 6 ] and Aït-Sahalia et al. [ 7 ]. More recently, Dassios and Zhao [ 8 ] introduced a more generalised self-exciting point process, named the dynamic contagion process ...
23
Multilinear and Integer Programming for Markov Decision Processes with Imprecise Probabilities
... are modeled by credal sets; that is, by sets of probability distribu- ...on Markov Decision Processes with Imprecise Probabilities (MDPIPs), following a sizeable literature that has steadily grown in ...
11
Loss bounds for uncertain transition probabilities in Markov decision processes
... sition probabilities in Markov decision processes with bounded nonnegative ...transition probabilities, but the system evolves according to different, true transition ...
8