• No results found

infinite state Markov chains

Topics in the theory and applications of Markov chains

Topics in the theory and applications of Markov chains

... Still continuing with the case m < 1 and Q R-positive, let us consider an application of Theorem 1.3 when the chain {Z^} starts from a specified ’ancestor* distribution {n\}. It is convenient to use criterion ( b ) of ...

145

Some limit theorems for the second order Markov chains indexed by a general infinite tree with uniform bounded degree

Some limit theorems for the second order Markov chains indexed by a general infinite tree with uniform bounded degree

... tree-indexed Markov chains and studied the recurrence and ray-recurrence for ...for Markov chains field on a homogeneous tree (a particular case of tree-indexed Markov chains ...

10

Analysis of non-reversible Markov chains

Analysis of non-reversible Markov chains

... of chains in SF ...for Markov chains as developed by Dynkin [39] to ex- press their q-potential ...birth-death chains, this q-potential is given in terms of the two fundamental so- lutions ...

185

Antichains of monomial ideals are finite

Antichains of monomial ideals are finite

... no infinite antichains that satisfy the descending chain ...no infinite antichains, then the same is true for the poset of dual order ideals of P × ...

7

An infinite chainmail of M6L6 metallacycles featuring multiple Borromean links

An infinite chainmail of M6L6 metallacycles featuring multiple Borromean links

... with infinite 2D or 3D network ...and infinite networks have been reported to form through catenane formation between chemically independent rings 24,25 catenane formation between 1D coordination polymers, ...

19

Two-state imprecise Markov chains for statistical modelling of two-state non-Markovian processes

Two-state imprecise Markov chains for statistical modelling of two-state non-Markovian processes

... imprecise Markov chain to time series data from a two- state non-Markovian ...states) Markov chain to the data, through its associated phase-type ...imprecise Markov chain. In practical ...

10

Using the National Radiotherapy Dataset within the National Cancer Data Repository to investigate patterns of use of radiotherapy in the management of surgically treated rectal cancer across the English NHS

Using the National Radiotherapy Dataset within the National Cancer Data Repository to investigate patterns of use of radiotherapy in the management of surgically treated rectal cancer across the English NHS

... with infinite 2D or 3D network ...and infinite networks have been reported to form through catenane formation between chemically independent rings 24,25 catenane formation between 1D coordination polymers, ...

19

Perfect sampling for nonhomogeneous Markov chains and hidden Markov models

Perfect sampling for nonhomogeneous Markov chains and hidden Markov models

... nonhomogeneous Markov chains. Applying these ideas to hidden Markov models, we show how to sample ex- actly from the finite-dimensional conditional distributions of the signal pro- cess given ...

35

Non reversible Metropolis Hastings

Non reversible Metropolis Hastings

... Here h is a suitable stepsize. This discretization is approx- imately correct if h is chosen to be sufficiently small. However, such a choice of h results in slow convergence to equilibrium of the Markov chain. ...

17

The strong deviation theorem for discrete time and continuous state nonhomogeneous Markov chains

The strong deviation theorem for discrete time and continuous state nonhomogeneous Markov chains

... and Markov chains, is introduced, and by constructing a nonnegative martingale, the strong deviation theorem for discrete-time and continuous-state nonhomogeneous Markov chains is ...

8

A new method for approximating vector autoregressive processes by finite state Markov chains

A new method for approximating vector autoregressive processes by finite state Markov chains

... finite-state Markov chain approximation methods developed by Tauchen (1986a) and Tauchen and Hussey (1991) are widely used in solving functional equations where the state variables follow ...

28

Non homogeneous Markov chains with a finite state space and a Doeblin type theorem

Non homogeneous Markov chains with a finite state space and a Doeblin type theorem

... The second step is to consider restrictions of the sequence of blocks each block is a product of length da to an essential class with period da; these restrictions are allowable nonnegat[r] ...

6

Accelerating Markov chain Monte Carlo via parallel predictive prefetching

Accelerating Markov chain Monte Carlo via parallel predictive prefetching

... In this chapter, we propose predictive prefetching, a new scheduling approach that uses local information to improve speedup relative to other prefetching schemes. First, we pro- vide a general mathematical framework ...

128

Markov Chains for Robust Graph Based Commonsense Information Extraction

Markov Chains for Robust Graph Based Commonsense Information Extraction

... 2011). State-of-the-art sources like Cyc and ConceptNet have limited coverage, while automated information extraction (IE) typically suffers from low accuracy (Tandon et ...

8

Markov Chains. Table of Contents. Schedules

Markov Chains. Table of Contents. Schedules

... A Markov process is a random process for which the future (the next step) depends only on the present state; it has no memory of how the present state was ...with Markov chains in ...

61

A Bayesian model for binary Markov chains

A Bayesian model for binary Markov chains

... dent Markov chains each with 21 observations; obviously, the chains may be of differing ...first state X 0 , in each chain, is equal to ...

9

On Limiting Distributions of Quantum Markov Chains

On Limiting Distributions of Quantum Markov Chains

... limiting state in the strict non-Ces`aro sense of the word ...initial state, the associated quantum Markov chain converges to a stationary ...associated Markov chain converges to the maximally ...

13

Limit Theorems on Fuzzy Markov Chains

Limit Theorems on Fuzzy Markov Chains

... Markov chains are one of the most important tools to model random phenomena evolving in time. A weak point of the most widely used model is that transition probabilities have to be constant and precisely ...

7

Actuarial Modelling with Mixtures of Markov Chains

Actuarial Modelling with Mixtures of Markov Chains

... a Markov process with state space that consists of a single absorbing state representing death and physiological states E = { 1, 2, 3, ...each state is referred to as a phase that represents ...

114

11 Conditional probability and Markov chains

11 Conditional probability and Markov chains

... Interestingly, the probabilities determined in Example 13 are identical, to the accuracy to which they are expressed (4 decimal places). This seems to indicate that, in this example, after a while the values in the ...

30

Show all 10000 documents...

Related subjects