discrete-state Markov chain
MARKOV MODEL WITH ABSORBING STATE FOR RELIABLE PACKET DELIVERY IN WIRELESS SENSOR NETWORKS
... This paper presents a model for reliable packet delivery in Wireless Sensor Networks based on Discrete Parameter Markov Chain with absorbing state. We have demonstrated the comparison between ...
5
Option pricing under two-state Markov chain market model
... two-state Markov chain model, which is a discrete-time model of a financial ...a discrete-time, two-state, Markov ...our Markov chain market model: first, ...
26
Finite State Markov Chain Approximations to Highly Persistent Processes
... a discrete state-space Markov ...a discrete state-space Markov chain with transition probabilities that provide a good approximation for the conditional density of the ...
52
Evaluation Criteria for Reliability in Computer Systems
... a Markov process because the number of events that occur after a certain time is regardless of the events that happened before ...that. Markov chains is a special case of Markov process where the ...
5
DREAM(D): an adaptive Markov Chain Monte Carlo simulation algorithm to solve discrete, noncontinuous, and combinatorial posterior parameter estimation problems
... The swap move is fully Markovian, that is, it uses only information from the current time for proposal generation, and retains detailed balanced with respect to π( · ) because the reverse move is equally probable. If the ...
13
Control Access Point of Devices for Delay Reduction in WBAN Systems with CSMA/CA
... The discrete time Markov chain (DTMC) is pro- posed to calculate the access probability of each device in every time ...empty state is described in Figure 4 and notations used in this section ...
12
Bounds on expected coupling times in Markov chains
... in Markov Chains” (RLIMS, 11, 1- 22, 2007) it was shown that it is very difficult to find explicit expressions for the expected time to coupling in a general Markov ...a discrete time finite ...
23
Wright Fisher construction of the two parameter Poisson Dirichlet diffusion
... Wright–Fisher Markov chain ...with discrete nonoverlapping generations, a uniform mutation pattern, and a specific state-dependent migration ...the Markov property is retained), which ...
29
A stochastic model of the provision of guided tours to tourists
... relevant state probabilities of the discrete-time Markov chain that we are studying exhibit “geometric tail ...the state space of is infinite—but, instead, we can focus on a finite set ...
15
Finite State Markov Chain Approximations to Highly Persistent Processes
... a discrete state-space Markov ...a discrete state-space Markov chain with transition probabilities that provide a good approximation for the conditional density of the ...
48
DA via Markov modeling is that the estimated DA is actually
... the state space (according to definition ...of state partitions we use the discrete-time Markov chain which is a Markov process n having a countable number of states A n ...
5
On Evaluating the Efficacy of Predictive Models for Cognitive Radio Spectrum Availability in Nigeria
... the state of the channel can ei- ther be idle or busy, a discrete time two state Markov chain model was proposed as the suitable model for this ...present state of the channel is ...
17
Modelling Summer Daily Peak Loads in South Africa Using Discrete Time Markov Chain
... tricity demand is 0.05233111. This resulted in a mean return time of about 19 days. We extended the two- state problem to the three-state problem. The steady state probability of an extreme increase ...
8
Semi-Markov Modeling in Discrete Time and State for the Study of Desertification in Nigeria
... A semi-Markov model to desert encroachment in the Northern part of Nigeria with emphasis on the land measured in square kilometres lost to desert in a year. This is where the transition from one state of ...
8
Markov chain comparison
... CS-RR-406 Permanent WRAP url: http://wrap.warwick.ac.uk/61321 Copyright and reuse: The Warwick Research Archive Portal WRAP makes this work by researchers of the University of Warwick av[r] ...
20
The strong deviation theorem for discrete time and continuous state nonhomogeneous Markov chains
... and Markov chains, is introduced, and by constructing a nonnegative martingale, the strong deviation theorem for discrete-time and continuous-state nonhomogeneous Markov chains is ...
8
Cyclic Markov chains with an application to an intermediate ENSO model
... tial state errors within the linear framework of singular vec- tors (Lorenz, ...the Markov chain approach allows for the extraction of those initial states (or patterns) which are associated with the ...
14
Component Safety Assessment Using Three State Markov Chain Model
... fail-safe state is a repairable state it directly affects the estimated value of the ...fail-safe state. If the component can be repaired at the fail-safe state, the repair from a failure ...
8
Generating Diagnoses for Probabilistic Model Checking Using Causality
... using Discrete-Time Markov Chains ( DTMC ) , Continuous-Time Markov Chains ( CTMC ) or Markov Decision Processes ( MDP ) , and veri- fied against properties specified in Probabilistic ...
10
SPDE limits of the random walk Metropolis algorithm in high dimensions
... the markov chain converge to a scalar SDE, as proved in Roberts et ...the Markov chain cannot be expected to converge to a scalar ...entire Markov chain to an infinite ...
43