Markov Process
On the use of Discrete – Time Markov Process for HIV/AIDs Epidemic Modelling
... The assumption that the susceptible people contract HIV disease only through sexual contact with the infective people is realistic. This is because sexual contact between the susceptible people and the infective people ...
8
Markov process-based retrieval for encrypted JPEG images
... A novel scheme for performing image retrieval in encrypted domain is introduced. With this scheme, the content owner can get encrypted images by utilizing stream cipher and permutation encryption and send them to the ...
9
Portfolio optimization of credit risky bonds: a semi-Markov process approach
... semi-Markov process based approach to optimally select a portfolio consisting of credit risky ...semi-Markov process. Modeling credit ratings by semi-Markov processes has several ...
14
Piecewise deterministic Markov process — recent results
... Abstract. We give a short overview of recent results on a specific class of Markov process: the Piecewise Deterministic Markov Processes (PDMPs). We first recall the definition of these processes and ...
15
The stochastic modelling of kleptoparasitism using a Markov process
... our Markov process iff it is a solution of the system ...aperiodic Markov process and show that a distribution is a stationary distribution of this new Markov process iff it is a ...
14
Model based Testing for Software Systems: An Application of Markov Modulated Markov Process
... using Markov chains to create system behavioral models from available system usage ...the Markov Modulated Markov Process to model hidden ...
8
The distributions and moments of the first entrance time for nonhomogeneous(H,Q) process and their application in nonhomogeneous semi markov process
... of Markov Skeleton processes, nonhomogeneous (H,Q) processes, and we mainly focus on their distributions and moments of the first entrance ...Semi-Markov Process, we study it’s distributions and ...
7
An Uninterrupted Time Markov Process on the Transition Probability Matrix with Markov Branching Process
... We shall terminate this section by discussing the convergence of sequences of increasing and stochastically monotone Markov chains. In this case the conditions for conditional compactness become much simpler. In ...
22
MATHEMATICAL MODELING AND AVAILABILITY ANALYSIS OF A CRYSTALLIZATION SYSTEM USING MARKOV PROCESS
... The sugar industry is becoming quite complex with large capital investment on process automation to enhance the reliability of system. Invariably, the proper maintenance of such systems and the frequency of ...
11
A generalised fixed point theorem of presic type in cone metric spaces and application to markov process
... Repeating this process n times we get, d(f fu, fu) <k n l n d(f fu, fu). So k n l n d(f fu, fu) - d(f fu, fu) Î P for all n ≥ 1. Since k n l n ® 0 as n ® ∞ and P is closed, –d(f fu, fu) Î P, but P ∩ (-P) = {0}. ...
8
A MARKOV PROCESS OF GENE FREQUENCY CHANGE IN A GEOGRAPHICALLY STRUCTURED POPULATION
... Based on the stochastic clock, whose time-rate depends on the total amount of the average local genetic variation which has appeared in the sample path, we have derived a Markov[r] ...
11
Inventory Control in Retrial Service Facility System – Semi Markov Decision Process
... The rest of the paper is organized as follows. Preliminary concepts of retrial queues is given in section 1. A brief account of Markov process with continuous time space is described in section 2. We ...
9
Markov denumerable process and queue theory
... the Markov chain for they have many similar ...a Markov process follows either one of two differential equations, which are called the Kolmogorov backward and forward ...of Markov chains. ...
128
Dirichlet Process Mixture Models For Markov Processes
... A Markov process is one of the most natural extensions of the ...a Markov process, one assumes that given the present, the future will not depend on the past any ...Markov ...
142
Performance simulation of the transportation process risk of bauxite carriers based on the Markov Chain and Cloud model
... the process risk was not ...the Markov process, which represents the risk status at different ...traditional Markov method. The final risks of the Markov method have great fluctuations ...
16
Optimizing credit limit policy by Markov Decision Process Models
... In the early study it was common to assume the bond rating migration follows a discrete stationary Markov process. That is to say the future rating of a bond depends only on the current rating, and bonds ...
188
Highly Secured Authentication and Authorization Using Partially Observable Markov Decision Process in MANETs
... The system can perform two types of operations: user authentication and intrusion detection. User authentication can be executed at every time instant and intrusion detection system can operate to monitor the system at ...
9
Exploring Induced Pedagogical Strategies Through a Markov Decision Process Framework: Lessons Learned
... In many domains, RL is applied with an immediate reward function. For example, in an automatic call center system, the agent can receive an immediate reward for every question it asks because the impact of each question ...
42
A hierarchical Markov decision process modeling feeding and marketing decisions of growing pigs
... Abstract: Feeding is the most important cost in the production of growing pigs and has a direct impact on the marketing decisions, growth and the final quality of the meat. In this paper, we address the sequential ...
34
Real Time Path Planning using a Simulation Based Markov Decision Process
... assumed as the estimated next state of E2 when action a is applied. The simulation also estimates and stores a reward for the state-action pair i.e. (E2, a). The depth of the look-ahead search is increased and RewardSim ...
15