Semi-Markov Decision Process (SMDP)-Based Resource
Time series semi-Markov decision process with variable costs for maintenance planning
... missioned at the end of the simulation, in which case the rewards for each state should be set to 0). The transition matrix P, which has a size of SxNxA, comprises of transition rates which can vary over time, making it ...
6
Continuous-observation partially observable semi-Markov decision processes for machine maintenance
... Though the POSMDP model has existed for decades, there has been little effort in bridging the gap between POSMDP and machine maintenance. Moreover, the documented works on employing POSMDP in machine maintenance are all ...
21
Action-Based Representation Discovery in Markov Decision Processes
... 6.1 Hierarchical Reinforcement Learning Hierarchical reinforcement learning algorithms constrain policies via a hierarchy (Barto & Mahadevan, 2003). These algorithms allow the agent to select actions that take more ...
156
Inventory Control in Retrial Service Facility System – Semi Markov Decision Process
... a Semi- Markov Decision Process and the optimum service rates to be employed is found using linear programming method so that the long–run expected cost rate is ...
9
Reachability-based model reduction for Markov decision process
... One example of algorithm for solving SSPs is real-time dynamic programming (RTDP) [4] that, given an SSP and a lower bound for V ∗ , computes an optimal policy for all the relevant states, i.e., all states reachable by ...
16
Testing the Adequacy of a Semi-Markov Process
... TESTING THE ADEQUACY OF A SEMI-MARKOV PROCESS I. Introduction The area of stochastic processes known as multi-state modeling describes systems in a vast array of fields, from finance and health care ...
79
Correlated Node Behavior Model based on Semi Markov Process for MANETS
... applied Semi Markov to determine node behavior transition. Semi Markov is a probabilistic system that made its transitions according to transition probability matrix of Markov ...
10
Markov Decision Process based Switching for Wireless Sensor Network
... technique. Markov Decision Process (MDP) switching algorithm has been designed for sustainable data collection tree to reduce energy consumption in the wireless sensor ...MDP based technique ...
5
Prediction Based Link Stability Analysis In Markov Decision Process
... Wireless links and battery-operated nodes that require power-efficient operation. Several wireless routing protocols have been designed to provide communication in a wireless ad hoc environment. These routing protocols ...
6
The Trust-Based Interactive Partially Observable Markov Decision Process
... observable Markov decision process (TI-POMDP) is developed to model the trust interactions between agents, enabling the agents to select the best course of action from the current ...tion ...
102
A novel resource scheduling method of netted radars based on Markov decision process during target tracking in clutter
... novel resource scheduling method of the radar network for target tracking in clutter is ...radar resource and tracking accuracy is built, and the sampling interval, power, and waveform will influence ...
9
Perishable Inventory Control in Retrial Service Facility- Semi Markov Decision Process S.Krishnakumar 1and
... a Semi-Markov Decision Process and the optimum inventory control to be employed by using linear programming method so that the long–run expected cost rate is ...
10
A hemimetric extension of simulation for semi-markov decision processes
... process s 1 if after accelerating the actions of s 2 by a factor ε > 0 it reacts to the inputs from the external environment as s 1 with at least the same speed. This type of quantitative reasoning is not new in ...
17
Model-based Bayesian Reinforcement Learning in Factored Markov Decision Process
... Yanpeng Feng and Hongyan Zheng Education Technology and Information Center, Shenzhen Polytechnic, Shenzhen, China Email: {zhenghongyan, ypfeng}@szpt.edu.cn Abstract—Learning the enormous number of parameters is a ...
6
Real Time Path Planning using a Simulation Based Markov Decision Process
... 7 Experimental Setup We have designed a set of experiments which test the MCRT technique against four of its main rivals: RRT, UCT, LSS-LRTA* and RTDP. Ten tests have been per- formed on three different game maps; each ...
15
A Markov Decision Process based flow assignment framework for heterogeneous network access
... flows based on greedy approaches or heuristics like average available bit rate on the ...MDP based dynamic flow assignment policy presented in this work is able to efficiently utilize the diversity of ...
15
Markov Decision Process Model for Optimisation of Patient Flow
... The validation of an MDP model such as the one presented here can be addressed in multiple ways. Con- sultation with industry experts has already provided a degree of qualitative validation. However, short of carrying ...
7
A Markov Decision Process Model for Traffic Prioritisation Provisioning
... These traffics that are comprised of many different types deploy network resources and without control mechanism the resource would be under strain. This effectively can degrade the perform- ance across the ...
9
Markov Decision Process Based Energy-Efficient Scheduling For Slice-Parallel Video Decoding
... 5. CONCLUSION We propose a Markov decision process based on-line scheduling algorithm for slice-parallel video decoders on multicore systems. To mitigate the complexity of solving the optimal ...
6
Closed-Loop Multi-Satellite Scheduling Based on Hierarchical Markov Decision Process (MDP)
... a Markov Decision Process (MDP) based closed-loop solution for the optical Earth Observing Satellites (EOSs) scheduling problem is ...computational resource on the satellite and the ...