History-based and Markov decision process environments
Reachability-based model reduction for Markov decision process
... One example of algorithm for solving SSPs is real-time dynamic programming (RTDP) [4] that, given an SSP and a lower bound for V ∗ , computes an optimal policy for all the relevant states, i.e., all states reachable by ...
16
Markov Decision Process based Switching for Wireless Sensor Network
... technique. Markov Decision Process (MDP) switching algorithm has been designed for sustainable data collection tree to reduce energy consumption in the wireless sensor ...MDP based technique ...
5
Prediction Based Link Stability Analysis In Markov Decision Process
... Wireless links and battery-operated nodes that require power-efficient operation. Several wireless routing protocols have been designed to provide communication in a wireless ad hoc environment. These routing protocols ...
6
The Trust-Based Interactive Partially Observable Markov Decision Process
... observable Markov decision process (TI-POMDP) is developed to model the trust interactions between agents, enabling the agents to select the best course of action from the current ...tion ...
102
Model-based Bayesian Reinforcement Learning in Factored Markov Decision Process
... Yanpeng Feng and Hongyan Zheng Education Technology and Information Center, Shenzhen Polytechnic, Shenzhen, China Email: {zhenghongyan, ypfeng}@szpt.edu.cn Abstract—Learning the enormous number of parameters is a ...
6
Real Time Path Planning using a Simulation Based Markov Decision Process
... 7 Experimental Setup We have designed a set of experiments which test the MCRT technique against four of its main rivals: RRT, UCT, LSS-LRTA* and RTDP. Ten tests have been per- formed on three different game maps; each ...
15
A Markov Decision Process based flow assignment framework for heterogeneous network access
... flows based on greedy approaches or heuristics like average available bit rate on the ...MDP based dynamic flow assignment policy presented in this work is able to efficiently utilize the diversity of ...
15
Markov Decision Process Model for Optimisation of Patient Flow
... The validation of an MDP model such as the one presented here can be addressed in multiple ways. Con- sultation with industry experts has already provided a degree of qualitative validation. However, short of carrying ...
7
Markov Decision Process Based Energy-Efficient Scheduling For Slice-Parallel Video Decoding
... 5. CONCLUSION We propose a Markov decision process based on-line scheduling algorithm for slice-parallel video decoders on multicore systems. To mitigate the complexity of solving the optimal ...
6
Closed-Loop Multi-Satellite Scheduling Based on Hierarchical Markov Decision Process (MDP)
... mihai.fl[email protected] Abstract—In this paper, a Markov Decision Process (MDP) based closed-loop solution for the optical Earth Observing Satellites (EOSs) scheduling problem is ...
Continuous time Markov decision process of a single aisle warehouse
... To be able to analyse each policy in the MDP model, all storage policies will be translated such that they are implementable in the MDP model. However, the storage policies from the literature only prescribe storage ...
74
Optimizing credit limit policy by Markov Decision Process Models
... the Markov chain is not first ...order Markov chains. So, we tested whether the process is second-order Markov ...the history of t − 2 and t − ...order Markov chain increases the ...
188
Optimizing Hypervideo Navigation using a Markov Decision Process Approach
... At least two different kinds of memory levels can be imag- ined: • Long-term memory based on a (cumulative) statistical analysis of interactions of users from various commu- nities or sessions. Long-term memory ...
10
A Decision Process for Applying Cloud Computing in Federal Environments
... cloud based activities, some data transfers are so large that they cannot be reasonably accomplished through WAN connection, due to excessive time requirements or bandwidth ...
36
Action-Based Representation Discovery in Markov Decision Processes
... resented in a low-dimensional manifold, their approaches are closer to automatic model selection than automatic basis function construction. Representation Policy Iteration (RPI) (Mahadevan, 2005) constructs a graph ...
156
An information theoretic approach for generating an aircraft avoidance Markov decision process
... The different performance characteristics of VTOL compared to a fixed-wing air- craft can potential lead to a different aircraft avoidance MDP formulation. Differ- ent assumptions will result in different state ranges ...
173
Markov process-based retrieval for encrypted JPEG images
... The multi-class SVM is an extension of SVM and can solve multi-class pattern recognition problems, where the class number is larger than two. At present, a com- mon method to implement multi-class SVM is that multi-class ...
9
Markov Decision Process Based Energy-Efficient On-Line Scheduling for Slice Parallel Video Decoders on Multicore Systems
... V. C ONCLUSION We propose a Markov decision process based on-line sched- uling algorithm for slice-parallel video decoders on multicore systems. To mitigate the complexity of solving the ...
11
A novel resource scheduling method of netted radars based on Markov decision process during target tracking in clutter
... algorithm based on Markov decision process which is converted to be a binary optimization problem is proposed, and an improved binary wind-driven optimization method is presented to solve that ...
9
Time series semi-Markov decision process with variable costs for maintenance planning
... Figure 1. The outline of the model. 3 CASE STUDY 3.1 Model inputs and assumptions The methodology described in the previous sec- tion was applied to a simple case study based on fic- tional data. The actions ...
6