An example of a Markov decision process
Reachability-based model reduction for Markov decision process
... Fig. 1 Refinement of partitions. Refinement of partitions P 1 with two blocks and P 2 , with three blocks. The refinement result is given by P 1 ∩ P 2 , a partition with six blocks the same reward or transition ...
16
A Markov Decision Process Model for Traffic Prioritisation Provisioning
... The drawback of this mechanism was that it does not address the issue of performance which is the real main concern in the networking. By using predefined rules in classifying the packets and without the consideration of ...
9
Continuous time Markov decision process of a single aisle warehouse
... This results in a small warehouse of 20 storage locations and 20 build-up stations. 4.1.2 Exponentially distributed staying times and build up times It is possible to reduce the number of types of containers even more by ...
74
Prediction Based Link Stability Analysis In Markov Decision Process
... Wireless links and battery-operated nodes that require power-efficient operation. Several wireless routing protocols have been designed to provide communication in a wireless ad hoc environment. These routing protocols ...
6
Optimizing Hypervideo Navigation using a Markov Decision Process Approach
... At least two different kinds of memory levels can be imag- ined: • Long-term memory based on a (cumulative) statistical analysis of interactions of users from various commu- nities or sessions. Long-term memory can also ...
10
An information theoretic approach for generating an aircraft avoidance Markov decision process
... all-inclusive range that was determined via simulation. NMAC entropy will also be used to quantitatively decide the order in which states are added to the state space. Starting with a single state, the question “what ...
173
Time series semi-Markov decision process with variable costs for maintenance planning
... have to be managed efficiently in order to reduce costs. Savings can be found for example through the opportunistic maintenance approach (Ding & Tian, 2011). Furthermore, it may be the case that a wind farm ...
6
Real Time Path Planning using a Simulation Based Markov Decision Process
... based Markov Decision Process (MDP) ...For example, for the current state s and action a, T selects a state s next randomly from all successor states of s that are possible to reach with ...
15
Cognitive Radio Jamming Mitigation using Markov Decision Process and Reinforcement Learning
... The behaviors of the CR, doing transitions between available frequencies, and the jammer, trying to prevent it from efficiently utilizing the spectrum, can be modeled using game theory. In this context, several works have ...
10
A Markov Decision Process Model for the Optimal Dispatch of Military Medical Evacuation Assets
... for decision-making at each discrete time epoch, they use the uni- formization method to convert the continuous-time MDP that they initially develop into an equivalent discrete-time ...For example, it may ...
88
Inventory Control in Retrial Service Facility System – Semi Markov Decision Process
... an example, the "customers" of this queue could be a network of computers attempting to access the same database, which may only be used by one customer at a ...
9
Scheduling Algorithms for Downlink Services in Wireless Networks: A Markov Decision Process Approach
... Keywords: Markov Decision Processes, 3G-Wireless, Cog- nitive Radio, Optimal Scheduling. I. I NTRODUCTION This paper proposes both a mathematical model and a scheduling algorithm for emerging new services ...
5
Battery optimization in microgrids using Markov decision process integrated with load and solar forecasting
... For example, in case of storms, the infrastructure of power systems is destructed due to which the solar panels directly tied to the power system stop working ...
96
Exploring Induced Pedagogical Strategies Through a Markov Decision Process Framework: Lessons Learned
... For example, in an automatic call center system, the agent can receive an immediate reward for every question it asks because the impact of each question can be assessed instantaneously (Williams, ...learning ...
42
Configurable Markov Decision Processes
... both Markov decision processes with imprecise probabilities and non- stationary Markov decision processes do not admit the pos- sibility to dynamically alter the environmental ...the ...
10
Markov Decision Process Model for Optimisation of Patient Flow
... a Markov decision process (MDP) model over a weekly time horizon to analyse FMC’s bed occupancy patterns with a goal of proposing policies that lead to reduced incidence of ...
7
Markov Decision Process modeled with Bandits for Sequential Decision Making in Linear-flow
... sequential decision making process, it is a simpler flow where customers per seeing recommended content on each page can only move forward in the process or drop from ...sequential decision ...
5
The Neuroeconomics of Learning and Information Processing; Applying Markov Decision Process
... From this representation, it seems that the law of this equation is bounded which is rational for which, there may be a fixed number of contexts to define either ‘ ’ or ‘ ’ while, the [r] ...
46
Optimizing credit limit policy by Markov Decision Process Models
... the Markov chain is not first ...order Markov chains. So, we tested whether the process is second-order Markov ...order Markov chain increases the size of the state space exponentially ...
188
Markov Decision Process based Switching for Wireless Sensor Network
... technique. Markov Decision Process (MDP) switching algorithm has been designed for sustainable data collection tree to reduce energy consumption in the wireless sensor ...
5