A metrized duality theorem for Markov processes

Semi-Markov decision processes pro- vide a more permissive model than continuous-time Markov decision processes, since they allow as residence-time distributions any

In this paper, we study the infinite-horizon expected discounted continuous-time optimal control problem for Piecewise Deterministic Markov Processes (PDMPs) with both impulsive

In this paper, we are interested in the synthesis of schedulers in double-weighted Markov decision processes, which satisfy both a percentile constraint over a weighted

In Chapter 4, we look at a related but still important branching model, Markov.. branching processes with immigration, emigration

In 2005, a new structure of generalized metric spaces was introduced by Zead Mustafa and Brailey Sims as appropriate notion of generalized metric space called G-metric spaces (see

Keywords and phrases: Cannings models, frequency-dependent selection, moment duality, an- cestral processes, branching-coalescing stochastic processes, fixation

This paper presents a fundamental study of similarity and bisimilarity for labelled Markov processes (LMPs). The main results characterize similarity as a testing preorder

In this paper, we attempt to use the language of structure learning to address learning the dynamic influence network between partially observable processes represented as hidden