Markov Chain

Efficient Steady State Analysis of Multimodal Markov Chains
We consider the problem of computing the steady state distribution of Markov chains describing cellular processes. Our main …
Approximation of event probabilities in noisy cellular processes
Molecular noise, which arises from the randomness of the discrete events in the cell, significantly influences fundamental biological …
Sliding Window Abstraction for Infinite Markov Chains
We present an on-the-fly abstraction technique for infinite-state continuous -time Markov chains. We consider Markov chains that are …
Equivalences on Phase Type Processes
In this thesis, we introduce Phase Type Processes (PTPs), a novel stochastic modeling approach that can express probabilistic and …
Modelling of Biochemical Reactions by Stochastic Automata Networks
This paper presents a stochastic modelling framework based on stochastic automata networks (SANs) for the analysis of complex …
A Numerical Aggregation Algorithm for the Enzyme-Catalyzed Substrate Conversion
Computational models of biochemical systems are usually very large, and moreover, if reaction frequencies of different reaction types …
Bisimulation and Simulation Relations for Markov Chains
Formal notions of bisimulation and simulation relation play a central role for any kind of process algebra. This short paper sketches …
Trace Machines for Observing Continuous-Time Markov Chains
In this paper, we study several linear-time equivalences (Markovian trace equivalence, failure and ready trace equivalence) for …
Comparative branching-time semantics for Markov chains
This paper presents various semantics in the branching-time spectrum of discrete-time and continuous-time Markov chains (DTMCs and …