Abstraction-Guided Truncations for Stationary Distributions of Markov Population Models

Abstract

To understand the long-run behavior of Markov population models, the computation of the stationary distribution is often a crucial part. We propose a truncation-based approximation that employs a state-space lumping scheme, aggregating states in a grid structure. The resulting approximate stationary distribution is used to iteratively refine relevant and truncate irrelevant parts of the state-space. This way, the algorithm learns a well-justified finite-state projection tailored to the stationary behavior. We demonstrate the method’s applicability to a wide range of non-linear problems with complex stationary behaviors.

Publication
Quantitative Evaluation of Systems

Cite

@inproceedings{backenkohlerAbstractionGuidedTruncationsForStationary2021,
 address = {Cham},
 author = {Backenköhler, Michael and Bortolussi, Luca and Großmann, Gerrit and Wolf, Verena},
 booktitle = {Quantitative Evaluation of Systems},
 editor = {Abate, Alessandro and Marin, Andrea},
 isbn = {978-3-030-85172-9},
 pages = {351--371},
 publisher = {Springer International Publishing},
 title = {Abstraction-Guided Truncations for Stationary Distributions of Markov Population Models},
 year = {2021}
}