Computing Conditional Probabilities in Markovian Models Efficiently

Publikation: Beitrag in Buch/Konferenzbericht/Sammelband/GutachtenBeitrag in KonferenzbandBeigetragenBegutachtung

Abstract

The fundamentals of probabilistic model checking for Markovian models and temporal properties have been studied extensively in the past 20 years. Research on methods for computing conditional probabilities for temporal properties under temporal conditions is, however, comparably rare. For computing conditional probabilities or expected values under ω-regular conditions in Markov chains, we introduce a new transformation of Markov chains that incorporates the effect of the condition into the model. For Markov decision processes, we show that the task to compute maximal reachability probabilities under reachability conditions is solvable in polynomial time, while it was conjectured to be computationally hard. Using adaptions of known automata-based methods, our algorithm can be generalized for computing the maximal conditional probabilities for ω-regular events under ω-regular conditions. The feasibility of our algorithms is studied in two benchmark examples.

Details

OriginalspracheEnglisch
TitelTools and Algorithms for the Construction and Analysis of Systems
Redakteure/-innenErika Ábrahám, Klaus Havelund
Herausgeber (Verlag)Springer, Berlin [u. a.]
Seiten515-530
Seitenumfang16
ISBN (Print)978-3-642-54861-1
PublikationsstatusVeröffentlicht - 2014
Peer-Review-StatusJa

Publikationsreihe

ReiheLecture Notes in Computer Science, Volume 8413
ISSN0302-9743

Konferenz

TitelEuropean Joint Conferences on Theory and Practice of Software 2014
KurztitelETAPS 2014
Veranstaltungsnummer
Dauer13 - 15 April 2014
Webseite
BekanntheitsgradInternationale Veranstaltung
Ort
StadtGrenoble
LandFrankreich

Externe IDs

Scopus 84900534492
ORCID /0000-0002-5321-9343/work/142236741

Schlagworte

Schlagwörter

  • conditional probabilities, Markovian Models

Bibliotheksschlagworte