Certificates and Witnesses for Multi-objective ω-regular Queries in Markov Decision Processes

Research output: Preprint/Documentation/ReportPreprint

Contributors

Abstract

Multi-objective probabilistic model checking is a powerful technique for verifying stochastic systems against multiple (potentially conflicting) properties. To enhance the trustworthiness and explainability of model checking tools, we present independently checkable certificates and witnesses for multi-objective {\omega}-regular queries in Markov decision processes. For the certification, we extend and improve existing certificates for the decomposition of maximal end components and reachability properties. We then derive mixed-integer linear programs (MILPs) for finding minimal witnessing subsystems. For the special case of Markov chains and LTL properties, we use unambiguous Büchi automata to find witnesses, resulting in an algorithm that requires single-exponential space. Existing approaches based on deterministic automata require doubly-exponential space in the worst case. Finally, we consider the practical computation of our certificates and witnesses and provide an implementation of the developed techniques, along with an experimental evaluation, demonstrating the efficacy of our techniques.

Details

Original languageEnglish
Publication statusPublished - 2025
No renderer: customAssociatesEventsRenderPortal,dk.atira.pure.api.shared.model.researchoutput.WorkingPaper

External IDs

ORCID /0000-0002-5321-9343/work/194821985
ORCID /0000-0003-1724-2586/work/194825127
ORCID /0000-0002-3437-0240/work/194826529

Keywords

Keywords

  • certificates, Markov decision process, multi-objective