Responsibility Attribution in Parameterized Markovian Models

Research output: Contribution to book/conference proceedings/anthology/reportConference contributionContributed

Contributors

Abstract

We consider the problem of responsibility attribution in the setting of parametric Markov chains. Given a family of Markov chains over a set of parameters, and a property, responsibility attribution asks how the difference in the value of the property should be attributed to the parameters when they change from one point in the parameter space to another. We formalize responsibility as path-based attribution schemes studied in cooperative game theory. An attribution scheme in a game determines how a value (a surplus or a cost) is distributed among a set of participants. Path-based attribution schemes include the well-studied Aumann-Shapley and the Shapley-Shubik schemes. In our context, an attribution scheme measures the responsibility of each parameter on the value function of the parametric Markov chain. We study the decision problem for path-based attribution schemes. Our main technical result is an algorithm for deciding if a path-based attribution scheme for a rational (ratios of polynomials) cost function is over a rational threshold. In particular, it is decidable if the Aumann-Shapley value for a player is at least a given rational number. As a consequence, we show that responsibility attribution is decidable for parametric Markov chains and for a general class of properties that include expectation and variance of discounted sum and long-run average rewards, as well as specifications in temporal logic.

Details

Original languageEnglish
Title of host publicationProceedings of the AAAI Conference on Artificial Intelligence
PublisherAAAI Press
Pages11734-11743
Number of pages10
Volume35
Edition13
ISBN (electronic)9781713835974
ISBN (print)978-1-57735-866-4
Publication statusPublished - 18 May 2021
Peer-reviewedNo

Conference

TitleThirty-Fifth AAAI Conference on Artificial Intelligence
Abbreviated titleAAAI-21
Duration2 - 9 February 2021
Degree of recognitionInternational event
CityVirtual

External IDs

Scopus 85108135862
ORCID /0000-0002-5321-9343/work/142236689

Keywords

DFG Classification of Subject Areas according to Review Boards

Subject groups, research areas, subject areas according to Destatis

ASJC Scopus subject areas

Keywords

  • Action, Causality, Change, Cooperative Game Theory, Planning with Markov Models (MDPs, POMDPs)