Reinforcement learning (RL) is widely used to train decision-making agents in domains such as autonomous driving, healthcare, and game playing. However, RL agents typically optimize numerical rewards without explicitly accounting for ethical, social, or legal norms, which is problematic in safety-critical and dynamic settings. Policy fixing addresses this issue by augmenting RL agents with symbolic reasoning for detecting or anticipating norm violations and applying emergency plans minimally altering the learned policy. Answer Set Programming (ASP) enables fixes that balance reward optimization with norm satisfaction. Existing approaches, however, rely on batch reasoning, solving each step from scratch and struggling with temporal norms requiring information over time. In this paper, we propose an ASP-based Stream Reasoning extension supporting incremental, stateful processing of observations. The approach improves efficiency and naturally supports dynamic, time-bound normative obligations. Experimental results show improved scalability in demanding scenarios and effective temporal norm management.

Emergency Planning for Norm Violations via ASP-Based Stream Reasoning

Calimeri F.;Laboccetta L.;Perri S.;Terracina G.
2027-01-01

Abstract

Reinforcement learning (RL) is widely used to train decision-making agents in domains such as autonomous driving, healthcare, and game playing. However, RL agents typically optimize numerical rewards without explicitly accounting for ethical, social, or legal norms, which is problematic in safety-critical and dynamic settings. Policy fixing addresses this issue by augmenting RL agents with symbolic reasoning for detecting or anticipating norm violations and applying emergency plans minimally altering the learned policy. Answer Set Programming (ASP) enables fixes that balance reward optimization with norm satisfaction. Existing approaches, however, rely on batch reasoning, solving each step from scratch and struggling with temporal norms requiring information over time. In this paper, we propose an ASP-based Stream Reasoning extension supporting incremental, stateful processing of observations. The approach improves efficiency and naturally supports dynamic, time-bound normative obligations. Experimental results show improved scalability in demanding scenarios and effective temporal norm management.
2027
9783032383198
9783032383204
File in questo prodotto:
Non ci sono file associati a questo prodotto.

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/20.500.11770/417882
 Attenzione

Attenzione! I dati visualizzati non sono stati sottoposti a validazione da parte dell'ateneo

Citazioni
  • ???jsp.display-item.citation.pmc??? ND
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
social impact