2026-04-21T07:57:57Zhttps://ebiltegia.mondragon.edu/oai/request

oai:ebiltegia.mondragon.edu:20.500.11984/63012024-03-22T11:44:01Zcom_20.500.11984_1143col_20.500.11984_1148

Fear Field: Adaptive constraints for safe environment transitions in Shielded Reinforcement Learning Odriozola Olalde, Haritz Arana-Arexolaleiba, Nestor Zamalloa, Maider Perez-Cerrolaza, Jon Arozamena-Rodríguez, Jokin Reinforcement Learning Shielding Adaptive constraints Robustness Safe AI ODS 9 Industria, innovación e infraestructura Shielding methods for Reinforcement Learning agents show potential for safety-critical industrial applications. However, they still lack robustness on nominal safety, a key property for safety control systems. In the case of a significant change in the environment dynamic, shielding methods cannot guarantee safety until their inherent dynamics model is updated to the new scenario. The agent could reach risky states because the model cannot predict well. These situations could lead to catastrophic outcomes, such as damage to the cyber-physical system or loss of human lives, which are not allowed on safety-critical applications. The novel method presented in this paper, Fear Field, replicates human behaviour in those scenarios, adapting safety constraints whenever a drastic environmental change is introduced. Fear Field reduces safety violations by one order of magnitude compared to an RL agent implementing only a shield. 2024-03-21T13:35:22Z 2024-03-21T13:35:22Z 2023 http://purl.org/coar/resource_type/c_c94f 1613-0073 https://katalogoa.mondragon.edu/janium-bin/janium_login_opac.pl?find&ficha_no=174296 https://hdl.handle.net/20.500.11984/6301 eng Attribution 4.0 International http://creativecommons.org/licenses/by/4.0/ © 2023 The Authors CEUR-WS.org