Puls Dane publiczne, aktualizowane automatycznie
arXiv – nowe publikacje publikacja

Algorithm Distillation for Safe In-Context Reinforcement Learning

[Uczenie maszynowe] Autorzy: Minjae Kwon, Amir Moeini, Shangtong Zhang i 1 więcej

Safe in-context reinforcement learning (Safe ICRL) asks a policy with fixed parameters to improve on an unseen constrained task from its interaction history while aiming to keep its cost within a budget. Prior work studied Safe ICRL on five benchmarks in three families: a grid world with a hidden goal and obstacles (DarkRoom), continuous navigation where goals and hazards stay invisible until reached (PointGoal, CarGoal), and locomotion with a hidden velocity limit (HalfCheetah, Ant). Safe Algorithm Distillation (Safe AD), trained on the learning histories of a safe RL algorithm, has shown adaptation failures in prior evaluations. For example, in the locomotion tasks its return stays below zero, and it rarely reaches the goal in CarGoal. We revisit two parts of Safe AD. First, we distill a budget-aware teacher with two phases. It searches for the hidden task, exploring more when more bu…

Kategoria arxiv
cs.LG
Kategoria
Uczenie maszynowe
Pdf
https://arxiv.org/pdf/2611.21524v1

Otwórz oryginał w źródle ↗

Więcej z tego źródła

Wszystkie