What Matters, When? Diagnosing and Improving Conditional Visual Grounding in Visuomotor Imitation Policies
[Robotyka] Autorzy: Vivek Chavan, Pengtao Xie, Yahuan Shi i 3 więcej
Visuomotor imitation policies can achieve high performance under in-distribution visual conditions yet fail when visually similar objects or receptacles are introduced. We study this behavior as a problem of conditional visual grounding: the visual target required for successful control changes with the manipulation phase and, in more complex tasks, with the observed task state. Using Action Chunking with Transformers (ACT), we systematically introduce distractor objects and receptacles with controlled color and shape similarity and localize failures to picking and placement. We find that distractor sensitivity is specific to both the type of visual similarity and the manipulation stage. Guided by this diagnosis, we evaluate distractor augmentation, phase-dependent attention regularization, and appearance-based visual prompting as complementary interventions for improving target selecti…
- Kategoria arxiv
- cs.RO
- Kategoria
- Robotyka