DuoCook: An Overcooked-Inspired Benchmark for Visual Planning and Coordination
[Sztuczna inteligencja] Autorzy: Ziyi Jiao, Heng Zhang, Drishti Regmi i 3 więcej
Coordinating two players in a cooking task requires a vision-language agent to track changing scene states, sequence recipe steps, and allocate shared resources under a time budget. We introduce an Overcooked-inspired benchmark for evaluating these capabilities in Unreal Engine environments constructed using coding agents. A single vision-language model controls both players from top-down visual observations, selecting high-level actions while the engine executes navigation. The benchmark contains 20 maps in five categories. These categories support evaluation of centralized coordination under equipment contention, changing terrain, and handoff dependencies. A prop legend and pot ingredient-count indicators provide explicit visual cues, while grid-based destinations support spatial grounding. The evaluation compares four VLMs on all 20 maps, measuring task score, order completion, deliv…
- Kategoria arxiv
- cs.AI
- Kategoria
- Sztuczna inteligencja