MAMHOI: Factorizing Scene-Aware Human-Object Interaction through Affordances
[Widzenie komputerowe] Autorzy: Mingyuan Lei, Yoonchang Sung, Tat-Jen Cham
Generating realistic human-object interactions (HOI) in complex 3D scenes requires two complementary capabilities: reasoning about interaction feasibility in the environment and synthesizing realistic human-object motion. However, supervision for these capabilities is rarely available jointly at scale. Human-scene datasets provide rich information about environment-aware motion, while human-object datasets capture detailed interaction dynamics, yet paired human-object-scene data remain scarce. We present MAMHOI, an affordance-mediated factorization for scene-aware human-object interaction generation. MAMHOI factorizes scene-aware HOI generation through an explicit motion-affordance interface between scene understanding and motion synthesis: a scene-conditioned model first predicts where and how an interaction can be feasibly executed, and an affordance-conditioned HOI model then generat…
- Kategoria arxiv
- cs.CV
- Kategoria
- Widzenie komputerowe