Never Look Back: Understanding Persistence in 3D Object Memory from Egocentric Videos
[Widzenie komputerowe] Autorzy: Shravan Chaudhari, William Paul, Suchi Saria i 2 więcej
As we move through the world and carry out everyday tasks, we encounter objects that may become relevant only later. We are capable of recalling where we left something or what was inside a container, even without knowing we would need it later. Here, we study how an embodied assistant can build a similar memory from egocentric videos, by observing a person's day-to-day activities. We present Ledger, a persistent 3D object memory that combines object locations, their histories, and contextual descriptions. It associates observations across the recording and retains objects after they leave the view, including those the person never touches. It clusters each object's observations by resting locations and records a move only after repeated evidence, reducing the effect of localization noise. Short descriptions preserve details such as an object's contents or supporting surface. It saves t…
- Kategoria arxiv
- cs.CV
- Kategoria
- Widzenie komputerowe