GoDeep: Annotation-Free Open-Vocabulary 3D Scene Understanding via Language-Space Lifting
[Widzenie komputerowe] Autorzy: Thodoris Betsas, Anastasios Doulamis, Andreas Georgopoulos
Open vocabulary 3D semantic segmentation methods typically lift CLIP features into 3D. This embeds points in a joint vision-language space known to behave like a bag-of-words on compositional tasks. Furthermore, even annotation free variants often require a large 3D training corpus and a dedicated 3D encoder per domain. Instead we use a vision-language model purely as a translator. It produces structured, entity-level descriptions of each posed image. These descriptions are grounded, projected, and aggregated directly in a general-purpose, language-only embedding space, with no 3D training corpus or encoder required. On ScanNet++, our pipeline is competitive with strong annotation free baselines trained on ScanNet. On a 5-building cultural heritage benchmark, raw scores initially favor a CLIP-based variant, but a single systematic vocabulary correction reverses this ranking. An effect c…
- Kategoria arxiv
- cs.CV
- Kategoria
- Widzenie komputerowe