Does the Action Matter? Probing Action-Conditioned Semantic Forecasting as a World Model for Autonomous Driving
[Widzenie komputerowe] Autorzy: Binay Kumar Singh, Niels Da Vitoria Lobo
World models are increasingly used in autonomous driving to predict how a scene evolves under the ego vehicle's actions, supporting counterfactual reasoning and model-based planning. However, existing evaluations focus on prediction fidelity and planning performance, and rarely verify that the predictions depend on the conditioning action. In this paper, we study action dependence in action-conditioned semantic forecasting, which predicts future semantic segmentation from past segmentations and the ego action. We compare a forecaster with feature-wise and input-level action conditioning against an identical model without action input, and measure action dependence with test-time action interventions scored by standard segmentation metrics. The evaluation is validated in a synthetic environment with known action-dependent dynamics and applied to Cityscapes and BDD100K, both within each d…
- Kategoria arxiv
- cs.CV
- Kategoria
- Widzenie komputerowe