Semantic Action Graph: A Shared Representation for Agent Grounding and Human Interpretation of Sports Highlights
[Interakcja człowiek–komputer] Autorzy: Tica Lin, Deepak Chandran, Gauri Jagatap i 4 więcej
Generative agents are increasingly used to select and narrate video highlights, but they typically operate over unstructured or frame-level representations. Their output is consequently difficult for a viewer to verify and steer toward individual preferences. We present the semantic action graph, a lightweight domain schema that represents a sports match as performer, action, recipient, moment, and state nodes connected by role, temporal, and outcome edges. The schema demonstrates three key properties: 1) connected event sequences, 2) a shared, closed vocabulary, and 3) frame-addressable moments, making it suitable to serve two consumers at once: an agentic pipeline that composes narrated highlights, and a visual interface through which viewers query and inspect the same structure. We instantiate it in SportSAGE, a design probe pairing a four-module highlight pipeline with a graph inter…
- Kategoria arxiv
- cs.HC
- Kategoria
- Interakcja człowiek–komputer