Answer-Distribution Trajectories: A Stochastic-Dynamics View of LLM Reasoning
[Sztuczna inteligencja] Autorzy: Mar Gonzàlez I Català, Haitz Sáez de Ocáriz Borde, Davide Murari i 3 więcej
Chain-of-thought reasoning provides a structured computation between a model's input and final answer. Yet it is often evaluated through endpoint accuracy, which ignores the path taken to reach that answer. An emerging line of work addresses this limitation using entropy profiles, which track how uncertainty evolves over the reasoning process but do not reveal which competing hypotheses account for that uncertainty. We introduce answer-distribution trajectories, a stochastic-dynamics-inspired representation that tracks the model's full predictive distribution over answers as reasoning unfolds. As a strictly finer representation than endpoint and entropy summaries, answer-distribution trajectories enable us to characterize a trace through a dynamical reasoning profile spanning exploration, revision, motion, and commitment, and to distinguish different dynamical mechanisms of reasoning su…
- Kategoria arxiv
- cs.AI
- Kategoria
- Sztuczna inteligencja