Token-Efficient Data Reasoning Agents via Adaptive Structuring of Unstructured Data
[Sztuczna inteligencja] Autorzy: Milad Rezaei Hajidehi, Qitong Wang, Stratos Idreos
Valuable data remains embedded in unstructured sources: web pages, reports, contracts, filings, earnings calls, and PDFs. The big bet in enterprise AI is deploying LLM agents that reason over this data to answer complex questions for every knowledge worker. Agents can do this today, but at prohibitive cost. Each question repeatedly opens large documents to recover scattered evidence, consuming up to a million tokens. However, if the data were already structured, the same question would reduce to a cheap database lookup. For example, on FanOutQA benchmark, reasoning over an ideal pre-structured store is 28X cheaper, and the gap grows to orders of magnitude as questions fan out over more documents. Yet structuring everything in advance is not viable: documents hold vastly more possible structure than any workload will use, and the useful structure and documents are unknown until queries a…
- Kategoria arxiv
- cs.AI
- Kategoria
- Sztuczna inteligencja