Exposing AI Inference as a Telco Network API over the 5G User Plane
[Sztuczna inteligencja] Autorzy: Rodrigo Moreira, Larissa Ferreira Rodrigues Moreira, Joberto S. B. Martins i 2 więcej
Supporting edge Artificial Intelligence (AI) inference as a network service is challenging because current mobile systems can transport tensors but do not expose or understand the inference context that gives those tensors operational meaning. Prior studies have addressed this gap through dynamic partitioning, collaborative inference, and split pipelines; however, these solutions remain application-bound, network-blind, or context-free. This work proposes Inference on Demand (IoD), an inference-on-demand abstraction that exposes split inference through a CAMARA-like Application Program Interface (API) and carries a split-aware tensor context in-band across the 5G user plane path. We evaluate the IoD on a programmable user plane function (UPF)-based testbed using a partitionable visual AI workload, showing that adaptive split selection can operate as a network-facing service while avoidi…
- Kategoria arxiv
- cs.AI
- Kategoria
- Sztuczna inteligencja