Prompt Minimization: Reducing Input Redundancy Without Sacrificing Output Fidelity
[Sztuczna inteligencja] Autorzy: Marius F. R. Juston, Kevin A. Karim, Jonathan Gao i 2 więcej
Despite the growing capabilities of large language models (LLMs), prompt design remains largely heuristic and ad hoc. This project will explore $\textit{prompt minimization}$, the process of reducing prompts to their smallest, most information-dense form while preserving output fidelity. Practically, shorter prompts reduce computational overhead and inference latency, especially when large contexts, such as entire documents or codebases, are included unnecessarily. Further, longer prompts can damage LLM reasoning and accuracy. Theoretically, the existence of multiple prompts yielding equivalent outputs suggests a high degree of redundancy in the input space, raising fundamental questions about what information is essential to elicit specific model behaviors. We propose three variant frameworks to identify and evaluate minimal prompts and demonstrate that minimal prompts often produce ou…
- Kategoria arxiv
- cs.AI
- Kategoria
- Sztuczna inteligencja