Configuration, Not Conscience: A Large-Scale Empirical Study of LLM System Prompts
[Kryptografia i bezpieczeństwo] Autorzy: Constantinos Patsakis, Vasilios Argyropoulos, Efthymios Alepis
Leaked system prompts are often treated as windows into the hidden values of commercial language models, yet their composition is rarely studied at scale. We analyze a merged corpus of 407 leaked, reconstructed, or officially published system prompts from 62 vendors across four community collections, identifying 29 near-duplicate clusters covering 66 files. Operational content rather than ethical statements dominates the corpus; a deliberately simple block-level classifier assigns roughly 58\% of classified words to tool/protocol and roughly 5\% to safety policy, while the strictest rule-lines guard tool use and file safety over harmful content by an 11:1 margin. Literal text transfer concentrates in a small set of cross-vendor pairs. Prompts also carry measurable maintenance debt, with version chains turning over thousands of words per release. The evidence supports treating leaked pro…
- Kategoria arxiv
- cs.CR
- Kategoria
- Kryptografia i bezpieczeństwo