Et Tu, Brute? Economic Misalignment in Personal AI Agents
[Sztuczna inteligencja] Autorzy: Aman Priyanshu, Supriti Vijay, Brian Jabarian i 1 więcej
Personal AI agents make recommendations and take actions on people's behalf in high-stakes economic contexts, e.g., buying a flight, choosing health insurance, or selecting a graduate program. The agent is given access to the user's personal context, e.g., their email inbox and a structured profile of personal attributes, with the intention of making an optimal, personalized decision for the user. We show that by simply providing this personal context, the agent steers recommendations based on inferred wealth, without being explicitly instructed to do so. In a suite of 325K experiments on 13 agents across three types of economic decisions (flights, health insurance, and graduate programs), we find that 8 models systematically choose more expensive options for wealthier users when requests are identical. This steering continues even when it directly goes against the user's stated objecti…
- Kategoria arxiv
- cs.AI
- Kategoria
- Sztuczna inteligencja