Specification Portability Across LLM Development Agents: Cross-Agent Compatibility in Specification-Driven Software Migration
[Inżynieria oprogramowania] Autorzy: Oleg Grynets, Oleksii Ilchuk, Dariia Zatulna i 1 więcej
This paper investigates cross-agent specification portability using Oracle-to-PostgreSQL migration as a controlled software transformation task. The study combines two experimental stages. First, a specification-first migration pipeline was evaluated on 1,006 PL/SQL files, of which 623 were successfully regenerated and 380 generated scripts executed successfully in PostgreSQL 16. Second, cross-agent experiments were conducted on a dataset of 1,802 Oracle scripts with corresponding PostgreSQL implementations using Amazon Kiro, Google Gemini, and GitHub Copilot, with Claude Code and Cursor included in the initial single-agent evaluation. Native and foreign specifications were assessed using Token F1, exact match, SQL syntax validity, AST exact match, AST mean similarity, and immediate runnability. The results show that specification size alone does not predict implementation quality and t…
- Kategoria arxiv
- cs.SE
- Kategoria
- Inżynieria oprogramowania