Automatic Model Card Generation Using an LLM
[Inżynieria oprogramowania] Autorzy: Tajkia Rahman Toma, Balreet Grewal, Cor-Paul Bezemer
Model cards are structured documents that summarize key information about machine learning models to improve transparency, usability, and accountability. However, they often lack a consistent structure, and many models provide no model cards, making comparison and interpretation difficult. This paper presents two contributions. First, we propose MCTidy, an LLM-based approach that reorganizes existing model cards into a standardized template to improve clarity and comparability. Second, we introduce MCGenie, an LLM-based system that generates model cards directly from model repository data. We apply MCTidy to 48 Hugging Face model cards and evaluate information retention, section alignment, hallucination, and stability. Our findings show high information retention with minimal textual loss, accurate section assignment, rare hallucinations primarily in descriptive sections, and strong sta…
- Kategoria arxiv
- cs.SE
- Kategoria
- Inżynieria oprogramowania