Gricea: An Open Science Platform for Conversational AI Research
[Interakcja człowiek–komputer] Autorzy: Nikhil Sharma, Yunlin Gong, Xinyang Cheng i 1 więcej
We need studies on conversational AI (CAI) at scale to understand human behavior and shape CAI design. However, fragmented reporting of systems and study configurations hinders replication, extension, and knowledge accumulation. We present Gricea, an open-science platform representing studies as configurable, deployable research artifacts that researchers can run, inspect, share, and reuse. Informed by a formative analysis of prior CAI research, Gricea couples study procedures, participant-facing systems, and conversational task behavior in. In a replication study using Gricea, we replicated configurations 93% of eligible CUI 2026 papers; while also flagging missing information in 96% of papers that hinder faithful replication --- further motivating Gricea's need. In a user study, researchers and practitioners from diverse backgrounds successfully constructed runnable studies addressing…
- Kategoria arxiv
- cs.HC
- Kategoria
- Interakcja człowiek–komputer