Puls Dane publiczne, aktualizowane automatycznie
arXiv – nowe publikacje publikacja

Scalable Conversational Assessment: Chat-Based Exams with a Two-Agent LLM Pipeline

[cs.CY] Autorzy: Geoffrey Challen, Craig Zilles

Oral exams are compelling because (1) students can be asked to provide their reasoning for an answer and (2) their interactive nature permits follow-up questions to resolve ambiguous answers. But oral exams scale poorly. In this paper, we present scalable conversational assessment, an LLM-based system that conducts interactive text-based conversations with students to assess their ability to make and support an argument. We use a two-agent architecture to separate concerns and reduce the likelihood that answers are leaked to the student: the interviewer interacts directly with the student, but only receives guidance about the next question to ask the student; the hidden evaluator knows the goals of the whole activity, tracks the student's progress using a rubric, and guides the interviewer on when to follow-up on the current question or proceed to the next question. The system was first…

Kategoria arxiv
cs.CY
Kategoria
cs.CY
Pdf
https://arxiv.org/pdf/2611.17220v1

Otwórz oryginał w źródle ↗

Więcej z tego źródła

Wszystkie