August 20th, 2025 | EVALUATION
We report on a conversational agent presented as an avatar on a TV and deployed inside a science museum in 2021. The avatar, Ilse, could answer questions about herself, the institutions she was connected to (the local university, the nearby lab, the museum), and a relevant science area (linguistics). We compared conversational interactions from 118 visitors to those visitors’ assessments of their own experiences. The interactions were similar to previous results from similar conversational agents: visitors often asked the avatar about herself and the avatar provided high-quality responses around half the time. Visitors’ survey responses showed that they enjoyed their interactions with the avatar, finding them easy and helpful. However, visitors who had received more high-quality responses from the avatar rated their subjective experiences significantly more positively. These results show the power of using conversational agents for public engagement and the importance of maintaining the underlying technology at a high level.
Document
Team Members
A’Niyah Brown, Project StaffVictoria Sevich, Project Staff
Madeleine Bloomquist, Author
Vishal Sunder, Co-Principal Investigator
Eric Fosler-Lussier, Principal Investigator
Michael White, Principal Investigator
Funders
Funding Source: NSF
Funding Program: IIS
Award Number: IIS 1618336
Funding Program: BCS
Award Number: BCS 2140708
Tags
Audience: General Public | Museum | ISE Professionals
Discipline: Computing and information science
Resource Type: Audience Study | Evaluation | Summative
Environment Type: Museum and Science Center Exhibits