Multimodal Trajectory Analysis of Visitor Engagement with Interactive Science Museum Exhibits

June 14th, 2021 | RESEARCH

Recent years have seen a growing interest in investigating visitor engagement in science museums with multimodal learning analytics. Visitor engagement is a multidimensional process that unfolds temporally over the course of a museum visit. In this paper, we introduce a multimodal trajectory analysis framework for modeling visitor engagement with an interactive science exhibit for environmental sustainability. We investigate trajectories of multimodal data captured during visitor interactions with the exhibit through slope-based time series analysis. Utilizing the slopes of the time series representations for each multimodal data channel, we conduct an ablation study to investigate how additional modalities lead to improved accuracy while modeling visitor engagement. We are able to enhance visitor engagement models by accounting for varying levels of visitors’ science fascination, a construct integrating science interest, curiosity, and mastery goals. The results suggest that trajectory-based representations of the multimodal visitor data can serve as the foundation for visitor engagement modeling to enhance museum learning experiences. 



Team Members

Andrew Emerson, Author, North Carolina State University
Nathan Henderson, Author, North Carolina State University
Wookhee Min, Author, North Carolina State University
Jonathan Rowe, Co-Principal Investigator, North Carolina State University
James Minogue, Co-Principal Investigator, North Carolina State University
James Lester, Principal Investigator, North Carolina State University


Identifier Type: doi
Identifier: 10.1007/978-3-030-78270-2_27

Publication: Proceedings of the Twenty-Second International Conference on Artificial Intelligence in Education
Page(s): 151-155


Funding Source: NSF
Funding Program: Advancing Informal STEM Learning (AISL)
Award Number: 1713545
Funding Amount: $1,951,956.00

Related URLs

Multimodal Visitor Analytics: Investigating Naturalistic Engagement with Interactive Tabletop Science Exhibits


Audience: Learning Researchers | Museum | ISE Professionals
Discipline: Climate | Ecology | forestry | agriculture
Resource Type: Conference Proceedings | Research
Environment Type: Games | Simulations | Interactives | Media and Technology | Museum and Science Center Exhibits

Linkedin   Youtube   Facebook   Instagram
Search: repository | repository and website pages | website pages
NSF logo

This material is supported by National Science Foundation award DRL-2229061, with previous support under DRL-1612739, DRL-1842633, DRL-1212803, and DRL-0638981. Any opinions, findings, conclusions, or recommendations contained within are those of the authors and do not necessarily reflect the views of NSF.

NSF AISL Project Meetings

Privacy Policy | Terms of Use | Contact Us