CMSA Interdisciplinary Science Seminar: Predicting Visual Search Task Success from Eye Gaze Data for User-Adaptive Information Visualization Systems
Ying Hsang Liu & Moritz Spiller - University of Southern Denmark & Otto von Guericke University Magdeburg
Information visualizations are an efficient means to support the users in understanding large amounts of complex, interconnected data; user comprehension. Previous research suggests that user-adaptive information visualizations positively impact the users’ performance in visualization tasks. This study aims to develop a computational model to predict the users’ success in visual search tasks from eye gaze data and thereby drive such user-adaptive systems. State-of-the-art deep learning models for time series classification have been trained on sequential eye gaze data obtained from 40 study participants’ interaction with a circular and an organizational graph. The results suggest that such models yield higher accuracy than a baseline classifier and previously used models for this purpose. In particular, a Multivariate Long Short Term Memory Fully Convolutional Network (MLSTM-FCN) shows encouraging performance for its use in on-line user-adaptive systems. Given this finding, such a computational model can infer the users’ need for support during interaction with a graph and trigger appropriate interventions in user-adaptive information visualization systems.