Exploring eye-tracking and augmented reality interaction for Industry 4.0 : Study of eye-tracking and augmented reality for manipulation, training and teleassistance

Abstract: In this project, we explore eye-tracking enabled interaction in augmented reality for training, teleassistance and controlling Internet of Things devices in the forthcoming manufacturing industry. We performed a design exploration with industrial partners that ended up with the design and implementation of a series of prototypes using gaze for interaction. To explore the possible benefits, we compared their efficiency, effectiveness and user experience against counterparts not using gaze. Overall, we found that participants using the eye-tracking implementation scored better on a subjective user experience questionnaire regarding comfort, stress and perceived completion time. In training prototypes, participants performed faster and committed fewer errors, while in the teleassistance and the Internet of Things prototypes they performed similarly to mouse or touch. We hence argue that augmented reality and eye-tracking can improve the overall experience of users in the manufacturing industry or at least perform equally as well stablished user input devices with the benefit of freeing the user’s hands.