Introducing Voice Control in a Graphical User Interface Using a Keyword-Based Approach

Abstract: Speech interaction is a growing field within human-computer interaction. The introduction of several voice-user interfaces on the market has raised the question of whether voice control could be a suitable feature for a video management system. This thesis investigated how voice control could be designed and integrated with a graphical interface in order to add value to the user experience. User research showed that the most common workflows included navigating the system as well as reviewing and exporting footage. Hence, these workflows were prioritized. The design of the voice control solution was developed with an agile approach, where implementation was alternated with testing and evaluation. The final solution was keyword-based, and allowed for a seamless integration between manual interaction and voice commands. This was complemented with graphical support to meet the challenges regarding the invisible nature of voice interaction. As a result, the user was able to perform the most common workflows by voice independently.