Implementation and Evaluation of Gesture-less Mid-Air Interactions on a Stereoscopic Display

Abstract: This report presents the work of a master thesis aimed at creating a modern stereoscopic mid-air interaction setup and developing and evaluating gesture-less mid-air interactions on said setup. A mid-air interaction system was created that combined OpenPose’s 2D hand joint detection with the depth data from an Intel depth camera to track a user’s hand position in three dimensions. Four mid-air interactions were developed, three gesture-less, and one gesture-based for comparison. One of the developed gesture-less interactions is capable of 6 Degrees-of- Freedom (DoF). A user study was conducted to test the three gesture-less interactions intuitiveness, the setup’s stereoscopic immersion, and also the task completion speed of the new gesture-less 6-DoF interaction.