Mediating Presence

Abstract: The new technologies of the Open Web Platform (OWP) are currently redefining what is possible in a browser application. Native support for 3D rendering, audio, video and real-time communication opens up a new world of possibilities for browser based videoconferencing. This project aims to combine these new web technologies with depth sensing 3D cameras to investigate some of these possibilities, such as achieving mediated gaze. To do so, a prototype videoconferencing system was developed. Aside from classic videoconferencing, it features online remote collaboration exercises, collaborative viewing and manipulation of 3D models, and a 3D motion parallax view of other users. To enable intuitive interaction with the system, it was outfitted with a depth sensor based touch interface.

Through user tests, it was shown that shared viewing and manipulation of 3D models is a useful addition to classic videoconferencing and can be used to convey information in ways not possible with shared images or video. The collaboration exercises showed that real-time voice communication and virtual representations of the user's actions were powerful tools for remote collaboration, while live video of the other person was less important. The motion parallax 3D view developed holds promise in the field of mediated gaze, but did not quite reach the goal due to technical limitations.