Collaborative virtual instrument design : Exploring resonance, agency and affordance through a cooperative virtual instrument

Abstract: In this paper, through the process of designing and building a collaborative virtual musical instrument I explore users' sense of resonance and agency in relation to technology. With technology’s constant acceleration leaving many feeling alienated, this paper attempts to investigate technology’s potential for creating more meaningful resonant relationships. I explored how co-operation and a sense of agency could be encouraged within a virtual musical instrument, how the interplay between the auditory and visual aspects of the instrument influenced users’ creativity, cooperation, and sense of agency, and used Hartmut Rosa’s theory on resonance as a tool to explore relationships within creativity and cooperation. Through a series of workshops, I tested prototypes of the virtual instrument controlled using midi interfaces, built using Unreal Engine and designed to require multiple users to operate. The instrument aim was to promote collaboration, have strong audio-visual congruence and to be intuitive to use while still allowing for more complex levels of expression. Through this process I gained valuable insight into the role of agency within successful creative collaboration, the complex interplay between the auditory and visual modes, the importance of mindset within collaboration and technology’s potential for encouraging resonance.