Sensory : Designing an Ai-Powered Interactive Artefact for Managing Sensory Overload Experiences

Abstract: This project aims to explore how interactive technological artefacts can support young adults with sensory overload in their experiences. It intends to investigate the potential of carefully designing technologies tailored to the user's sensory needs of managing and reflecting on the sensory experience, and understanding their patterns. The project adopted an iterative design process and applied several methods with an emphasis on designing meaningful user experiences. The project conducted user research with people experiencing sensory overload to understand the experiential aspects of trying to manage the negative experiences it entails. The final design consists of two prototypes. The first one was a Role Prototype created with Figma and took the form of a mHealth app powered by Artificial Intelligence for detecting patterns in the user’s data and documenting sensory experiences through journaling. The second one is an Implementation prototype in the form of a tangible electronic prototype created by using Arduino Nano BLE 33 Sense and sensors for recognising biometric data and environmental cues. Additionally, technological exploration was undertaken through sketching in hardware. This led to delving into how Machine Learning and gas sensors can be combined in order to create a scent-detecting sensor. The results suggest that the design concept provides the user with valuable tools to manage their overwhelming sensory experiences. Lastly, the results indicate that a sensory experience prediction component would be a valuable feature for people who need to manage sensory overload.