ITG - Tangible Geometry for the Visually Impaired : Exploring the potential of extending tablet functionality with appcessories

Abstract: This thesis explores how an Android application that is used in combination with tangible appcessories is capable of facilitating a learning experience for visually impaired students within the specific domain of geometry. This study’s approach illustrates how using an application in combination with a physical appcessory can provide information concerning geometry to the visually impaired. An application, called Invisible Tangible Geometry (ITG), was programmed using Android in conjunction with a 3D printed model. This thesis describes the application, the physical appcessory, as well as early stage user studies. The application enables visually impaired users to explore simple geometric forms displayed on a tablet through sound and vibrotactile feedback. A physical appcessory, that can be manipulated to adopt several forms and is dynamic, is used in addition. Its shape is sensed by the tablet adds an additional tactile layer to the application and experience. Within the thesis a methodological framework, as well as a user-centered design approach was applied. An expert interview and three user engagements with visually impaired individuals serve as early validations of the project and ideas and provide feedback that directs design and development of future work. Current avenues for the future work will include additional interaction modes in the application. For example, the ability to digitize real world forms, and improving the robustness of the tangible appcessory. The plan, for future development, is to establish an autonomous functioning application that enables the visually impaired to be able to explore, participate and interact with geometry smoothly and without the need of aid from others. The correlation of application and appcessory will allow for anything between a quick glance, through feeling the model, and gaining detailed information, by using the application. The application enhances provided information through the use of a model and enriched digital feedback.