Towards Navigational Aids using Augmented Reality for People with Alzheimer’s Disease in Outdoor Environments : A user study using HoloLens 2 around a University campus

Abstract: This paper investigates the potential of augmented reality (AR) as a navigational aid for individuals with Alzheimer’s disease (AD), offering innovative solutions to the evolving challenges of AD care. As the disease progresses, patients often require more assistance and may transition to care centers, resulting in reduced independence. Prior to this, home-based care aims to stimulate cognitive functions and preserve autonomy. To enhance their freedom and mobility, it is proposed to leverage AR technology to create a first-person navigational aid addressing the unique needs of AD patients. The research confronts two primary challenges: firstly, exploring the design of AR navigational aids customized for individuals with Alzheimer’s disease adapted to outdoor use. Then, it aims to develop an outdoor localization system for the HoloLens 2 and evaluate its performance. Despite limitations induced by the approximate positioning, various types of aids compatible with the technical constraints faced have been envisioned. A set of features was implemented using the optical see-through AR headset HoloLens 2. These features included two distinct types of holograms (Arrow and Wind) and the ability to catch user attention prior to turns, allowing us to explore the effectiveness of these design choices. They were evaluated through a user study involving 15 healthy participants. Usability and task load were measured with Nasa-TLX and SUS questionnaires. An approximate positioning for outdoor use of the HoloLens 2 was elaborated using a smartphone as a GPS receiver, and a Kalman filter for filtering and fusion with IMU data. This enables to reach positioning accuracy at the meter level. This research demonstrates the promising utility of AR in assisting navigation in outdoor environments. Despite few significant results, the Arrow hologram appears to be a better fit for usability and users’ personal preferences. Further research is needed to get significant results on the impact of adaptive aids. The outdoor use of AR navigational aids is still limited by the poor visibility of holograms outdoors and low positioning accuracy.