Augmented reality with holograms for combat management systems : Performance limitations for sonar tracks in a 3D map, presented with Microsoft HoloLens

Abstract: Technical advancements in 3D projection has recently made presentation of holographic images possible by using self-contained devices. Instead of using a screen to present objects, glasses like Microsoft HoloLens can render objects that appear as holograms around the user. SAAB Defence and Security are evaluating if this new technology can complement their command and control system 9LV Combat Management System. This degree project is a study of the technical possibilities and limitations of introducing holographic display of sonar tracks used for detecting submarines or sea mines. The project was started with a background study into what methods are available to render 3D underwater terrain. A basic hologram representing a map of littoral terrain was constructed and simulated sonar tracks from the command and control system was mapped into the terrain. Implementation of the application was done using the Unity 3D game engine that has built in support for the HoloLens. Performance evaluation was done using Unity3D profiler that is an extensive application evaluation tool that maintain overhead to a minimum. An evaluation of HoloLens usage onboard two different boats was done to conclude if the equipment can be used in the normal 9LV CMS operating environment. Results show that it is possible to successfully use holographic display for sonar tracks, but due to limited processing power of the HoloLens terrain detail will be reduced. Holograms are orientated by combining camera spatial mapping and an inertial measurement unit. Usage tests onboard a vessel indicates that holograms will unexpectedly move and the HoloLens will loose spatial mapping due to acceleration forces caused by seastate.