Prototyping and Evaluation of a Lightweight Simulator Concept Combining Physical and Digital Assets

Abstract: Serious injuries often occur in high-risk environments such as warfare, urban combat, and traffic accidents. The medical proficiency of soldiers and first responders in these situations is paramount. However, traditional training practices frequently fall short, failing to replicate the stress of these environments accurately and involving substantial logistical efforts and personnel, leading to high costs and poor scalability. Meanwhile, virtual reality (VR) has shown promise as a cost-effective and immersive training tool in related areas. This thesis investigates the feasibility of a mixed reality (MR) training solution for combat casualty care, aiming to blend the immersive environments of VR with the tactile interaction of physical props. Through the development of a prototype, using Design Research Methodology, various challenges were identified, evaluated, and addressed. The MR training simulator demonstrated potential as a cost-effective alternative that offers a more realistic and immersive training experience. A software-based approach allows for standardization thanks to the replicability of training scenarios and the collection of user performance data. However, the seamless integration of physical assets proved challenging, primarily due to tracking inaccuracies and a lack of real-world visual feedback. Medical MR training research is still in its early stages, particularly regarding accurate tactile interaction with digital and physical objects. However, as demand for MR training solutions continues to grow, it’s expected that advancements in this field will follow.