Subjective Evaluation of Marker-Based and Marker-Less AR for an Exhibition of a Digitally Recreated Swedish Warship

Abstract: Background: In recent years, research in the field of Augmented Reality (AR) in cultural heritage has been rapidly expanding, due to the advancement of technology and availability of cheaper “off the shelf” hardware. It is, amongst other things, being used as a means to increase availability and regain the public’s interest in cultural heritage.Objectives: This study compares marker-based and marker-less AR in perceived usability and perceived performance through a user study. Methods: With the use of the software Unity3D and Vuforia, two AR applications were implemented. Both applications display a model of an 18th-century Swedish warship, based on a wooden ship model, each using one of the two AR methods. The digital model was remade in Autodesk Maya, to suit the needs of an AR application used on mobile devices. The applications were evaluated in a user study with 14 participants. Each participant was asked to perform a simple task of walking around the displayed ship and then answering a questionnaire on usability. This process was done for both applications, followed by a post-experiment questionnaire on perceived performance where the two methods were compared. Results: The result of the study showed that both applications were perceived as usable and well performing. The result of the usability questionnaire showed that the applications were considered usable, with an average of 90.5 points for marker-based AR and 86.8 points for marker-less AR on a 0-100 point scale. Regarding performance, the marker-based method was perceived as better performing. Conclusions: The participants felt that with just a few instructions, the applications were easy to use, even though 50% of them had no previous experience in using AR, that it could enhance a museum exhibition. Possible further development of the app would be to complete the ship-model by adding more details that are currently missing.