The User Needs Of Agent-Based Modelling Experts : What Information Architecture reveals about ABM frameworks

Abstract: Present-day Agent Based Modelling is used to simulate complex systems in which agents are explicitly heterogeneous. Researchers within the field of ABM have a set of tools at their disposal, yet little is known about the usability and learnability of these systems. Information Architecture establishes a set of guidelines for constructing digital spaces that facilitate the fulfilment of the user’s goal; these guidelines are expressed as Principles of Information Architecture and categories of user behaviour. The purpose of this paper is to determine the needs of ABM researchers and explore how scientific software can be improved to better support them in their work. A System Usability Scale questionnaire quantifies the current level of usability on ABM frameworks while semi-structured interviews with six expert modellers provide data on user needs and user behaviour. The participants are allowed to review more than one ABM framework by means of questionnaires and a cognitive walkthrough that exposes GUI elements and other framework features linked to procedural steps of modelling. Information Architecture principles are exposed in each interface along with user behaviour categories. Albeit limited in its scope of participants, the survey with in-depth interviews provides valuable information on the needs of domain experts. Data is analysed both quantitatively and qualitatively; the paper follows, therefore, a mixed-method approach. It is proven that, at the present moment, most ABM frameworks fail to meet established standards for usability and learnability. User needs are exposed through an analysis of the data reported by experts. Finally, considerations are presented upon the impact of implementing Information Architecture guidelines within ABM frameworks.