Software Evolvability Measurement Framework during an Open Source Software Evolution

Abstract: Context： Software evolution comes with the increasing growth of software applications both in size and complexity. Unlike the software maintenance, software evolution addresses more on the adaption of the new fast-changing requirements. Then the term of “software evolvability” comes with its importance for evaluating the evolution status of the software. However, it is not clearly identified especially in the context of open source software (OSS). Besides the most studies are about the description of software evolvability as a quality attribute, and very few research have done on the measurement of software evolvability during the software evolution process. Objectives： In this study we perform an in-depth investigation on identification of the OSS evolvability, and figure out the appropriate metrics used for measuring the OSS evolvability. Based on that we finally proposed the open source software evolvability measurement framework (OSEM) which could be used for measuring the software evolvability generally in an OSS context. Methods： At first, we conducted a literature review by combining backward snowballing search with systematic database search. Two research questions which are RQ1 and RQ2 are proposed for helping us to retrieve the key information for building the needed framework. Then we performed a case study on VLC media player (an OSS project) to validate the processes of the proposed framework. Results： Based on literature we could explicitly identify the OSS evolvability, and figure out the differences of software evolvability addressed in OSS context and non OSS context (e.g, the traceability refers to documentation in non OSS context, however in OSS context it refers to the release version of OSS project). Besides we also fulfill the evolvability measuring method by addressing the process of prioritization of evolvability sub-characteristics. In the end we implement the OSEM framework on VLC media player and get the well documented results which are clearly presented and easy to understand. Such results could be taken by the VLC developers as an input for the design and development of the VLC. Conclusions: We conclude that the open source software measurement framework (OSEM) is applicable, based on the time we spent on the case of VLC media player it is quite fast and efficient to use such framework. The results from the conduction of this framework are documented well and very clear for OSS users/developers to follow.