Automating the Evaluation Process of Software Testing in Vehicles

Abstract: The Safe Driving Test (SDT) is a software test performed in a real vehicle where the software is flashed to an ECU and connected to the CAN network in the vehicle. The test driver then conducts different driving scenarios according to the test instructions of the SDT. All the data during testing is logged and then evaluated manually by a test engineer. The entire process including testing, evaluating and fixing defects is very time-consuming and ineffective, especially the evaluation. Therefore the possibility of automating the evaluation process in Safe Driving Tests was explored in this master thesis. The result of this work was a program containing an automatic evaluation process for the test cases in the Safe Driving Test. The program takes log files of the test cases as input and generates a report containing evaluations of each test case as output. This program can be integrated into different projects at BorgWarner. The conclusion of this work is that it is definitely possible to automate the evaluation process and an automatic evaluation process will save time. However the test results must still be verified manually by a test engineer since the evaluation can only provide a pass or fail result and not the cause of the failed results.