An industrial experience report on applying search-based boundary input generation to cyber-physical systems

Abstract

Testing Cyber Physical Systems (CPS) is crucial, as they play a central role in modern society. In the complex input space of these systems, boundary test inputs provide a valuable asset for test engineers as they identify slight input modifications that dramatically impact Quality of Service. In this experience paper, we propose LiftJanus, the first search-based test generator for CPS that integrates test input minimization, boundary value detection, and automated system repair. We performed an empirical study involving two real-world elevator systems provided by our industrial collaborator, Orona. Our results proved that LiftJanus generated boundary inputs twice as effective as the baselines, with the repair algorithm successfully enhancing the system’s configuration in 76.25% of the cases. Interviews with domain experts confirmed that LiftJanus is a comprehensive solution for enhancing the quality of elevator systems.