24 July 2023 in ACM Transactions on Software Engineering and Methodology
Automated Driving Systems ( ADS ) have made great achievements in recent years thanks to the efforts from both academia and industry. A typical ADS is composed of multiple modules, including sensing, perception, planning, and control, which brings together the latest advances in different domains. Despite these achievements, safety assurance of ADS is of great significance, since unsafe behavior of ADS can bring catastrophic consequences. Testing has been recognized as an important system validation approach that aims to expose unsafe system behavior; however, in the context of ADS, it is extremely challenging to devise effective testing techniques, due to the high complexity and multidisciplinarity of the systems. There has been great much literature that focuses on the testing of ADS, and a number of surveys have also emerged to summarize the technical advances. Most of the surveys focus on the system-level testing performed within software simulators, and they thereby ignore the distinct features of different modules. In this article, we provide a comprehensive survey on the existing ADS testing literature, which takes into account both module-level and system-level testing. Specifically, we make the following contributions: (1) We survey the module-level testing techniques for ADS and highlight the technical differences affected by the features of different modules; (2) we also survey the system-level testing techniques, with focuses on the empirical studies that summarize the issues occurring in system development or deployment, the problems due to the collaborations between different modules, and the gap between ADS testing in simulators and the real world; and (3) we identify the challenges and opportunities in ADS testing, which pave the path to the future research in this field.
26 July 2022 in Information Processing & Management
23 January 2020 in IEEE Transactions on Software Engineering
A Cyber-Physical System (CPS) is a system which consists of software components and physical components. Traditional system verification techniques such as model checking or theorem proving are difficult to apply to CPS because the physical components have infinite number of states. To solve this problem, robustness guided falsification of CPS is introduced. Robustness measures how robustly the given specification is satisfied. Robustness guided falsification tries to minimize the robustness by changing inputs and parameters of the system. The input with a minimal robustness (counterexample) is a good candidate to violate the specification. Existing methods use several optimization techniques to minimize robustness. However, those methods do not use temporal structures in a system input and often require a large number of simulation runs to the minimize robustness. In this paper, we explore state-of-the-art Deep Reinforcement Learning (DRL) techniques, i.e., Asynchronous Advantage Actor-Critic (A3C) and Double Deep Q Network (DDQN), to reduce the number of simulation runs required to find such counterexamples. We theoretically show how robustness guided falsification of a safety property is formatted as a reinforcement learning problem. Then, we experimentally compare the effectiveness of our methods with three baseline methods, i.e., random sampling, cross entropy and simulated annealing, on three well known CPS systems. We thoroughly analyse the experiment results and identify two factors of CPS which make DRL based methods better than existing methods. The most important factor is the availability of the system internal dynamics to the reinforcement learning algorithm. The other factor is the existence of learnable structure in the counterexample.
1 July 2019 in Proceedings of the American Mathematical Society
We investigate the effect of frequency on the principal eigenvalue of a time-periodic parabolic operator with Dirichlet, Robin, or Neumann boundary conditions. The monotonicity and asymptotic behaviors of the principal eigenvalue with respect to the frequency parameter are established. Our results prove a conjecture raised by Hutson, Michaikow, and Poláčik.
1 February 2022 in Journal of Functional Analysis
20 April 2021 in Transactions of the American Mathematical Society
We investigate the effect of small diffusion on the principal eigenvalues of linear time-periodic parabolic operators with zero Neumann boundary conditions in one dimensional space. The asymptotic behaviors of the principal eigenvalues, as the diffusion coefficients tend to zero, are established for non-degenerate and degenerate spatial-temporally varying environments. A new finding is the dependence of these asymptotic behaviors on the periodic solutions of a specific ordinary differential equation induced by the drift. The proofs are based upon delicate constructions of super/sub-solutions and the applications of comparison principles.