About the competition

The Cyber-Physical Systems (CPS) testing tool competition focuses on self-driving cars simulation environments, held as part of the SBFT workshop. Participants are challenged to design a test generator that crafts tests leading to failures. For the competition, a test consists of virtual roads intended for lane keeping assistance (LKA) functionality. The objective is to create roads that cause the LKA system to deviate from its lane boundaries. The competing tools are evaluated in terms of coverage, i.e. how many failed tests the tool generates, and how diverse these tests are. The competition gives researchers the opportunity to advance, present, compare and discuss their work.

A driving task for lane keeping assist systems (left); test simulation in BeamNG.tech (right), as published here.

The competition website and the infrastructure of the CPS tool competition can be found here.

BeamNG.tech role

BeamNG is based on soft-body physics simulation, where vehicles are modelled as a set of nodes and beams. Beams enable the simulation of bodies’ deformation, while triangles enable the simulation of aerodynamic’ drag, lift and detecting collisions. This approach allows to model the kinematic properties of vehicles in a bottom-up way, since the overall dynamics of an object are dictated by the state of its individual components. For example vehicle behavior displays more realistic suspension, load distribution etc.

BeamNG also has a Python API that lets the users adress scenarios to the simulation. BeamNGpy comes with a wide range of low-level functions to interact with the simulation and a few higher-level interfaces that make more complex actions easier.

BeamNG is committed to support the CPS and SBFT tool competition :

  • BeamNG.tech allows to procedurally generate roads.
  • The generated roads in the competitions are evaluated in BeamNG.tech simulation.
  • Then the AI mode of BeamNG is used as LKA testing along with DAVE-2.
  • BeamNG provides academic licenses.

Publications

The interested reader can access the proceedings of the competitions here on 2023, on 2022, on 2021.