The regulatory standards of railway control software impose stringent certification requirements. These constraints, combined with the heterogeneity of the components, the interactive user interfaces, and the proprietary environments that characterize the development processes of this class of software, complicate the adoption of standard practices for continuous integration and continuous testing. This paper discusses our experience in supporting continuous on-commit certification testing of railway control software in an industrial setting. We describe the challenges that we addressed and the design decisions that we adopted accordingly. The result is a solution for continuous integration and continuous certification testing that decouples build, orchestration, and artifact management using isolated execution environments. It features a multi-runner model that enables efficient on-commit execution of hundreds of certification test sequences, supporting full automation of test sequences that require interactions with both the simulated environment and the driver. It aggregates the results from multiple, heterogeneous logging sources, facilitating regression testing, failure analysis, and certification reporting. Overall, our design enables continuous execution of large certification test suites while preserving reproducibility, traceability, and result analysis.

Maltagliati, J., De Simone, S., Denaro, G. (2026). Continuous On-Commit Certification Testing of Railway Control Software: An Experience Report. In ASE '26: Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering (pp.4456-4462) [10.1145/3832783.3834532].

Continuous On-Commit Certification Testing of Railway Control Software: An Experience Report

Maltagliati J.;Denaro G.
2026

Abstract

The regulatory standards of railway control software impose stringent certification requirements. These constraints, combined with the heterogeneity of the components, the interactive user interfaces, and the proprietary environments that characterize the development processes of this class of software, complicate the adoption of standard practices for continuous integration and continuous testing. This paper discusses our experience in supporting continuous on-commit certification testing of railway control software in an industrial setting. We describe the challenges that we addressed and the design decisions that we adopted accordingly. The result is a solution for continuous integration and continuous certification testing that decouples build, orchestration, and artifact management using isolated execution environments. It features a multi-runner model that enables efficient on-commit execution of hundreds of certification test sequences, supporting full automation of test sequences that require interactions with both the simulated environment and the driver. It aggregates the results from multiple, heterogeneous logging sources, facilitating regression testing, failure analysis, and certification reporting. Overall, our design enables continuous execution of large certification test suites while preserving reproducibility, traceability, and result analysis.
paper
continuous integration; parallel execution; railway control software; regression testing;
English
41st IEEE/ACM International Conference on Automated Software Engineering, ASE 2026 - 12 October 2026 - 16 October 2026
2026
ASE '26: Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering
9798400728822
2026
4456
4462
open
Maltagliati, J., De Simone, S., Denaro, G. (2026). Continuous On-Commit Certification Testing of Railway Control Software: An Experience Report. In ASE '26: Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering (pp.4456-4462) [10.1145/3832783.3834532].
File in questo prodotto:
File Dimensione Formato  
Maltagliati et al-2026-ACM International Conference on Automated Software Engineering, ASE-VoR.pdf

accesso aperto

Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Creative Commons
Dimensione 659.15 kB
Formato Adobe PDF
659.15 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/630361
Citazioni
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
Social impact