The regulatory standards of railway control software impose stringent certification requirements. These constraints, combined with the heterogeneity of the components, the interactive user interfaces, and the proprietary environments that characterize the development processes of this class of software, complicate the adoption of standard practices for continuous integration and continuous testing. This paper discusses our experience in supporting continuous on-commit certification testing of railway control software in an industrial setting. We describe the challenges that we addressed and the design decisions that we adopted accordingly. The result is a solution for continuous integration and continuous certification testing that decouples build, orchestration, and artifact management using isolated execution environments. It features a multi-runner model that enables efficient on-commit execution of hundreds of certification test sequences, supporting full automation of test sequences that require interactions with both the simulated environment and the driver. It aggregates the results from multiple, heterogeneous logging sources, facilitating regression testing, failure analysis, and certification reporting. Overall, our design enables continuous execution of large certification test suites while preserving reproducibility, traceability, and result analysis.
Maltagliati, J., De Simone, S., Denaro, G. (2026). Continuous On-Commit Certification Testing of Railway Control Software: An Experience Report. In ASE '26: Proceedings of the 41st IEEE/ACM International Conference on Automated Software Engineering (pp.4456-4462) [10.1145/3832783.3834532].
Continuous On-Commit Certification Testing of Railway Control Software: An Experience Report
Maltagliati J.;Denaro G.
2026
Abstract
The regulatory standards of railway control software impose stringent certification requirements. These constraints, combined with the heterogeneity of the components, the interactive user interfaces, and the proprietary environments that characterize the development processes of this class of software, complicate the adoption of standard practices for continuous integration and continuous testing. This paper discusses our experience in supporting continuous on-commit certification testing of railway control software in an industrial setting. We describe the challenges that we addressed and the design decisions that we adopted accordingly. The result is a solution for continuous integration and continuous certification testing that decouples build, orchestration, and artifact management using isolated execution environments. It features a multi-runner model that enables efficient on-commit execution of hundreds of certification test sequences, supporting full automation of test sequences that require interactions with both the simulated environment and the driver. It aggregates the results from multiple, heterogeneous logging sources, facilitating regression testing, failure analysis, and certification reporting. Overall, our design enables continuous execution of large certification test suites while preserving reproducibility, traceability, and result analysis.| File | Dimensione | Formato | |
|---|---|---|---|
|
Maltagliati et al-2026-ACM International Conference on Automated Software Engineering, ASE-VoR.pdf
accesso aperto
Tipologia di allegato:
Publisher’s Version (Version of Record, VoR)
Licenza:
Creative Commons
Dimensione
659.15 kB
Formato
Adobe PDF
|
659.15 kB | Adobe PDF | Visualizza/Apri |
I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.


