This paper introduces a novel framework for Distributionally Robust Bayesian Optimization (DRBO) with continuous context that integrates optimal transport theory and entropic regularization. We propose the sampling from the Wasserstein Barycenter Bayesian Optimization (SWBBO) method to deal with uncertainty about the context; that is, the unknown stochastic component affecting the observations of the black-box objective function. This approach captures the geometric structure of the underlying distributional uncertainty and enables robust acquisition strategies without incurring excessive computational costs. The method incorporates adaptive robustness scheduling, Lipschitz regularization, and efficient barycenter construction to balance exploration and exploitation. Theoretical analysis establishes convergence guarantees for the robust Bayesian Optimization acquisition function. Empirical evaluations on standard global optimization problems and real-life inspired benchmarks demonstrate that SWBBO consistently achieves faster convergence, good final regret, and greater stability than other recently proposed methods for DRBO with continuous context. Indeed, SWBBO outperforms all of them in terms of both optimization performance and robustness under repeated evaluations.

Seyedi, I., Candelieri, A., Archetti, F. (2025). Distributionally Robust Bayesian Optimization via Sinkhorn-Based Wasserstein Barycenter. MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 7(3) [10.3390/make7030090].

Distributionally Robust Bayesian Optimization via Sinkhorn-Based Wasserstein Barycenter

Seyedi I.
Primo
;
Candelieri A.
Secondo
;
Archetti F.
Ultimo
2025

Abstract

This paper introduces a novel framework for Distributionally Robust Bayesian Optimization (DRBO) with continuous context that integrates optimal transport theory and entropic regularization. We propose the sampling from the Wasserstein Barycenter Bayesian Optimization (SWBBO) method to deal with uncertainty about the context; that is, the unknown stochastic component affecting the observations of the black-box objective function. This approach captures the geometric structure of the underlying distributional uncertainty and enables robust acquisition strategies without incurring excessive computational costs. The method incorporates adaptive robustness scheduling, Lipschitz regularization, and efficient barycenter construction to balance exploration and exploitation. Theoretical analysis establishes convergence guarantees for the robust Bayesian Optimization acquisition function. Empirical evaluations on standard global optimization problems and real-life inspired benchmarks demonstrate that SWBBO consistently achieves faster convergence, good final regret, and greater stability than other recently proposed methods for DRBO with continuous context. Indeed, SWBBO outperforms all of them in terms of both optimization performance and robustness under repeated evaluations.
Articolo in rivista - Articolo scientifico
Distributionally Robust Bayesian Optimization; Sinkhorn-regularized Wasserstein distance; Wasserstein Barycenter;
English
28-ago-2025
2025
7
3
90
open
Seyedi, I., Candelieri, A., Archetti, F. (2025). Distributionally Robust Bayesian Optimization via Sinkhorn-Based Wasserstein Barycenter. MACHINE LEARNING AND KNOWLEDGE EXTRACTION, 7(3) [10.3390/make7030090].
File in questo prodotto:
File Dimensione Formato  
Seyedi et al-2025-Machine Learning and Knowledge Extraction-VoR.pdf

accesso aperto

Descrizione: This article is an open access article distributed under the terms and conditions of the Creative Commons Attribution (CC BY) license (https://creativecommons.org/licenses/by/4.0/).
Tipologia di allegato: Publisher’s Version (Version of Record, VoR)
Licenza: Creative Commons
Dimensione 4.35 MB
Formato Adobe PDF
4.35 MB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/576174
Citazioni
  • Scopus 0
  • ???jsp.display-item.citation.isi??? 0
Social impact