Synthetic tabular data are increasingly used for augmentation and privacyoriented data access, but their value for probabilistic risk prediction cannot be inferred from distributional resemblance or discrimination alone. We evaluated a calibration-aware conditional synthetic augmentation framework for miscarriage-risk prediction from repeatedly collected mobile and healthcaresensor records. A conditional Wasserstein generative adversarial network with gradient penalty was conditioned on the binary outcome and prespecified age and body-mass-index strata. Its objective combined adversarial learning with moment matching, correlation preservation, raw-domain feasibility, and label-consistency penalties. Generative and predictive hyperparameters were selected on a dedicated tuning partition using constrained Bayesian optimization and then locked for 20 repeated held-out evaluations. In each repetition, elastic-net logistic models were fitted to real records alone or to real plus 4,000 synthetic records. Recalibration was estimated only from a separate real-data calibration partition, and all metrics were evaluated on held-out real records. Synthetic augmentation did not change discrimination: mean AUC was 0.641 for both training strategies, with a paired difference of 0.000 (0.000, 0.000). It produced small improvements in Brier score (-0.001), log loss (-0.002), absolute calibration-slope error (-0.248), and 10-bin equal-width ECE (-0.071). Tie-preserving 10-bin ACE decreased by -0.007, but its resampling interval included zero (-0.016 to 0.002; adjusted Wilcoxon p = 0.751). Differences largely disappeared after Platt or temperature calibration. No Bayesian-optimization candidate satisfied all feasibility constraints; mean classifier two-sample-test AUC was 0.612, mean pre-projection domain-violation rate was 87.5%, and the nearest-neighbour memorization proxy was 0.022%. Conditional augmentation therefore acted as a modest regularizer for the uncalibrated predictor, but it neither improved ranking nor yielded a generator that naturally respected the prespecified feature domain. Because the data comprise repeated records and were split at record level, the findings are methodological and do not establish clinical deployment readiness.

Saba, S., Saeed, M., Candelieri, A. (2026). Calibration-Aware Conditional Synthetic Augmentation under Explicit Feasibility Constraints: Repeated Validation on Mobile and Sensor Miscarriage-Risk Records [Altro] [10.2139/ssrn.7309178].

Calibration-Aware Conditional Synthetic Augmentation under Explicit Feasibility Constraints: Repeated Validation on Mobile and Sensor Miscarriage-Risk Records

Saba, Sadia
Co-primo
;
Saeed, Muhammad Amir
Secondo
;
Candelieri, Antonio
Ultimo
2026

Abstract

Synthetic tabular data are increasingly used for augmentation and privacyoriented data access, but their value for probabilistic risk prediction cannot be inferred from distributional resemblance or discrimination alone. We evaluated a calibration-aware conditional synthetic augmentation framework for miscarriage-risk prediction from repeatedly collected mobile and healthcaresensor records. A conditional Wasserstein generative adversarial network with gradient penalty was conditioned on the binary outcome and prespecified age and body-mass-index strata. Its objective combined adversarial learning with moment matching, correlation preservation, raw-domain feasibility, and label-consistency penalties. Generative and predictive hyperparameters were selected on a dedicated tuning partition using constrained Bayesian optimization and then locked for 20 repeated held-out evaluations. In each repetition, elastic-net logistic models were fitted to real records alone or to real plus 4,000 synthetic records. Recalibration was estimated only from a separate real-data calibration partition, and all metrics were evaluated on held-out real records. Synthetic augmentation did not change discrimination: mean AUC was 0.641 for both training strategies, with a paired difference of 0.000 (0.000, 0.000). It produced small improvements in Brier score (-0.001), log loss (-0.002), absolute calibration-slope error (-0.248), and 10-bin equal-width ECE (-0.071). Tie-preserving 10-bin ACE decreased by -0.007, but its resampling interval included zero (-0.016 to 0.002; adjusted Wilcoxon p = 0.751). Differences largely disappeared after Platt or temperature calibration. No Bayesian-optimization candidate satisfied all feasibility constraints; mean classifier two-sample-test AUC was 0.612, mean pre-projection domain-violation rate was 87.5%, and the nearest-neighbour memorization proxy was 0.022%. Conditional augmentation therefore acted as a modest regularizer for the uncalibrated predictor, but it neither improved ranking nor yielded a generator that naturally respected the prespecified feature domain. Because the data comprise repeated records and were split at record level, the findings are methodological and do not establish clinical deployment readiness.
Altro
Preprint
Synthetic Tabular Data, Probability Calibration, Conditional WGAN-GP, Constrained Bayesian Optimization, Mobile Sensing, Repeated Validation
English
19-ago-2026
2026
https://papers.ssrn.com/sol3/papers.cfm?abstract_id=7309178
Saba, S., Saeed, M., Candelieri, A. (2026). Calibration-Aware Conditional Synthetic Augmentation under Explicit Feasibility Constraints: Repeated Validation on Mobile and Sensor Miscarriage-Risk Records [Altro] [10.2139/ssrn.7309178].
open
File in questo prodotto:
File Dimensione Formato  
Saba et al-2026-SSRN-Preprint.pdf

accesso aperto

Descrizione: Preprint of Paper
Tipologia di allegato: Submitted Version (Pre-print)
Licenza: Altro
Dimensione 886.17 kB
Formato Adobe PDF
886.17 kB Adobe PDF Visualizza/Apri

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/10281/621862
Citazioni
  • Scopus ND
  • ???jsp.display-item.citation.isi??? ND
Social impact