Hyperparameter Optimization of Sparse Bayesian Learning based on Stein's Unbiased Risk Estimator - EURECOM Access content directly
Conference Papers Year : 2024

Hyperparameter Optimization of Sparse Bayesian Learning based on Stein's Unbiased Risk Estimator

Fangqing Xiao
  • Function : Author
  • PersonId : 1349123
Dirk Slock

Abstract

Sparse Bayesian Learning (SBL) stands as a widely utilized compressed sensing technique wherein the sparsityinducing prior for the unknowns within the underdetermined linear system is characterized by a Gaussian scale mixture. This formulation results in several hyperparameters, which encompass the variance profile, noise variance, and potentially other parameters within the variance profile priors. Traditionally, these hyperparameters are determined via Type I or Type II Maximum Likelihood (ML) estimation methods. In this paper, we introduce SURE SBL, wherein the optimization of hyperparameters (as opposed to mere estimation) relies on Stein’s Unbiased Risk Estimator (SURE). Notably, the primary performance criterion typically centers on the Mean Squared Error (MSE) of the sparse parameters or the resultant signal model. We conduct a review of the SURE approach. Subsequently, we apply the SURE approach to assess the MSE of the sparse parameters (the input to the linear model) and observe that it produces identical hyperparameter optimization outcomes as those obtained via Type II ML. Furthermore, we propose extending the SURE approach to the output level of the linear model. Remarkably, in the context of the large system limit, this extension yields equivalent hyperparameter optimization outcomes concerning the input to the linear model; however, when measurement noise is present, the results obtained by the two kinds of SURE optimizers diverge from those obtained through MSE optimization.
Fichier principal
Vignette du fichier
publi-7694.pdf (276.61 Ko) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-04575273 , version 1 (21-05-2024)

Identifiers

  • HAL Id : hal-04575273 , version 1

Cite

Fangqing Xiao, Dirk Slock. Hyperparameter Optimization of Sparse Bayesian Learning based on Stein's Unbiased Risk Estimator. ISIT 2024, Learn to Compress, Workshop at the International Symposium on Information Theory, Jul 2024, Athens, Greece. ⟨hal-04575273⟩

Collections

EURECOM ANR
8 View
6 Download

Share

Gmail Mastodon Facebook X LinkedIn More