A Bayesian Fisher-EM algorithm for discriminative Gaussian subspace clustering - 3IA Côte d’Azur – Interdisciplinary Institute for Artificial Intelligence
Article Dans Une Revue Statistics and Computing Année : 2021

A Bayesian Fisher-EM algorithm for discriminative Gaussian subspace clustering

Résumé

High-dimensional data clustering has become and remains a challenging task for modern statistics and machine learning, with a wide range of applications. We consider in this work the powerful discriminative latent mixture model, and we extend it to the Bayesian framework. Modeling data as a mixture of Gaussians in a low-dimensional discriminative subspace, a Gaussian prior distribution is introduced over the latent group means and a family of twelve submodels are derived considering different covariance structures. Model inference is done with a variational EM algorithm, while the discriminative subspace is estimated via a Fisher-step maximizing an unsupervised Fisher criterion. An empirical Bayes procedure is proposed for the estimation of the prior hyper-parameters, and an integrated classification likelihood criterion is derived for selecting both the number of clusters and the submodel. The performances of the resulting Bayesian Fisher-EM algorithm are investigated in two thorough simulated scenarios, regarding both dimensionality as well as noise and assessing its superiority with respect to state-of-the-art Gaussian subspace clustering models. In addition to standard real data benchmarks, an application to single image denoising is proposed, displaying relevant results. This work comes with a reference implementation for the R software in the FisherEM package accompanying the paper.
Fichier principal
Vignette du fichier
2012.04620v1.pdf (2.7 Mo) Télécharger le fichier
Origine Fichiers éditeurs autorisés sur une archive ouverte

Dates et versions

hal-03047930 , version 1 (25-09-2024)

Identifiants

Citer

Nicolas Jouvin, Charles Bouveyron, Pierre Latouche. A Bayesian Fisher-EM algorithm for discriminative Gaussian subspace clustering. Statistics and Computing, 2021, 31, ⟨10.1007/s11222-021-10018-6⟩. ⟨hal-03047930⟩
369 Consultations
0 Téléchargements

Altmetric

Partager

More