Deterministic Approximate EM Algorithm; Application to the Riemann Approximation EM and the Tempered EM - Université de Rennes Accéder directement au contenu
Pré-Publication, Document De Travail Année : 2020

Deterministic Approximate EM Algorithm; Application to the Riemann Approximation EM and the Tempered EM

Résumé

The Expectation Maximisation (EM) algorithm is widely used to optimise non-convex likelihood functions with hidden variables. Many authors modified its simple design to fit more specific situations. For instance the Expectation (E) step has been replaced by Monte Carlo (MC) approximations, Markov Chain Monte Carlo approximations, tempered approximations... Most of the well studied approximations belong to the stochastic class. By comparison, the literature is lacking when it comes to deterministic approximations. In this paper, we introduce a theoretical framework, with state of the art convergence guarantees, for any deterministic approximation of the E step. We analyse theoretically and empirically several approximations that fit into this framework. First, for cases with intractable E steps, we introduce a deterministic alternative to the MC-EM, using Riemann sums. This method is easy to implement and does not require the tuning of hyper-parameters. Then, we consider the tempered approximation, borrowed from the Simulated Annealing optimisation technique and meant to improve the EM solution. We prove that the the tempered EM verifies the convergence guarantees for a wide range of temperature profiles. We showcase empirically how it is able to escape adversarial initialisations. Finally, we combine the Riemann and tempered approximations to accomplish both their purposes.
Fichier principal
Vignette du fichier
main.pdf (742.41 Ko) Télécharger le fichier
DAEM_supplements.pdf (2.4 Mo) Télécharger le fichier
Origine : Fichiers produits par l'(les) auteur(s)

Dates et versions

hal-02513593 , version 1 (20-03-2020)
hal-02513593 , version 2 (18-12-2020)
hal-02513593 , version 3 (03-02-2022)
hal-02513593 , version 4 (02-05-2022)

Identifiants

Citer

Thomas Lartigue, Stanley Durrleman, Stéphanie Allassonnière. Deterministic Approximate EM Algorithm; Application to the Riemann Approximation EM and the Tempered EM. 2020. ⟨hal-02513593v1⟩
352 Consultations
614 Téléchargements

Altmetric

Partager

Gmail Facebook X LinkedIn More