What's on in Computing Science?

Date: Wednesday, 12 May, 2010
Time: 11:00
Location: Sir Alwyn Williams Building, 422 Seminar Room
[ Inference Seminar ] Natural Conjugate Gradient Learning for Fixed-Form Variational Bayes
Antti Honkela - Aalto University School of Science and Technology
Variational Bayesian (VB) methods are typically only applied to models in the conjugate-exponential family using the variational Bayesian expectation maximisation (VB EM) algorithm or one of its variants. Here I present an efficient algorithm for applying VB to more general models. The method is based on specifying the functional form of the approximation, such as multivariate Gaussian. The parameters of the approximation are optimised using a natural conjugate gradient algorithm that utilises the Riemannian geometry of the space of the approximations. This leads to a very efficient algorithm for suitably structured approximations. It is shown empirically that the proposed method is comparable or superior in efficiency to the VB EM in a case where both are applicable. The algorithm is also applied to learning a nonlinear state-space model and a nonlinear factor analysis model for which the VB EM is not applicable. For these models, the proposed algorithm outperforms alternative gradient-based methods by a significant margin. This is joint work with Tapani Raiko, Mikael Kuusela, Matti Tornio and Juha Karhunen.

Contact: Dr Rónán Daly (rdaly@dcs.gla.ac.uk)

Add to my calendar