Speaker: Professor Christophe Andrieu (University of Bristol)
Date: 19th Jul 2024
Title: Monte Carlo sampling with integrator snippets
Event: (DMLW01) International workshop on diffusions in machine learning: foundations, generative models, and optimisation
Abstract: Assume interest is in sampling from a probability distribution μ defined on (Z,Z). We develop a framework to construct sampling algorithms taking full advantage of numerical integrators of ODEs, say ψ : Z→ Z for one integration step, to explore μ efficiently and robustly. The popular Hybrid/Hamiltonian Monte Carlo (HMC) algorithm [duane1987hybrid, neal2011mcmc] and its derivatives are example of such a use of numerical integrators. However, we show how the potential of integrators can be exploited beyond current ideas and HMC sampling in order to take into account aspects of the geometry of the target distribution. A key idea is the notion of integrator snippet, a fragment of the orbit of an ODE numerical integrator ψ , and its associate probability distribution μ ‾, which takes the form of a mixture of distributions derived from μ and ψ . Exploiting properties of mixtures we show how samples from μ ‾ can be used to estimate expectations with respect to μ . We focus here primarily on Sequential Monte Carlo (SMC) algorithms, but the approach can be used in the context of Markov chain Monte Carlo algorithms as discussed at the end of the manuscript. We illustrate performance of these new algorithms through numerical experimentation and provide preliminary theoretical results supporting observed performance.
👉 Want to learn more about the talks in this stream?
🔗| Seminar Link: www.newton.ac....
🔗| Workshop Link: www.newton.ac....
-------------------
FOLLOW US
🌐| Website: www.newton.ac.uk
🎥| Main Channel: / @isaacnewtoninstitute
🐦| Twitter: / newtoninstitute
💬| Facebook: / newton.institute
📷| Instagram: / isaacnewtoninstitute
🔗| LinkedIn: / isaac-newton-institute...
SEMINAR ROOMS
🥇| INI Seminar Room 1: / @iniseminarroom1
🥈| INI Seminar Room 2: / @iniseminarroom2
🛰️| INI Satellite Events: / @inisatellite
ABOUT
The Isaac Newton Institute is a national and international visitor research institute. It runs research programmes on selected themes in mathematics and the mathematical sciences with applications over a wide range of science and technology. It attracts leading mathematical scientists from the UK and overseas to interact in research over an extended period.
👉 Learn more about us and our events here: www.newton.ac.uk
Негізгі бет Prof. Christophe Andrieu | Monte Carlo sampling with integrator snippets
Пікірлер