Posterior Sampling using Particle Swarm Optimizers and Model Reduction Techniques

Posterior Sampling using Particle Swarm Optimizers and Model Reduction Techniques

J. L. Fernández Martínez, E. García Gonzalo, Z. Fernández Muñiz, G. Mariethoz, T. Mukerji
Copyright: © 2012 |Pages: 23
DOI: 10.4018/978-1-4666-1749-0.ch010
OnDemand:
(Individual Chapters)
Available
$37.50
Current Special Offers
No Current Special Offers
TOTAL SAVINGS: $37.50

Abstract

Inverse problems are ill-posed and posterior sampling is a way of providing an estimate of the uncertainty based on a finite set of the family of models that fit the observed data within the same tolerance. Monte Carlo methods are used for this purpose but are highly inefficient. Global optimization methods address the inverse problem as a sampling problem, particularly Particle Swarm, which is a very interesting algorithm that is typically used in an exploitative form. Although PSO has not been designed originally to perform importance sampling, the authors show practical applications in the domain of environmental geophysics, where it provides a proxy for the posterior distribution when it is used in its explorative form. Finally, this paper presents a hydrogeological example how to perform a similar task for inverse problems in high dimensional spaces through the combined use with model reduction techniques.
Chapter Preview
Top

Particle Swarm Optimization (Pso) Applied To Inverse Problems

Particle swarm optimization is a stochastic evolutionary computation technique inspired by the social behavior of individuals (called particles) in nature, such as bird flocking and fish schooling (Kennedy & Eberhart, 1995).

Let us consider an inverse problem of the form 978-1-4666-1749-0.ch010.m01, where 978-1-4666-1749-0.ch010.m02 are the model parameters, 978-1-4666-1749-0.ch010.m03 the discrete observed data, and

978-1-4666-1749-0.ch010.m04
is the vector field representing the forward operator and 978-1-4666-1749-0.ch010.m05 is the scalar field that accounts for the j-th data. Inverse problems are very important in science and technology and sometimes referred to as, parameter identification, reverse modeling, etc. The “classical” goal of inversion given a particular data set (often affected by noise), is to find a unique set of parameters m, such the data prediction error 978-1-4666-1749-0.ch010.m06 in a certain norm p, is minimized.

The PSO algorithm to approach this inverse problem is at first glance very easy to understand and implement:

  • 1.

    A prismatic space of admissible models, M, is defined:

    978-1-4666-1749-0.ch010.m07

where 978-1-4666-1749-0.ch010.m08 are the lower and upper limits for the j-th coordinate of each particle in the swarm, n is the number of parameters in the optimization problem and 978-1-4666-1749-0.ch010.m09 is the swarm size.

  • 2.

    The misfit for each particle of the swarm is calculated, 978-1-4666-1749-0.ch010.m10 and for each particle its local best position found so far (called 978-1-4666-1749-0.ch010.m11) is determined as well as the minimum of all of them, called the global best (978-1-4666-1749-0.ch010.m12).

  • 3.

    The algorithm updates at each iteration the positions 978-1-4666-1749-0.ch010.m13 and velocities 978-1-4666-1749-0.ch010.m14 of each model in the swarm. The velocity of each particle i at each iteration k is a function of three major components:

    • a.

      The inertia term, which consists of the old velocity of the particle, 978-1-4666-1749-0.ch010.m15 weighted by a real constant, 978-1-4666-1749-0.ch010.m16, called inertia.

    • b.

      The social learning term, which is the difference between the global best position found so far (called 978-1-4666-1749-0.ch010.m17) and the particle's current position (978-1-4666-1749-0.ch010.m18).

    • c.

      The cognitive learning term, which is the difference between the particle's best position (called 978-1-4666-1749-0.ch010.m19) and the particle's current position (978-1-4666-1749-0.ch010.m20):

      978-1-4666-1749-0.ch010.m21

Complete Chapter List

Search this Book:
Reset