Posterior Sampling using Particle Swarm Optimizers and Model Reduction Techniques: Computer Science & IT Book Chapter | IGI Global

×

Receive a 20% Discount on All Purchases Directly Through IGI Global's Online Bookstore.
Additionally, libraries can receive an extra 5% discount. Learn More

Subscribe to the latest research through IGI Global's new InfoSci-OnDemand Plus

InfoSci®-OnDemand Plus, a subscription-based service, provides researchers the ability to access full-text content from over 100,000 peer-reviewed book chapters and 26,000+ scholarly journal articles covering 11 core subjects. Users can select articles or chapters that meet their interests and gain access to the full content permanently in their personal online InfoSci-OnDemand Plus library.

Purchase the Encyclopedia of Information Science and Technology, Fourth Edition and Receive Complimentary E-Books of Previous Editions

When ordering directly through IGI Global's Online Bookstore, receive the complimentary e-books for the first, second, and third editions with the purchase of the Encyclopedia of Information Science and Technology, Fourth Edition e-book.

Create a Free IGI Global Library Account to Receive a 25% Discount on All Purchases

Exclusive benefits include one-click shopping, flexible payment options, free COUNTER 4 and MARC records, and a 25% discount on all titles as well as the award-winning InfoSci^{®}-Databases.

InfoSci^{®}-Journals Annual Subscription Price for New Customers: As Low As US$ 5,100

This collection of over 175 e-journals offers unlimited access to highly-cited, forward-thinking content in full-text PDF and HTML with no DRM. There are no platform or maintenance fees and a guarantee of no more than 5% increase annually.

Martínez, J. L. Fernández, E. García Gonzalo, Z. Fernández Muñiz, G. Mariethoz and T. Mukerji. "Posterior Sampling using Particle Swarm Optimizers and Model Reduction Techniques." Principal Concepts in Applied Evolutionary Computation: Emerging Trends. IGI Global, 2012. 192-214. Web. 21 Oct. 2018. doi:10.4018/978-1-4666-1749-0.ch010

APA

Martínez, J. L., Gonzalo, E. G., Muñiz, Z. F., Mariethoz, G., & Mukerji, T. (2012). Posterior Sampling using Particle Swarm Optimizers and Model Reduction Techniques. In W. Hong (Ed.), Principal Concepts in Applied Evolutionary Computation: Emerging Trends (pp. 192-214). Hershey, PA: IGI Global. doi:10.4018/978-1-4666-1749-0.ch010

Chicago

Martínez, J. L. Fernández, E. García Gonzalo, Z. Fernández Muñiz, G. Mariethoz and T. Mukerji. "Posterior Sampling using Particle Swarm Optimizers and Model Reduction Techniques." In Principal Concepts in Applied Evolutionary Computation: Emerging Trends, ed. Wei-Chiang Samuelson Hong, 192-214 (2012), accessed October 21, 2018. doi:10.4018/978-1-4666-1749-0.ch010

Posterior Sampling using Particle Swarm Optimizers and Model Reduction Techniques

J. L. Fernández Martínez (Stanford University, University of California-Berkeley, USA and University of Oviedo, Spain), E. García Gonzalo (University of Oviedo, Spain), Z. Fernández Muñiz (University of Oviedo, Spain), G. Mariethoz (Stanford University, USA) and T. Mukerji (Stanford University, USA)

Inverse problems are ill-posed and posterior sampling is a way of providing an estimate of the uncertainty based on a finite set of the family of models that fit the observed data within the same tolerance. Monte Carlo methods are used for this purpose but are highly inefficient. Global optimization methods address the inverse problem as a sampling problem, particularly Particle Swarm, which is a very interesting algorithm that is typically used in an exploitative form. Although PSO has not been designed originally to perform importance sampling, the authors show practical applications in the domain of environmental geophysics, where it provides a proxy for the posterior distribution when it is used in its explorative form. Finally, this paper presents a hydrogeological example how to perform a similar task for inverse problems in high dimensional spaces through the combined use with model reduction techniques.

Particle Swarm Optimization (Pso) Applied To Inverse Problems

Particle swarm optimization is a stochastic evolutionary computation technique inspired by the social behavior of individuals (called particles) in nature, such as bird flocking and fish schooling (Kennedy & Eberhart, 1995).

Let us consider an inverse problem of the form , where are the model parameters, the discrete observed data, and

is the vector field representing the forward operator and is the scalar field that accounts for the j-th data. Inverse problems are very important in science and technology and sometimes referred to as, parameter identification, reverse modeling, etc. The “classical” goal of inversion given a particular data set (often affected by noise), is to find a unique set of parameters m, such the data prediction error in a certain norm p, is minimized.

The PSO algorithm to approach this inverse problem is at first glance very easy to understand and implement:

1.

A prismatic space of admissible models, M, is defined:

where are the lower and upper limits for the j-th coordinate of each particle in the swarm, n is the number of parameters in the optimization problem and is the swarm size.

2.

The misfit for each particle of the swarm is calculated, and for each particle its local best position found so far (called ) is determined as well as the minimum of all of them, called the global best ().

3.

The algorithm updates at each iteration the positions and velocities of each model in the swarm. The velocity of each particle i at each iteration k is a function of three major components:

a.

The inertia term, which consists of the old velocity of the particle, weighted by a real constant, , called inertia.

b.

The social learning term, which is the difference between the global best position found so far (called ) and the particle's current position ().

c.

The cognitive learning term, which is the difference between the particle's best position (called ) and the particle's current position ():