Automatic Speaker Localization and Tracking: Using a Fusion of the Filtered Correlation with the Energy Differential

Automatic Speaker Localization and Tracking: Using a Fusion of the Filtered Correlation with the Energy Differential

Siham Ouamour (USTHB University, Algeria), Halim Sayoud (USTHB University, Algeria) and Salah Khennouf (USTHB University, Algeria)
Copyright: © 2010 |Pages: 19
DOI: 10.4018/jmcmc.2010070102

Abstract

This paper presents a system of speaker localization for a purpose of speaker tracking by camera. The authors use the information given by the two microphones, placed in opposition, to determine the position of the active speaker in trying to supervise the audio-visual recording. To achieve the speaker localization task, the authors have proposed and employed two methods, which are called respectively: the filtered correlation method and the energy differential method. The principle of the first method is based on the calculation of the correlation between the two signals collected by the two microphones and a special filtering. The second is based on the computation of the logarithmic energy differential between these two signals. However, when different methods are used simultaneously to make a decision, it is often interesting to use a fusion technique combining those estimations or decisions in order to enhance the system performances. For that purpose, this paper proposes two fusion techniques operating at the decision level which are used to fuse the two estimations into one that should be more precise.
Article Preview
Top

Speech Database

We have built four experimental databases with different scenarios, different speakers and different configurations:

  • -

    DB8 database: the distance between the two microphones is 4.20 m.

  • -

    DB9 database: the distance between the two microphones is 2 m.

  • -

    DB10 database: the distance between the two microphones is 1 m.

  • -

    DB11 database: the distance between the two microphones is 1 m.

In this paper, we will describe only the experiments done on DB11 database, since the results got with long distances (DB8 and DB9) are very affected by the echo effect, and those obtained on the DB10 are insufficient.

The DB11 database contains several scenarios with different speakers speaking alternatively in a natural manner and with different configurations. There are two general configurations: a stable configuration and a mobile configuration. In the stable configuration, the speakers are seated at one of the 3 fixed positions: Left, Middle or Right (Figure 1.a and Figure 1.b) in a same line. In the mobile configuration, the speaker walks smoothly from one side to the other (e.g., from the left to the right). The distance between the two microphones is 1m, the number of scenarios is 11and the number of speakers is 7 (4 female and 3 male speakers).

Complete Article List

Search this Journal:
Reset
Open Access Articles: Forthcoming
Volume 11: 4 Issues (2020): 1 Released, 3 Forthcoming
Volume 10: 4 Issues (2019)
Volume 9: 4 Issues (2018)
Volume 8: 4 Issues (2017)
Volume 7: 4 Issues (2016)
Volume 6: 4 Issues (2014)
Volume 5: 4 Issues (2013)
Volume 4: 4 Issues (2012)
Volume 3: 4 Issues (2011)
Volume 2: 4 Issues (2010)
Volume 1: 4 Issues (2009)
View Complete Journal Contents Listing