Video-Based Person Re-Identification With Unregulated Sequences

Video-Based Person Re-Identification With Unregulated Sequences

Wenjun Huang (National Engineering Research Center for Multimedia Software, Wuhan University, Wuhan, China), Chao Liang (National Engineering Research Center for Multimedia Software, Wuhan University, Wuhan, China), Chunxia Xiao (School of Computer Science, Wuhan University, Wuhan, China) and Zhen Han (School of Computer Science, Wuhan University, Wuhan, China)
Copyright: © 2020 |Pages: 18
DOI: 10.4018/IJDCF.2020040104

Abstract

Video-based person re-identification (re-id) has recently attracted widespread attentions because extra space-time information and more appearance cues in videos can be used to improve the performance of image-based person re-id. Most existing approaches equally treat person video images, ignoring their individual discrepancy. However, in real scenarios, captured images are usually contaminated by various noises, especially occlusions, resulting in a series of unregulated sequences. Through investigating the impact of unregulated sequences to feature representation of video-based person re-id, the authors find a remarkable promotion by eliminating noisy sub sequences. Based on this interesting finding, an adaptive unregulated sub sequence detection and refinement method is proposed to purify original video sequence and obtain a more effective and discriminative feature representation for video-based person re-id. Experimental results on two public datasets demonstrate that the proposed method outperforms the state-of-the-art work.
Article Preview
Top

Introduction

Person re-identification, which aims at identifying a person of interest among different cameras, has become increasingly popular in the community due to its critical role in many surveillance, security and multimedia applications. Currently, major efforts towards this problem focus on the still-image-based scenario, in which each person has only one image available per camera view. Many methods have been developed to either extract discriminative features (Liao et al., 2015; Matsukawa et al., 2013; Satta et al., 2013; Shen et al., 2013) or learn effective distance metric (Hirzer et al., 2012; Köstinger et al., 2012; Liang et al., 2015; Liao et al., 2015; Yang et al., 2016) for this problem.

In spite of great research progress achieved for the still-image-based task, the real-world re-id performance is hindered by limited information extracted from a single image. Such still-image-based person re-id ignores the temporal information among person images, which leads poor feature representation of person. In practical surveillance systems, persons are always recorded by videos, which means that there are multiple consecutive frames available for an individual in each camera’s view field. Thus, it is intuitive to use such sequential images to improve re-id performance, which directly motivates the investigation of video-based person re-id.

Figure 1.

An example illustrating that person images are always highly noisy in practical situations

IJDCF.2020040104.f01

Recently, impressive research progress has been reported in video-based person re-id. However, most approaches mentioned above generally assume that all images in each sequence are of equal importance, losing sight of their difference caused by the interference of various noises. Take iLIDS-VID dataset (Wang et al. 2014) in Figure 1 as an example, person images are always flooded with various noises, such as object occlusions or background clutters, resulting in highly noisy unregulated sequences. In our preliminary comparative experiment conducted on 199-pair unregulated person sequences of iLID-VID dataset, average matching accuracy on original unregulated video sequences is only 7%, ten percent lower than that obtained on filtered clean video sequences.

Table 1.
Occlusion condition investigation
DatasetOcclusionLong-Term OcclusionTemporary Occlusion
ETHZ45.21%15.15%84.85%
OTB58.05%10.03%89.97%
iLIDS-VID66.33%10.05%89.95%

Complete Article List

Search this Journal:
Reset
Open Access Articles: Forthcoming
Volume 12: 4 Issues (2020): 2 Released, 2 Forthcoming
Volume 11: 4 Issues (2019)
Volume 10: 4 Issues (2018)
Volume 9: 4 Issues (2017)
Volume 8: 4 Issues (2016)
Volume 7: 4 Issues (2015)
Volume 6: 4 Issues (2014)
Volume 5: 4 Issues (2013)
Volume 4: 4 Issues (2012)
Volume 3: 4 Issues (2011)
Volume 2: 4 Issues (2010)
Volume 1: 4 Issues (2009)
View Complete Journal Contents Listing