Semantic Analysis of Videos for Tags Prediction and Segmentation

Video Tagging & Segmentation

The problem of video tagging and segmentation has not been addressed in combination, though its applications are ostensible. The existing approaches of video segmentation operate on surficial level and/or are focused on specific videos. As the related work in this domain in the coming sections will show that the approaches dependent on the hand-crafted image features do not suffice to deliver an adequate level of accuracy in this problem, an intelligent algorithm for this semantic analysis is required. At the same time, the problem of video segmentation in the context of video tagging needs to be re-formulated.

Applying the traditional approaches of object detection on the individual video frames will be inefficient as we will end up with low-level information (e.g., the localization of objects in the individual frames instead of the contextual relationship among them). In addition, processing each video frame will also introduce computational inefficiency and result in redundant information. This problem can only be addressed by a machine learning algorithm which can be trained to predict the high-level, representative features of video scenes.