Multi-Lingual Scene Text Detection Using One-Class Classifier

Multi-Lingual Scene Text Detection Using One-Class Classifier

Anirban Mukhopadhyay (Jadavpur University, Kolkata, India), Sourav Kumar (Jadavpur University, Kolkata, India), Souvik Roy Chowdhury (Jadavpur University, Kolkata, India), Neelotpal Chakraborty (Jadavpur University, Kolkata, India), Ayatullah Faruk Mollah (Aliah University, Kolkata, India), Subhadip Basu (Jadavpur University, Kolkata, India) and Ram Sarkar (Department of Computer Science and Engineering, Jadavpur University, Kolkata, India)
Copyright: © 2019 |Pages: 18
DOI: 10.4018/IJCVIP.2019040104
OnDemand PDF Download:
List Price: $37.50
10% Discount:-$3.75


The main purpose of scene text recognition is to detect texts in a given image. The problem of text detection and recognition in such images has gained great attention in recent years due to rising demand of several applications like visual based applications, multimedia and content-based retrieval. Due to low accuracies of existing scene text detection methods, an improved pipeline is developed for text localizing task. First, candidate text regions are generated using Maximally Stable Extremal Region and Stroke Width Transform methods that capture true positives along with many false positives. A One Class Classifier is trained to label the candidate regions obtained, as text or non-text, which in this case is suitable as non-text class cannot be adequately represented to train a binary classifier. The one class classifier is trained with some popular feature descriptors like Histogram of Oriented Gradients, Grey Level Co-Occurrence Matrix, Discrete Cosine Transform and Gabor filter. Experimental results show high recall for text containing regions and reducing false positives.
Article Preview

1. Introduction

The fundamental goal of scene text detection problem (Yao et al. 2013) is to determine whether or not there is any text in a given image, and if present, to localize and recognize it. These stages involved in developing an “end-to-end” system, are equally important for any scene text processing applications. The problem of text detection and recognition (Yao et al. 2014) from images have received significant attention in recent years due to growing demand of a number of applications.

Applications for text detection in images can be broadly categorized as visual-based, multimedia and content-based retrieval. Text in web and document images is relevant to content of the same. Street hoardings and sign-boards generally have description of place, time and doer of events taking place thus carrying important information. Automatic text recognition and translation systems help people to break language constraints. Recognizing texts on packages, containers, houses, maps, etc. has broad visual based applications. However, text detection in natural scenes is extremely difficult and challenging due to the following major factors:

  • Wide Variation of Scenes Containing Text: In comparison to document images having dark texts on light background with regular font and standard formatting, texts in a natural scene image mostly have high diversity in fonts, styles, sizes, colors and orientations.

  • Background Complexity: The backgrounds in natural scene images can be very complex due to heterogeneity in colors and indistinguishable foreground-background due to shade closeness. Elements like signs, fences, bricks, grasses, tree leaves and branches may give impression of true texts, thereby causing confusions and errors. This makes the task difficult for a general Optical Character Recognition (OCR) engine with raw forms of such images.

  • Interference Factors: Various interference factors like noise, blur, distortion, low resolution, non-uniform illumination and partial occlusion, may prove to be challenging issues during the detection and recognition tasks for the text present in the image. Camera captured applications face a lot of these issues.

There are two main approaches for developing the solution for scene-text recognition (Yao et al. 2014): stepwise and integrated. In stepwise methodologies, the recognition and detection tasks are separate. They employ a framework that divides the task into segments which take care of the detection, segmentation and recognition modules one after another. Whereas in integrated methodologies, word recognition is done by sharing information between the detection and recognition tasks through optimization techniques and character classifiers. Key difference is that recognition is the main aim of the task and the strategies used in integrated methods mostly deal with that aspect. Present study deals with images containing multi-lingual texts, so a single OCR engine will not suffice. Hence, a stepwise method is followed that mainly aims to localize text regions and treat recognition as a separate module for later stage. Keeping this fact in mind, a text localization system is developed in the current work.

Text detection is the precursor to the recognition stage in the pipeline and errors only get cascaded. The localization step coarsely groups the components into possible text containing regions. These candidate regions undergo another classification to separate out some of the non-text regions during verification. The guiding principle is that the text regions display a similar underlying structure which can be represented using feature engineering to identify this invariant pattern. A bottom-up approach is applied, where the localization of text regions is performed before the application of specially trained classifier to verify those segments. One of the major advantages stems from the fact that the computation cost of the later stages through OCR reduces drastically when most of the background gets filtered in the coarse localization step. Given language independent features of multilingual OCR modules, the developed system can process texts in different languages.

Complete Article List

Search this Journal:
Volume 13: 1 Issue (2023): Forthcoming, Available for Pre-Order
Volume 12: 4 Issues (2022): 1 Released, 3 Forthcoming
Volume 11: 4 Issues (2021)
Volume 10: 4 Issues (2020)
Volume 9: 4 Issues (2019)
Volume 8: 4 Issues (2018)
Volume 7: 4 Issues (2017)
Volume 6: 2 Issues (2016)
Volume 5: 2 Issues (2015)
Volume 4: 2 Issues (2014)
Volume 3: 4 Issues (2013)
Volume 2: 4 Issues (2012)
Volume 1: 4 Issues (2011)
View Complete Journal Contents Listing