Article Preview
Top1. Introduction
In recent years, the text topic mining has been gaining extensive attention. Various algorithms emerge, among which topic model Latent Dirichlet Allocation (LDA) (Blei, Ng & Jordan, 2003) is widely used to mine the topics of large text corpora.
In 2003, Blei et al. (2003) proposed LDA based on Latent Semantic Analysis and probabilistic latent semantic analysis. LDA is a topic model and a generative probabilistic model for collections of discrete data such as text corpora. LDA is a three-level hierarchical Bayesian model, in which each item of a collection is modeled as a finite mixture over an underlying set of topics. Each topic is, in turn, modeled as an infinite mixture over an underlying set of topic probabilities. In the context of text modeling, the topic probabilities provide an explicit representation of a document. LDA is based upon the idea that documents are mixtures of topics, where a topic is a probability distribution over words. A topic model is a generative model for documents. It specifies a simple probabilistic procedure by which documents can be generated. To make a new document, one chooses a distribution over topics. Then, for each word in that document, one chooses a topic at random according to this distribution, and draws a word from that topic. Standard statistical techniques can be used to invert this process, inferring the set of topics that were responsible for generating a collection of documents.
Micro-blog platforms such as Tencent Micro-blog and Sina Micro-blog have become a part of peoples' daily life, from which we can gain information timely to keep in touch with the world at any time. However, sometimes we may sink into the massive information. A lot of time can be saved for users in data mining if micro-blog can be classified efficiently. The purpose of this paper is to find an efficient topic model for classification of Chinese micro-blog. However, the problem is still more intractable than classification of any traditional documents, since micro-blog posts suffer from short texts, heavy noise and bad normalization, while traditional documents are usually in nice structure, long texts and clear semantic. To overcome the above difficulties, we propose a new method named Micro-blog Relation LDA model (MR-LDA) to classify micro-blog by aggregating several Chinese micro-blogs as a single micro-blog document to solve the problem of short texts and taking relationship between micro-blog documents into consideration to improve the performance of classification for Chinese micro-blog. Most existing micro-blog classification methods suffer from low performance. Unlike most existing methods, the authors' new model can offer an effective solution to text mining for Chinese micro-blog. MR-LDA is more suitable for model Chinese micro-blog data.
The main contributions of the authors' work can be summarized as follows. 1) This paper proposes a new model to classification of Chinese micro-blog by taking relationship of micro-blog documents into consideration. 2) The authors propose a way to overcome problem of short texts by using a sliding window to expand the texts. According to the size of the sliding window (MN), MN micro-blogs combined into a text. 3) We propose a new method to compute relational value between Chinese micro-blogs. 4) This paper proposes new methods to compute the parameter α of Dirichlet distribution on MR-LDA model. Therefore, the MR-LDA method is more suitable to model Chinese micro-blog data. Compared with classification of Chinese micro-blog based on LDA, the experimental results on actual dataset demonstrate the superiority of the authors' method.
The outline of this paper is as follows. The authors briefly review the related work in Section 2, and then describe the authors’ proposed MR-LDA method in details in Section 3. Experimental results on actual Chinese micro-blog dataset are shown in Section 4, followed by a conclusion.