A Hybrid Learning Particle Swarm Optimization With Fuzzy Logic for Sentiment Classification Problems

A Hybrid Learning Particle Swarm Optimization With Fuzzy Logic for Sentiment Classification Problems

Jiyuan Wang, Kaiyue Wang, Xiangfang Yan, Chanjuan Wang
DOI: 10.4018/IJCINI.314782
Article PDF Download
Open access articles are freely available for download

Abstract

Methods based on deep learning have great utility in the current field of sentiment classification. To better optimize the setting of hyper-parameters in deep learning, a hybrid learning particle swarm optimization with fuzzy logic (HLPSO-FL) is proposed in this paper. Hybrid learning strategies are divided into mainstream learning strategies and random learning strategies. The mainstream learning strategy is to define the mainstream particles in the cluster and build a scale-free network through the mainstream particles. The random learning strategy makes full use of historical information and speeds up the convergence of the algorithm. Furthermore, fuzzy logic is used to control algorithm parameters to balance algorithm exploration and exploration performance. HLPSO-FL has completed comparison experiments on benchmark functions and real sentiment classification problems respectively. The experimental results show that HLPSO-FL can effectively complete the hyperparameter optimization of sentiment classification problem in deep learning and has strong convergence.
Article Preview
Top

Introduction

An optimization problem refers to finding a set of parameter values in the feasible solution set so that the objective value of the problem can reach the maximum or minimum under some constraints. Various optimization problems in life have prompted the progress of algorithm research. Intelligent optimization algorithms have been vigorously developed in this regard. At present, the utilization of information flow in the network has become a hot topic, and the research on sentiment analysis of large-scale data in the network has gradually attracted the attention of scholars. Nowadays, the most commonly used sentiment analysis method is the text sentiment analysis method based on deep learning. However, due to the large number of hyperparameters involved in this method, an appropriate optimization method is needed to improve the efficiency of this sentiment analysis method.

A Particle Swarm Optimization algorithm (PSO) is a class of classical swarm intelligence optimization algorithms (Kennedy & Eberhart, 1995). A PSO algorithm has a simple principle and fast convergence speed. It has undergone extensive research and development in recent years in many fields, such as resource transportation (Singh & Singh, 2023), system reliability tests (Li et al., 2022), high-speed train head shape optimization (He et al., 2022), etc. However, the PSO algorithm, like other swarm intelligence optimization methods, tends to premature maturity and falls into the local optimum (Ding & Gu, 2020). For this reason, many PSO variants have been proposed to enhance the search performance of a PSO. Common variants include using parameter adaptive control to optimize the execution effect of the algorithm, mixing a PSO algorithm with other algorithms or strategies to improve the performance of the algorithm, using different neighborhood structure to optimize the search ability of the algorithm, using multiple population mechanisms to optimize the efficiency of population information interaction, and changing the learning mechanism of particles to improve the performance.

The PSO variants proposed above will be optimized for different characteristics according to their respective algorithm strategies. They are highly dependent on the problem and are not suitable for solving sentiment classification problems. In this study, a hybrid learning particle swarm optimization with a fuzzy logic (HLPSO-FL) algorithm is proposed for sentiment analysis in the context of deep learning. The main contributions of this paper are as follows:

  • 1.

    Based on the scale-free network topology, a mainstream learning strategy is proposed to reduce the speed of algorithm information transmission and avoid the algorithm falling into the local optimum.

  • 2.

    Utilizing a random learning method as opposed to the self-learning strategy enhances the population's diversity and prevents its early convergence.

  • 3.

    According to the state of each particle, fuzzy logic is introduced to dynamically control parameters, such as inertia weight and individual learning factor of each particle, and dynamically adjust the exploration and development capabilities.

The rest of the paper is structured as follows: The related work of particle swarm optimization algorithm, scale-free network, and sentiment analysis approach is introduced in Related Works. Hybrid learning particle swarm optimization with fuzzy logic details the algorithms outlined in this study. The experimental analysis is arranged in Experimental Results and Analysis. Finally, the summary and prospect of the work of this paper are given.

Complete Article List

Search this Journal:
Reset
Volume 18: 1 Issue (2024)
Volume 17: 1 Issue (2023)
Volume 16: 1 Issue (2022)
Volume 15: 4 Issues (2021)
Volume 14: 4 Issues (2020)
Volume 13: 4 Issues (2019)
Volume 12: 4 Issues (2018)
Volume 11: 4 Issues (2017)
Volume 10: 4 Issues (2016)
Volume 9: 4 Issues (2015)
Volume 8: 4 Issues (2014)
Volume 7: 4 Issues (2013)
Volume 6: 4 Issues (2012)
Volume 5: 4 Issues (2011)
Volume 4: 4 Issues (2010)
Volume 3: 4 Issues (2009)
Volume 2: 4 Issues (2008)
Volume 1: 4 Issues (2007)
View Complete Journal Contents Listing