Ant Colony Optimization Applied to the Training of a High Order Neural Network with Adaptable Exponential Weights

Ant Colony Optimization Applied to the Training of a High Order Neural Network with Adaptable Exponential Weights

Ashraf M. Abdelbar, Islam Elnabarawy, Donald C. Wunsch II, Khalid M. Salama
ISBN13: 9781799804147|ISBN10: 1799804143|EISBN13: 9781799804154
DOI: 10.4018/978-1-7998-0414-7.ch006
Cite Chapter Cite Chapter

MLA

Abdelbar, Ashraf M., et al. "Ant Colony Optimization Applied to the Training of a High Order Neural Network with Adaptable Exponential Weights." Deep Learning and Neural Networks: Concepts, Methodologies, Tools, and Applications, edited by Information Resources Management Association, IGI Global, 2020, pp. 82-95. https://doi.org/10.4018/978-1-7998-0414-7.ch006

APA

Abdelbar, A. M., Elnabarawy, I., Wunsch II, D. C., & Salama, K. M. (2020). Ant Colony Optimization Applied to the Training of a High Order Neural Network with Adaptable Exponential Weights. In I. Management Association (Ed.), Deep Learning and Neural Networks: Concepts, Methodologies, Tools, and Applications (pp. 82-95). IGI Global. https://doi.org/10.4018/978-1-7998-0414-7.ch006

Chicago

Abdelbar, Ashraf M., et al. "Ant Colony Optimization Applied to the Training of a High Order Neural Network with Adaptable Exponential Weights." In Deep Learning and Neural Networks: Concepts, Methodologies, Tools, and Applications, edited by Information Resources Management Association, 82-95. Hershey, PA: IGI Global, 2020. https://doi.org/10.4018/978-1-7998-0414-7.ch006

Export Reference

Mendeley
Favorite

Abstract

High order neural networks (HONN) are neural networks which employ neurons that combine their inputs non-linearly. The HONEST (High Order Network with Exponential SynapTic links) network is a HONN that uses neurons with product units and adaptable exponents. The output of a trained HONEST network can be expressed in terms of the network inputs by a polynomial-like equation. This makes the structure of the network more transparent and easier to interpret. This study adapts ACOℝ, an Ant Colony Optimization algorithm, to the training of an HONEST network. Using a collection of 10 widely-used benchmark datasets, we compare ACOℝ to the well-known gradient-based Resilient Propagation (R-Prop) algorithm, in the training of HONEST networks. We find that our adaptation of ACOℝ has better test set generalization than R-Prop, though not to a statistically significant extent.

Request Access

You do not own this content. Please login to recommend this title to your institution's librarian or purchase it from the IGI Global bookstore.