Ultra High Frequency Sigmoid and Trigonometric Higher Order Neural Networks for Data Pattern Recognition

Introduction

The contributions of this chapter will be:

• •

  Introduce the background of HONNs with the pattern recognition of HONNs.

• •

  Develop a new UGT-HONN model for ultra-high frequency data pattern recognition.

• •

  Provide the UGT-HONN learning algorithm and weight update formulae.

• •

  Applications of UGT-HONN model for data pattern recognition.

This chapter is organized as follows: Section “BACKGROUND” gives the background knowledge of HONNs and pattern recognition applications using HONNs. Section “UGT-HONN MODELS” introduces UGT-HONN structure and different modes of the UGT-HONN model. Section LEARNING ALGORITHM OF UGT-HONN MODELS provides the UGT-HONN model update formula, learning algorithms, and convergence theories of HONN. Section “UGT-HONN TESTING” describes UGT-HONN computer software system and testing results for data pattern recognition.

Background

Artificial Neural Network (ANN) techniques had been widely used in the pattern recognition area. Sankar and Mammone (1991) study speaker independent vowel recognition using neural tree networks. Sethi and Jan (1991) analyze decision tree performance enhancement using an artificial neural networks implementation. Yao, Freeman, Burke, and Yang (1991) experiment pattern recognition by a distributed neural network.

Artificial Higher Order Neural Network (HONN) had been widely used in the pattern recognition area too. Reid, Spirkovska, and Ochoa (1989) show rapid training of higher-order neural networks for invariant pattern recognition. Spirkovska and Reid (1990) suggest connectivity strategies for higher-order neural networks applied to pattern recognition. Lisboa and Perantonis (1991) display the invariant pattern recognition using third-order networks and zernlike moments. Kanaoka, Chellappa, Yoshitaka, and Tomita (1992) built an artificial higher order neural network for distortion un-variant pattern recognition. Perantonis and Lisboa (1992) test the rotation and scale invariant pattern recognition by high-order neural networks and moment classifiers. Schmidt and Davis (1993) check the pattern recognition properties of various feature spaces for higher order neural networks. Spirkovska and Reid (1994) try higher order neural networks to apply 2D and 3D object recognition. He, and Siyal (1999) operate Improvement on higher-order neural networks for invariant object recognition. Park, Smith, and Mersereau (2000) employ target recognition based on directional filter banks and higher-order neural network. Kaita, Tomita, and Yamanaka (2002) research on a higher-order neural network for distortion invariant pattern recognition. Voutriaridis, Boutalis, and Mertzios (2003) seek ridge polynomial networks in pattern recognition. Foresti and Dolso (2004) look into an adaptive high-order neural tree for pattern recognition. Artyomov and Yadid-Pecht (2005) provide modified high-order neural network for invariant pattern recognition.