Genetic Learning: Initialization and Representation Issues

Genetic Learning: Initialization and Representation Issues

Ivan Bruha (McMaster University, Canada)
DOI: 10.4018/978-1-59904-982-3.ch007
OnDemand PDF Download:
$37.50

Abstract

This chapter discusses the incorporation of genetic algorithms into machine learning. It does not present the principles of genetic algorithms (because it has been already done by many more or less large monographs) but rather focuses particularly on some important issues and enhancements of genetic algorithms design is faced by, namely: (a) the ways of initialization of a population for a genetic algorithm, (b) representation of chromosomes (individuals) in genetic algorithms (because it plays an influential role in the entire processing), and (c) discretization and fuzzification of numerical attributes for genetic algorithms (since they are not in its genuine form able to process these attributes). Furthermore, this chapter surveys new trends of dealing with the variable-length chromosomes and other issues related to the genetic learners. It concludes by discussing some directions of further improvement of the genetic learners, namely two topologies with the ‘meta’ level.
Chapter Preview
Top

Introduction

A machine learning algorithm induces descriptions of concepts (classes) of a given problem. The induction of concepts from databases consists of searching usually a huge space of possible concept descriptions. There exist several paradigms how to control this search, e.g., various statistical methods, logical/symbolic algorithms, neural nets, and the like. This chapter presents the paradigm of genetic algorithms for such a search. There are several projects of incorporating genetic algorithms into machine learning (ML); we would like to present our contribution to this field, called genetic learning.

Genetic algorithms (GAs) represent a relatively new efficient optimization technique for inducing new concepts. They emulate biological evolution and are utilized in optimization processes, similarly to simulated annealing, rough sets, and neural nets. The optimization is performed by processing a population (a set) of individuals. Each individual (chromosome) is usually divided into several substructures, called genes. An individual as a unit is in most applications represented by a binary string. For representation purposes, we distinguish fixed- and variable-length strings.

A designer of a GA has to provide an evaluation function, called fitness; it evaluates any individual (chromosome). Also the formulas/procedures for so-called genetic operators must be provided by the user (see their definitions below).

GAs have become an attractive alternative to classical search algorithms for exploring large spaces of hypotheses (models, concept descriptions). They are two important characteristics of the search performed by a GA: the search is usually global and is parallel in nature since a GA processes not just a single individual (chromosome) but a large set (population) of individuals.

There exist both theoretical and experimental results showing that GAs can rapidly locate individuals with high fitness rating (even for very huge search spaces) by using a relatively small population of 50-100 individuals (chromosomes). This chapter, of course, does not present the principles of genetic algorithms; detailed and exhausted discussion can be found, e.g. in (Holland, 1975; De Jong, 1980; Grefenstette, 1986).

Top

Background

Research projects of incorporating (merging) genetic algorithms into the field of learning algorithms inducing concept descriptions can be divided into two categories.

  • In the first category, called external one, the actual concept description (model) is derived (induced) by a traditional machine learning algorithm and a GA serves as an evaluation or parameter-optimizing device. Behaviour of any performance system (not only a ML algorithm) exhibits several parameters that affect its behaviour; a suitable strategy for changing these parameters’ values improves performance of the system. How can a GA serve in this issue?

    • -

      In one application, a GA plays a role of an evaluation device, and the performance system itself modifies its internal structure by GA’s evaluation characteristics.

    • -

      In a more sophisticated application, a GA itself searches for a combination of parameters that improve the performance of a machine learning (performance) system. Here, the parameters are viewed as genes, and the genetic material of individuals (chromosomes) as a fixed-length string of genes.

    • -

      Another application of GAs (De Jong, 1988): in some tasks, a simple vector of parameters is not adequate, but rather a more complex data structure of parameters is involved in controlling the behaviour of the performance system. Such a data structure can be ‘linearized’ into a binary string representation; however, the traditional genetic operators (namely, crossover and mutation) could produce illegal data structures (not having the sense in a given task). Therefore, representation-sensitive operators are to be designed and applied.

Complete Chapter List

Search this Book:
Reset
Editorial Advisory Board
Table of Contents
Preface
Hsiao-Fan Wang
Acknowledgment
Hsiao-Fan Wang
Chapter 1
Martin Spott, Detlef Nauck
This chapter introduces a new way of using soft constraints for selecting data analysis methods that match certain user requirements. It presents a... Sample PDF
Automatic Intelligent Data Analysis
$37.50
Chapter 2
Hung T. Nguyen, Vladik Kreinovich, Gang Xiang
It is well known that in decision making under uncertainty, while we are guided by a general (and abstract) theory of probability and of statistical... Sample PDF
Random Fuzzy Sets: Theory & Applications
$37.50
Chapter 3
Gráinne Kerr, Heather Ruskin, Martin Crane
Microarray technology1 provides an opportunity to monitor mRNA levels of expression of thousands of genes simultaneously in a single experiment. The... Sample PDF
Pattern Discovery in Gene Expression Data
$37.50
Chapter 4
Erica Craig, Falk Huettmann
The use of machine-learning algorithms capable of rapidly completing intensive computations may be an answer to processing the sheer volumes of... Sample PDF
Using "Blackbox" Algorithms Such AS TreeNET and Random Forests for Data-Ming and for Finding Meaningful Patterns, Relationships and Outliers in Complex Ecological Data: An Overview, an Example Using G
$37.50
Chapter 5
Eulalia Szmidt, Marta Kukier
We present a new method of classification of imbalanced classes. The crucial point of the method lies in applying Atanassov’s intuitionistic fuzzy... Sample PDF
A New Approach to Classification of Imbalanced Classes via Atanassov's Intuitionistic Fuzzy Sets
$37.50
Chapter 6
Arun Kulkarni, Sara McCaslin
This chapter introduces fuzzy neural network models as means for knowledge discovery from databases. It describes architectures and learning... Sample PDF
Fuzzy Neural Network Models for Knowledge Discovery
$37.50
Chapter 7
Ivan Bruha
This chapter discusses the incorporation of genetic algorithms into machine learning. It does not present the principles of genetic algorithms... Sample PDF
Genetic Learning: Initialization and Representation Issues
$37.50
Chapter 8
Evolutionary Computing  (pages 131-142)
Thomas E. Potok, Xiaohui Cui, Yu Jiao
The rate at which information overwhelms humans is significantly more than the rate at which humans have learned to process, analyze, and leverage... Sample PDF
Evolutionary Computing
$37.50
Chapter 9
M. C. Bartholomew-Biggs, Z. Ulanowski, S. Zakovic
We discuss some experience of solving an inverse light scattering problem for single, spherical, homogeneous particles using least squares global... Sample PDF
Particle Identification Using Light Scattering: A Global Optimization Problem
$37.50
Chapter 10
Dominic Savio Lee
This chapter describes algorithms that use Markov chains for generating exact sample values from complex distributions, and discusses their use in... Sample PDF
Exact Markov Chain Monte Carlo Algorithms and Their Applications in Probabilistic Data Analysis and Inference
$37.50
Chapter 11
J. P. Ganjigatti, Dilip Kumar Pratihar
In this chapter, an attempt has been made to design suitable knowledge bases (KBs) for carrying out forward and reverse mappings of a Tungsten inert... Sample PDF
Design and Development of Knowledge Bases for Forward and Reverse Mappings of TIG Welding Process
$37.50
Chapter 12
Malcolm J. Beynon
This chapter considers the role of fuzzy decision trees as a tool for intelligent data analysis in domestic travel research. It demonstrates the... Sample PDF
A Fuzzy Decision Tree Analysis of Traffic Fatalities in the US
$37.50
Chapter 13
Dymitr Ruta, Christoph Adl, Detlef Nauck
In the telecom industry, high installation and marketing costs make it six to 10 times more expensive to acquire a new customer than it is to retain... Sample PDF
New Churn Prediction Strategies in the Telecom Industry
$37.50
Chapter 14
Malcolm J. Beynon
This chapter demonstrates intelligent data analysis, within the environment of uncertain reasoning, using the recently introduced CaRBS technique... Sample PDF
Intelligent Classification and Ranking Analyses Using CARBS: Bank Rating Applications
$37.50
Chapter 15
Fei-Chen Hsu, Hsiao-Fan Wang
In this chapter, we used Cumulative Prospect Theory to propose an individual risk management process (IRM) including a risk analysis stage and a... Sample PDF
Analysis of Individual Risk Attitude for Risk Management Based on Cumulative Prospect Theory
$37.50
Chapter 16
Francesco Giordano, Michele La Rocca, Cira Perna
This chapter introduces the use of the bootstrap in a nonlinear, nonparametric regression framework with dependent errors. The aim is to construct... Sample PDF
Neural Networks and Bootstrap Methods for Regression Models with Dependent Errors
$37.50
Chapter 17
Lean Yu, Shouyang Wang, Kin Keung Lai
Financial crisis is a kind of typical rare event, but it is harmful to economic sustainable development if occurs. In this chapter, a... Sample PDF
Financial Crisis Modeling and Prediction with a Hilbert-EMD-Based SVM Approachs
$37.50
Chapter 18
Chun-Jung Huang, Hsiao-Fan Wang, Shouyang Wang
One of the key problems in supervised learning is due to the insufficient size of the training data set. The natural way for an intelligent learning... Sample PDF
Virtual Sampling with Data Construction Analysis
$37.50
About the Contributors