Ethology-Based Approximate Adaptive Learning: A Near Set Approach

Ethology-Based Approximate Adaptive Learning: A Near Set Approach

James F. Peters (University of Manitoba, Canada) and Shabnam Shahfar (University of Manitoba, Canada)
DOI: 10.4018/978-1-60566-310-4.ch022
OnDemand PDF Download:
$37.50

Abstract

The problem considered in this chapter is how to use the observed behavior of organisms as a basis for machine learning. The proposed approach for machine learning combines near sets and ethology. It leads to novel forms of Q-learning algorithm that have practical applications in the controlling the behavior of machines, which learn to adapt to changing environments. Both traditional and new forms of adaptive learning theory and applications are considered in this chapter. A complete framework for an ethology-based approximate adaptive learning is established by using near sets.
Chapter Preview
Top

Abstract

The problem considered in this chapter is how to use the observed behavior of organisms as a basis for machine learning. The proposed approach for machine learning combines near sets and ethology. It leads to novel forms of Q-learning algorithm that have practical applications in the controlling the behavior of machines, which learn to adapt to changing environments. Both traditional and new forms of adaptive learning theory and applications are considered in this chapter. A complete framework for an ethology-based approximate adaptive learning is established by using near sets.

Top

Introduction

The problem considered in this paper is how learning by a machine can adapt its behaviour to changing environmental conditions to achieve a better result. The solution to this problem hearkens back to the work of ethologist Niko Tinbergen (1940, 1942, 1948, 1951, 1953, 1963), starting in the 1940s. Tinbergen (1953b) suggested that the behaviour of swarms of interacting organisms and their environment make swarms be seen as individual. Of course, the insight in Tinbergen’s work augurs later by those who were interested in adaptive learning by societies of interacting machines. The work by Tinbergen and Konrad Lorenz (1981) led to the introduction of ethology, a comparative science of behaviour. The basic idea in the proposed approach to adaptive learning is to look behaviour of an organism as episodic and to record observed behaviours ethograms. An ethogram is a tabular representation of observed behaviours. An ethogram is a tabular representation of observed behaviours during an episode. Let si, ai, ri denote the ith state, action, reward, respectively. Reward ri results from performing action ai, where 0 ≤ in for some finite, positive integer n. Each episode consists of a finite state-action-reward sequence of the form . In this chapter, adaptive learning itself is observed at the individual level as well as at the society level.

Key Terms in this Chapter

Social Learning: Acquiring a new behaviour by watching or interacting with other animals.

Organism Behaviour: Tuples of behavior function values.

Ethogram: A tabular representation of observed behaviours.

Return: Cumulative future discounted rewards.

Near Sets: At least one object in a set has a description matching that of an object in another set.

Episode: A finite state-action-reward sequence.

Object Description: Tuple of function values.

Adaptive Learning: Behaviour modification in response to changes in the environment.

Complete Chapter List

Search this Book:
Reset
Editorial Advisory Board
Table of Contents
Foreword
Lipo Wang
Preface
Hongwei Mo
Chapter 1
Fabio Freschi, Carlos A. Coello Coello, Maurizio Repetto
This chapter aims to review the state of the art in algorithms of multiobjective optimization with artificial immune systems (MOAIS). As it will be... Sample PDF
Multiobjective Optimization and Artificial Immune Systems: A Review
$37.50
Chapter 2
Jun Chen, Mahdi Mahfouf
The primary objective of this chapter is to introduce Artificial Immune Systems (AIS) as a relatively new bio-inspired optimization technique and to... Sample PDF
Artificial Immune Systems as a Bio-Inspired Optimization Technique and Its Engineering Applications
$37.50
Chapter 3
Licheng Jiao, Maoguo Gong, Wenping Ma
Many immue-inspired algorithms are based on the abstractions of one or several immunology theories, such as clonal selection, negative selection... Sample PDF
An Artificial Immune Dynamical System for Optimization
$37.50
Chapter 4
Malgorzata Lucinska, Slawomir T. Wierzchon
Multi-agent systems (MAS), consist of a number of autonomous agents, which interact with one-another. To make such interactions successful, they... Sample PDF
An Immune Inspired Algorithm for Learning Strategies in a Pursuit-Evasion Game
$37.50
Chapter 5
Luis Fernando Niño Vasquez, Fredy Fernando Muñoz Mopan, Camilo Eduardo Prieto Salazar, José Guillermo Guarnizo Marín
Artificial Immune Systems (AIS) have been widely used in different fields such as robotics, computer science, and multi-agent systems with high... Sample PDF
Applications of Artificial Immune Systems in Agents
$37.50
Chapter 6
Xingquan Zuo
Inspired from the robust control principle, a robust scheduling method is proposed to solve uncertain scheduling problems. The uncertain scheduling... Sample PDF
An Immune Algorithm Based Robust Scheduling Methods
$37.50
Chapter 7
Fabio Freschi, Maurizio Repetto
The increasing cost of energy and the introduction of micro-generation facilities and the changes in energy production systems require new... Sample PDF
Artificial Immune System in the Management of Complex Small Scale Cogeneration Systems
$37.50
Chapter 8
Krzysztof Ciesielski, Mieczyslaw A. Klopotek, Slawomir T. Wierzchon
In this chapter the authors discuss an application of an immune-based algorithm for extraction and visualization of clusters structure in large... Sample PDF
Applying the Immunological Network Concept to Clustering Document Collections
$37.50
Chapter 9
Xiangrong Zhang, Fang Liu
The problem of feature selection is fundamental in various tasks like classification, data mining, image processing, conceptual learning, and so on.... Sample PDF
Feature Selection Based on Clonal Selection Algorithm: Evaluation and Application
$37.50
Chapter 10
Yong-Sheng Ding, Xiang-Feng Zhang, Li-Hong Ren
Future Internet should be capable of extensibility, survivability, mobility, and adaptability to the changes of different users and network... Sample PDF
Immune Based Bio-Network Architecture and its Simulation Platform for Future Internet
$37.50
Chapter 11
Tao Gong
Static Web immune system is an important applicatiion of artificial immune system, and it is also a good platform to develop new immune computing... Sample PDF
A Static Web Immune System and Its Robustness Analysis
$37.50
Chapter 12
Alexander O. Tarakanov
Based on mathematical models of immunocomputing, this chapter describes an approach to spatio-temporal forecast (STF) by intelligent signal... Sample PDF
Immunocomputing for Spatio-Temporal Forecast
$37.50
Chapter 13
Fu Dongmei
In engineering application, the characteristics of the control system are entirely determined by the system controller once the controlled object... Sample PDF
Research of Immune Controllers
$37.50
Chapter 14
Xiaojun Bi
In fact, image segmentation can be regarded as a constrained optimization problem, and a series of optimization strategies can be used to complete... Sample PDF
Immune Programming Applications in Image Segmentation
$37.50
Chapter 15
Xin Wang, Wenjian Luo, Zhifang Li, Xufa Wang
A hardware immune system for the error detection of MC8051 IP core is designed in this chapter. The binary string to be detected by the hardware... Sample PDF
A Hardware Immune System for MC8051 IP Core
$37.50
Chapter 16
Mark Burgin, Eugene Eberbach
There are different models of evolutionary computations: genetic algorithms, genetic programming, etc. This chapter presents mathematical... Sample PDF
On Foundations of Evolutionary Computation: An Evolutionary Automata Approach
$37.50
Chapter 17
Terrence P. Fries
Path planning is an essential component in the control software for an autonomous mobile robot. Evolutionary strategies are employed to determine... Sample PDF
Evolutionary Path Planning for Robot Navigation Under Varying Terrain Conditions
$37.50
Chapter 18
Konstantinos Konstantinidis, Georgios Ch. Sirakoulis, Ioannis Andreadis
The aim of this chapter is to provide the reader with a Content Based Image Retrieval (CBIR) system which incorporates AI through ant colony... Sample PDF
Ant Colony Optimization for Use in Content Based Image Retrieval
$37.50
Chapter 19
Miroslav Bursa, Lenka Lhotska
The chapter concentrates on the use of swarm intelligence in data mining. It focuses on the problem of medical data clustering. Clustering is a... Sample PDF
Ant Colonies and Data Mining
$37.50
Chapter 20
Bo-Suk Yang
This chapter describes a hybrid artificial life optimization algorithm (ALRT) based on emergent colonization to compute the solutions of global... Sample PDF
Artificial Life Optimization Algorithm and Applications
$37.50
Chapter 21
Martin Macaš, Lenka Lhotská
A novel binary optimization technique is introduced called Social Impact Theory based Optimizer (SITO), which is based on social psychology model of... Sample PDF
Optimizing Society: The Social Impact Theory Based Optimizer
$37.50
Chapter 22
James F. Peters, Shabnam Shahfar
The problem considered in this chapter is how to use the observed behavior of organisms as a basis for machine learning. The proposed approach for... Sample PDF
Ethology-Based Approximate Adaptive Learning: A Near Set Approach
$37.50
Chapter 23
Dingju Zhu
Parallel computing is more and more important for science and engineering, but it is not used so widely as serial computing. People are used to... Sample PDF
Nature Inspired Parallel Computing
$37.50
Chapter 24
Tang Mo, Wang Kejun, Zhang Jianmin, Zheng Liying
An understanding of the human brain’s local function has improved in recent years. But the cognition of human brain’s working process as a whole is... Sample PDF
Fuzzy Chaotic Neural Networks
$37.50
About the Contributors