Reinforcement Learning-Based Intelligent Agents for Improved Productivity in Container Vessel Berthing Applications

Abstract

This chapter introduces the use of hybrid intelligent agents in a vessel berthing application. Vessel berthing in container terminals is regarded as a very complex, dynamic application, which requires autonomous decision-making capabilities to improve the productivity of the berths. In this chapter, the dynamic nature of the container vessel berthing system has been simulated with reinforcement learning theory, which essentially learns what to do by interaction with the environment. Other techniques, such as Belief-Desire-Intention (BDI) agent systems have also been implemented in many business applications. The chapter proposes a new hybrid agent model using an Adaptive Neuro Fuzzy Inference System (ANFIS), neural networks, and reinforcement learning methods to improve the reactive, proactive and intelligent behavior of generic BDI agents in a shipping application.