EPSSNet: A Lightweight Network With Edge Processing and Semantic Segmentation for Mobile Robotics

EPSSNet: A Lightweight Network With Edge Processing and Semantic Segmentation for Mobile Robotics

Zechun Cao, German Zavala Villafuerte, Joseph Almaznaai
Copyright: © 2024 |Pages: 22
DOI: 10.4018/IJSWIS.342087
Article PDF Download
Open access articles are freely available for download

Abstract

Fast and accurate segmentation is important for robot judgement, e.g. robot detection, segmentation, and control. Most researchers have focused on deploying lightweight semantic segmentation models into robot services. The problem is that the critical interaction between semantic segmentation and boundaries is ignored. In this chapter, the authors propose a lightweight parallel execution model (EPSSNet) based on semantic flow branch (SFB), edge flow branch (EFB) and self-adapting weighting fusion (SAWF) for mobile robot service projects. The semantic flow branching module is used to obtain accurate object shape features. The boundary constraint module uses multiple convolution and upsampling to distinguish boundary features from semantic features. In order to adaptively fuse boundary features with semantic segmentation features, the SAWF is proposed. It adaptively fuses semantic and boundary features by learning boundary and semantic feature fusion weights. Detailed experimental results on Cityscapes, Pascal VOC 2012 and ADE20k datasets demonstrate the superior performance of our approach.
Article Preview
Top

Introduction

In recent years, rapid advancements in machine learning and deep learning have found extensive applications across various domains. For instance, supervised classification leveraging machine learning techniques has been explored (Salhi et al., 2021). Text analysis has notably benefited from deep learning methodologies (Singh & Sachan, 2021; Ismail et al., 2022; Gu et al., 2022), alongside sentiment analysis (Mohammed et al., 2022), industrial applications (Sharma et al., 2022), medical diagnostics (Xu et al., 2021), disease safety detection (Nguyen et al., 2021), and image enhancement tasks like defogging (Liu et al., 2022). The metaverse (Deveci et al., 2022) emerges as a groundbreaking platform for experimenting with autonomous driving, heavily reliant on deep learning for its core technology. Image segmentation and boundary detection are crucial in the field of computer vision, serving various fields such as autonomous driving assistance (Teichmann et al., 2018), simultaneous localization and mapping (SLAM) (Chen et al., 2021), point cloud segmentation (Wang et al., 2022), and medical imaging (Liu et al., 2022). Semantic segmentation involves assigning specific labels to individual pixels within objects, while boundary detection focuses on delineating object edges. However, prevalent neural network architectures like FCN (Long et al., 2015), ODE (Zhou et al., 2014), and UERF (Luo et al., 2016) face challenges in effectively capturing extensive pixel relationships as network depth increases, impeding accurate pixel classification. Moreover, deeper networks introduce noise and interference, further complicating the precise classification of minimal pixel clusters and leading to resolution loss and blurring during feature extraction downsampling. As network depth increases, external factors increasingly interfere with end-to-end segmentation. Predicted image outputs often contain unknown pixel classes, significantly impacting subject boundary segmentation quality. Accurate recognition of subject boundary pixels is crucial, especially for mobile robots operating in various environments. The main focus of boundary detection in the study aims to precisely locate subject boundary pixels, even in scenarios involving multiple object classes, where edge pixels belonging to different classes can lead to inadequate environmental understanding by mobile robots.

Figure 1.

EPSSNet is compared with other lightweight models

IJSWIS.342087.f01

Complete Article List

Search this Journal:
Reset
Volume 20: 1 Issue (2024)
Volume 19: 1 Issue (2023)
Volume 18: 4 Issues (2022): 2 Released, 2 Forthcoming
Volume 17: 4 Issues (2021)
Volume 16: 4 Issues (2020)
Volume 15: 4 Issues (2019)
Volume 14: 4 Issues (2018)
Volume 13: 4 Issues (2017)
Volume 12: 4 Issues (2016)
Volume 11: 4 Issues (2015)
Volume 10: 4 Issues (2014)
Volume 9: 4 Issues (2013)
Volume 8: 4 Issues (2012)
Volume 7: 4 Issues (2011)
Volume 6: 4 Issues (2010)
Volume 5: 4 Issues (2009)
Volume 4: 4 Issues (2008)
Volume 3: 4 Issues (2007)
Volume 2: 4 Issues (2006)
Volume 1: 4 Issues (2005)
View Complete Journal Contents Listing