Improved Yolov5 and Image Morphology Processing Based on UAV Platform for Dike Health Inspection

Improved Yolov5 and Image Morphology Processing Based on UAV Platform for Dike Health Inspection

Wei Ma, Pei Chang Zhang, Lei Huang, Jun Wei Zhu, Yu Tao Lian, Jie Xiong, Fan Jin
Copyright: © 2023 |Pages: 13
DOI: 10.4018/IJWSR.328072
Article PDF Download
Open access articles are freely available for download

Abstract

Dike health inspection is crucial in river channel regulating. The conventional manual collapse inspection is inefficient and costly so that the unmanned aerial vehicle (UAV)-based inspection has been widely applied. However, the existing vision-based defect detection methods face challenges, such as lack of defect sample data and closed specified data sets. To address them, a defect detection method based on improved YOLOv5 recognition combined with image morphology processing is proposed for dike health inspection with zero defect samples. Specifically, the coordinate attention mechanism is introduced in YOLOv5 model to improve recognition capability for dikes. Also, a rotating bounding box target detection is designed for arbitrary orientation of dikes under UAV view, due to ineffective horizontal bounding box detection. Furthermore, for suspected defect locating efficiency promotion, the specific recognized area of the dike is isolated in the image morphology process. The results show that the proposed method outperforms the traditional Yolov5 algorithm on recall rate, F1, and mAP.
Article Preview
Top

Introduction

Since global warming and extreme weather events have become increasingly intense, flood control has become one of the priorities among disaster protection systems. Dikes play a crucial role in flood control efforts, serving as critical elements for flood prevention and mitigation. However, as a result of prolonged operation and inadequate maintenance, dikes are vulnerable to seepage penetration and water scouring, which leads to varying degrees of danger and poses a serious threat to property and human safety in affected areas. Unfortunately, current dike collapse risk monitoring methods mostly rely on regular manual inspections, which not only consume significant human, financial, and material resources, but also are inefficient. Additionally, dikes in remote areas may not be readily accessible for manual inspections, leading to inspection loopholes.

In recent years, with the aid of neural networks and deep learning technology, visual defect detection, based on deep learning, has gained significant attention in the field of defect detection (Luo et al., 2021; Luo et al., 2022; Ofir et al., 2023; Tapamo et al., 2023). The deep learning-based computer vision defect detection is primarily trained by feeding a large number of defect samples into a deep network, which in turn learns the characteristics of the identified targets. In comparison with traditional feature extraction methods such as the Scale Invariant Feature Transform (SIFT) (Gao et al., 2015) and the Histogram of Oriented Gradients (HOG) (Chacon-Murguia et al., 2021), this kind of target detection method not only lowers false detection rate and leakage rate, but also has better feature expression capability and detection accuracy. There are two main categories of deep learning-based target detection algorithms. One category is two-stage target detection, which divides the candidate bounding box and classification tasks. The first stage extracts the potential location of the target through a specific neural network to form a target candidate region, and the second stage detects the target of candidate regions, which represent R-CNN (Agrawal et al., 2014) and Fast R-CNN (Girshick, 2015), in particular. The other category is one-stage target detection, which combines candidate region proposal and target detection into a single step. The YOLO (Bochkovskiy et al., 2020; Redmon et al., 2016; Redmon & Farhadi, 2017, 2018) series is a representative example of the other category.

However, traditional target detection algorithms such as YOLO are often utilized for defect detection by firstly identifying a large number of defective samples, labeling them, and then feeding them into the YOLO model for training. Although this approach is effective, it may be challenging to obtain a significant number of defective samples. In the context of dike collapse detection, the occurrence rate of collapsed and defective sections within an individual embankment is consistently observed to be minimal. Consequently, this scarcity poses a significant challenge in acquiring an ample defect sample data. Furthermore, obtaining certain specified data sets may not be feasible owing to the limited availability of openness. Accordingly, the detection of defects with zero defect samples remains a significant challenge that both industry and academia strive to overcome. In this paper, an UAV platform based zero defect sample defect detection method for dike collapse defect detection, which is also capable of providing heuristic method in further scenarios, is proposed.

Complete Article List

Search this Journal:
Reset
Volume 21: 1 Issue (2024)
Volume 20: 1 Issue (2023)
Volume 19: 4 Issues (2022): 1 Released, 3 Forthcoming
Volume 18: 4 Issues (2021)
Volume 17: 4 Issues (2020)
Volume 16: 4 Issues (2019)
Volume 15: 4 Issues (2018)
Volume 14: 4 Issues (2017)
Volume 13: 4 Issues (2016)
Volume 12: 4 Issues (2015)
Volume 11: 4 Issues (2014)
Volume 10: 4 Issues (2013)
Volume 9: 4 Issues (2012)
Volume 8: 4 Issues (2011)
Volume 7: 4 Issues (2010)
Volume 6: 4 Issues (2009)
Volume 5: 4 Issues (2008)
Volume 4: 4 Issues (2007)
Volume 3: 4 Issues (2006)
Volume 2: 4 Issues (2005)
Volume 1: 4 Issues (2004)
View Complete Journal Contents Listing