• Journal of Ocean Engineering and Technology
• /
• v.30 no.3
• /
• pp.214-220
• /
• 2016

Imaging sonars such as side-scanning sonar or forward-looking sonar are becoming fundamental sensors in the underwater robotics field. However, using sonar images for underwater perception presents many challenges. Sonar images are usually low resolution with inherent speckled noise. To overcome the limited sensor information for underwater perception, we investigated preprocessing methods for sonar images and feature detection methods for a nonlinear scale space. In this paper, we focus on a comparative analysis of (1) preprocessing for sonar images and (2) the feature detection performance in relation to the scale space composition.

• Ocean Systems Engineering
• /
• v.10 no.4
• /
• pp.435-449
• /
• 2020

This paper proposes a method to estimate the underwater target object's yaw angle using a sonar image. A simulator modeling imaging mechanism of a sonar sensor and a generative adversarial network for style transfer generates realistic template images of the target object by predicting shapes according to the viewing angles. Then, the target object's yaw angle can be estimated by comparing the template images and a shape taken in real sonar images. We verified the proposed method by conducting water tank experiments. The proposed method was also applied to AUV in field experiments. The proposed method, which provides bearing information between underwater objects and the sonar sensor, can be applied to algorithms such as underwater localization or multi-view-based underwater object recognition.

• The Journal of Korea Robotics Society
• /
• v.15 no.1
• /
• pp.1-7
• /
• 2020

In this paper, we introduce the methodology that utilizes deep learning-based front-end to enhance underwater feature matching. Both optical camera and sonar are widely applicable sensors in underwater research, however, each sensor has its own weaknesses, such as light condition and turbidity for the optic camera, and noise for sonar. To overcome the problems, we proposed the opti-acoustic transformation method. Since feature detection in sonar image is challenging, we converted the sonar image to an optic style image. Maintaining the main contents in the sonar image, CNN-based style transfer method changed the style of the image that facilitates feature detection. Finally, we verified our result using cosine similarity comparison and feature matching against the original optic image.

• Journal of Ocean Engineering and Technology
• /
• v.30 no.3
• /
• pp.227-233
• /
• 2016

This paper presents an underwater structure 3D reconstruction method using a 2D multibeam imaging sonar. Compared with other underwater environmental recognition sensors, the 2D multibeam imaging sonar offers high resolution images in water with a high turbidity level by showing the reflection intensity data in real-time. With such advantages, almost all underwater applications, including ROVs, have applied this 2D multibeam imaging sonar. However, the elevation data are missing in sonar images, which causes difficulties with correctly understanding the underwater topography. To solve this problem, this paper concentrates on the physical relationship between the sonar image and the scene topography to find the elevation information. First, the modeling of the sonar reflection intensity data is studied using the distances and angles of the sonar beams and underwater objects. Second, the elevation data are determined based on parameters like the reflection intensity and shadow length. Then, the elevation information is applied to the 3D underwater reconstruction. This paper evaluates the presented real-time 3D reconstruction method using real underwater environments. Experimental results are shown to appraise the performance of the method. Additionally, with the utilization of ROVs, the contour and texture image mapping results from the obtained 3D reconstruction results are presented as applications.

• Journal of Advanced Marine Engineering and Technology
• /
• v.33 no.2
• /
• pp.344-354
• /
• 2009

Side scan sonar using acoustic wave plays a very important role in the underwater, sea floor, and shallow marine geologic survey. In this study, we have acquired side scan sonar data for the underwater man-made structures, artificial reefs and fishing grounds, installed and distributed in the survey area. We applied digital image processing techniques to side scan sonar data in order to improve and enhance an image quality. We carried out digital image processing with various kinds of filtering in spatial domain and frequency domain. We tested filtering parameters such as kernel size, differential operator, and statistical value. We could easily estimate the conditions, distribution and environment of artificial structures through the interpretation of side scan sonar.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.53 no.3
• /
• pp.91-98
• /
• 2016

Detection and classification of underwater objects in sonar imagery are challenging problems. This paper proposes a system that detects and identifies underwater objects at the sea floor level using a sonar image and image processing techniques. The identification process of underwater objects consists of two steps; detection of candidate regions and identification of underwater objects. The candidate regions of underwater objects are extracted by image registration through the detection of common feature points between the reference background image and the current scanning image. And then, underwater objects are identified as the closest pattern within the database using eigenvectors and eigenvalues as features. The proposed system is expected to be used in efficient securement of Q route in vessel navigation.

• The Journal of Korea Robotics Society
• /
• v.14 no.1
• /
• pp.14-21
• /
• 2019

In the ground environment, mobile robot research uses sensors such as GPS and optical cameras to localize surrounding landmarks and to estimate the position of the robot. However, an underwater environment restricts the use of sensors such as optical cameras and GPS. Also, unlike the ground environment, it is difficult to make a continuous observation of landmarks for location estimation. So, in underwater research, artificial markers are installed to generate a strong and lasting landmark. When artificial markers are acquired with an underwater sonar sensor, different types of noise are caused in the underwater sonar image. This noise is one of the factors that reduces object detection performance. This paper aims to improve object detection performance through distortion and rotation augmentation of training data. Object detection is detected using a Faster R-CNN.

• The Journal of the Acoustical Society of Korea
• /
• v.37 no.2
• /
• pp.118-128
• /
• 2018

In this paper, we have studied how to search an underwater object by learning the image generated by the side scan sonar in the convolution neural network. In the method of human side analysis of the side scan image or the image, the convolution neural network algorithm can enhance the efficiency of the analysis. The image data of the side scan sonar used in the experiment is the public data of NSWC (Naval Surface Warfare Center) and consists of four kinds of synthetic underwater objects. The convolutional neural network algorithm is based on Faster R-CNN (Region based Convolutional Neural Networks) learning based on region of interest and the details of the neural network are self-organized to fit the data we have. The results of the study were compared with a precision-recall curve, and we investigated the applicability of underwater object detection in convolution neural networks by examining the effect of change of region of interest assigned to sonar image data on detection performance.

• The Journal of Korea Robotics Society
• /
• v.9 no.4
• /
• pp.232-241
• /
• 2014

This paper proposes an underwater localization algorithm using probabilistic object recognition. It is organized as follows; 1) recognizing artificial objects using imaging sonar, and 2) localizing the recognized objects and the vehicle using EKF(Extended Kalman Filter) based SLAM. For this purpose, we develop artificial landmarks to be recognized even under the unstable sonar images induced by noise. Moreover, a probabilistic recognition framework is proposed. In this way, the distance and bearing of the recognized artificial landmarks are acquired to perform the localization of the underwater vehicle. Using the recognized objects, EKF-based SLAM is carried out and results in a path of the underwater vehicle and the location of landmarks. The proposed localization algorithm is verified by experiments in a basin.

• Proceedings of the Korean Society of Marine Engineers Conference
• /
• 2005.11a
• /
• pp.152-153
• /
• 2005

Side scan sonar System occupies an important position as one of marine survey equipments. The purpose of this research is to express sonar' scan images in underwater and compare with the measured size, shape and the quality of the material. Also we confirm the effectiveness of obtained images using the Side scan sonar.