• Journal of Korea Multimedia Society
• /
• v.19 no.8
• /
• pp.1225-1235
• /
• 2016

This paper presents a method for computer-assisted slide presentation using vision-based gesture recognition. The proposed method consists of a sequence of steps, first detecting a hand in the scene of projector beam, then estimating the smooth trajectory of a hand or a pointing finger using Kalman Filter, and finally interfacing to an application system. Additional slide navigation control includes moving back and forth the pages of the presentation. The proposed method is to help speakers for an effective presentation with natural improved interaction with the computer. In particular, the proposed method of using finger pointing is believed to be more effective than using a laser pointer since the hand, the pointing or finger are more visible and thus can better grab the attention of the audience.

• The Journal of Korea Robotics Society
• /
• v.17 no.3
• /
• pp.245-254
• /
• 2022

Sensor dataset for autonomous driving is one of the essential components as the deep learning approaches are widely used. However, most driving datasets are focused on typical environments such as sunny or cloudy. In addition, most datasets deal with color images and lidar. In this paper, we propose a driving dataset with multi-spectral images and lidar in adverse weather conditions such as snowy, rainy, smoky, and dusty. The proposed data acquisition system has 4 types of cameras (color, near-infrared, shortwave, thermal), 1 lidar, 2 radars, and a navigation sensor. Our dataset is the first dataset that handles multi-spectral cameras in adverse weather conditions. The Proposed dataset is annotated as 2D semantic labels, 3D semantic labels, and 2D/3D bounding boxes. Many tasks are available on our dataset, for example, object detection and driveable region detection. We also present some experimental results on the adverse weather dataset.

• Journal of Advanced Navigation Technology
• /
• v.21 no.3
• /
• pp.251-257
• /
• 2017

Recently, hybrid positioning system combining GPS, vision sensor, and inertial sensor has drawn many attentions to estimate accurate vehicle positions. Since accurate multi-sensor fusion requires efficient time synchronization, this paper proposes an efficient method to obtain time synchronized measurements of vision sensor, inertial sensor, and OBD device based on GPS time information. In the proposed method, the time and position information is obtained by the GPS receiver, the attitude information is obtained by the inertial sensor, and the speed information is obtained by the OBD device. The obtained time, position, speed, and attitude information is converted to the color information. The color information is inserted to several corner pixels of the corresponding image frame. An experiment was performed with real measurements to evaluate the feasibility of the proposed method.

• Journal of Navigation and Port Research
• /
• v.41 no.6
• /
• pp.395-400
• /
• 2017

As a serial communications protocol, Modbus has become a practically standard communication protocol and is now a commonly available means of connecting industrial electronic devices. Therefore, all devices can be connected using the Modbus protocol with the measurement and remote control on ships, buildings, trains, airplanes and more. The existing Modbus that has been used is based on serial communication. Modbus TCP uses Ethernet communication based on TCP / IP which is the most widely used Internet protocol today; so, it is faster than serial communication and can be connected to the Internet of Things. In this paper, we designed an algorithm to control LED lighting in a wireless Wi-Fi environment using the Modbus TCP communication protocol, and designed and implemented a LED controller circuit that can check external environmental factors and control remotely through the integrated management system of a ship. Temperature, humidity, current and illuminance values, which are external environmental factors, are received by the controller through the sensors, and these values are communicated to the ship's integrated management system via the Modbus protocol. The Modbus can be connected to Master devices via TCP communication to monitor temperature, humidity, current, illuminance status and LED output values, and also users can change the RGB value remotely in order to change to the desired color. In addition, in order to confirm the implementation of the controller, we developed a simulated ship management system to monitor the temperature, humidity, current and illumination conditions, and change the LED color of the controller by changing the RGB value remotely.

• Journal of Institute of Control, Robotics and Systems
• /
• v.19 no.11
• /
• pp.1029-1035
• /
• 2013

This paper proposes a real time lane detection algorithm using LRF (Laser Range Finder) for autonomous navigation of a mobile robot. There are many technologies for safety of the vehicles such as airbags, ABS, EPS etc. The real time lane detection is a fundamental requirement for an automobile system that utilizes outside information of automobiles. Representative methods of lane recognition are vision-based and LRF-based systems. By the vision-based system, recognition of environment for three dimensional space becomes excellent only in good conditions for capturing images. However there are so many unexpected barriers such as bad illumination, occlusions, and vibrations that the vision cannot be used for satisfying the fundamental requirement. In this paper, we introduce a three dimensional lane detection algorithm using LRF, which is very robust against the illumination. For the three dimensional lane detections, the laser reflection difference between the asphalt and lane according to the color and distance has been utilized with the extraction of feature points. Also a stable tracking algorithm is introduced empirically in this research. The performance of the proposed algorithm of lane detection and tracking has been verified through the real experiments.

• Journal of the Korean Society of Marine Environment & Safety
• /
• v.18 no.5
• /
• pp.475-480
• /
• 2012

This study on the methode is easied to distinguish with emotional visual lighting on AtoN facility using 3colors LED, and which is controlled to on-off switching of approach light in shore or harbor. The identification have easied to provide a differentiation between the AtoN facility of red and white light and surrounding light in harbor both sides. And the integrated controller have designed to left-right and serial sequential lighting system for harbor guidance using the GPS synchronous or timer. There is expectation effect that is prevent a confusion about distinguish of facility by ship's operator and to beautify a night scene of harbor, which is expressed to emotional identification lighting and variable color lighting on AtoN body by vertical layer color lighting using LED. In addition, the performance of AtoN is implemented to display with guidance light the harbor safety message by morse code lighting. Effectiveness of system is enhanced that age and power consumption reduce by candle alternated high light LED.

• Journal of Advanced Navigation Technology
• /
• v.16 no.3
• /
• pp.545-552
• /
• 2012

In this paper, we propose Modified Multi CAMShift Algorithm based on Kalman filter and Weighted Search Windows(KWMCAMShift) that extracts skin color area and tracks several human body parts for real-time human tracking system. We propose modified CAMShift algorithm that generates background model, extracts skin area of hands and head, and tracks the body parts. Kalman filter stabilizes tracking search window of skin area due to changing skin area in consecutive frames. Each occlusion areas is avoided by using weighted window of non-search areas and main-search area. And shadows are eliminated from background model and intensity of shadow. The proposed KWMCAMShift algorithm can estimate human pose in real-time and achieves 96.82% accuracy even in the case of occlusions.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.20 no.12
• /
• pp.2355-2362
• /
• 2016

Seg fog removal is an important issue concerned by both computer vision and image processing. Sea fog or haze removal is widely used in lots of fields, such as automatic control system, CCTV, and image recognition. Color image dehazing techniques have been extensively studied, and expecially the dark channel prior(DCP) technique has been widely used. This paper propose a fast and efficient image prior - dark channel prior to remove seg-fog from a single digital image based on the GPU. We implement the basic parallel program and then optimize it to obtain performance acceleration with more than 250 times. While paralleling and the optimizing the algorithm, we improve some parts of the original serial program or basic parallel program according to the characteristics of several steps. The proposed GPU programming algorithm and implementation results may be used with advantages as pre-processing in many systems, such as safe navigation for ship, topographical survey, intelligent vehicles, etc.

• Journal of the Institute of Electronics Engineers of Korea SC
• /
• v.45 no.6
• /
• pp.26-34
• /
• 2008

The information of traversability and path planning is essential for UGV(Unmanned Ground Vehicle) navigation. Such information can be obtained by analyzing 3D terrain. In this paper, we present the method of 3D terrain modeling with color information from a camera, precise distance information from a 2D Laser Range Finder(LRF) and wheel encoder information from mobile robot with less data. And also we present the method of 3B terrain modeling with the information from GPS/IMU and 2D LRF with less data. To fuse the color information from camera and distance information from 2D LRF, we obtain extrinsic parameters between a camera and LRF using planar pattern. We set up such a fused system on a mobile robot and make an experiment on indoor environment. And we make an experiment on outdoor environment to reconstruction 3D terrain with 2D LRF and GPS/IMU(Inertial Measurement Unit). The obtained 3D terrain model is based on points and requires large amount of data. To reduce the amount of data, we use cubic grid-based model instead of point-based model.

• Proceedings of the Korean Institute of Navigation and Port Research Conference
• /
• 2002.11a
• /
• pp.147-153
• /
• 2002

Due to the growth of population and industrial development at the coastal cities, there has been much increase in necessity to effective control of the wastes into the coastal water and river. The amount of disposal at those waters has been increased rapidly and it is necessary for us to track of it in order to keep the water clean. The investigation and research related to the water quality in this region have been conducted continuously but the systematic survey of the disposed wastes at the bottom was neglected and/or minor. In this study we surveyed the status of disposed waste distribution at the bottom coastal water and river from the scanned images. The intensity of sound received by the side scan sonar tow vehicle from the sea floor provides information as to the general distribution and characteristics of the superficial wastes. The port and starboard side scanned images produced from a transducer borne on a tow fish connected by tow cable to a tug boat have the area with width of 22m∼112m, and band of 44m∼224m. All data are displayed in real-time on a high-resolution color display (1280 ${\times}$ 1024 pixels) together with position information by DGPS. From the field measurement and analysis of the recorded images, we could draw the location and distribution of bottom disposals. Furthermore, we made a database system which might be fundamental for planning the waste reception and process control system.