• Journal of Korea Multimedia Society
• /
• v.21 no.11
• /
• pp.1305-1316
• /
• 2018

Graphical user interface(GUI) has a very important role to interact with software users. However, designing and coding of GUI are tedious and pain taking processes. In many studies, the researchers are trying to convert GUI elements or widgets to code or describe formally their structures by help of domain knowledge of stochastic methods. In this paper, we propose the GUI elements detection approach based on object detection strategy using deep neural networks(DNN). Object detection with DNN is the approach that integrates localization and classification techniques. From the experimental result, if we selected the appropriate object detection model, the results can be used for automatic code generation from the sketch or capture images. The successful GUI elements detection can describe the objects as hierarchical structures of elements and transform their information to appropriate code by object description translator that will be studied at future.

• Journal of Multimedia Information System
• /
• v.6 no.4
• /
• pp.329-332
• /
• 2019

Recently, smart lighting systems are the combination between sensors and lights. These systems turn on/off and adjust the brightness of lights based on the motion of object and the brightness of environment. These systems are often applied in places such as buildings, rooms, garages and parking lot. However, these lighting systems are controlled by lighting sensors, motion sensors based on illumination environment and motion detection. In this paper, we propose an automatic lighting control system using one single camera for buildings, rooms and garages. The proposed system is one integration the results of digital image processing as motion detection, hand gesture detection to control and dim the lighting system. The experimental results showed that the proposed system work very well and could consider to apply for automatic lighting spaces.

• Journal of Advanced Navigation Technology
• /
• v.23 no.6
• /
• pp.495-500
• /
• 2019

Foreign object debris (FOD) is a generic term for various metals and non-metal foreign object and materials with potential hazards to aircraft operations. Since the method of manual FOD detection and collection in the aircraft moving area is very low in efficiency and economic efficiency, it is essential to develop to FOD automatic detection system suitable for domestic environment. This paper is the result of the performance comparison test results of the two systems for the combined operation of each optimal detection time and 95% accuracy above 100 m for complex operation using the fixed FOD automatic detection system and the mobile FOD system using EO/IR camera and radar at Taean Airfield Hanseo University. It is expected that FOD can be performed unattended through continuous R & D.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.54 no.3
• /
• pp.97-107
• /
• 2017

In the field of automatic door, the infrared rays and microwave sensor are much used as the important components in charge of the motor's operation control of open and close through the incoming signal of object recognition. In case of existing system that the sensor of the infrared rays and microwave are applied to the automatic door, there are many malfunctions by the infrared rays and visible rays of the sun. Because the automatic doors are usually installed outside of building in state of exposure. The environmental change by temperature difference occurs the noise of object recognition detection signal. With this problem, the hardware fault that the detection sensor is unable to follow the object moving rapidly within detection area makes the sensing blind spot. This fault should be improved as soon as possible. Because It influences safety of passengers who use the automatic doors. This paper conducted an experiment to improve the detection area by installing extra ultrasonic sensor besides existing detection sensor. So, this paper realize the computing circuit and detection algorithm which can correctly and rapidly process the access route of objects moving fast and the location area of fixed obstacles by applying detection and advantages of ultrasonic signal to the automatic doors. With this, It is proved that the automatic door applying ultrasonic sensor is improved detection area of blind spot sensing through field test and improvement plan is proposed.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.13 no.8
• /
• pp.3981-4004
• /
• 2019

This paper proposes a novel method for locating objects in real space from a single remote image and measuring actual distances between them by automatic detection and perspective transformation. The dimensions of the real space are known in advance. First, the corner points of the interested region are detected from an image using deep learning. Then, based on the corner points, the region of interest (ROI) is extracted and made proportional to real space by applying warp-perspective transformation. Finally, the objects are detected and mapped to the real-world location. Removing distortion from the image using camera calibration improves the accuracy in most of the cases. The deep learning framework Darknet is used for detection, and necessary modifications are made to integrate perspective transformation, camera calibration, un-distortion, etc. Experiments are performed with two types of cameras, one with barrel and the other with pincushion distortions. The results show that the difference between calculated distances and measured on real space with measurement tapes are very small; approximately 1 cm on an average. Furthermore, automatic corner detection allows the system to be used with any type of camera that has a fixed pose or in motion; using more points significantly enhances the accuracy of real-world mapping even without camera calibration. Perspective transformation also increases the object detection efficiency by making unified sizes of all objects.

• International Journal of Advanced Culture Technology
• /
• v.10 no.1
• /
• pp.230-235
• /
• 2022

This study is to select an optimal object detection algorithm for designing a self-checkout counter to improve the inconvenience of payment systems for products without existing barcodes. To this end, a performance comparison analysis of YOLO v2, Tiny YOLO v2, and the latest YOLO v5 among deep learning-based object detection algorithms was performed to derive results. In this paper, performance comparison was conducted by forming learning data as an example of 'donut' in a bakery store, and the performance result of YOLO v5 was the highest at 96.9% of mAP. Therefore, YOLO v5 was selected as the artificial intelligence object detection algorithm to be applied in this paper. As a result of performance analysis, when the optimal threshold was set for each donut, the precision and reproduction rate of all donuts exceeded 0.85, and the majority of donuts showed excellent recognition performance of 0.90 or more. We expect that the results of this paper will be helpful as the fundamental data for the development of an automatic payment system using AI self-service technology that is highly usable in the non-face-to-face era.

• Journal of Advanced Navigation Technology
• /
• v.24 no.6
• /
• pp.479-484
• /
• 2020

Foreign object debris (FOD) is a generic term for all substances that may pose a threat to aircraft operations on a runway. In the past, FOD detection and collection methods using human resources were very inefficient in terms of efficiency and economics, so it is essential to develop an unmanned FOD detection system suitable for domestic use. In this paper, the fixed FOD automatic detection system and mobile FOD automatic detection system using EO camera and radar were studied and developed at the Taean airfield of Hanseo University, and fixed and mobile method were operated to confirm that automatic FOD detection in the runway of the airfield is possible regardless of illumination and weather conditions.

• Journal of Korea Multimedia Society
• /
• v.20 no.5
• /
• pp.769-781
• /
• 2017

Deep learning networks like Convolutional Neural Networks (CNNs) show successful performances in many computer vision applications such as image classification, object detection, and so on. For implementation of deep learning networks in embedded system with limited processing power and memory, deep learning network may need to be simplified. However, simplified deep learning network cannot learn every possible scene. One realistic strategy for embedded deep learning network is to construct a simplified deep learning network model optimized for the scene images of the installation place. Then, automatic training will be necessitated for commercialization. In this paper, as an intermediate step toward automatic training under fisheye camera environments, we study more precise human localization in fisheye images, and propose an accurate human localization method, Automatic Ground-Truth Labelling Method (AGTLM). AGTLM first localizes candidate human object bounding boxes by utilizing GoogLeNet-LSTM approach, and after reassurance process by GoogLeNet-based CNN network, finally refines them more correctly and precisely(tightly) by applying saliency object detection technique. The performance improvement of the proposed human localization method, AGTLM with respect to accuracy and tightness is shown through several experiments.

• Journal of Korean Tunnelling and Underground Space Association
• /
• v.20 no.6
• /
• pp.1161-1175
• /
• 2018

An unexpected event could be easily followed by a large secondary accident due to the limitation in sight of drivers in road tunnels. Therefore, a series of automated incident detection systems have been under operation, which, however, appear in very low detection rates due to very low image qualities on CCTVs in tunnels. In order to overcome that limit, deep learning based tunnel incident detection system was developed, which already showed high detection rates in November of 2017. However, since the object detection process could deal with only still images, moving direction and speed of moving vehicles could not be identified. Furthermore it was hard to detect stopping and reverse the status of moving vehicles. Therefore, apart from the object detection, an object tracking method has been introduced and combined with the detection algorithm to track the moving vehicles. Also, stopping-reverse discrimination algorithm was proposed, thereby implementing into the combined incident detection processes. Each performance on detection of stopping, reverse driving and fire incident state were evaluated with showing 100% detection rate. But the detection for 'person' object appears relatively low success rate to 78.5%. Nevertheless, it is believed that the enlarged richness of image big-data could dramatically enhance the detection capacity of the automatic incident detection system.

• Korean Journal of Remote Sensing
• /
• v.33 no.6_1
• /
• pp.1019-1027
• /
• 2017

As high resolution satellite images can be used, numerous studies have been carried out for exploiting these images in various fields. This paper proposes horse hoof shaped object detection method based on mathematical morphology to extract interesting targets. Interesting targets have conceptually similar shapes such as a horse hoof, not having exact size or shape. Detection of an object with the similar shapes is possible by applying mathematical morphology processes. The proposed method allows an automatic object detection system to detect the meaningful object in a large satellite image rapidly. The mathematical morphology process can be applied to binary images, and thus this method is very simple. Therefore, this method can easily extract a "horse hoof shaped object" from any image that has indistinct edges of the interesting object and different image qualities depending on the filming location, filming time, and filming environment. Using the proposed method by which a "horse hoof shaped object" can be rapidly extracted, the performance of the automatic object detection system can be improved.