• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.19 no.11
• /
• pp.594-603
• /
• 2018

Recently, according to the development of measurement techniques, it has become possible to take complicated and time-consuming field measurements in a simple and convenient manner. In this background, this study estimated the tension of cables under ambient vibration using minimized measurement and signal processing. The VBDM using video-only by low-cost equipment was used as a minimized measurement. An estimation of the natural frequency using the mirror frequency concept was also proposed to solve the shortage of frequency band in this case. Furthermore, the FDD method was adopted for a natural frequency estimation in the ambient vibration related to field application. Experimental studies using a cable-stayed bridge model were carried out to examine the properties of the mirror frequency and the applicability of FDD with the proposed minimized system. The results showed that FDD for ambient vibration also works properly in an estimation of the natural frequency using the minimized system. In addition, the mirror frequency concept can allow a high natural frequency estimation even in a distorted signal by low-speed recording, which can overcome the limit of the minimized system. Overall, the proposed minimized system can be effective for the tension estimations of a cable under ambient vibration.

• Journal of the Institute of Convergence Signal Processing
• /
• v.22 no.4
• /
• pp.193-198
• /
• 2021

Recently, interests in the 4th industry have increased the level of demand for pest control by farmers in the field of rice farming, and the interests and use of agricultural pest control drones. Therefore, the diversification of agricultural control drones that spray high-concentration pesticides and the increase of agricultural exterminators due to the acquisition of national drone certifications are rapidly developing the agricultural sector in the drone industry. In addition, as detailed projects, an effective platform is required to construct large-scale big data due to pesticide management, exterminator management, precise spraying, pest control work volume classification, settlement, soil management, prediction and monitoring of damages by pests, etc. and to process the data. However, studies in South Korea and other countries on development of models and programs to integrate and process the big data such as data analysis algorithms, image analysis algorithms, growth management algorithms, AI algorithms, etc. are insufficient. This paper proposed an online drone pest control management information platform to meet the needs of managers and farmers in the agricultural field and to realize precise AI pest control based on the agricultural drone pest control processor using drones and presented foundation for development of a comprehensive management system through empirical experiments.

• Journal of the Institute of Convergence Signal Processing
• /
• v.22 no.4
• /
• pp.179-184
• /
• 2021

Along with the development of the fourth industry, the public sector has increasingly paid more attention to search using drones and real-time monitoring, for various goals. The drones are used and researched to complete a variety of searching and monitoring missions, including search for missing persons, security, coastal patrol and monitoring, speed enforcement, highway and urban traffic monitoring, fire and wildfire monitoring, monitoring of illegal fishing in reservoirs and protest rally monitoring. Police stations, fire departments and military authorities, however, concentrate on the hardware part, so there are little research on efficient communication systems for the real-time monitoring of data collected from high-performance resolution and infrared thermal imagining cameras, and analysis programs suitable for special missions. In order to increase the efficiency of drones with the searching mission, this paper, therefore, attempts to propose an image analysis technique to increase the precision of search by producing image data suitable for searching missions, based on images obtained from drones and provide the foundation for improving relevant policies and establishing proper platforms, based on actual field cases and experiments.

• KIPS Transactions on Software and Data Engineering
• /
• v.11 no.5
• /
• pp.211-220
• /
• 2022

Recently, research on smart factories triggered by the 4th industrial revolution is being actively conducted. Accordingly, the manufacturing industry is conducting various studies to improve productivity and quality based on deep learning technology with robust performance. This paper is a study on the method of detecting tire surface defects in the visual inspection stage of the tire manufacturing process, and introduces a tire surface defect detection method using a depth image acquired through a 3D camera. The tire surface depth image dealt with in this study has the problem of low contrast caused by the shallow depth of the tire surface and the difference in the reference depth value due to the data acquisition environment. And due to the nature of the manufacturing industry, algorithms with performance that can be processed in real time along with detection performance is required. Therefore, in this paper, we studied a method to normalize the depth image through relatively simple methods so that the tire surface defect detection algorithm does not consist of a complex algorithm pipeline. and conducted a comparative experiment between the general normalization method and the normalization method suggested in this paper using YOLO V3, which could satisfy both detection performance and speed. As a result of the experiment, it is confirmed that the normalization method proposed in this paper improved performance by about 7% based on mAP 0.5, and the method proposed in this paper is effective.

• Journal of the Institute of Convergence Signal Processing
• /
• v.24 no.1
• /
• pp.27-33
• /
• 2023

Recently, water shortages have occurred due to climate change, and the need for water management of agricultural water has increased due to the occurrence of algal blooms in reservoirs. Existing algae prevention is operated by putting many people on site and misses the optimal spraying time due to movement through boats. In order to solve this problem, it is necessary to block contamination in advance and move within time to uniformly spray complex microorganisms uniformly. Control drones are used for pesticide spraying and can be applied to algae prevention work by utilizing control drones. In this paper, basic research for the establishment of a marine control system was conducted for application to the reservoir environment, and as one of the results, the characteristics of a drone nozzle, a core technology that can be used for control drones, were calculated. In particular, it was found that the existing agricultural control drones had a disadvantage that the concentration was non-uniform within the suggested spraying interval, and to compensate for this, nozzle positioning and nozzle spraying uniformity were calculated. Based on the experimental results, we develop a core algorithm for establishing an algal bloom monitoring system in the reservoir environment and propose a precision control technology that can be used for marine control work in the future.

• Journal of Internet of Things and Convergence
• /
• v.10 no.2
• /
• pp.85-91
• /
• 2024

In this paper, we studied projection mapping, which is being utilized as a digital canvas beyond space and time for theme parks, mega events, and exhibition performances. Since the existing projection technology used for fixed objects has the limitation that it is difficult to map moving objects in terms of utilization, it is urgent to develop a technology that can track and map moving objects and a real-time dynamic projection mapping system based on dynamically moving objects so that it can respond to various markets such as performances, exhibitions, and theme parks. In this paper, we propose a system that can track real-time objects in real time and eliminate the delay phenomenon by developing hardware and performing high-speed image processing. Specifically, we develop a real-time object image analysis and projection focusing control unit, an integrated operating system for a real-time object tracking system, and an image processing library for projection mapping. This research is expected to have a wide range of applications in the technology-intensive industry that utilizes real-time vision machine-based detection technology, as well as in the industry where cutting-edge science and technology are converged and produced.

• Journal of Intelligence and Information Systems
• /
• v.28 no.1
• /
• pp.89-106
• /
• 2022

Recently, the amount of video data collected from smartphones, CCTVs, black boxes, and high-definition cameras has increased rapidly. According to the increasing video data, the requirements for analysis and utilization are increasing. Due to the lack of skilled manpower to analyze videos in many industries, machine learning and artificial intelligence are actively used to assist manpower. In this situation, the demand for various computer vision technologies such as object detection and tracking, action detection, emotion detection, and Re-ID also increased rapidly. However, the object detection and tracking technology has many difficulties that degrade performance, such as re-appearance after the object's departure from the video recording location, and occlusion. Accordingly, action and emotion detection models based on object detection and tracking models also have difficulties in extracting data for each object. In addition, deep learning architectures consist of various models suffer from performance degradation due to bottlenects and lack of optimization. In this study, we propose an video analysis system consists of YOLOv5 based DeepSORT object tracking model, SlowFast based action recognition model, Torchreid based Re-ID model, and AWS Rekognition which is emotion recognition service. Proposed model uses single-linkage hierarchical clustering based Re-ID and some processing method which maximize hardware throughput. It has higher accuracy than the performance of the re-identification model using simple metrics, near real-time processing performance, and prevents tracking failure due to object departure and re-emergence, occlusion, etc. By continuously linking the action and facial emotion detection results of each object to the same object, it is possible to efficiently analyze videos. The re-identification model extracts a feature vector from the bounding box of object image detected by the object tracking model for each frame, and applies the single-linkage hierarchical clustering from the past frame using the extracted feature vectors to identify the same object that failed to track. Through the above process, it is possible to re-track the same object that has failed to tracking in the case of re-appearance or occlusion after leaving the video location. As a result, action and facial emotion detection results of the newly recognized object due to the tracking fails can be linked to those of the object that appeared in the past. On the other hand, as a way to improve processing performance, we introduce Bounding Box Queue by Object and Feature Queue method that can reduce RAM memory requirements while maximizing GPU memory throughput. Also we introduce the IoF(Intersection over Face) algorithm that allows facial emotion recognized through AWS Rekognition to be linked with object tracking information. The academic significance of this study is that the two-stage re-identification model can have real-time performance even in a high-cost environment that performs action and facial emotion detection according to processing techniques without reducing the accuracy by using simple metrics to achieve real-time performance. The practical implication of this study is that in various industrial fields that require action and facial emotion detection but have many difficulties due to the fails in object tracking can analyze videos effectively through proposed model. Proposed model which has high accuracy of retrace and processing performance can be used in various fields such as intelligent monitoring, observation services and behavioral or psychological analysis services where the integration of tracking information and extracted metadata creates greate industrial and business value. In the future, in order to measure the object tracking performance more precisely, there is a need to conduct an experiment using the MOT Challenge dataset, which is data used by many international conferences. We will investigate the problem that the IoF algorithm cannot solve to develop an additional complementary algorithm. In addition, we plan to conduct additional research to apply this model to various fields' dataset related to intelligent video analysis.

• Journal of Bio-Environment Control
• /
• v.7 no.3
• /
• pp.226-236
• /
• 1998

If the lowest leaves of the cucumber were removed or training cultivable method was changed, a computer vision system could divide well the cucumber fruit from the others, and also an end-effector could reach and grip cucumber fruit and cut well its fruit stalk. Therefore, this study investigated whether removal leaves and training cultivable method of a cucumber could affect its growth and yield. They can help to be designed the vision system and the end-effector. A cucumber fruit grew by 6-l5cm long for 2 days regardless of removing leaves. Removal leaves didn't affect growth of cucumber fruit. Number of cucumber fruit was produced within 10% different values by three methods (A, B, C) of removal leaves. The first grade rate (best quality) of 4 B and C was 56.7%, 53.1%, 56.3% respectively. Consequently, proper removal leaves were better than traditional way, which does not remove a leaf, because they make cucumber plant ventilate more freely and absorb more light.

• The KIPS Transactions:PartB
• /
• v.16B no.5
• /
• pp.341-346
• /
• 2009

The motion data glove is a representative human-computer interaction tool that inputs human hand gestures to computers by measuring their motions. The motion data glove is essential equipment used for new computer technologiesincluding home automation, virtual reality, biometrics, motion capture. For its popular usage, this paper attempts to develop an inexpensive visual.type motion data glove that can be used without any special equipment. The proposed approach has the special feature; it can be developed as a low-cost one becauseof not using high-cost motion-sensing fibers that were used in the conventional approaches. That makes its easy production and popular use possible. This approach adopts a visual method that is obtained by improving conventional optic motion capture technology, instead of mechanical method using motion-sensing fibers. Compared to conventional visual methods, the proposed method has the following advantages and originalities Firstly, conventional visual methods use many cameras and equipments to reconstruct 3D pose with eliminating occlusions But the proposed method adopts a mono vision approachthat makes simple and low cost equipments possible. Secondly, conventional mono vision methods have difficulty in reconstructing 3D pose of occluded parts in images because they have weak points about occlusions. But the proposed approach can reconstruct occluded parts in images by using originally designed thin-bar-shaped optic indicators. Thirdly, many cases of conventional methods use nonlinear numerical computation image analysis algorithm, so they have inconvenience about their initialization and computation times. But the proposed method improves these inconveniences by using a closed-form image analysis algorithm that is obtained from original formulation. Fourthly, many cases of conventional closed-form algorithms use approximations in their formulations processes, so they have disadvantages of low accuracy and confined applications due to singularities. But the proposed method improves these disadvantages by original formulation techniques where a closed-form algorithm is derived by using exponential-form twist coordinates, instead of using approximations or local parameterizations such as Euler angels.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.51 no.4
• /
• pp.144-159
• /
• 2014

Techniques for making a single panoramic image using multiple pictures are widely studied in many areas such as computer vision, computer graphics, etc. The panorama image can be applied to various fields like virtual reality, robot vision areas which require wide-angled shots as an useful way to overcome the limitations such as picture-angle, resolutions, and internal informations of an image taken from a single camera. It is so much meaningful in a point that a panoramic image usually provides better immersion feeling than a plain image. Although there are many ways to build a panoramic image, most of them are using the way of extracting feature points and matching points of each images for making a single panoramic image. In addition, those methods use the RANSAC(RANdom SAmple Consensus) algorithm with matching points and the Homography matrix to transform the image. The SURF(Speeded Up Robust Features) algorithm which is used in this paper to extract featuring points uses an image's black and white informations and local spatial informations. The SURF is widely being used since it is very much robust at detecting image's size, view-point changes, and additionally, faster than the SIFT(Scale Invariant Features Transform) algorithm. The SURF has a shortcoming of making an error which results in decreasing the RANSAC algorithm's performance speed when extracting image's feature points. As a result, this may increase the CPU usage occupation rate. The error of detecting matching points may role as a critical reason for disqualifying panoramic image's accuracy and lucidity. In this paper, in order to minimize errors of extracting matching points, we used $3{\times}3$ region's RGB pixel values around the matching points' coordinates to perform intermediate filtering process for removing wrong matching points. We have also presented analysis and evaluation results relating to enhanced working speed for producing a panorama image, CPU usage rate, extracted matching points' decreasing rate and accuracy.