• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.45 no.2
• /
• pp.49-64
• /
• 2008

Recently, many researches about making more comfortable input device based on gaze detection technology have been done in human computer interface. However, the system cost becomes high due to the complicated hardware and there is difficulty to use the gaze detection system due to the complicated user calibration procedure. In this paper, we propose a new gaze detection method based on the 2D analysis and a simple user calibration. Our method used a small USB (Universal Serial Bus) camera attached on a HMD (Head-Mounted Display), hot-mirror and IR (Infra-Red) light illuminator. Because the HMD is moved according to user's facial movement, we can implement the gaze detection system of which performance is not affected by facial movement. In addition, we apply our gaze detection system to 3D first person shooting game. From that, the gaze direction of game character is controlled by our gaze detection method and it can target the enemy character and shoot, which can increase the immersion and interest of game. Experimental results showed that the game and gaze detection system could be operated at real-time speed in one desktop computer and we could obtain the gaze detection accuracy of 0.88 degrees. In addition, we could know our gaze detection technology could replace the conventional mouse in the 3D first person shooting game.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.45 no.2
• /
• pp.1-9
• /
• 2008

In this paper, to extract object regions in stereo image, we propose an enhanced algorithm that extracts objects combining both of brightness information and disparity information. The approach that extracts objects using both has been studied by Ping and Chaohui. In their algorithm, the segmentation for an input image is carried out using the brightness, and integration of segmented regions in consideration of disparity information within the previously segmented regions. In the regions where the brightness values between object regions and background regions are similar, however, the segmented regions probably include both of object regions and background regions. It may cause incorrect object extraction in the merging process executed in the unit of the segmented region. To solve this problem, in proposed method, we adopt the merging process which is performed in pixel unit. In addition, we perform the bi-directional stereo matching process to enhance reliability of the disparity information and supplement the disparity information resulted from a single directional matching process. Further searching for disparity is decided by edge information of the input image. The proposed method gives good performance in the object extraction since we find the disparity information that is not extracted in the traditional methods. Finally, we evaluate our method by experiments for the pictures acquired from a real stereoscopic camera.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.50 no.9
• /
• pp.127-135
• /
• 2013

In order to acquire images in low-light environments, it is usually necessary to adopt long exposure times or resort to flash lights. However, flashes often induce color distortion, cause the red-eye effect and can be disturbing to subjects. On the other hand, long-exposure shots are susceptible to subject-motion, as well as motion-blur due to camera shake when performed hand-held. A recently introduced technique to overcome the limitations of traditional low-light photography is that of multi-spectral flash. Multi-spectral flash images are a combination of UV/IR and visible spectrum information. The general idea is that of retrieving details from the UV/IR spectrum and color from the visible spectrum. However, multi-spectral flash images themselves are subject to color distortion and noise. This works presents a method to compute multi-spectral flash images so that noise can be reduced and color accuracy improved. The proposed approach is a previously seen optimization method, improved by the introduction of a weight map used to discriminate uniform regions from detail regions. The weight map is generated by applying canny edge operator and it is applied to the optimization process for discriminating the weights in uniform region and edge. Accordingly, the weight of color information is increased in the uniform region and the detail region of weight is decreased in detail region. Therefore, the proposed method can be enhancing color reproduction and removing artifacts. The performance of the proposed method has been objectively evaluated using long-exposure shots as reference.

• The Journal of Korea Institute of Information, Electronics, and Communication Technology
• /
• v.11 no.4
• /
• pp.414-420
• /
• 2018

The digital convergence looking for new ways to engage visitors by superimposing virtual content on projection over the real world captured media contents. This paper propose the Light ID based interactive 3D immersive exhibition things view using HMD AR technology. This approach does not required to add any additional infrastructure to be built-in to enable service and uses the installed Lighting or displays devices in the exhibit area. In this approach, the Light ID can be used as a Location Identifier and communication medium to access the content unlike the QR Tag which supports provide the download information through web interface. This utilize the advantages of camera based optical wireless communication (OWC) to receive the media content on smart device to deliver immersive 3D content visualization using AR. The proposed exhibition method is emulated on GALAXY S8 smart phone and the visual performance is evaluated for Jeonju Hanok Village. The experimental results shows that the proposed method can give immersive 3D view for exhibit things in real-time.

• Journal of Korea Multimedia Society
• /
• v.13 no.5
• /
• pp.663-673
• /
• 2010

As a tool used for video maintenance, Video segmentation divides videos in hierarchical and structural manner. This technique can be considered as a core technique that can be applied commonly for various applications such as indexing, abstraction or retrieval. Conventional video segmentation used adaptive threshold to split video by calculating difference between consecutive frames and threshold value in window with fixed size. In this case, if the time difference between occurrences of cuts is less than the size of a window or there is much difference in neighbor feature, accurate detection is impossible. In this paper, Improved Adaptive threshold algorithm which enables determination of window size according to video format and reacts sensitively on change in neighbor feature is proposed to solve the problems above. Post-Processing method for decrement in error caused by camera flash and fast movement of large objects is applied. Evaluation result showed that there is 3.7% improvement in performance of detection compared to conventional method. In case of application of this method on modified video, the result showed 95.5% of reproducibility. Therefore, the proposed method is more accurated compared to conventional method and having reproducibility even in case of various modification of videos, it is applicable in various area as a video maintenance tool.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.21 no.3
• /
• pp.246-252
• /
• 2020

Safety accidents have been reported due to falling accumulated snow from cables of cable-supported bridges. In addition to the direct damage caused by falling snow, secondary damage, such as traffic accidents, can occur. Various methods have been proposed to prevent these accidents, but there are still problems in safety and practicality. In this study, a cable robot type was selected as one of the active methods for removing accumulated snow on cables. An attempt was made to increase the climbing ability of the robot to improve the efficiency of snow removal. In addition, the available range of cable diameter for the robot can be adjusted flexibly to be applied to cables used in the field. A high-resolution camera was also installed to check the surface condition of the cable in real time to increase the utility, and be used as a cable inspection robot. A three-axis accelerometer and a tension conversion algorithm were added to measure the tension force of cables. To verify the performance, indoor and field experiments were conducted, and future improvements for the inspection robot were proposed.

• Smart Media Journal
• /
• v.3 no.4
• /
• pp.28-34
• /
• 2014

Recently the depth-image-based rendering (DIBR) method is usually used in 3D image application filed. Virtual view image is created by using a known view with associated depth map to make a virtual view point which did not taken by the camera. But, disocclusion area occur because the virtual view point is created using a depth image based image 3D warping. To remove those kind of disocclusion region, many hole filling methods are proposed until now. Constant color region searching, horizontal interpolation, horizontal extrapolation, and variational inpainting techniques are proposed as a hole filling methods. But when using those hole filling method some problem occurred. The different types of annoying artifacts are appear in texture region hole filling procedure. In this paper to solve those problem, the multi-directional extrapolation method is newly proposed for efficiency of expanded hole filling performance. The proposed method is efficient when performing hole filling which complex texture background region. Consideration of directionality for hole filling method use the hole neighbor texture pixel value when estimate the hole pixel value. We can check the proposed hole filling method can more efficiently fill the hole region which generated by virtual view synthesis result.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.34 no.6
• /
• pp.619-627
• /
• 2016

Cells of a PV (photovoltaic) module can suffer defects due to various causes resulting in a loss of power output. As a malfunctioning cell has a higher temperature than adjacent normal cells, it can be easily detected with a thermal infrared sensor. A conventional method of PV cell inspection is to use a hand-held infrared sensor for visual inspection. The main disadvantages of this method, when applied to a large-scale PV power plant, are that it is time-consuming and costly. This paper presents an algorithm for automatically detecting defective PV panels using images captured with a thermal imaging camera from an UAV (unmanned aerial vehicle). The proposed algorithm uses statistical analysis of thermal intensity (surface temperature) characteristics of each PV module to verify the mean intensity and standard deviation of each panel as parameters for fault diagnosis. One of the characteristics of thermal infrared imaging is that the larger the distance between sensor and target, the lower the measured temperature of the object. Consequently, a global detection rule using the mean intensity of all panels in the fault detection algorithm is not applicable. Therefore, a local detection rule was applied to automatically detect defective panels using the mean intensity and standard deviation range of each panel by array. The performance of the proposed algorithm was tested on three sample images; this verified a detection accuracy of defective panels of 97% or higher. In addition, as the proposed algorithm can adjust the range of threshold values for judging malfunction at the array level, the local detection rule is considered better suited for highly sensitive fault detection compared to a global detection rule. In this study, we used a panel area extraction method that we previously developed; fault detection accuracy would be improved if panel area extraction from images was more precise. Furthermore, the proposed algorithm contributes to the development of a maintenance and repair system for large-scale PV power plants, in combination with a geo-referencing algorithm for accurate determination of panel locations using sensor-based orientation parameters and photogrammetry from ground control points.

• Korean Journal of Applied Biomechanics
• /
• v.26 no.1
• /
• pp.21-30
• /
• 2016

Objective: This study aimed to examine the characteristics of joint kinematics and synchronicity of rowing motion between elite and non-elite rowers. Methods: Two elite and two non-elite rowers performed rowing strokes (3 trials, 20 strokes in each trial) at three different stroke rates (20, 30, 40 stroke/min) on two stationary rowing ergometers. The rowing motions of the rowers were captured using a 3-dimensional motion analysis system (8-infrared camera VICON system, Oxford, UK). The range of motion (RoM) of the knee, hip, and elbow joints on the sagittal plane, the lead time ($T_{Lead}$) and the drive time $T_{Drive}$) for each joint, and the elapsed time for the knee joint to maintain a fully extended position ($T_{Knee}$) during the stroke were analyzed and compared between elite and non-elite rowers. Synchronicity of the rowing motion within and between groups was examined using coefficients of variation (CV) of the $T_{Drive}$ for each joint. Results: Regardless of the stroke rate, the RoM of all joints were greater for the elite than for non-elite rowers, except for the RoMs of the knee joint at 30 stroke/min and the elbow joint at 40 stroke/min (p < .05). Although the $T_{Lead}$ at all stroke rates were the same between the groups, the $T_{Drive}$ for each joint was shorter for the elite than for the non-elite rowers. During the drive phase, elite rowers kept the fully extended knee joint angle longer than the non-elite rowers (p < .05). The CV values of the TDrive within each group were smaller for the elite compared with non-elite rowers, except for the CV values of the hip at all stroke/min and elbow at 40 stroke/min. Conclusion: The elite, compared with non-elite, rowers seem to be able to perform more powerful and efficient rowing strokes with large RoM and a short $T_{Drive}$ with the same $T_{Lead}$.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.38 no.4
• /
• pp.317-325
• /
• 2020

UAV (Unmanned Aerial Vehicle) photogrammetry has recently emerged as a means of obtaining highly precise and rapid spatial information due to its cost-effectiveness and high efficiency. However, current procedures or regulations for quantitative quality verification methods and certification processes for UAV-images are insufficient. In addition, the current verification method for image quality is not evaluated by an MTF (Modulation Transfer Function) analysis or edge response analysis, which can analyze the degree of contrast including image resolution, and only relies on the GSD (Ground Sample Distance) analysis. Therefore, in this study, the edge response analysis using a Slanted edge target was performed along with GSD analysis to confirm the necessity of analyzing edge response analysis in UAV-images quality analysis. Furthermore, a Matlab GUI-based software tool was developed to help streamline the edge response analysis. As a result, we confirmed the need for edge response analysis since the outputs of the edge response analysis from the same GSD had significantly different outcomes. Additionally, we found that the quality of the edge response analysis of UAV-images is proportional to the performance of the camera mounted on the UAV.