• Journal of the Ergonomics Society of Korea
• /
• v.31 no.3
• /
• pp.427-435
• /
• 2012

The aim of this study is to investigate facial temperature changes induced by facial expression and emotional state in order to recognize a persons emotion using facial thermal images. Background: Facial thermal images have two advantages compared to visual images. Firstly, facial temperature measured by thermal camera does not depend on skin color, darkness, and lighting condition. Secondly, facial thermal images are changed not only by facial expression but also emotional state. To our knowledge, there is no study to concurrently investigate these two sources of facial temperature changes. Method: 231 students participated in the experiment. Four kinds of stimuli inducing anger, fear, boredom, and neutral were presented to participants and the facial temperatures were measured by an infrared camera. Each stimulus consisted of baseline and emotion period. Baseline period lasted during 1min and emotion period 1~3min. In the data analysis, the temperature differences between the baseline and emotion state were analyzed. Eyes, mouth, and glabella were selected for facial expression features, and forehead, nose, cheeks were selected for emotional state features. Results: The temperatures of eyes, mouth, glanella, forehead, and nose area were significantly decreased during the emotional experience and the changes were significantly different by the kind of emotion. The result of linear discriminant analysis for emotion recognition showed that the correct classification percentage in four emotions was 62.7% when using both facial expression features and emotional state features. The accuracy was slightly but significantly decreased at 56.7% when using only facial expression features, and the accuracy was 40.2% when using only emotional state features. Conclusion: Facial expression features are essential in emotion recognition, but emotion state features are also important to classify the emotion. Application: The results of this study can be applied to human-computer interaction system in the work places or the automobiles.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.34 no.6
• /
• pp.559-568
• /
• 2016

For the economic management of photovoltaic power plants, it is necessary to regularly monitor the panels within the plants to detect malfunctions. Thermal infrared image cameras are generally used for monitoring, since malfunctioning panels emit higher temperatures compared to those that are functioning. Recently, technologies that observe photovoltaic arrays by mounting thermal infrared cameras on UAVs (Unmanned Aerial Vehicle) are being developed for the efficient monitoring of large-scale photovoltaic power plants. However, the technologies developed until now have had the shortcomings of having to analyze the images manually to detect malfunctioning panels, which is time-consuming. In this paper, we propose an automatic photovoltaic panel area extraction algorithm for thermal infrared images acquired via a UAV. In the thermal infrared images, panel boundaries are presented as obvious linear features, and the panels are regularly arranged. Therefore, we exaggerate the linear features with a vertical and horizontal filtering algorithm, and apply a modified hierarchical histogram clustering method to extract candidates of panel boundaries. Among the candidates, initial panel areas are extracted by exclusion editing with the results of the photovoltaic array area detection. In this step, thresholding and image morphological algorithms are applied. Finally, panel areas are refined with the geometry of the surrounding panels. The accuracy of the results is evaluated quantitatively by manually digitized data, and a mean completeness of 95.0%, a mean correctness of 96.9%, and mean quality of 92.1 percent are obtained with the proposed algorithm.

• Journal of IKEEE
• /
• v.24 no.1
• /
• pp.97-105
• /
• 2020

A thermal imaging sensor receives the radiating energy from the target and the background, so it has been widely used for detection, tracking, and classification of targets at night for military purpose. In recognizing the target automatically using thermal images, if the correct edges of object are used then it can generate the classification results with high accuracy. However since the thermal images have lower spatial resolution and more blurred edges than color images, the accuracy of the classification using thermal images can be decreased. In this paper, to overcome this problem, a new hierarchical classifier using both shape and local features based on the segmentation reliabilities, and the class/pose updating method for vehicle classification are proposed. The proposed classification method was validated using thermal video sequences of more than 20,000 images which include four types of military vehicles - main battle tank, armored personnel carrier, military truck, and estate car. The experiment results showed that the proposed method outperformed the state-of-the-arts methods in classification accuracy.

• Journal of the Semiconductor & Display Technology
• /
• v.15 no.3
• /
• pp.51-56
• /
• 2016

This paper proposes a new image enhancement method for an infrared thermal image. The proposed method uses both Laplacian and Prewitt edge detectors. Without a visible light, it uses an infrared image for the edge detection. The method subtracts contour images from the infrared thermal image. It results black contours of objects in the infrared thermal image. That makes the objects in the infrared thermal image distinguished clearly. The proposed method is implemented using C language in an embedded Linux system for a high-speed real-time image processing. Experiments were conducted by using various infrared thermal images. The results show that the proposed method is successful for image enhancement of an infrared thermal image.

• Proceedings of the KSRS Conference
• /
• 2004.10a
• /
• pp.685-688
• /
• 2004

Fresh water discharge from the sea floor strongly affects a coastal ecology and the diffusion of contaminants. Much fresh water discharge has been found in the edge of Kurobe alluvial fan, in which annual rainfall is over 4000mm and there is abundant groundwater. However, it is difficult to find the groundwater discharge, thus the search of possible areas with some remote sensing tools is required. Because the temperature of the discharge point is relatively low compared with the surrounding sea water surfaces, there is a possibility to detect the area as an irregular zone of thermal infrared images. Two anomalous temperature zones, which have no surface streams from rivers, are detected by ASTER thermal-infrared images. One of them was verified as the groundwater discharge point by dives. In addition, the distribution of water table under the land side of the two areas is also detected as irregular zones by a ground-penetrating radar

• Journal of the Institute of Electronics Engineers of Korea SC
• /
• v.37 no.3
• /
• pp.63-71
• /
• 2000

Infrared (IR) detector chip, which detects the IR radiation from all of the objects and converts to image signal, is usually fabricated using hybrid bonding technology with detector away and readout integrated circuit (ROIC). In this study, we designed the readout circuit and simulated its operations. Fabricating readout circuit chips, we measured operation results satisfying its design requirements in 6V supply voltage. After we mount the IR detector chip in the manufactured thermal image system, thermal images were implemented. The obtained thermal images for high and room temperature target objects are sufficiently recognizable. Using the low noise thermal Image system, we expect to obtain thermal images with higher temperature resolution.

• Journal of Software Assessment and Valuation
• /
• v.17 no.2
• /
• pp.1-10
• /
• 2021

The ability to recognize human emotions by computer vision is a very important task, with many potential applications. Therefore the demand for emotion recognition using not only RGB images but also thermal images is increasing. Compared to RGB images, thermal images has the advantage of being less affected by lighting conditions but require a more sophisticated recognition method with low-resolution sources. In this paper, we propose a Divide and Conquer-based CNN training strategy to improve the performance of facial thermal image-based emotion recognition. The proposed method first trains to classify difficult-to-classify similar emotion classes into the same class group by confusion matrix analysis and then divides and solves the problem so that the emotion group classified into the same class group is recognized again as actual emotions. In experiments, the proposed method has improved accuracy in all the tests than when recognizing all the presented emotions with a single CNN model.

• KSCE Journal of Civil and Environmental Engineering Research
• /
• v.44 no.3
• /
• pp.397-405
• /
• 2024

In order to improve the visibility of nighttime thermal infrared images, a simulation method with daytime color images was proposed. As a simulation method consisting of two steps, the daytime thermal infrared image was simulated by learning the unpaired nighttime thermal infrared image and daytime thermal infrared image, then the result was translated into a daytime color image. A temperature change regression equation was constructed and applied to reflect the systematic characteristics of temperature changes in daytime and nighttime images, and day and night simulation and colorization were trained and modeled by CycleGAN. For the experimental area, 100 images were captured and used for training. As a result, the simulation showed an average SSIM of 0.2449 and a PSNR of 51.2254. It was confirmed that the method could simulate complex and detailed features such as vegetation.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.42 no.3
• /
• pp.89-94
• /
• 2019

K1A1 tank commander's primary thermal sight is a device that enables tank commanders to detect, identify, aim and track the target by observing targets in all directions during day, night and in situations of smokescreen and fog through $360^{\circ}$ rotation independent from the gunner's primary thermal sight and stabilizing the line of sight even under the vibrations occurring when the tank is standstill and moving. The main function of this device is to detect and process visible and thermal images and deliver the final images to the tank commander. One of the core parts to that end is the observation window (daytime/thermal image window). This core part is mounted at the entrance of the optical path for observing the target and plays the role of making visible light during the daytime and infrared light during the night pass through the target and transmitting the resultant images to the internal optical system of the tank commander's primary thermal sight. Such core parts have been selected as depot maintenance items so that they are replaced by new parts instead of being recycled when they are subjected to maintenance in most cases. That is, the military budget is wasted because such parts are replaced by new parts despite that they can be recycled for maintenance. Therefore, this study proposed a mounting tool for polishing and coating observation windows (daytime and thermal image window) using planar polishing equipment and DLC (Diamond-Like Carbon) coating equipment. In addition, this study presented an amendment (proposal) of the Depot Maintenance Work Request (DMWR) already published to verify the performance of recycled products including the establishment of inspection standards for recycling processes.

• Computers and Concrete
• /
• v.18 no.3
• /
• pp.319-336
• /
• 2016

In this study, both two- and three-dimensional (2D and 3D) finite-volume-based models were developed to analyze the heat transfer mechanisms through the porous structures of cellular concretes under steady-state heat transfer conditions and to investigate the differences between the 2D and 3D modeling results. The 2D and 3D reconstructed pore networks were generated from the microstructural information measured by 3D images captured by X-ray computerized tomography (X-CT). The computed effective thermal conductivities based on the 2D and 3D calculations performed on the reconstructed porous structures were found to be nearly identical to those evaluated from the 2D cross-sectional images and the 3D X-CT images, respectively. In addition, the 3D computed effective thermal conductivity was found to agree better with the measured values, in comparison with the 2D reconstruction and real cross-sectional images. Finally, the thermal conductivities computed for different reconstructed porous 3D structures of cellular concretes were compared with those obtained from 2D computations performed on 2D reconstructed structures. This comparison revealed the differences between 2D and 3D image-based modeling. A correlation was thus derived between the results of the 3D and 2D models.