• Proceedings of the Korea Information Processing Society Conference
• /
• 2023.11a
• /
• pp.637-640
• /
• 2023

This paper presents multimodal image fusion with human pose for detecting abnormal human behaviors in low illumination conditions. Detecting human behaviors in low illumination conditions is challenging due to its limited visibility of the objects of interest in the scene. Multimodal image fusion simultaneously combines visual information in the visible spectrum and thermal radiation information in the long-wave infrared spectrum. We propose an abnormal event detection scheme based on the multimodal fused image and the human poses using the keypoints to characterize the action of the human body. Our method assumes that human behaviors are well correlated to body keypoints such as shoulders, elbows, wrists, hips. In detail, we extracted the human keypoint coordinates from human targets in multimodal fused videos. The coordinate values are used as inputs to train a multilayer perceptron network to classify human behaviors as normal or abnormal. Our experiment demonstrates a significant result on multimodal imaging dataset. The proposed model can capture the complex distribution pattern for both normal and abnormal behaviors.

• Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
• /
• v.8 no.10
• /
• pp.63-70
• /
• 2018

Biomedical signal measurement technology using images has been developed, and researches on respiration signal measurement technology for maintaining life have been continuously carried out. The existing technology measured respiratory signals through a thermal imaging camera that measures heat emitted from a person's body. In addition, research was conducted to measure respiration rate by analyzing human chest movement in real time. However, the image processing using the infrared thermal image may be difficult to detect the respiratory organ due to the external environmental factors (temperature change, noise, etc.), and thus the accuracy of the measurement of the respiration rate is low.In this study, the images were acquired using visible light and infrared thermal camera to enhance the area of the respiratory tract. Then, based on the two images, features of the respiratory tract region are extracted through processes such as face recognition and image matching. The pattern of the respiratory signal is classified through the k-nearest neighbor classifier, which is one of the statistical classification methods. The respiration rate was calculated according to the characteristics of the classified patterns and the possibility of breathing rate measurement was verified by analyzing the measured respiration rate with the actual respiration rate.

• Journal of the Korean Society for Precision Engineering
• /
• v.11 no.5
• /
• pp.56-65
• /
• 1994

We have carried out a research on automatic measurement of gage blocks below 250mm and then improved the accuracy of the system, and reduced the measurement time using image processing technique and computer interface. The accuracy of the system is (230+10330 $L^{2}$)$^{2}$ nm (L:m) with confidence level of 95%. We participated APMP gage block intercomparision-1993/1994. The 1st round intercomparision showed that the measured values of all 5 gage blocks were within 21 nm from average.

• Journal of Acupuncture Research
• /
• v.21 no.2
• /
• pp.223-233
• /
• 2004

Objective: As a manual accupucture method, the twirling-needle treatment has been known more effective in relieving pain than the conventional simple accupuncture treatment. Finding a proper treatment condition is difficult because of the lack of a quantative measurement of the alleviation of pain made by acupuncture. In this research, the authors propose the use of infrared thermal images in a formalin test to quantatively verify the effect of twirling. Methods: After injecting 10%~20% formalin into the tail of rats, the infrared thermal images(ITI) have been obtained to estimate the thermal distribution caused by inflammation. The authors propose a processing method to measure the thermal distribution from the thermal images obtained from the infrared camera as a pain model of the formalin test. Results: The pain model obtained from the infrared thermal image has two phases. The first phase, which is a transient period, is the initial 20 minutes when the pain is developed after the formalin injection. The second phase, which is a steady state, is where the development of pain lasts for 60 minutes or more after the first stage. This characteristic of the proposed model based on ITI is consistent with that of the pain model reported by other researchers whose works are based on the time-course of flinching and licking/biting, following a different concentration of formalin. It is noticed that the response of the thermal distribution obtained from ITI shows very high correlation to the behavioral response in the formalin test performed by Kazuhiro Okuda and four others5). In addition, the authors propose an ITI method to determine the pain-reducing effect of the acupuncture. The thermal distribution obtained from the experiment shows that there is significant pain reducing effect made by the twirling-needle method.

• Journal of Biosystems Engineering
• /
• v.25 no.4
• /
• pp.293-300
• /
• 2000

Automated greenhouse production system often require crop growth monitoring involving accurate quantification of plant physiological properties. Conventional methods are usually burdensome, inaccurate, and harmful to crops. A thermal image analysis system can accomplish rapid and accurate measurements of physiological-property changes of stressed crops. In this research a thermal imaging system was used to measure the leaf-temperature changes of several crops according to nutrient stresses. Thermal images were obtained from lettuce, cucumber, and pepper plants. Plants were placed in growth chamber to provide relatively constant growth environment. Results showed that there were significant differences in the temperature of stressed plants and non-stressed plants. In a case of the both N deficiency and excess, the leaf temperatures of cucumber were $2^{\circ}C$ lower than controlled temperature. The leaf temperature of cucumber was $2^{\circ}C$ lower than controlled temperature only when it was under N excess stress. For the potassium deficiency or excess stress, the leaf temperaures of cucumber and hot pepper were $2^{\circ}C$ lower than controls, respectively. The phosphorous deficiency stress dropped the leaf temperatures of cucumber and hot pepper $2^{\circ}C$ and $1.5^{\circ}C$ below than controls. However, the leaf temperature of lettuce did not change. It was possible to detect the changes in leaf temperature by infrared thermography when subjected to nutrition stress. Since the changes in leaf temperatures were different each other for plants and kinds of stresses, however, it is necessary to add a nutrient measurement system to a plant-growth monitoring system using thermography.

• Journal of Institute of Control, Robotics and Systems
• /
• v.11 no.1
• /
• pp.84-91
• /
• 2005

In this paper, we describe the real-time parallel processing simulator developed for the use of performance analysis of rolling missiles. The real-time parallel processing simulator developed here consists of seeker emulator generating infrared image signal on aircraft, real-time computer, host computer, system unit, and actual equipments such as auto-pilot processor and seeker processor. Software is developed from mathematic models, 6 degree-of-freedom module, aerodynamic module which are resided in real-time computer, and graphic user interface program resided in host computer. The real-time computer consists of six TIC-40 processors connected in parallel. The seeker emulator is designed by using analog circuits coupled with mechanical equipments. The system unit provides interface function to match impedance between the components and processes very small electrical signals. Also real launch unit of missiles is interfaced to simulator through system unit. In order to apply the real-time parallel processing simulator to performance analysis equipment of rolling missiles it is essential to perform the performance verification test of simulator.

• Journal of Satellite, Information and Communications
• /
• v.9 no.4
• /
• pp.91-96
• /
• 2014

This paper proposed an adaptive threshold method for detecting flame candidate regions in a infrared image and it adapts according to the contrast and intensity changes in the image. Conventional flame detection systems uses fixed threshold method since surveillance environment does not change, once the system installed. But it needs a adaptive threshold method as requirements of surveillance system has changed. The proposed adaptive threshold algorithm uses the dynamic behavior of flame as featured parameter. The test result is analysed by comparing test result of proposed adaptive threshold algorithm and conventional fixed threshold method. The analysed data shows, the proposed method has 91.42% of correct detection rate and false detection is reduced by 20% comparing to the conventional method.

• Journal of Institute of Control, Robotics and Systems
• /
• v.18 no.5
• /
• pp.502-508
• /
• 2012

Heliostat, as a concentrator to reflect the incident solar energy to the receiver, is the most important system in the tower-type solar thermal power plant since it determines the efficiency and ultimately the overall performance of solar thermal power plant. Thus, a good sun tracking ability as well as a good optical property of it are required. Heliostat sun tracking system uses usually an open loop control system. Thus the sun tracking error caused by heliostat's geometrical error, optical error and computational error cannot be compensated. Recently use of sun tracking error model to compensate the sun tracking error has been proposed, where the error model is obtained from the measured ones. This work is a development of heliostat sun tracking error measurement and compensation method using BCS (Beam Characterization System). We first developed an image processing system to measure the sun tracking error optically. Then the measured error is modeled in linear polynomial form and neural network form trained by the extended Kalman filter respectively. Finally error models are used to compensate the sun tracking error. We also developed the necessary image processing algorithms so that the heliostat optical properties such as maximum heat flux intensity, heat flux distribution and total reflected heat energy could be analyzed. Experimentally obtained data shows that the heliostat sun tracking accuracy could be dramatically improved using either linear polynomial type error model or neural network type error model. Neural network type error model is somewhat better in improving the sun tracking performance. Nevertheless, since the difference between two error models in compensation of sun tracking error is small, a linear error model is preferred in actual implementation due to its simplicity.

• Journal of Korea Multimedia Society
• /
• v.8 no.1
• /
• pp.46-55
• /
• 2005

In this paper, we realize the panoramic infrared warning system to detect the small threaten object and propose the infrared image enhancement method to improve the warning ability of this system. This system composes of the sense head unit, the signal processing unit, and so on. In the proposed system, the sense head unit acquires the panoramic IR image with 360 degree field of view(FOV) by rotating the thermal sensor. The signal processing unit divides panoramic image into four sub-images with 90 degree FOV and computes the adaptive plateau value by using statistical characteristics of each subimage. Then the histogram equalization is performed for each subimage by using the adaptive plateau value. We realize the signal Processing unit by using the DSP and FPGA to perform the proposed method in real time. Experimental results show that the proposed method has better discrimination and lower false alarm rate than the conventional methods in this warning system.

• Proceedings of the KIEE Conference
• /
• 1992.07b
• /
• pp.1250-1254
• /
• 1992

This paper describes the designed and fabricated thermal imaging system with the SPRITE(Signal PRocessing in The Element) detector, operating in the 3-12 micron band. This system consists of an afocal telescope, a scan unit containing the SPRITE detector, an electronic processor unit and a cooler. The optical scan system utilizing rotating polygon and oscillating mirror, is 2-dimensional serial/parallel scan type using five elements of the detector. And the electronic processor unit performs digital scan conversion to reform the parallel data stream into serial analog data compatable with conventional RS-170 video. The scan field of view is 40 ${\times}$ 26.7 and the MRTD(Minium Resolvable Temperature Difference) is 0.6 K at 7.5 cycles/mm. The acquired thermal image indicates that this system has a satisfactory performance.