• The Journal of the Korea Contents Association
• /
• v.16 no.3
• /
• pp.43-51
• /
• 2016

This paper presents the concept of "interactive teleprompter", which provides the user with interaction with oneself or other users for live television broadcasts or smart mirrors. In such interactive applications, eye contacts between the user and the regenerated image or between the user and other persons are important in handling psychological processes or non-verbal communications. Unfortunately, it is not straightforward to address the eye contact issues with conventional combination of normal display and video camera. To address this problem, we propose an "interactive" teleprompter enhanced from conventional teleprompter devices. Our interactive teleprompter can recognize the user's gestures by applying infra-red (IR) depth sensor. This paper also presents test results for a beam splitter which plays a critical role for teleprompter and is designed to handle both visual light for RGB camera and IR for Depth sensor effectively.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.13 no.8
• /
• pp.3666-3671
• /
• 2012

We evaluate the face detection and recognition of depth image that is obtained by infrared range sensor. and Face recognition was usually focused on accuracy aspect but it is not enough to evaluate the performance in testing for real world application. In this paper, we evaluate the overall performance like accuracy, training, test speed and memory use for the well known face recognition algorithm like PCA, LDA, ICA and SVM. This experiment evaluate the good results of depth and colored depth image compatible with the colored image although the file size of depth and colored depth image is 30%~40% less than the colored image. Whereas, LDA got the good accuracy performance next to the SVM and also shows the good performance in speed and the amount of memory.

• Current Optics and Photonics
• /
• v.3 no.1
• /
• pp.8-15
• /
• 2019

We describe a common optical system that merges a LADAR system, which generates a point cloud, and a more traditional imaging system operating in the LWIR, which generates image data. The optimum diameter of the entrance pupil was determined by analysis of detection ranges of the LADAR sensor, and the result was applied to design a common optical system using LADAR sensors and LWIR sensors; the performance of these sensors was then evaluated. The minimum detectable signal of the $128{\times}128-pixel$ LADAR detector was calculated as 20.5 nW. The detection range of the LADAR optical system was calculated to be 1,000 m, and according to the results, the optimum diameter of the entrance pupil was determined to be 15.7 cm. The modulation transfer function (MTF) in relation to the diffraction limit of the designed common optical system was analyzed and, according to the results, the MTF of the LADAR optical system was 98.8% at the spatial frequency of 5 cycles per millimeter, while that of the LWIR optical system was 92.4% at the spatial frequency of 29 cycles per millimeter. The detection, recognition, and identification distances of the LWIR optical system were determined to be 5.12, 2.82, and 1.96 km, respectively.

• Journal of Broadcast Engineering
• /
• v.26 no.2
• /
• pp.155-166
• /
• 2021

Most object detection algorithms are studied based on RGB images. Because the RGB cameras are capturing images based on light, however, the object detection performance is poor when the light condition is not good, e.g., at night or foggy days. On the other hand, high-quality infrared(IR) images regardless of weather condition and light can be acquired because IR images are captured by an IR sensor that makes images with heat information. In this paper, we performed the object detection algorithm based on the compression ratio in RGB and IR images to show the detection capabilities. We selected RGB and IR images that were taken at night from the Free FLIR Thermal dataset for the ADAS(Advanced Driver Assistance Systems) research. We used the pre-trained object detection network for RGB images and a fine-tuned network that is tuned based on night RGB and IR images. Experimental results show that higher object detection performance can be acquired using IR images than using RGB images in both networks.

• Transactions of the Korean Society of Mechanical Engineers A
• /
• v.34 no.5
• /
• pp.605-609
• /
• 2010

In modern surveillance equipment, infrared (IR) sensors are essential for detection and observation. The IR sensor is connected to a miniature cryogenic cooler to maintain the temperature at very low levels, i.e., temperatures as low as 77 K. However, the quality of the image captured by the sensor is degraded by the transmission of vibration disturbances from the cooler. Therefore, to maintain high image quality, the compressor vibration and the force transmitted to the sensor have to be mitigated. For the compressor vibration isolating system, a tuned dynamic vibration absorber, combined with a passive isolator, is proposed. A cryogenic compressor bracket and springs are designed to allow the absorber mass to mitigate the vibration jitter in the axial direction. The system design is analyzed and evaluated in terms of the dynamic suppression of the harmonic force at the operating frequency of the cooler.

• Journal of the Korean Society for Aeronautical & Space Sciences
• /
• v.45 no.7
• /
• pp.600-609
• /
• 2017

We designed a target management integration system that enables us to select the final target manually or automatically from seeker's sensor image. The integrated system was developed separately for the air vehicle system and the ground system. The air vehicle system simulates the motion dynamics and the sensor image of the air vehicle, and the ground system is composed of the target template image module and the ground control center module. The flight maneuver of the air vehicle is based on pseudo 6-degree of freedom motion equation and the proportional navigation guidance. The sensor image module was developed using the known infrared(IR) image rendering method, and was verified by comparing the rendered image to that of a commercial software. The ground control center module includes an user interface that can display as much information to meet user needs. Finally, we verified the integrated system with simulated impact target mission of the air vehicle, by confirming the final target change and the shot down result of the user's intervention.

• The Journal of the Korea Contents Association
• /
• v.11 no.5
• /
• pp.205-215
• /
• 2011

Films are sensitive to ultraviolet rays and in contrast, digital camera sensors are extremely sensitive to infrared rays due to the differences in spectral characteristics. As a result, all digital cameras that use CCD or CMOS are equipped with IR Cut-Off Filter on the overall sensor. Complete block out of infrared rays is ideal, but the actual experiment results showed that infrared rays were not being blocked out completely. Infrared permeability was also different for each camera. Therefore, this study aims to analyze the effect of the minute quantities of infrared rays, which get transmitted due to mechanical properties of IR Cut-Off Filters that are installed on digital cameras, on digital picture images. The results obtained by carrying out a comparative analysis of a UV Filter (infrared transmitting state) and a UV-IR Filter (infrared blocked out state) are as follows. It was confirmed that the minute quantities of infrared rays do affect dynamic range and resolution to some extent, despite the little or no difference in noise and color reproduction.

• Journal of the Korea Society of Computer and Information
• /
• v.17 no.6
• /
• pp.37-48
• /
• 2012

Image registration is a process to establish the spatial correspondence between the images of same scene, which are acquired at different view points, at different times, or by different sensors. In this paper, we propose an effective registration method for images acquired by multi-sensors, such as EO (electro-optic) and IR (infrared) sensors. Image registration is achieved by extracting features and finding the correspondence between features in each input images. In the recent research, the multi-sensor image registration method that finds corresponding features by exploiting NMI (Normalized Mutual Information) was proposed. Conventional NMI-based image registration methods assume that the statistical correlation between two images should be global, however images from EO and IR sensors often cannot satisfy this assumption. Therefore the registration performance of conventional method may not be sufficient for some practical applications because of the low accuracy of corresponding feature points. The proposed method improves the accuracy of corresponding feature points by combining the gradient orientation as spatial information along with NMI attributes and provides more accurate and robust registration performance. Representative experimental results prove the effectiveness of the proposed method.

• The Journal of Korea Robotics Society
• /
• v.16 no.4
• /
• pp.291-298
• /
• 2021

In this study, we present a multi-sensor module for snake robot searching survivors in a narrow space. To this end, we integrated five sensor systems by considering the opinions of the first responders: a gas sensor to detect CO₂ gases from the exhalation of survivors, a CMOS camera to provide the image of survivors, an IR camera to see in the dark & smoky environment, two microphones to detect the voice of survivors, and an IMU to recognize the approximate location and direction of the robot and survivors. Furthermore, we integrated a speaker into the sensor module system to provide a communication channel between the first responders and survivors. To integrated all these mechatronics systems in a small, compact snake head, we optimized the positions of the sensors and designed a stacked structure for the whole system. We also developed a user-friendly GUI to show the information from the proposed sensor systems visually. Experimental results verified the searching function of the proposed sensor module system.

• Journal of the Korea Society of Computer and Information
• /
• v.26 no.3
• /
• pp.43-50
• /
• 2021

In this paper, we design and implement KITNESS, a windows application that feeds back the accuracy of fitness motions based on Kinect sensors. The feature of this application is to use Kinect's camera and joint recognition sensor to give feedback to the user to exercise in the correct fitness position. At this time, the distance between the user and the Kinect is measured using Kinect's IR Emitter and IR Depth Sensor, and the joint, which is the user's joint position, and the Skeleton data of each joint are measured. Using this data, a certain distance is calculated for each joint position and posture of the user, and the accuracy of the posture is determined. And it is implemented so that users can check their posture through Kinect's RGB camera. That is, if the user's posture is correct, the skeleton information is displayed as a green line, and if it is not correct, the inaccurate part is displayed as a red line to inform intuitively. Through this application, the user receives feedback on the accuracy of the exercise position, so he can exercise himself in the correct position. This application classifies the exercise area into three areas: neck, waist, and leg, and increases the recognition rate of Kinect by excluding positions that Kinect does not recognize due to overlapping joints in the position of each exercise area. And at the end of the application, the last exercise is shown as an image for 5 seconds to inspire a sense of accomplishment and to continuously exercise.