• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.25 no.10
• /
• pp.1448-1451
• /
• 2021

In this paper, 3D range sensor is applied to the sensor-based widerange microphone system for lectures. Since the 2D range sensor measures the shortest distance of the speaker, an error occurs and the performance is degraded. The 3D sensor provides a 160×60 distance image so that the position of the speaker can be obtained with accuracy. We propose a method for obtaining the distance per pixel required to determine the absolute position of the speaker from the distance image. The proposed array microphone system using the 3D sensor shows the improvement of 0.8~1.5dB compared to the previous works using 2D sensor.

• The Journal of Korea Robotics Society
• /
• v.4 no.4
• /
• pp.298-304
• /
• 2009

This paper describes an algorithm that improves 3D reconstruction result using a multi-sensor fusion disparity map. We can project LRF (Laser Range Finder) 3D points onto image pixel coordinatesusing extrinsic calibration matrixes of a camera-LRF (${\Phi}$, ${\Delta}$) and a camera calibration matrix (K). The LRF disparity map can be generated by interpolating projected LRF points. In the stereo reconstruction, we can compensate invalid points caused by repeated pattern and textureless region using the LRF disparity map. The result disparity map of compensation process is the multi-sensor fusion disparity map. We can refine the multi-sensor 3D reconstruction based on stereo vision and LRF using the multi-sensor fusion disparity map. The refinement algorithm of multi-sensor based 3D reconstruction is specified in four subsections dealing with virtual LRF stereo image generation, LRF disparity map generation, multi-sensor fusion disparity map generation, and 3D reconstruction process. It has been tested by synchronized stereo image pair and LRF 3D scan data.

• Transactions on Electrical and Electronic Materials
• /
• v.18 no.6
• /
• pp.341-344
• /
• 2017

Infrared (IR) filters were developed to implement integrated three-dimensional (3D) image sensors that are capable of obtaining both color image and depth information at the same time. The combination of light filters applicable to the 3D image sensor is composed of a modified IR cut filter mounted on the objective lens module and on-chip filters such as IR pass filters and color filters. The IR cut filters were fabricated by inorganic $SiO_2/TiO_2$ multilayered thin-film deposition using RF magnetron sputtering. On-chip IR pass filters were synthetized by dissolving various pigments and dyes in organic solvents and by subsequent patterning with photolithography. The fabrication process of the filters is fairly compatible with the complementary metal oxide semiconductor (CMOS) process. Thus, the IR cut filter and IR pass filter combined with conventional color filters are considered successfully applicable to 3D image sensors.

• Journal of the Microelectronics and Packaging Society
• /
• v.26 no.1
• /
• pp.17-21
• /
• 2019

In this paper, a high precision straightness measurement system has been developed at low cost using a visible laser and CMOS image sensor. CMOS image sensor detected optical image and the variation of straightness was calculated by image processing. We have observed that the error of the developed straightness measurement system was 0.9% when a distance of 3m between laser and image sensor. And it can be applied to 3D printer and any other areas.

• The KIPS Transactions:PartB
• /
• v.15B no.3
• /
• pp.189-196
• /
• 2008

In this paper, a CMOS digital image sensor, which consists of A/D conversion, motion estimation circuits, and an attention module for ROI (Region of Interest) detection is presented. The functions of A/D conversion and motion estimation are implemented by $0.6{\mu}m$ CMOS processing circuit as hardware, and the attention module is implemented outside the circuit as software currently. Attention modules are taken to improve limited applications of the smart image sensor. The current smart image sensor responses to the changes of intensity, and uses the integration time to estimate motion. Therefore it is limited in its applications. To make up for inherent property of the sensor from circuit design and extend its applications we decide to introduce perception solutions to the image sensor. Attention modules for still and moving images are employed to achieve such purposes. The suggested approach makes the smart image sensor available with additional functions for such cases that motion estimation or intensity changes are not observed. Experimental result shows the usefulness and extension of the image sensor.

• The Journal of Korea Robotics Society
• /
• v.1 no.2
• /
• pp.180-187
• /
• 2006

This paper presents a new sensor system, CALOS, for motion estimation and 3D reconstruction. The 2D laser sensor provides accurate depth information of a plane, not the whole 3D structure. On the contrary, the CCD cameras provide the projected image of whole 3D scene, not the depth of the scene. To overcome the limitations, we combine these two types of sensors, the laser sensor and the CCD cameras. We develop a motion estimation scheme appropriate for this sensor system. In the proposed scheme, the motion between two frames is estimated by using three points among the scan data and their corresponding image points, and refined by non-linear optimization. We validate the accuracy of the proposed method by 3D reconstruction using real images. The results show that the proposed system can be a practical solution for motion estimation as well as for 3D reconstruction.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.50 no.11
• /
• pp.64-69
• /
• 2013

In this paper, a high-speed CMOS Image Sensor (CIS) based on a 10-bit two-step single-slope A/D converter is proposed. The A/D converter is composed of both a 5-bit coarse ADC and a 6-bit fine ADC, and the conversion speed is 10 times faster than that of the single-slope A/D converter. In order to have a small noise characteristics, further, a Digital Correlated Double Sampling(D-CDS) is also discussed. The proposed A/D converter has been fabricated with 0.13um 1-poly 4-metal CIS process, and it has a QVGA($320{\times}240$) resolution. The fabricated chip size is $5mm{\times}3mm$, and the power consumption is about 35mW at 3.3V supply voltage. The measured conversion speed is 10us, and the frame rate is 220 frames/s.

• Journal of Institute of Control, Robotics and Systems
• /
• v.3 no.6
• /
• pp.613-618
• /
• 1997

In this paper, we designed a line CCD camera for a flying image, which is composed of a line CCD sensor(2048 cells) and a rotating mirror, and investigated its optical properties. We also made the 3-D image from the flying image which is made of 2-D image being juxtaposed to 1-D images obtained by the camera, and performed the calibration to acquire high precision 3-D data. As a result, we obtained the 3-D measurement system using the slit type of laser projector is available to measure the high precision shape of objects.

• Korean Journal of Remote Sensing
• /
• v.28 no.3
• /
• pp.319-327
• /
• 2012

In this paper, we introduce a newly developed photogrammetric software for automatic generation of high quality geo-products and its performance assessment carried out using various satellite images. Our newly developed software provides the latest techniques of an optimized sensor modelling, ortho-image generation and automated Digital Elevation Model (DEM) generation for diverse remote sensing images. In particular, images from dual- and multi-sensor images can be integrated for 3D mapping. This can be a novel innovation toward a wider applicability of remote sensing data, since 3D mapping has been limited within only single-sensor so far. We used Kompsat-2, Ikonos, QuickBird, Spot-5 high resolution satellite images to test an accuracy of 3D points and ortho-image generated by the software. Outputs were assessed by comparing reliable reference data. From various sensor combinations 3D mapping were implemented and their accuracy was evaluated using independent check points. Model accuracy of 1~2 pixels or better was achieved regardless of sensor combination type. The high resolution ortho-image results are consistent with the reference map on a scale of 1:5,000 after being rectified by the software and an accuracy of 1~2 pixels could be achieved through quantitative assessment. The developed software offers efficient critical geo-processing modules of various remote sensing images and it is expected that the software can be widely used to meet the demand on the high-quality geo products.

• Journal of Digital Convergence
• /
• v.14 no.1
• /
• pp.189-194
• /
• 2016

Recently, there is increasing demand for image processing technology while activated the use of equipments such as camera, camcorder and CCTV. In particular, research and development related to 3D image technology using the depth camera such as Kinect sensor has been more activated. Kinect sensor is a high-performance camera that can acquire a 3D human skeleton structure via a RGB, skeleton and depth image in real-time frame-by-frame. In this paper, we develop a system. This system captures the motion of a 3D human skeleton structure using the Kinect sensor. And this system can be stored by selecting the motion file format as trc and bvh that is used for general purposes. The system also has a function that converts TRC motion captured format file into BVH format. Finally, this paper confirms visually through the motion capture data viewer that motion data captured using the Kinect sensor is captured correctly.