• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.11 no.6
• /
• pp.3208-3229
• /
• 2017

Rectification is an essential procedure for simplifying the disparity extraction of stereo matching algorithms by removing vertical mismatches between left and right images. To support real-time stereo matching, studies have introduced several look-up table (LUT)- and computational logic (CL)-based rectification approaches. However, to support high-resolution images, the LUT-based approach requires considerable memory resources, and the CL-based approach requires numerous hardware resources for its circuit implementation. Thus, this paper proposes a multi-level accumulation-based rectification method as a simple CL-based method and its circuit implementation. The proposed method, which includes distortion correction, reduces addition operations by 29%, and removes multiplication operations by replacing the complex matrix computations and high-degree polynomial calculations of the conventional rectification with simple multi-level accumulations. The proposed rectification circuit can rectify $1,280{\times}720$ stereo images at a frame rate of 135 fps at a clock frequency of 125 MHz. Because the circuit is fully pipelined, it continuously generates a pair of left and right rectified pixels every cycle after 13-cycle latency plus initial image buffering time. Experimental results show that the proposed method requires significantly fewer hardware resources than the conventional method while the differences between the results of the proposed and conventional full rectifications are negligible.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2008.08a
• /
• pp.73-76
• /
• 2008

We present a area-based method for stereo matching using varying weights. A central problem in a area-based stereo matching is different result from selecting a window size. Most of the previous window-based methods iteratively update windows. However, the iterative methods very sensitive the initial disparity estimation and are computationally expensive. To resolve this problem, we proposed a new function to assign weights to pixels using features. To begin with, we extract features in a given stereo images based on edge. We adjust the weights of the pixels in a given window based on correlation of the stereo images. Then, we match pixels in a given window between the reference and target images of a stereo pair. The proposed method is compared to existing matching strategies using both synthetic and real images. The experimental results show the improved accuracy of the proposed method.

• Journal of Information Processing Systems
• /
• v.13 no.2
• /
• pp.256-267
• /
• 2017

An active research area in computer vision, stereo matching is aimed at obtaining three-dimensional (3D) information from a stereo image pair captured by a stereo camera. To extract accurate 3D information, a number of studies have examined stereo matching algorithms that employ adaptive support weight. Among them, the adaptive census transform (ACT) algorithm has yielded a relatively strong matching capability. The drawbacks of the ACT, however, are that it produces low matching accuracy at the border of an object and is vulnerable to noise. To mitigate these drawbacks, this paper proposes and analyzes the features of an improved stereo matching algorithm that not only enhances matching accuracy but also is also robust to noise. The proposed algorithm, based on the ACT, adopts the truncated absolute difference and the multiple sparse windows method. The experimental results show that compared to the ACT, the proposed algorithm reduces the average error rate of depth maps on Middlebury dataset images by as much as 2% and that is has a strong robustness to noise.

• Journal of Institute of Control, Robotics and Systems
• /
• v.7 no.6
• /
• pp.523-531
• /
• 2001

This paper describes and automatic mirror adjustment system that rotates a pair of side mirrors and the room mirror of a car to the optimal position for a driver by using the locating of the driver\`s pupils. A stereo vision system measures 3D coordinates of a pair pupils by analyzing the input images of stereo B/W CCD cameras mounted on the instrument panel. this system determines the position angle of each mir-ror on the basis of information about the location of the pupils and rotates each mirror to the appropriate po-sition by mirror actuators. The vision system can detect the driver\`s pupils regardless of whether it is day-time or nighttime by virtue of an infrared light source. information about the pair of nostrils in used to im- prove the correctness of pupil detection. This system can adjust side mirrors and the room mirror automati- cally and rapidly by a simple interface regardless of driver replacement of driver\`s posture. Experiment has shown this to be a new mirror adjustment system that can make up for the weak points of previous mirror adjustment systems.

• International Journal of Automotive Technology
• /
• v.5 no.4
• /
• pp.277-285
• /
• 2004

This paper describes an intelligent mirror adjustment system that rotates a pair of side mirrors and the room mirror of a car to the optimal position for a driver by using the location of the driver's pupils. A stereo vision system measures the three-dimensional coordinates of a pair of pupils by analyzing the input images of stereo B/W CCD cameras mounted on the instrument panel. This system determines the position angle of each mirror on the basis of information about the location of the pupils and rotates each mirror to the appropriate position by mirror actuators. The vision system can detect the driver's pupils regardless of whether it is daytime or nighttime by virtue of an infrared light source. Information about the pair of nostrils is used to improve the correctness of pupil detection. This system can adjust side mirrors and the room mirror automatically and rapidly by a simple interface regardless of driver replacement or driver's posture. Experiment has shown this to be a new mirror adjustment system that can make up for the weak points of previous mirror adjustment systems.

• Journal of Biomedical Engineering Research
• /
• v.22 no.6
• /
• pp.527-534
• /
• 2001

Conventional stereo image acquisition uses a pair of frame grabbers in the CAS(Computer Assisted Surgery) system. In this Paper, we developed a synchronized stereo image acquisition method with only one frame grabber Two images from left and right camera each other. were merged with different color space without time delay and thus only one frame grabber was enough toy stereo image. Due to this synchronous Property of image acquisition, we can improve spatial revolution on the computation of 3D Position. Furthermore the overall costs for 3D navigator can be down and the extraction time of stereo Position tan be shortened.

• Proceedings of the KIEE Conference
• /
• 2003.11c
• /
• pp.777-780
• /
• 2003

We have tried to create a vision system like human eye for a long time. We have obtained some distinguished results through many studies. Stereo vision is the most similar to human eye among those. This is the process of recreating 3-D spatial information from a pair of 2-D images. In this paper, we have designed a stereo matching algorithm based on systolic array architecture using edges and pixel data. This is more advanced vision system that improves some problems of previous stereo vision systems. This decreases noise and improves matching rate using edges and pixel data and also improves processing speed using high integration one chip FPGA and compact modules. We can apply this to robot vision and automatic control vehicles and artificial satellites.

• Proceedings of the KSRS Conference
• /
• 2005.10a
• /
• pp.683-686
• /
• 2005

This study addresses a photogrammetric approach to generate Mars topographic products from mapping data of Mars Global Surveyor (MGS). High-resolution stereo images and laser altimetry data collected from the MGS mission are combined and processed to produce Digital Elevation Models (DEM) and orthoimages. First, altimeter data is registered to high resolution images and considerable registration offset (around 325 m) is discovered on high resolution stereo images. Altimetry data, exterior orientation elements of the camera and conjugate points are used for bundle adjustment to solve this mis-registration and detennine the ground coordinates. The mis-registration of altimetry data are effectively eliminated after the bundle adjustment. Using the adjusted exterior orientation the ground coordinates of conjugate points are detennined. A sufficient number of corresponding points collected through image matching and their precise 3-D ground coordinates are used to generate DEM and orthoimages. A posteriori standard deviations of ground points after bundle adjustment indicate the accuracy of OEM generated in this study. This paper addresses the photogrammetric procedure: the registration of altimetry data to stereo pair images, the bundle adjustment and the evaluation, and the generation of OEM and orthoimages.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.5 no.9
• /
• pp.1613-1631
• /
• 2011

Several metrics have been reported in the literature to assess stereo image quality, mostly based on visual attention or human visual sensitivity based distortion prediction with the help of disparity information, which do not consider the combined aspects of human visual processing. In this paper, visual attention and depth assisted stereo image quality assessment model (VAD-SIQAM) is devised that consists of three main components, i.e., stereo attention predictor (SAP), depth variation (DV), and stereo distortion predictor (SDP). Visual attention is modeled based on entropy and inverse contrast to detect regions or objects of interest/attention. Depth variation is fused into the attention probability to account for the amount of changed depth in distorted stereo images. Finally, the stereo distortion predictor is designed by integrating distortion probability, which is based on low-level human visual system (HVS), responses into actual attention probabilities. The results show that regions of attention are detected among the visually significant distortions in the stereo image pair. Drawbacks of human visual sensitivity based picture quality metrics are alleviated by integrating visual attention and depth information. We also show that positive correlation with ground-truth attention and depth maps are increased by up to 0.949 and 0.936 in terms of the Pearson and the Spearman correlation coefficients, respectively.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.49 no.12
• /
• pp.651-658
• /
• 2000

This paper presents a new method to extract traffic information such as number of passing vehicles and average speed by a pair of stereo road images. The whole process consists of the extraction of vehicles and the tracking of the extracted vehicles. For the extraction of vehicles, the outline of each vehicle is obtained by using binary region growing technique applied to disparity map based on multi-resolution stereo matching. The Kalman filter tracking algorithm is applied to the extracted vehicle outlines to determine the flow of vehicles. Experimental results show that the proposed method significantly improved recognition rate of vehicles over the conventional methods-frame difference and background elimination methods.