• IEIE Transactions on Smart Processing and Computing
• /
• v.6 no.3
• /
• pp.175-182
• /
• 2017

In this paper, we present a multi-depth generation method using a time-of-flight (ToF) fusion camera system. Multi-view color cameras in the parallel type and ToF depth sensors are used for 3D scene capturing. Although each ToF depth sensor can measure the depth information of the scene in real-time, it has several problems to overcome. Therefore, after we capture low-resolution depth images by ToF depth sensors, we perform a post-processing to solve the problems. Then, the depth information of the depth sensor is warped to color image positions and used as initial disparity values. In addition, the warped depth data is used to generate a depth-discontinuity map for efficient stereo matching. By applying the stereo matching using belief propagation with the depth-discontinuity map and the initial disparity information, we have obtained more accurate and stable multi-view disparity maps in reduced time.

• Journal of the Institute of Convergence Signal Processing
• /
• v.13 no.1
• /
• pp.12-18
• /
• 2012

Stereo correspondence is the central problem of stereo vision. In this paper, we propose a stereo matching scheme based on a genetic algorithm using a multi-resolution method and AD-Census. The proposed approach considers the matching environment as an optimization problem and finds the disparity by using a genetic algorithm And adaptive chronosome structure using edge pixels and crossover mechanism are employed in this technique. A cost function is composes of certain constraints whice are commonly used in stereo matching. AD-Census measure is applied to reduce disparity error. To increase the efficiency of process, we apply image pyramid method to stereo matching and calculate the initial disparity map at the coarsest resolution. Then initial disparity map is propagated to the next finer resolution, interpolated and performed disparity refinement using local feature vector. We valid our method not only reduces the search time for correspondence compared with conventional GA-based method but also ensures the validity of matching.

• Proceedings of the KSR Conference
• /
• 2003.05a
• /
• pp.321-325
• /
• 2003

The technology for the multi-dimensional terrain perspective view can be used as an important factors in planning and designing for the various construction projects. In this study, the stereo image perspective view has been generated for the multi-dimension analysis by combining useful digital map and remotely sensed satellite images. In the course of experimenting with the multi-dimensional topography generated by the combination of the front-projected image by the precise GCP and DEM from the contour line, the technology has been developed to offer the multi-dimensional access to the potential construction sites from the nearby main roads. This stereo image bird's eye view has made it possible to make multi-dimensional analysis on the terrain, which provides real time virtual access to the designated construction sites and will be a versatile application for development planning and construction projects.

• Proceedings of the IEEK Conference
• /
• 2003.07e
• /
• pp.1907-1910
• /
• 2003

This paper describes a method of stereo image composition for mixed reality without camera calibration or complicate tracking algorithm. The proposed system tracks the panel which has blob makers, and composes virtual objects naturally using the method of texture mapping which is often used in geological computer graphics mapping when we do mapping 2D computer graphic data or man-made 2D images. The proposed algorithm makes it possible for us to compose virtual data even in the case that the panel is bent. For composing 3D object, the system uses depth information obtained from stereo image so that we do not need cumbersome procedure of camera calibration.

• Journal of Institute of Control, Robotics and Systems
• /
• v.4 no.4
• /
• pp.487-493
• /
• 1998

Camera calibration is the process of determining the coordinate relationship between a camera image and its real world space. Accurate calibration of a camera is necessary for the applications that involve quantitative measurement of camera images. However, if the camera plane is parallel or near parallel to the calibration board on which 2 dimensional objects are defined(this is called "ill-conditioned"), existing solution procedures are not well applied. In this paper, we propose a neural network-based approach to camera calibration for 2D images formed by a mono-camera or a pair of cameras. Multi-layer perceptrons are developed to transform the coordinates of each image point to the world coordinates. The validity of the approach is tested with data points which cover the whole 2D space concerned. Experimental results for both mono-camera and stereo-camera cases indicate that the proposed approach is comparable to Tsai's method［8］. Especially for the stereo camera case, the approach works better than the Tsai's method as the angle between the camera optical axis and the Z-axis increases. Therefore, we believe the approach could be an alternative solution procedure for the ill -conditioned camera calibration.libration.

• Journal of Information Display
• /
• v.5 no.4
• /
• pp.38-44
• /
• 2004

In this paper, a server and client simulator for the web-based multi-view 3D image communication system is implemented by using the IEEE 1394 digital cameras, Intel Xeon server computer and Microsoft's DirectShow programming library. In the proposed system, two-view image is initially captured by using the IEEE 1394 stereo camera and then, this data is compressed through extraction of its disparity information in the Intel Xeon server computer and transmitted to the client system, in which multi-view images are generated through the intermediate views reconstruction method and finally display on the 3D display monitor. Through some experiments it is found that the proposed system can display 8-view image having a grey level of 8 bits with a frame rate of 15 fps.

• ETRI Journal
• /
• v.26 no.3
• /
• pp.218-228
• /
• 2004

Using stereo images with ephemeris data from the Korea Multi-Purpose Satellite-1 electro-optical camera (KOMPSAT-1 EOC), we performed geometric modeling for three-dimensional (3-D) positioning and evaluated its accuracy. In the geometric modeling procedures, we used ephemeris data included in the image header file to calculate the orbital parameters, sensor attitudes, and satellite position. An inconsistency between the time information of the ephemeris data and that of the center of the image frame was found, which caused a significant offset in satellite position. This time inconsistency was successfully adjusted. We modeled the actual satellite positions of the left and right images using only two ground control points and then achieved 3-D positioning using the KOMPSAT-1 EOC stereo images. The results show that the positioning accuracy was about 12-17 m root mean square error (RMSE) when 6.6 m resolution EOC stereo images were used along with the ephemeris data and only two ground control points (GCPs). If more accurate ephemeris data are provided in the near future, then a more accurate 3-D positioning will also be realized using only the EOC stereo images with ephemeris data and without the need for any GCPs.

• The Transactions of the Korean Institute of Electrical Engineers D
• /
• v.49 no.12
• /
• pp.651-658
• /
• 2000

This paper presents a new method to extract traffic information such as number of passing vehicles and average speed by a pair of stereo road images. The whole process consists of the extraction of vehicles and the tracking of the extracted vehicles. For the extraction of vehicles, the outline of each vehicle is obtained by using binary region growing technique applied to disparity map based on multi-resolution stereo matching. The Kalman filter tracking algorithm is applied to the extracted vehicle outlines to determine the flow of vehicles. Experimental results show that the proposed method significantly improved recognition rate of vehicles over the conventional methods-frame difference and background elimination methods.

• IEMEK Journal of Embedded Systems and Applications
• /
• v.16 no.5
• /
• pp.179-186
• /
• 2021

For stereo matching based on deep learning, the design of network structure is crucial to the calculation of matching cost, and the time-consuming problem of convolutional neural network in image processing also needs to be solved urgently. In this paper, a method of stereo matching using sparse loss volume in parallax dimension is proposed. A sparse 3D loss volume is constructed by using a wide step length translation of the right view feature map, which reduces the video memory and computing resources required by the 3D convolution module by several times. In order to improve the accuracy of the algorithm, the nonlinear up-sampling of the matching loss in the parallax dimension is carried out by using the method of multi-category output, and the training model is combined with two kinds of loss functions. Compared with the benchmark algorithm, the proposed algorithm not only improves the accuracy but also shortens the running time by about 30%.

• Journal of Institute of Control, Robotics and Systems
• /
• v.9 no.11
• /
• pp.899-905
• /
• 2003

An intermediate images generation method using multi-resolution based hierarchical block matching disparity map is proposed. This method is composed of a disparity estimation, an occlusion detection and intermediate image synthesis. For the disparity estimation, which is one of the important processes in intermediate image synthesis, we use the multi-resolution based hierarchical block matching algorithm to overcome the imperfect ness of block matching algorithm. The proposed method makes disparity maps more accurate and dense by multi-resolution based hierarchical block matching, and the estimated disparity maps are used to generate intermediate images of stereo images. Generated intermediate images show 0.1∼1.4 ㏈ higher PSNR than the images obtained by block matching algorithm.