• Journal of Korea Multimedia Society
• /
• v.19 no.6
• /
• pp.1003-1013
• /
• 2016

This paper proposes a framework of superpixel-based vehicle detection method using plane normal vector in disparity space. We utilize two common factors for detecting vehicles: Hypothesis Generation (HG) and Hypothesis Verification (HV). At the stage of HG, we set the regions of interest (ROI) by estimating the lane, and track them to reduce computational cost of the overall processes. The image is then divided into compact superpixels, each of which is viewed as a plane composed of the normal vector in disparity space. After that, the representative normal vector is computed at a superpixel-level, which alleviates the well-known problems of conventional color-based and depth-based approaches. Based on the assumption that the central-bottom of the input image is always on the navigable region, the road and obstacle candidates are simultaneously extracted by the plane normal vectors obtained from K-means algorithm. At the stage of HV, the separated obstacle candidates are verified by employing HOG and SVM as for a feature and classifying function, respectively. To achieve this, we trained SVM classifier by HOG features of KITTI training dataset. The experimental results demonstrate that the proposed vehicle detection system outperforms the conventional HOG-based methods qualitatively and quantitatively.

• The Journal of Korea Robotics Society
• /
• v.14 no.1
• /
• pp.65-73
• /
• 2019

In this paper, we propose an algorithm that estimates the location of lunar rover using IMU and vision system instead of the dead-reckoning method using IMU and encoder, which is difficult to estimate the exact distance due to the accumulated error and slip. First, in the lunar environment, magnetic fields are not uniform, unlike the Earth, so only acceleration and gyro sensor data were used for the localization. These data were applied to extended kalman filter to estimate Roll, Pitch, Yaw Euler angles of the exploration rover. Also, the lunar module has special color which can not be seen in the lunar environment. Therefore, the lunar module were correctly recognized by applying the HSV color filter to the stereo image taken by lunar rover. Then, the distance between the exploration rover and the lunar module was estimated through SIFT feature point matching algorithm and geometry. Finally, the estimated Euler angles and distances were used to estimate the current position of the rover from the lunar module. The performance of the proposed algorithm was been compared to the conventional algorithm to show the superiority of the proposed algorithm.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.33 no.10C
• /
• pp.787-797
• /
• 2008

In this paper, we propose a fast disparity estimation method considering temporal and spatial redundancy based on a dynamic programming for stereo matching. For the first step, the dynamic programming is performed to estimate disparity vectors with correlation between neighboring pixels in an image. Next, we efficiently compensate regions, which disparity vectors are not allocated, with neighboring disparity vectors assuming that disparity vectors in same object are quite similar. Moreover, in case of video sequence, we can decrease a complexity with temporal redundancy between neighboring frames. For performance comparison, we generate an intermediate-view image using the estimated disparity vector. Test results show that the proposed algorithm gives $0.8{\sim}2.4dB$-increased PSNR(peak signal to noise ratio) compared to a conventional block matching algorithm, and the proposed algorithm also gives approximately 0.1dB-increased PSNR and $48{\sim}68%$-lower complexity compared to the disparity estimation method based on general dynamic programming.

• Proceedings of the Korea Contents Association Conference
• /
• 2009.05a
• /
• pp.488-490
• /
• 2009

The Spatial Image contents of Geomorphology 3-D environment is focused by the requirement and importance in the fields such as, national land development plan, telecommunication facility management, railway construction, general construction engineering, Ubiquitous city development, safety and disaster prevention engineering. The currently used DEM system using contour lines, which embodies geographic information based on the 2-D digital maps and facility information has limitation in implementation in reproducing the 3-D spatial city. Moreover, this method often neglects the altitude of the rail way infrastructure which has narrow width and long length. This As the results, We confirmed the solutions of varieties application for railway facilities management using 3-D spatial image contents and database design. Also, I suggested that U-city using topographical modeling about matching methods of high density elevation value using 3-D aerial photo with laser data are best approach for detail stereo modeling and simulation. There for of this, Using of rapid spatial information generation by various images and laser data through matching methods for the make of Spatial data base management inplementation are very powerful and much application of our life and real worlds.

• The KIPS Transactions:PartB
• /
• v.11B no.2
• /
• pp.141-148
• /
• 2004

The ground positions and elevations information called DEMs(Digital Elevation Models) which are extracted from the stereo aerial photographs and/or satellite images using image matching method have the natural errors caused by variant environments. This study suggests the method to evaluate DEMs using correlation values between the reference and the target DEMs. This would be strongly helpful for experts to correct these errors. To evaluate the whole area of DEMs in the horizontal and vertical errors, the target cell is matched for each reference cell using the correlation values of these two cells. When the target cell is matched for each reference cell, horizontal and vertical error was calculated so as to help experts to recognize a certain area of DEMs which should be corrected and edited. If the correlation value is low and tile difference in height is high, the target cell will be candidated as changed or corrupted cell. When the area is clustered with those candidated cells, that area will be regarded as changed or corrupted area to be corrected and edited. Using this method, the evaluation for all DEM cells is practicable, the horizontal errors as well as vertical errors is calculable and the changed or corrupted area can be detected more efficiently.

• Journal of IKEEE
• /
• v.17 no.1
• /
• pp.1-9
• /
• 2013

The quantitative evaluation of DEM(Digital Elevation Map) is very important to the assessment of the effectiveness for the applied 3D image analysis technique. This paper presents a new quantitative evaluation method of 3D reconstruction process by using synthetic images. The proposed method is based on the assumption that a preacquired DEM and ortho-image should be the pseudo ground truth. The proposed evaluation process begins by generating a pair of photo-realistic synthetic images of the terrain from any viewpoint in terms of application of the constructed ray tracing algorithm to the pseudo ground truth. By comparing the DEM obtained by a pair of photo-realistic synthetic images with the assumed pseudo ground truth, we can analyze the quantitative error in DEM and evaluate the effectiveness of the applied 3D analysis method. To verify the effectiveness of the proposed evaluation method, we carry out the quantitative and the qualitative experiments. For the quantitative experiment, we prove the accuracy of the photo-realistic synthetic image. Also, the proposed evaluation method is experimented on the 3D reconstruction with regards to the change of the matching window. Based on the fact that the experimental result agrees with the anticipation, we can qualitatively manifest the effectiveness of the proposed evaluation method.

• Korean Journal of Remote Sensing
• /
• v.39 no.6_1
• /
• pp.1245-1254
• /
• 2023

Significant research has been conducted on the W-band synthetic aperture radar (SAR) system that utilizes the 77 GHz frequency modulation continuous wave (FMCW) radar. To reconstruct the high-resolution W-band SAR image, it is necessary to transform the point cloud acquired from the stereo cameras or the LiDAR in the direction of 6 degrees of freedom (DOF) and apply them to the SAR signal processing. However, there are difficulties in matching images due to the different geometric structures of images acquired from different sensors. In this study, we present the method to extract an optimized depth map by obtaining 6 DOF of the point cloud using a gradient descent method based on the entropy of the SAR image. An experiment was conducted to reconstruct a tree, which is a major road environment object, using the constructed W-band SAR system. The SAR image, reconstructed using the entropy-based gradient descent method, showed a decrease of 53.2828 in mean square error and an increase of 0.5529 in the structural similarity index, compared to SAR images reconstructed from radar coordinates.

• The KIPS Transactions:PartA
• /
• v.14A no.5
• /
• pp.301-308
• /
• 2007

This paper proposes high performance coprocessor architecture for real time dense disparity computation based on a phase-based binocular stereo matching technique called local weighted phase-correlation(LWPC). The algorithm combines the robustness of wavelet based phase difference methods and the basic control strategy of phase correlation methods, which consists of 4 stages. For parallel and efficient hardware implementation, the proposed architecture employs SIMD(Single Instruction Multiple Data Stream) architecture for each functional stage and all stages work on pipelined mode. Such that the newly devised pipelined linear array processor is optimized for the case of row-column image processing eliminating the need for transposed memory while preserving generality and high throughput. The proposed architecture is implemented with Xilinx HDL tool and the required hardware resources are calculated in terms of look up tables, flip flops, slices, and the amount of memory. The result shows the possibility that the proposed architecture can be integrated into one chip while maintaining the processing speed at video rate.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.37 no.1A
• /
• pp.57-63
• /
• 2012

In this paper, we propose a real-time view interpolation method using virtual viewpoint disparity estimation and convergence check. For the real-time process, we estimate a disparity map at the virtual viewpoint from stereo images using the belief propagation method. This method needs only one disparity map, compared to the conventional methods that need two disparity maps. In the view synthesis part, we warp pixels from the reference images to the virtual viewpoint image using the disparity map at the virtual viewpoint. For real-time acceleration, we utilize a high speed GPU parallel programming, called CUDA. As a result, we can interpolate virtual viewpoint images in real-time.

• Korean Journal of Agricultural Science
• /
• v.47 no.2
• /
• pp.315-326
• /
• 2020

In this study, a real-time crop recognition system was developed for an unmanned farm machine for upland farming. The crop recognition system was developed based on a stereo camera, and an image processing framework was proposed that consists of disparity matching, localization of crop area, and estimation of crop height with coordinate transformations. The performance was evaluated by attaching the crop recognition system to a tractor for five representative crops (cabbage, potato, sesame, radish, and soybean). The test condition was set at 3 levels of distances to the crop (100, 150, and 200 cm) and 5 levels of camera height (42, 44, 46, 48, and 50 cm). The mean relative error (MRE) was used to compare the height between the measured and estimated results. As a result, the MRE of Chinese cabbage was the lowest at 1.70%, and the MRE of soybean was the highest at 4.97%. It is considered that the MRE of the crop which has more similar distribution lower. the results showed that all crop height was estimated with less than 5% MRE. The developed crop recognition system can be applied to various agricultural machinery which enhances the accuracy of crop detection and its performance in various illumination conditions.