• Korean Journal of Remote Sensing
• /
• v.35 no.5_1
• /
• pp.727-736
• /
• 2019

In this paper, we present how to create a point cloud for a target area using multiple unmanned aerial vehicle images and to remove the gaps and overlapping points between datasets. For this purpose, first, IBA (Incremental Bundle Adjustment) technique was applied to correct the position and attitude of UAV platform. We generate a point cloud by using MDR (Multi-Dimensional Relaxation) matching technique. Next, we register point clouds based on observation vectors between stereo images by doing this we remove gaps between point clouds which are generated from different stereo pairs. Finally, we applied an occupancy grids based integration algorithm to remove duplicated points to create an integrated point cloud. The experiments were performed using UAV images, and our experiments show that it is possible to remove gaps and duplicate points between point clouds generated from different stereo pairs.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.31 no.1C
• /
• pp.26-35
• /
• 2006

In this paper, an automatic mobile robot system for a intelligent path planning using the detection scheme of the spatial coordinates based on stereo camera is proposed. In the proposed system, face area of a moving person is detected from a left image among the stereo image pairs by using the YCbCr color model and its center coordinates are computed by using the centroid method and then using these data, the stereo camera embedded on the mobile robot can be controlled for tracking the moving target in real-time. Moreover, using the disparity map obtained from the left and right images captured by the tracking-controlled stereo camera system and the perspective transformation between a 3-D scene and an image plane, depth information can be detected. Finally, based-on the analysis of these calculated coordinates, a mobile robot system is derived as a intelligent path planning and a estimation. From some experiments on robot driving with 240 frames of the stereo images, it is analyzed that error ratio between the calculated and measured values of the distance between the mobile robot and the objects, and relative distance between the other objects is found to be very low value of $2.19\%$ and $1.52\%$ on average, respectably.

• ETRI Journal
• /
• v.26 no.3
• /
• pp.218-228
• /
• 2004

Using stereo images with ephemeris data from the Korea Multi-Purpose Satellite-1 electro-optical camera (KOMPSAT-1 EOC), we performed geometric modeling for three-dimensional (3-D) positioning and evaluated its accuracy. In the geometric modeling procedures, we used ephemeris data included in the image header file to calculate the orbital parameters, sensor attitudes, and satellite position. An inconsistency between the time information of the ephemeris data and that of the center of the image frame was found, which caused a significant offset in satellite position. This time inconsistency was successfully adjusted. We modeled the actual satellite positions of the left and right images using only two ground control points and then achieved 3-D positioning using the KOMPSAT-1 EOC stereo images. The results show that the positioning accuracy was about 12-17 m root mean square error (RMSE) when 6.6 m resolution EOC stereo images were used along with the ephemeris data and only two ground control points (GCPs). If more accurate ephemeris data are provided in the near future, then a more accurate 3-D positioning will also be realized using only the EOC stereo images with ephemeris data and without the need for any GCPs.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.45 no.3
• /
• pp.1-10
• /
• 2008

An occupancy map is a representation methodology describing the region occupied by objects in 3D space, which can be utilized for autonomous navigation and object recognition. In this paper, we describe a technique for building an occupancy map using depth data extracted from stereo images. In addition, some techniques are proposed for utilizing the occupancy map for the segmentation of object regions. After the geometric information on the ground plane is extracted from a disparity image, the occupancy map is constructed by projecting each matched point to the ground plane-based 3D space. We explain techniques for extracting moving object regions using the occupancy map and present experimental results using real stereo images.

• Korean Journal of Remote Sensing
• /
• v.21 no.3
• /
• pp.229-242
• /
• 2005

Photogrammetry is a current method of GIS data acquisition. However, as a matter of fact, a large manpower and expenditure for making detailed 3D spatial information is required especially in urban areas where various buildings exist. There are no photogrammetric systems which can automate a process of spatial information acquisition completely. On the other hand, LiDAR has high potential of automating 3D spatial data acquisition because it can directly measure 3D coordinates of objects, but it is rather difficult to recognize the object with only LiDAR data, for its low resolution at this moment. With this background, we believe that it is very advantageous to integrate LiDAR data and stereo CCD images for more efficient and automated acquisition of the 3D spatial data with higher resolution. In this research, the automatic urban object recognition methodology was proposed by integrating ultra highresolution stereo images and LiDAR data. Moreover, a method to enable more reliable and detailed stereo matching method for CCD images was examined by using LiDAR data as an initial 3D data to determine the search range and to detect possibility of occlusions. Finally, intellectual DSMs, which were identified urban features with high resolution, were generated with high speed processing.

• Korean Journal of Remote Sensing
• /
• v.21 no.5
• /
• pp.383-392
• /
• 2005

Vegetation classes, especially grass and tree classes, are often confused in classification when conventional spectral pattern recognition techniques are used to classify urban areas. This paper reports on a study to improve the classification results by using an automated process of considering height information in separating urban vegetation classes, specifically tree and grass, using three-band, high-spatial resolution, digital aerial imagery. Height information was derived photogrammetrically from stereo pair imagery using cross correlation image matching to estimate differential parallax for vegetation pixels. A threshold value of differential parallax was used to assess whether the original class was correct. The average increase in overall accuracy for three test stereo pairs was $7.8\%$, and detailed examination showed that pixels reclassified as grass improved the overall accuracy more than pixels reclassified as tree. Visual examination and statistical accuracy assessment of four test areas showed improvement in vegetation classification with the increase in accuracy ranging from $3.7\%\;to\;18.1\%$. Vegetation classification can, in fact, be improved by adding height information to the classification procedure.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.26 no.1
• /
• pp.44-49
• /
• 2016

This paper proposed the method to improve performance of a pixel, which has low accuracy, by applying image segmentation methods based on color and multi-threshold of brightness. Stereo matching is the process to find the corresponding point on the right image with the point on the left image. For this process, distance(depth) information in stereo images is calculated. However, in the case of a region which has textureless, stereo matching has low accuracy and bad pixels occur on the disparity map. In the proposed method, the relationship between adjacent pixels is considered for compensating bad pixels. Generally, the object has similar color and brightness. Therefore, by considering the relationship between regions based on segmented regions by means of color and multi-threshold of brightness respectively, the region which is considered as parts of same object is re-segmented. According to relationship information of segmented sets of pixels, bad pixels in the disparity map are compensated efficiently. By applying the proposed method, the results show a decrease of nearly 28% in the number of bad pixels of the image applied the method which is established.

• 제어로봇시스템학회:학술대회논문집
• /
• 2004.08a
• /
• pp.1416-1418
• /
• 2004

This paper proposes an image processing algorithm for detecting obstacles on road-lane using DLI(disparity of lane-related information) that is generated by stereo images acquired from dual cameras mounted on a moving vehicle. The DLI is a disparity that is acquired using single lane information from road lane detection. For the purpose to reduce processing time, we use small blocks obtained by edge-histogram based blocking logic. This algorithm detects moving objects such as preceding vehicles and obstacles. The proposed algorithm has been implemented in a personal computer with the road image data of a typical highway. We successfully performed experiments under a wide variety of road conditions without changing parameter values or adding human intervention. Experimental results also showed that the proposed DLI is quite successful.

• Proceedings of the IEEK Conference
• /
• 1998.10a
• /
• pp.1243-1246
• /
• 1998

Three-dimensional(3-D) sound is a technique for generating or recreating sounds so they are perceived as emanating from locations in a three-dimensional space. Three dimensional sound has the potential of increasing the feeling of realism in music or movie soundtracks. Three-dimensional sound effects depend on psychoacoustic spectral and phase cues being presented in a reproduced signal. In this paper we propose an effective algorithm for the sound image expansion in television system using stereo image enhancement techniques. Compared to the other techniques of three-dimensional sound, the proposed algorithm use only two speakers to enhance the sound image expansion, while maintaining the original sound characteristics.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.22 no.1
• /
• pp.73-80
• /
• 2004

The purpose of this study is the GCP/DEM estimations through satellite stereo image interpretation using GPS. We carried out GPS observation fixing first order control points and GPS permanent stations. Comparing static surveying and kinematic surveying, we analysed the surveying methods for GCP and DEM estimations. As the results, considering SPOT image spatial resolution, the DEM can be made through satellite stereo image interpretation.