• The Journal of Korea Robotics Society
• /
• v.4 no.4
• /
• pp.298-304
• /
• 2009

This paper describes an algorithm that improves 3D reconstruction result using a multi-sensor fusion disparity map. We can project LRF (Laser Range Finder) 3D points onto image pixel coordinatesusing extrinsic calibration matrixes of a camera-LRF (${\Phi}$, ${\Delta}$) and a camera calibration matrix (K). The LRF disparity map can be generated by interpolating projected LRF points. In the stereo reconstruction, we can compensate invalid points caused by repeated pattern and textureless region using the LRF disparity map. The result disparity map of compensation process is the multi-sensor fusion disparity map. We can refine the multi-sensor 3D reconstruction based on stereo vision and LRF using the multi-sensor fusion disparity map. The refinement algorithm of multi-sensor based 3D reconstruction is specified in four subsections dealing with virtual LRF stereo image generation, LRF disparity map generation, multi-sensor fusion disparity map generation, and 3D reconstruction process. It has been tested by synchronized stereo image pair and LRF 3D scan data.

• Korean Journal of Remote Sensing
• /
• v.31 no.2
• /
• pp.171-182
• /
• 2015

We propose a camera system to acquire indoor stereo omni-directional images and its calibration method. These images can be utilized for indoor precise mapping and sophisticated imagebased services. The proposed system is configured with a rotating stereo line camera system, providing stereo omni-directional images appropriate to stable stereoscopy and precise derivation of object point coordinates. Based on the projection model, we derive a mathematical model for the system calibration. After performing the system calibration, we can estimate object points with an accuracy of less than ${\pm}16cm$ in indoor space. The proposed system and calibration method will be applied to indoor precise 3D modeling.

• Journal of Institute of Control, Robotics and Systems
• /
• v.15 no.5
• /
• pp.519-524
• /
• 2009

This paper describes a new sensor system for 3D environment perception using stereo structured infrared light sources and a camera. Environment and obstacle sensing is the key issue for mobile robot localization and navigation. Laser scanners and infrared scanners cover $180^{\circ}$ and are accurate but too expensive. Those sensors use rotating light beams so that the range measurements are constrained on a plane. 3D measurements are much more useful in many ways for obstacle detection, map building and localization. Stereo vision is very common way of getting the depth information of 3D environment. However, it requires that the correspondence should be clearly identified and it also heavily depends on the light condition of the environment. Instead of using stereo camera, monocular camera and two projected infrared light sources are used in order to reduce the effects of the ambient light while getting 3D depth map. Modeling of the projected light pattern enabled precise estimation of the range. Two successive captures of the image with left and right infrared light projection provide several benefits, which include wider area of depth measurement, higher spatial resolution and the visibility perception.

• Korean Journal of Remote Sensing
• /
• v.23 no.5
• /
• pp.401-408
• /
• 2007

Animated anaglyph is the most cost-effective method for 3D stereo visualization of virtual or actual 3D geo-based data model. Unlike 3D anaglyph scene generation using paired epipolar images, the main data sets of this study is the multi-typed 3D feature model containing 3D shaped objects, DEM and satellite imagery. For this purpose, a prototype implementation for 3D animated anaglyph using OpenGL API is carried out, and virtual 3D feature modeling is performed to demonstrate the applicability of this anaglyph approach. Although 3D features are not real objects in this stage, these can be substituted with actual 3D feature model with full texture images along all facades. Currently, it is regarded as the special viewing effect within 3D GIS application domains, because just stereo 3D viewing is a part of lots of GIS functionalities or remote sensing image processing modules. Animated anaglyph process can be linked with real-time manipulation process of 3D feature model and its database attributes in real world problem. As well, this approach of feature-based 3D animated anaglyph scheme is a bridging technology to further image-based 3D animated anaglyph rendering system, portable mobile 3D stereo viewing system or auto-stereo viewing system without glasses for multi-viewers.

• Journal of information and communication convergence engineering
• /
• v.5 no.1
• /
• pp.78-82
• /
• 2007

This paper propose a building reconstruction method of urban area for a 3D GIS with stereo images. The 3D reconstruction is performed by the grouping 3D line segments extracted from the stereo matching of salient edges which are derived from multiple images. The grouping is achieved by conditions of degrees and distances between lines. Building objects are determined by the junction combinations of the grouped line segments. The proposed algorithm demonstrates effective results of 3D reconstruction of buildings with 2D aerial images.

• Korean Journal of Remote Sensing
• /
• v.36 no.6_2
• /
• pp.1615-1627
• /
• 2020

The purpose of this study is to compare and analyze the performance of KOMPSAT-3 Digital Surface Model (DSM) made in overseas testbed area. To that end, we collected the KOMPSAT-3 in-track stereo image taken in San Francisco, the U.S. The stereo geometry elements (B/H, converse angle, etc.) of the stereo image taken were all found to be in the stable range. By applying precise sensor modeling using Ground Control Point (GCP) and DSM automatic generation technique, DSM with 1 m resolution was produced. Reference materials for evaluation and calibration are ground points with accuracy within 0.01 m from Compass Data Inc., 1 m resolution Elevation 1-DSM produced by Airbus. The precision sensor modeling accuracy of KOMPSAT-3 was within 0.5 m (RMSE) in horizontal and vertical directions. When the difference map was written between the generated DSM and the reference DSM, the mean and standard deviation were 0.61 m and 5.25 m respectively, but in some areas, they showed a large difference of more than 100 m. These areas appeared mainly in closed areas where high-rise buildings were concentrated. If KOMPSAT-3 tri-stereo images are used and various post-processing techniques are developed, it will be possible to produce DSM with more improved quality.

• Journal of Korean Society for Geospatial Information Science
• /
• v.21 no.2
• /
• pp.11-17
• /
• 2013

Nowadays 3D models are used in diverse sectors. The 3D maps provide better reality than existing plane maps as well as diverse pieces of information that cannot be expected from the limited plane maps. A process proposed in this paper enables easy and quick production by replacing the expensive laser scanners for modeling by an improved digital camera stereo matching algorithm. The algorithm used in this study was a SURF algorithm contained in the OpenCV library. The unconformity points of the algorithm were eliminated using the homography conversion and epipolar lines. In addition, the improved algorithm was compared with the commercial program, and it showed a better performance than the commercial program. It is expected that the proposed method can contribute to the digital maps and 3D virtual reality because it enables easy and quick 3D modeling provided that the stereo matching conditions are met.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.27 no.2A
• /
• pp.137-145
• /
• 2002

In the method of 3D modeling, stereo matching method which obtains three dimensional depth information from the two images is taken from the different view points. In general, it is very essential work for the 3D modeling from 2D stereo images to estimate the exact disparity through fading the conjugate pair of pixel from the left and right image. In this paper to solve the problems of the stereo image disparity estimation, we introduce a novel approach method to improve the exactness and efficiency of the disparity. In the first place, we perform a wavelet transformation of the stereo images and set the reference points in the image by the feature-based matching method. This reference points have very high probability over 95 %. In the base of these reference points we can decide the size of the variable block searching windows for estimating dense disparity of area based method and perform the ordering constraint to prevent mismatching. By doing this, we could estimate the disparity in a short time and solve the occlusion caused by applying the fried-sized windows and probable error caused by repeating patterns.

• Korean Journal of Remote Sensing
• /
• v.35 no.3
• /
• pp.401-413
• /
• 2019

The purpose of this study is to generate DSM using the stereo matching algorithm of worldview-1 stereo images and verify the accuracy of the generated DSM. To generate DSM, RPC block modeling was performed to correct RPC errors, and image matching was performed using SGM, which is a stereo matching algorithm after the epipolar image was generated. The COST for SGM was calculated by using CENSUS, and 4-paths and 8-paths were applied for COST aggregation in SGM. To verify the quality and accuracy of the generated DSM, it was compared with the LiDAR-derived DSM and the DSM generated by commercial SW. The results showed that the vertical accuracy of the generated DSM using 4-paths of COST aggregation was 1.647 m to 3.689 m (RMSE). In case of using 8-paths of COST aggregation was 1.550 m to 3.106 m (RMSE).

• Journal of radiological science and technology
• /
• v.39 no.2
• /
• pp.257-262
• /
• 2016

This study aimed to suggest a novel method of modeling a hearing aid ear shell based on Digital Imaging and Communication in Medicine (DICOM) in the hearing aid ear shell manufacturing method using a 3D printer. In the experiment, a 3D external auditory meatus was extracted by using the critical values in the DICOM volume images, and the modeling surface structures were compared in standard type STL (STereoLithography) files which could be recognized by a 3D printer. In this 3D modeling method, a conventional ear model was prepared, and the gaps between adjacent isograms produced by a 3D scanner were filled with 3D surface fragments to express the modeling structure. In this study, the same type of triangular surface structures were prepared by using the DICOM images. The result showed that the modeling surface structure based on the DICOM images provide the same environment that the conventional 3D printers may recognize, eventually enabling to print out the hearing aid ear shell shape.