• Title/Summary/Keyword: Stereo-Matching

Search Result 611, Processing Time 0.023 seconds

Accuracy Evaluation of DEM generated from Satellite Images Using Automated Geo-positioning Approach

  • Oh, Kwan-Young;Jung, Hyung-Sup;Lee, Moung-Jin
    • Korean Journal of Remote Sensing
    • /
    • v.33 no.1
    • /
    • pp.69-77
    • /
    • 2017
  • S The need for an automated geo-positioning approach for near real-time results and to boost cost-effectiveness has become increasingly urgent. Following this trend, a new approach to automatically compensate for the bias of the rational function model (RFM) was proposed. The core idea of this approach is to remove the bias of RFM only using tie points, which are corrected by matching with the digital elevation model (DEM) without any additional ground control points (GCPs). However, there has to be a additional evaluation according to the quality of DEM because DEM is used as a core element in this approach. To address this issue, this paper compared the quality effects of DEM in the conduct of the this approach using the Shuttle Radar Topographic Mission (SRTM) DEM with the spatial resolution of 90m. and the National Geographic Information Institute (NGII) DEM with the spatial resolution of 5m. One KOMPSAT-2 stereo-pair image acquired at Busan, Korea was used as experimental data. The accuracy was compared to 29 check points acquired by GPS surveying. After bias-compensation using the two DEMs, the Root Mean Square (RMS) errors were less than 6 m in all coordinate components. When SRTM DEM was used, the RMSE vector was about 11.2m. On the other hand, when NGII DEM was used, the RMSE vector was about 7.8 m. The experimental results showed that automated geo-positioning approach can be accomplished more effectively by using NGII DEM with higher resolution than SRTM DEM.

3D Depth Information Extraction Algorithm Based on Motion Estimation in Monocular Video Sequence (단안 영상 시퀸스에서 움직임 추정 기반의 3차원 깊이 정보 추출 알고리즘)

  • Park, Jun-Ho;Jeon, Dae-Seong;Yun, Yeong-U
    • The KIPS Transactions:PartB
    • /
    • v.8B no.5
    • /
    • pp.549-556
    • /
    • 2001
  • The general problems of recovering 3D for 2D imagery require the depth information for each picture element form focus. The manual creation of those 3D models is consuming time and cost expensive. The goal in this paper is to simplify the depth estimation algorithm that extracts the depth information of every region from monocular image sequence with camera translation to implement 3D video in realtime. The paper is based on the property that the motion of every point within image which taken from camera translation depends on the depth information. Full-search motion estimation based on block matching algorithm is exploited at first step and ten, motion vectors are compensated for the effect by camera rotation and zooming. We have introduced the algorithm that estimates motion of object by analysis of monocular motion picture and also calculates the averages of frame depth and relative depth of region to the average depth. Simulation results show that the depth of region belongs to a near object or a distant object is in accord with relative depth that human visual system recognizes.

  • PDF

A Pilot Project on Producing Topographic Map Using Medium Resolution Satellite Image (중해상도 위성영상을 이용한 지도제작 시험연구)

  • 박희주;한상득;안기원;박병욱
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.19 no.4
    • /
    • pp.373-383
    • /
    • 2001
  • This study conducted pilot mapping project to know the possibility of mapping with medium resolution satellite imageries. For this purpose, mapping experiments were conducted with each stereo model imageries of SPOT, KOMPSAT, and IRS- lC. And positional accuracy, analysis of detectable and describable features, and comparison with existing digital map were checked, possible mapping scale and cost analysis were conducted with these results. Regarding SPOT imagery, digital photogrammetric workstation was used for stereoplotting. Regarding KOMPSAT and IRS-lC imageries, because there were data format support problems. head-up digitizing was performed with ortho imageries rectified with DEMs generated by image matching. The results of experiments show that such features as wide road, river, coast line, etc are possible to detect and depict but many other features are not for SPOT, KOMPSAT, and IRS-lC imageries. On the aspect of mapping, therefore, SPOT is available for 1/50,000 topographic map revision, KOMPSAT and IRS-lC for 1/25.000 topographic map revision.

  • PDF

Data Base Design Methods for Railway Facility Information using 3D Spatial (3차원 공간에서의 철도시설정보 데이터베이스 설계방안)

  • Yeon, Sang-Ho
    • Proceedings of the KSR Conference
    • /
    • 2009.05a
    • /
    • pp.1003-1009
    • /
    • 2009
  • The Spatial Image contents of Geomorphology 3-D environment is focused by the requirement and importance in the fields such as, national land development plan, telecommunication facility management, railway construction, general construction engineering, Ubiquitous city development, safety and disaster prevention engineering. The currently used DEM system using contour lines, which embodies geographic information based on the 2-D digital maps and facility information has limitation in implementation in reproducing the 3-D spatial city. Moreover, this method often neglects the altitude of the rail way infrastructure which has narrow width and long length. This As the results, We confirmed the solutions of varieties application for railway facilities management using 3-D spatial image contents and database design. Also, I suggested that U-city using railway modeling about matching methods of high density elevation value using 3-D aerial photo with laser data are best approach for detail stereo modeling and simulation.

  • PDF

Human Skin Region Detection Utilizing Depth Information (깊이 정보를 활용한 사람의 피부영역 검출)

  • Jang, Seok-Woo;Park, Young-Jae;Kim, Gye-Young
    • Journal of the Korea Society of Computer and Information
    • /
    • v.17 no.6
    • /
    • pp.29-36
    • /
    • 2012
  • In this paper, we suggest a new method of detecting human skin-color regions from three-dimensional static or dynamic stereoscopic images by effectively integrating depth and color features. The suggested method first extracts depth information that represents the distance between a camera and an object from input left and right stereoscopic images through a stereo matching technique. It then performs labeling for pixels with similar depth features and determines the labeled regions having human skin color as actual skin color regions. Our experimental results show that the suggested skin region extraction method outperforms existing skin detection methods in terms of skin-color region extraction accuracy.

Patient Setup Aid with Wireless CCTV System in Radiation Therapy (무선 CCTV 시스템을 이용한 환자 고정 보조기술의 개발)

  • Park, Yang-Kyun;Ha, Sung-Whan;Ye, Sung-Joon;Cho, Woong;Park, Jong-Min;Park, Suk-Won;Huh, Soon-Nyung
    • Radiation Oncology Journal
    • /
    • v.24 no.4
    • /
    • pp.300-308
    • /
    • 2006
  • $\underline{Purpose}$: To develop a wireless CCTV system in semi-beam's eye view (BEV) to monitor daily patient setup in radiation therapy. $\underline{Materials\;and\;Methods}$: In order to get patient images in semi-BEV, CCTV cameras are installed in a custom-made acrylic applicator below the treatment head of a linear accelerator. The images from the cameras are transmitted via radio frequency signal (${\sim}2.4\;GHz$ and 10 mW RF output). An expected problem with this system is radio frequency interference, which is solved utilizing RF shielding with Cu foils and median filtering software. The images are analyzed by our custom-made software. In the software, three anatomical landmarks in the patient surface are indicated by a user, then automatically the 3 dimensional structures are obtained and registered by utilizing a localization procedure consisting mainly of stereo matching algorithm and Gauss-Newton optimization. This algorithm is applied to phantom images to investigate the setup accuracy. Respiratory gating system is also researched with real-time image processing. A line-laser marker projected on a patient's surface is extracted by binary image processing and the breath pattern is calculated and displayed in real-time. $\underline{Results}$: More than 80% of the camera noises from the linear accelerator are eliminated by wrapping the camera with copper foils. The accuracy of the localization procedure is found to be on the order of $1.5{\pm}0.7\;mm$ with a point phantom and sub-millimeters and degrees with a custom-made head/neck phantom. With line-laser marker, real-time respiratory monitoring is possible in the delay time of ${\sim}0.17\;sec$. $\underline{Conclusion}$: The wireless CCTV camera system is the novel tool which can monitor daily patient setups. The feasibility of respiratory gating system with the wireless CCTV is hopeful.

A Experimental Study on the 3-D Image Restoration Technique of Submerged Area by Chung-ju Dam (충주댐 수몰지구의 3차원 영상복원 기법에 관한 실험적 연구)

  • 연상호
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.22 no.1
    • /
    • pp.21-27
    • /
    • 2004
  • It will be a real good news fer the people who were lost their hometown by the construction of a large dam to be restored to the farmer state. Focused on Cheung-pyung around where most part were submerged by the Chungju large Dam founded in eurly 1980s, It used remote sensing image restoration Technique in this study in order to restore topographical features before the flood with stereo effects. We gathered comparatively good satellite photos and remotely sensed digital images, then its made a new fusion image from these various satellite images and the topographical map which had been made before the water filled by the DAM. This task was putting together two kinds of different timed images. And then, we generated DEM including the outskirts of that area as matching current contour lines with the map. That could be a perfect 3D image of test areas around before when it had been water filled by making perspective images from all directions included north, south, east and west, fer showing there in 3 dimensions. Also, for close range visiting made of flying simulation can bring to experience their real space at that time. As a result of this experimental task, it made of new fusion images and 3-D perspective images and simulation live images by remotely sensed photos and images, old paper maps about vanished submerged Dam areas and gained of possibility 3-D terrain image restoration about submerged area by large Dam construction.

Multi-view Generation using High Resolution Stereoscopic Cameras and a Low Resolution Time-of-Flight Camera (고해상도 스테레오 카메라와 저해상도 깊이 카메라를 이용한 다시점 영상 생성)

  • Lee, Cheon;Song, Hyok;Choi, Byeong-Ho;Ho, Yo-Sung
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.37 no.4A
    • /
    • pp.239-249
    • /
    • 2012
  • Recently, the virtual view generation method using depth data is employed to support the advanced stereoscopic and auto-stereoscopic displays. Although depth data is invisible to user at 3D video rendering, its accuracy is very important since it determines the quality of generated virtual view image. Many works are related to such depth enhancement exploiting a time-of-flight (TOF) camera. In this paper, we propose a fast 3D scene capturing system using one TOF camera at center and two high-resolution cameras at both sides. Since we need two depth data for both color cameras, we obtain two views' depth data from the center using the 3D warping technique. Holes in warped depth maps are filled by referring to the surrounded background depth values. In order to reduce mismatches of object boundaries between the depth and color images, we used the joint bilateral filter on the warped depth data. Finally, using two color images and depth maps, we generated 10 additional intermediate images. To realize fast capturing system, we implemented the proposed system using multi-threading technique. Experimental results show that the proposed capturing system captured two viewpoints' color and depth videos in real-time and generated 10 additional views at 7 fps.

Fast Generation of Intermediate View Image Using GPGPU-Based Disparity Increment Method (GPGPU 기반의 변위증분 방법을 이용한 중간시점 고속 생성)

  • Koo, Ja-Myung;Seo, Young-Ho;Kim, Dong-Wook
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.17 no.8
    • /
    • pp.1908-1918
    • /
    • 2013
  • Free-view, auto-stereoscopic video service is a next generation broadcasting system which offers a three-dimensional video, images of the various point are needed. This paper proposes a method that parallelizes the algorithm for arbitrary intermediate view-point image fast generation and make it faster using General Propose Graphic Processing Unit(GPGPU) with help of the Compute Unified Device Architecture(CUDA). It uses a parallelized stereo-matching method between the leftmost and the rightmost depth images to obtain disparity information and It use data calculated disparity increment per depth value. The disparity increment is used to find the location in the intermediate view-point image for each depth in the given images. Then, It is eliminate to disocclusions complement each other and remaining holes are filled image using hole-filling method and to get the final intermediate view-point image. The proposed method was implemented and applied to several test sequences. The results revealed that the quality of the generated intermediate view-point image corresponds to 30.47dB of PSNR in average and it takes about 38 frames per second to generate a Full HD intermediate view-point image.

Intermediate View Image and its Digital Hologram Generation for an Virtual Arbitrary View-Point Hologram Service (임의의 가상시점 홀로그램 서비스를 위한 중간시점 영상 및 디지털 홀로그램 생성)

  • Seo, Young-Ho;Lee, Yoon-Hyuk;Koo, Ja-Myung;Kim, Dong-Wook
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.17 no.1
    • /
    • pp.15-31
    • /
    • 2013
  • This paper proposes an intermediate image generation method for the viewer's view point by tracking the viewer's face, which is converted to a digital hologram. Its purpose is to increase the viewing angle of a digital hologram, which is gathering higher and higher interest these days. The method assumes that the image information for the leftmost and the rightmost view points within the viewing angle to be controlled are given. It uses a stereo-matching method between the leftmost and the rightmost depth images to obtain the pseudo-disparity increment per depth value. With this increment, the positional informations from both the leftmost view point and the rightmost view point are generated, which are blended to get the information at the wanted intermediate viewpoint. The occurrable dis-occlusion region in this case is defined and a inpainting method is proposed. The results from implementing and experimenting this method showed that the average image qualities of the generated depth and RGB image were 33.83[dB] and 29.5[dB], respectively, and the average execution time was 250[ms] per frame. Also, we propose a prototype system to service digital hologram interactively to the viewer by using the proposed intermediate view generation method. It includes the operations of data acquisition for the leftmost and the rightmost viewpoints, camera calibration and image rectification, intermediate view image generation, computer-generated hologram (CGH) generation, and reconstruction of the hologram image. This system is implemented in the LabView(R) environments, in which CGH generation and hologram image reconstruction are implemented with GPGPUs, while others are implemented in software. The implemented system showed the execution speed to process about 5 frames per second.