• Title/Summary/Keyword: 3D stereo

Search Result 804, Processing Time 0.042 seconds

A Study on the 3D Shape Reconstruction Algorithm of an Indoor Environment Using Active Stereo Vision (능동 스테레오 비젼을 이용한 실내환경의 3차원 형상 재구성 알고리즘)

  • Byun, Ki-Won;Joo, Jae-Heum;Nam, Ki-Gon
    • Journal of the Institute of Convergence Signal Processing
    • /
    • v.10 no.1
    • /
    • pp.13-22
    • /
    • 2009
  • In this paper, we propose the 3D shape reconstruction method that combine the mosaic method and the active stereo matching using the laser beam. The active stereo matching method detects the position information of the irradiated laser beam on object by analyzing the color and brightness variation of left and right image, and acquires the depth information in epipolar line. The mosaic method extracts feature point of image by using harris comer detection and matches the same keypoint between the sequence of images using the keypoint descriptor index method and infers correlation between the sequence of images. The depth information of the sequence image was calculated by the active stereo matching and the mosaic method. The merged depth information was reconstructed to the 3D shape information by wrapping and blending with image color and texture. The proposed reconstruction method could acquire strong the 3D distance information, and overcome constraint of place and distance etc, by using laser slit beam and stereo camera.

  • PDF

Enhanced Stereo Matching Algorithm based on 3-Dimensional Convolutional Neural Network (3차원 합성곱 신경망 기반 향상된 스테레오 매칭 알고리즘)

  • Wang, Jian;Noh, Jackyou
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.16 no.5
    • /
    • pp.179-186
    • /
    • 2021
  • For stereo matching based on deep learning, the design of network structure is crucial to the calculation of matching cost, and the time-consuming problem of convolutional neural network in image processing also needs to be solved urgently. In this paper, a method of stereo matching using sparse loss volume in parallax dimension is proposed. A sparse 3D loss volume is constructed by using a wide step length translation of the right view feature map, which reduces the video memory and computing resources required by the 3D convolution module by several times. In order to improve the accuracy of the algorithm, the nonlinear up-sampling of the matching loss in the parallax dimension is carried out by using the method of multi-category output, and the training model is combined with two kinds of loss functions. Compared with the benchmark algorithm, the proposed algorithm not only improves the accuracy but also shortens the running time by about 30%.

Application of Stereo Vision for Shape Measurement of Free-form Surface using Shape-from-shading (자유곡면의 형상 측정에서 shape-from-shading을 접목한 스테레오 비전의 적용)

  • Yang, Young-Soo;Bae, Kang-Yul
    • Journal of the Korean Society of Manufacturing Process Engineers
    • /
    • v.16 no.5
    • /
    • pp.134-140
    • /
    • 2017
  • Shape-from-shading (SFS) or stereo vision algorithms can be utilized to measure the shape of an object with imaging techniques for effective sensing in non-contact measurements. SFS algorithms could reconstruct the 3D information from a 2D image data, offering relatively comprehensive information. Meanwhile, a stereo vision algorithm needs several feature points or lines to extract 3D information from two 2D images. However, to measure the size of an object with a freeform surface, the two algorithms need some additional information, such as boundary conditions and grids, respectively. In this study, a stereo vision scheme using the depth information obtained by shape-from-shading as patterns was proposed to measure the size of an object with a freeform surface. The feasibility of the scheme was proved with an experiment where the images of an object were acquired by a CCD camera at two positions, then processed by SFS, and finally by stereo matching. The experimental results revealed that the proposed scheme could recognize the size and shape of freeform surface fairly well.

A Study of the 3D-Reconstruction of indoor using Stereo Camera System (스테레오 카메라를 이용한 실내환경의 3차원 복원에 관한 연구)

  • Lee Dong-Hun;Um Dae-Youn;Kang Hoon
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.15 no.1
    • /
    • pp.42-47
    • /
    • 2005
  • In this papcr, we address the 3D reconstruction of the indoor circumstance using what the data is extracted by a pall of image from Stereo Camera. Generally sucaking, there arc three methods to extract 3-Dimensional data using IR sensor, Laser sensor and Stereo camera sensor. The best is stereo camera sensor which can show a high performance at a reasonable price. We used 'Window Correlation Matching Method' to extract 3-Dimensional data in stereo image. We proposed new Method to reduce error data, said 'Histogram Weighted Hough Transform'. Owing to this mettled, we reduced error data in each stereo image. So reconstruction is well done. 3-Dimensional Reconstruction is accomplished by using the DirectX that is well known as 3D-Game development tool. We show that the stereo camera can be not only used to extract 3-dimensional data but also applied to reconstruct the 3-Dimensional circumstance. And we try to reduce the error data using various method.

Real-Time Augmented Reality on 3-D Mobile Display using Stereo Camera Tracking (스테레오 카메라 추적을 이용한 모바일 3차원 디스플레이 상의 실시간 증강현실)

  • Park, Jungsik;Seo, Byung-Kuk;Park, Jong-Il
    • Journal of Broadcast Engineering
    • /
    • v.18 no.3
    • /
    • pp.362-371
    • /
    • 2013
  • This paper presents a framework of real-time augmented reality on 3-D mobile display with stereo camera tracking. In the framework, camera poses are jointly estimated with the geometric relationship between stereoscopic images, which is based on model-based tracking. With the estimated camera poses, the virtual contents are correctly augmented on stereoscopic images through image rectification. For real-time performance, stereo camera tracking and image rectification are efficiently performed using multiple threads. Image rectification and color conversion are accelerated with a GPU processing. The proposed framework is tested and demonstrated on a commercial smartphone, which is equipped with a stereoscopic camera and a parallax barrier 3-D display.

High efficient vision system for volumetric display (입체영상 디스플레이를 위한 고효율 비젼 시스템)

  • Kim, Sang Hyun
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.14 no.10
    • /
    • pp.5130-5133
    • /
    • 2013
  • Volumetric display has many applications recently in education, 3D movie, medical images but these applications have several problems that need to be overcome. Volumetric display may process a amount of visual data and design the high efficient vision system for realtime display. The stereo data for volumetric display estimated the disparity vectors from the stereoscopic sequences has been transmitted the disparity vectors, motion vectors and residual images with the reference images, and the stereoscopic sequences have been reconstructed at the receiver for 3D display. Central issue for efficient 3D display lies in selecting an appropriate stereo matching with robust vision system. In this paper, high efficient vision system is proposed for efficient stereo image matching and the experimental results represent high efficiency for proposed 3D display system.

Viewers' Psychophysiological and Self-report Responses to 3D Stereoscopic Display (3D 영상의 입체성이 콘텐츠 특성에 따라 이용자의 심리적 반응에 미치는 효과 - 콘텐츠의 유인가와 각성도를 중심으로 -)

  • Lim, So-Hei;Chung, Ji-In
    • The Journal of the Korea Contents Association
    • /
    • v.12 no.6
    • /
    • pp.211-222
    • /
    • 2012
  • There has been growing academic interest in revealing the effect of 3D stereoscopic displays, mostly based on the assumption that 3D would enhance the media user's psychological experiences. A 2(Display: 2D, 3D) x 2(Arousal: High, Low) x2(Valence: Positive, Negative) within-between subject experimental design, including both psychophysiological and self-report measurements, was employed to investigate if valence and arousal of the media content interact with the 3D stereo display. The results confirmed that 3D stereo significantly enhances the viewer's skin conductance level, while no meaningful difference for HR was found across the experimental conditions. The viewer's recall memory did not differ depending on the display type either. However, the viewer experienced a greater level of presence and liking of the content when the negative content was displayed in 3D stereo in comparison with the positive content. The practical implications of the results are further discussed.

Convergence Control of Moving Object using Opto-Digital Algorithm in the 3D Robot Vision System

  • Ko, Jung-Hwan;Kim, Eun-Soo
    • Journal of Information Display
    • /
    • v.3 no.2
    • /
    • pp.19-25
    • /
    • 2002
  • In this paper, a new target extraction algorithm is proposed, in which the coordinates of target are obtained adaptively by using the difference image information and the optical BPEJTC(binary phase extraction joint transform correlator) with which the target object can be segmented from the input image and background noises are removed in the stereo vision system. First, the proposed algorithm extracts the target object by removing the background noises through the difference image information of the sequential left images and then controlls the pan/tilt and convergence angle of the stereo camera by using the coordinates of the target position obtained from the optical BPEJTC between the extracted target image and the input image. From some experimental results, it is found that the proposed algorithm can extract the target object from the input image with background noises and then, effectively track the target object in real time. Finally, a possibility of implementation of the adaptive stereo object tracking system by using the proposed algorithm is also suggested.

Efficient and Robust Correspondence Detection between Unbalanced Stereo Images

  • Kim, Yong-Ho;Kim, Jong-Su;Lee, Sangkeun;Choi, Jong-Soo
    • IEIE Transactions on Smart Processing and Computing
    • /
    • v.1 no.3
    • /
    • pp.161-170
    • /
    • 2012
  • This paper presents an efficient and robust approach for determining the correspondence between unbalanced stereo images. The disparity vectors were used instead of feature points, such as corners, to calculate a correspondence relationship. For a faster and optimal estimation, the vectors were classified into several regions, and the homography of each region was calculated using the RANSAC algorithm. The correspondence image was calculated from the images transformed by each homography. Although it provided good results under normal conditions, it was difficult to obtain reliable results in an unbalanced stereo pair. Therefore, a balancing method is also proposed to minimize the unbalance effects using the histogram specification and structural similarity index. The experimental results showed that the proposed approach outperformed the baseline algorithms with respect to the speed and peak-signal-to-noise ratio. This work can be applied to practical fields including 3D depth map acquisition, fast stereo coding, 2D-to-3D conversion, etc.

  • PDF

A Study on the Stereo Infrared Image Enhancement (스테레오 적외선영상의 이미지 향상에 관한 연구)

  • 류재훈;김윤호;류광렬
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2003.05a
    • /
    • pp.171-174
    • /
    • 2003
  • This paper is a study on the 3D infrared image enhancement with Stereoscopic algorithm on still infrared image. The adapted stereo method is that the depth is extracted by comparison with right-left image, and the enhanced 3D infrared image by matching based on feature is realized. As the result of experiment this method forced the more smooth edge lines of 3D infrared images.

  • PDF