• Title/Summary/Keyword: 3D Stereoscopic Images

Search Result 222, Processing Time 0.026 seconds

Fast Generation of Intermediate View Image Using GPGPU-Based Disparity Increment Method (GPGPU 기반의 변위증분 방법을 이용한 중간시점 고속 생성)

  • Koo, Ja-Myung;Seo, Young-Ho;Kim, Dong-Wook
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.17 no.8
    • /
    • pp.1908-1918
    • /
    • 2013
  • Free-view, auto-stereoscopic video service is a next generation broadcasting system which offers a three-dimensional video, images of the various point are needed. This paper proposes a method that parallelizes the algorithm for arbitrary intermediate view-point image fast generation and make it faster using General Propose Graphic Processing Unit(GPGPU) with help of the Compute Unified Device Architecture(CUDA). It uses a parallelized stereo-matching method between the leftmost and the rightmost depth images to obtain disparity information and It use data calculated disparity increment per depth value. The disparity increment is used to find the location in the intermediate view-point image for each depth in the given images. Then, It is eliminate to disocclusions complement each other and remaining holes are filled image using hole-filling method and to get the final intermediate view-point image. The proposed method was implemented and applied to several test sequences. The results revealed that the quality of the generated intermediate view-point image corresponds to 30.47dB of PSNR in average and it takes about 38 frames per second to generate a Full HD intermediate view-point image.

A New Rectification Scheme for Uncalibrated Stereo Image Pairs and Its Application to Intermediate View Reconstruction

  • Ko, Jung-Hwan;Jung, Yong-Woo;Kim, Eun-Soo
    • Journal of Information Display
    • /
    • v.6 no.4
    • /
    • pp.26-34
    • /
    • 2005
  • In this paper, a new rectification scheme to transform the uncalibrated stereo image pair into the calibrated one is suggested and its performance is analyzed by applying this scheme to the reconstruction of the intermediate views for multi-view stereoscopic display. In the proposed method, feature points are extracted from the stereo image pair by detecting the comers and similarities between each pixel of the stereo image pair. These detected feature points, are then used to extract moving vectors between the stereo image pair and the epipolar line. Finally, the input stereo image pair is rectified by matching the extracted epipolar line between the stereo image pair in the horizontal direction. Based on some experiments done on the synthesis of the intermediate views by using the calibrated stereo image pairs through the proposed rectification algorithm and the uncalibrated ones for three kinds of stereo image pairs; 'Man', 'Face' and 'Car', it is found that PSNRs of the intermediate views reconstructed from the calibrated images improved by about 2.5${\sim}$3.26 dB than those of the uncalibrated ones.

Children's Education Application Design Using AR Technology (AR기술을 활용한 어린이 교육 어플리케이션 디자인)

  • Chung, HaeKyung;Ko, JangHyok
    • Journal of the Semiconductor & Display Technology
    • /
    • v.20 no.4
    • /
    • pp.23-28
    • /
    • 2021
  • Augmented reality is a technique for combining virtual images into real life by showing information of virtual 3D objects on top of a real-world environment (Azuma et al., 2001). This study is an augmented reality-based educational content delivery device that receives user input that selects either a preset object or a photographed object for augmented reality-based training; It includes a three-dimensional design generation unit that generates a stereoscopic model of the augmented reality environment from an object, a three-dimensional view of the scene, a disassembly process of the developing road from a three-dimensional model, and a content control unit provided by the user terminal by generating educational content including a three-dimensional model, a scene chart, a scene, a decomposition process, and a coupling process to build a coupling process from the scene to the three-dimensional model in an augmented reality environment. The next study provides a variety of educational content so that children can use AR technology as well as shapes to improve learning effectiveness. We also believe that studies are needed to quantitatively measure the efficacy of which educational content is more effective when utilizing AR technology.

Character Region Extraction Based on Texture and Depth Features (질감과 깊이 특징 기반의 문자영역 추출)

  • Jang, Seok-Woo;Park, Young-Jae;Huh, Moon-Haeng
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.14 no.2
    • /
    • pp.885-892
    • /
    • 2013
  • In this paper, we propose a method of effectively segmenting character regions by using texture and depth features in 3D stereoscopic images. The suggested method is mainly composed of four steps. The candidate character region extraction step extracts candidate character regions by using texture features. The character region localization step obtains only the string regions in the candidate character regions. The character/background separation step separates characters from background in the localized character areas. The verification step verifies if the candidate regions are real characters or not. In experimental results, we show that the proposed method can extract character regions from input images more accurately compared to other existing methods.

Implementation of Random Controlling of Convergence Point in VR Image Content Production (VR 영상콘텐츠 제작을 위한 컨버전스 포인트 임의조절 구현)

  • Jin, Hyung Woo;Baek, Gwang Ho;Kim, Mijin
    • Smart Media Journal
    • /
    • v.4 no.4
    • /
    • pp.111-119
    • /
    • 2015
  • As a variety of HMD(Head Mounted Display) has come out, the production of 3D images onto which VR(Virtual Reality) technologies are grafted has been contributed to activating the production of image contents depending on a tangible or immersing type. VR-based image contents have enlarged their applicability across the entertainment industry from animation and game to realistic images. At the same time, the solution development for producing VR image contents has also gained elasticity. However, among those production solutions which have been used until now, fixed stereo camera based photographing has a limit that the binocular disparity of a user is fixed. This does not only restrict a way of expression a producer intends to direct, but also may cause the effect of 3D or space not to be sensed enough as view condition is not considered enough in a user's side. This study is aimed at resolving with skills applying in the latter part of 3D image production the problem that convergence points may be adjusted with restriction, which tends to happen at the time of the production of VR image contents. The later stage of the 3D imaging work analyzes and applies to game engines the significance of adjusting convergence points through the visualization of binocular disparity so that it is available to implement a function that the points could be controlled at random by a user.

A Study on the Correlation of Factors in 3-D Stereoscopic Visual-perception (3차원 입체영상에서 시지각(時知覺) 요인의 상관관계)

  • Cho, Yong-Keun
    • Cartoon and Animation Studies
    • /
    • s.19
    • /
    • pp.161-181
    • /
    • 2010
  • Human beings experience the outside world through senses and have developed various ways of representation to preserve what they've experienced. The rapid progress of digital technology has opened a new era of representation technology, and furthermore, is functioning as a technology which offers new experiences. The sensory experiences through the sense of sight, which humans depend on more than 70% to perceive the outside world, have been becoming the center of representing the reality as the 3-D graphics technology has been growing, and developing by being grafted onto different areas of study. Various technologies to express the sense of reality, such as the technology to reinforce the virtual reality and to represent it in the reality, computer graphic, TUI technology, and five sensory technologies which apply humans' senses, are making advancement based on humans' visual features and sensory elements. In particular, the 3-D technology to display solidness provides not only representation but also new sensory experiences, and is emerging as the key technology to image contents. However, compared to the development of technology of 3-D graphics, there have been few basic studies on the principles of the sense of vision. Therefore, in this study, the principles and elements to sense videos will be examined. The sensory features of 3-D images to represent the sense of reality will be researched into, especially focusing on the experiential and physiological elements to sense 3-D structures, and the physical and psychological elements to sense shapes, which might be hopefully the basic study for producing 3-D contents.

  • PDF

Reconstruction of Stereo MR Angiography Optimized to View Position and Distance using MIP (최대강도투사를 이용한 관찰 위치와 거리에 최적화 된 입체 자기공명 뇌 혈관영상 재구성)

  • Shin, Seok-Hyun;Hwang, Do-Sik
    • Investigative Magnetic Resonance Imaging
    • /
    • v.16 no.1
    • /
    • pp.67-75
    • /
    • 2012
  • Purpose : We studied enhanced method to view the vessels in the brain using Magnetic Resonance Angiography (MRA). Noticing that Maximum Intensity Projection (MIP) image is often used to evaluate the arteries of the neck and brain, we propose a new method for view brain vessels to stereo image in 3D space with more superior and more correct compared with conventional method. Materials and Methods: We use 3T Siemens Tim Trio MRI scanner with 4 channel head coil and get a 3D MRA brain data by fixing volunteers head and radiating Phase Contrast pulse sequence. MRA brain data is 3D rotated according to the view angle of each eyes. Optimal view angle (projection angle) is determined by the distance between eye and center of the data. Newly acquired MRA data are projected along with the projection line and display only the highest values. Each left and right view MIP image is integrated through anaglyph imaging method and optimal stereoscopic MIP image is acquired. Results: Result image shows that proposed method let enable to view MIP image at any direction of MRA data that is impossible to the conventional method. Moreover, considering disparity and distance from viewer to center of MRA data at spherical coordinates, we can get more realistic stereo image. In conclusion, we can get optimal stereoscopic images according to the position that viewers want to see and distance between viewer and MRA data. Conclusion: Proposed method overcome problems of conventional method that shows only specific projected image (z-axis projection) and give optimal depth information by converting mono MIP image to stereoscopic image considering viewers position. And can display any view of MRA data at spherical coordinates. If the optimization algorithm and parallel processing is applied, it may give useful medical information for diagnosis and treatment planning in real-time.

Real-time Stereo Video Generation using Graphics Processing Unit (GPU를 이용한 실시간 양안식 영상 생성 방법)

  • Shin, In-Yong;Ho, Yo-Sung
    • Journal of Broadcast Engineering
    • /
    • v.16 no.4
    • /
    • pp.596-601
    • /
    • 2011
  • In this paper, we propose a fast depth-image-based rendering method to generate a virtual view image in real-time using a graphic processor unit (GPU) for a 3D broadcasting system. Before the transmission, we encode the input 2D+depth video using the H.264 coding standard. At the receiver, we decode the received bitstream and generate a stereo video using a GPU which can compute in parallel. In this paper, we apply a simple and efficient hole filling method to reduce the decoder complexity and reduce hole filling errors. Besides, we design a vertical parallel structure for a forward mapping process to take advantage of the single instruction multiple thread structure of GPU. We also utilize high speed GPU memories to boost the computation speed. As a result, we can generate virtual view images 15 times faster than the case of CPU-based processing.

Luminance Correction for Stereo Images using Histogram Interval Calibration (히스토그램 구간 교정을 이용한 스테레오 영상의 휘도 보정)

  • Kim, Seaho;Kim, Hiseok
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.12
    • /
    • pp.159-167
    • /
    • 2013
  • In stereo-view system, variations of target camera position or lighting conditions cause discrepancies on the luminance and chrominance components of stereo views. These discrepancies lead to inaccurate frame view prediction and low quality of 3 D video coding. In this paper, an efficient histogram interval calibration method is proposed for stereo-view coding, so as to compensate for the luminance component of target view. First the proposed method is analyzed by the histogram of the target image frame. Then, it divide two sections of histogram of that frame to correct the color discrepancies. Secondly, each section of the target frame is corrected the luminance component by identify the maximum matching region between the reference frame and the target frame. We have verified our proposed histogram matching method in comparison with the other color correction ones. Experimental results show that it can correct better luminance calibration results of PSNR(Peak Signal to Noise Ratio) and has less computation time.

Accurate Camera Calibration Method for Multiview Stereoscopic Image Acquisition (다중 입체 영상 획득을 위한 정밀 카메라 캘리브레이션 기법)

  • Kim, Jung Hee;Yun, Yeohun;Kim, Junsu;Yun, Kugjin;Cheong, Won-Sik;Kang, Suk-Ju
    • Journal of Broadcast Engineering
    • /
    • v.24 no.6
    • /
    • pp.919-927
    • /
    • 2019
  • In this paper, we propose an accurate camera calibration method for acquiring multiview stereoscopic images. Generally, camera calibration is performed by using checkerboard structured patterns. The checkerboard pattern simplifies feature point extraction process and utilizes previously recognized lattice structure, which results in the accurate estimation of relations between the point on 2-dimensional image and the point on 3-dimensional space. Since estimation accuracy of camera parameters is dependent on feature matching, accurate detection of checkerboard corner is crucial. Therefore, in this paper, we propose the method that performs accurate camera calibration method through accurate detection of checkerboard corners. Proposed method detects checkerboard corner candidates by utilizing 1-dimensional gaussian filters with succeeding corner refinement process to remove outliers from corner candidates and accurately detect checkerboard corners in sub-pixel unit. In order to verify the proposed method, we check reprojection errors and camera location estimation results to confirm camera intrinsic parameters and extrinsic parameters estimation accuracy.