• Title/Summary/Keyword: Image-Based Rendering

Search Result 320, Processing Time 0.027 seconds

Real-Time 2D-to-3D Conversion for 3DTV using Time-Coherent Depth-Map Generation Method

  • Nam, Seung-Woo;Kim, Hye-Sun;Ban, Yun-Ji;Chien, Sung-Il
    • International Journal of Contents
    • /
    • v.10 no.3
    • /
    • pp.9-16
    • /
    • 2014
  • Depth-image-based rendering is generally used in real-time 2D-to-3D conversion for 3DTV. However, inaccurate depth maps cause flickering issues between image frames in a video sequence, resulting in eye fatigue while viewing 3DTV. To resolve this flickering issue, we propose a new 2D-to-3D conversion scheme based on fast and robust depth-map generation from a 2D video sequence. The proposed depth-map generation algorithm divides an input video sequence into several cuts using a color histogram. The initial depth of each cut is assigned based on a hypothesized depth-gradient model. The initial depth map of the current frame is refined using color and motion information. Thereafter, the depth map of the next frame is updated using the difference image to reduce depth flickering. The experimental results confirm that the proposed scheme performs real-time 2D-to-3D conversions effectively and reduces human eye fatigue.

An Image Quality Evaluation Model for Optical Strip Signal-to-Noise Ratio in the Target Area of High Temperature Forgings

  • Ma, Hongtao;Zhao, Yuyang;Feng, Yiran;Lee, Eung-Joo;Tao, Xueheng
    • Journal of Multimedia Information System
    • /
    • v.8 no.2
    • /
    • pp.93-100
    • /
    • 2021
  • Under the time-varying temperature, the high-temperature radiation of forgings and the change of reflection characteristics of oxide skin on the surface of forgings lead to the difficulty of obtaining images to truly reflect the geometric characteristics of forgings. It is urgent to study the clear and reliable acquisition method of hot forging feature image under time-varying temperature to meet the requirements of visual measurement of hot geometric parameters of forgings. Based on this, this chapter first puts forward the quality evaluation method of forging feature image, which provides guarantee for the accurate evaluation of feature image quality. Furthermore, the factors that affect the image quality, such as the radiation characteristics of forgings and the photographic characteristics of cameras, are analyzed, and the imaging spectrum which can effectively suppress the radiation intensity of forgings is determined. Finally, aiming at the problem that the quality of image acquisition is difficult to guarantee due to the drastic change of radiation intensity of forgings under time-varying temperature, an image acquisition method based on minimum signal-to-noise ratio (SNR) based laser light intensity adaptation is proposed, which significantly improves the definition of feature light strips in forging images at high temperature, and finally realizes the clear acquisition of feature images of large-scale hot forging under time-varying temperature.

Generation of an eye-contacted view using color and depth cameras (컬러와 깊이 카메라를 이용한 시점 일치 영상 생성 기법)

  • Hyun, Jee-Ho;Han, Jae-Young;Won, Jong-Pil;Yoo, Ji-Sang
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.16 no.8
    • /
    • pp.1642-1652
    • /
    • 2012
  • Generally, a camera isn't located at the center of display in a tele-presence system and it causes an incorrect eye contact between speakers which reduce the realistic feeling during the conversation. To solve this incorrect eye contact problem, we newly propose an intermediate view reconstruction algorithm using both a color camera and a depth camera and applying for the depth image based rendering (DIBR) algorithm. In the proposed algorithm, an efficient hole filling method using the arithmetic mean value of neighbor pixels and an efficient boundary noise removal method by expanding the edge region of depth image are included. We show that the generated eye-contacted image has good quality through experiments.

Multiple TIP Images Blending for Wide Virtual Environment (넓은 가상환경 구축을 위한 다수의 TIP (Tour into the Picture) 영상 합성)

  • Roh, Chang-Hyun;Lee, Wan-Bok;Ryu, Dae-Hyun;Kang, Jung-Jin
    • Journal of the Institute of Electronics Engineers of Korea TE
    • /
    • v.42 no.1
    • /
    • pp.61-68
    • /
    • 2005
  • Image-based rendering is an approach to generate realistic images in real-time without modeling explicit 3D geometry. Especially, owing to its simplicity, TIP(Tour Into the Picture) is preferred to constructing a 3D background scene. Because existing TIP methods have a limitation in that they lack geometrical information, we can not expect a accurate scene if the viewpoint is far from the origin of the TIP. In this paper, we propose the method of constructing a virtual environment of a wide area by blending multiple TIP images. Firstly, we construct multiple TIP models of the virtual environment. Then we interpolate foreground and background objects respectively, to generate a smooth navigation image. The method proposed here can be applied to various industry applications, such as computer game, 3D car navigation, and so on.

Parallax Map Preprocessing Algorithm for Performance Improvement of Hole-Filling (홀 채우기의 성능 개선을 위한 시차지도의 전처리 알고리즘)

  • Kim, Jun-Ho;Lee, Si-Woong
    • The Journal of the Korea Contents Association
    • /
    • v.13 no.10
    • /
    • pp.62-70
    • /
    • 2013
  • DIBR(Depth Image Based Rendering) is a kind of view synthesis algorithm to generate images at free view points from the reference color image and its depth map. One of the main challenges of DIBR is the occurrence of holes that correspond to uncovered backgrounds at the synthesized view. In order to cover holes efficiently, two main approaches have been actively investigated. One is to develop preprocessing algorithms for depth maps or parallax maps to reduce the size of possible holes, and the other is to develop hole filling methods to fill the generated holes using adjacent pixels in non-hole areas. Most conventional preprocessing algorithms for reducing the size of holes are based on the smoothing process of depth map. Filtering of depth map, however, attenuates the resolution of depth map and generates geometric distortions. In this paper, we proposes a novel preprocessing algorithm for parallax map to improve the performance of hole-filling by avoiding the drawbacks of conventional methods.

Texture-based Hatching for Color Image and Video

  • Yang, Hee-Kyung;Min, Kyung-Ha
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.5 no.4
    • /
    • pp.763-781
    • /
    • 2011
  • We present a texture-based hatching technique for color images and video. Whereas existing approaches produce monochrome hatching effects in considering of triangular mesh models by applying strokes of uniform size, our scheme produces color hatching effects from photographs and video using strokes with a range of sizes. We use a Delaunay triangulation to create a mesh of triangles with sizes that reflect the structure of an input image. At each vertex of this triangulation, the flow of the image is analyzed and a hatching texture is then created with the same alignment, based on real pencil strokes. This texture is given a modified version of a color sampled from the image, and then it is used to fill all the triangles adjoining the vertex. The three hatching textures that accumulate in each triangle are averaged and the result of this process across all the triangles forms the output image. We can also add a paper texture effect and enhance feature lines in the image. Our algorithm can also be applied to video. The results are visually pleasing hatching effects similar to those seen in color pencil drawings and oil paintings.

Scattered Light Representation in Accordance with the Material Using Scatterer Template in Volume Rendering (볼륨 렌더링에서 산란자 템플릿을 이용한 재질별 산란광 표현)

  • Lee, Byeong-Joon;Kwon, Koojoo;Shin, Byeong-Seok
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.5 no.12
    • /
    • pp.677-684
    • /
    • 2016
  • For realistic rendering volume to calculate the light effects as well as the shade is essential. In order to produce the high quality of the resulting image, it is necessary to represent a global illumination, and it should be considered an indirect effect of the direct impact and scattering of light. It requires a lot of resources in order to perform this operation and, in particular, is very expensive when large amounts of data to be rendered as a volume data is consumed. In this paper, we generate a scatterer template according to the physical laws for each material. Considering that each object having material property stores photons of the template based on the Lambert illumination model. When the volume rendering in this paper, using the photon is stored in the template, based on the voxel to be sampled within the examination volume occluded, and it represents the global illumination of the scattering. Because the materials produced by the template requires a less resource only if comprised of a complex material, a simple operation can be expressed within the scattering volume at a low cost through.

Implementation of Neural Network Accelerator for Rendering Noise Reduction on OpenCL (OpenCL을 이용한 랜더링 노이즈 제거를 위한 뉴럴 네트워크 가속기 구현)

  • Nam, Kihun
    • The Journal of the Convergence on Culture Technology
    • /
    • v.4 no.4
    • /
    • pp.373-377
    • /
    • 2018
  • In this paper, we propose an implementation of a neural network accelerator for reducing the rendering noise using OpenCL. Among the rendering algorithms, we selects a ray tracing to assure a high quality graphics. Ray tracing rendering uses ray to render, less use of the ray will result in noise. Ray used more will produce a higher quality image but will take operation time longer. To reduce operation time whiles using fewer rays, Learning Base Filtering algorithm using neural network was applied. it's not always produce optimize result. In this paper, a new approach to Matrix Multiplication that is based on General Matrix Multiplication for improved performance. The development environment, we used specialized in high speed parallel processing of OpenCL. The proposed architecture was verified using Kintex UltraScale XKU6909T-2FDFG1157C FPGA board. The time it takes to calculate the parameters is about 1.12 times fast than that of Verilog-HDL structure.

A Pen Drawing Method by Tensor-based Strokes Generation (텐서 기반 스트로크 생성에 의한 펜화기법)

  • Shin, Do-kyung;Ahn, Eun-young
    • Journal of Korea Multimedia Society
    • /
    • v.20 no.4
    • /
    • pp.713-720
    • /
    • 2017
  • We present a non-photo realistic pen-ink drawing method for outlining and shading of the input image. Especially, we focus on the detailed illustration of the image of which stroke's direction is important. The pen-ink renderer is an alternative display models user can generate traditional illustration renderings of their photo realistic image. The previously proposed pen drawing methods produce feasible description in general image but it is difficult to express in detail for the sophisticated images that need to consider the direction of stroke for each image region. In order to overcome the disadvantages of the conventional method, a direction vector is extracted from a tensor field and we determine a stroke's direction in consideration of not only an edge area but also a gradient of a surrounding area in the image. For more detailed description for the sophisticated image, we generate white noises based on the light and shade of the input image and determine the direction and length of the stroke by using the tensor field for each generated white noise. The proposed method works particularly well for traditional architectural images where the direction and detailed description of the pen is important.

Algorithm Selection Method for Efficient Maximum Intensity Projection Based on User Preference (사용자 선호에 기반한 효율적 최대 휘소 가시화 알고리즘의 선택 방법)

  • Han, Cheol Hee;Kye, Heewon
    • Journal of Korea Multimedia Society
    • /
    • v.21 no.2
    • /
    • pp.87-97
    • /
    • 2018
  • Maximum intensity projection (MIP) is a common visualization technique in medical imaging system. A typical method to improve the performance of MIP is empty space leaping, which skips unnecessary area. This research proposes a new method to improve the existing empty space leaping. In order to skip more regions, we introduce a variety of acceleration strategies that use some tolerance given by the user to take part in image quality loss. Each proposed method shows various image quality and speed, and this study compares them to select the best one. Experimental results show that it is most efficient to add a constant tolerance function when the image quality required by the user is low. Conversely, when the user required image quality is high, a function with a low tolerance of volume center is most effective. Applying the proposed method to general MIP visualization can generate a relatively high quality image in a short time.