• Journal of the Korean Institute of Intelligent Systems
• /
• v.25 no.4
• /
• pp.412-417
• /
• 2015

Kinect sensor has two output data which are produced from red green blue (RGB) sensor and depth sensor, it is called color image and depth map, respectively. Although this device's prices are cheapest than the other devices for three-dimensional (3D) reconstruction, we need extra work for reconstruct a smooth 3D data and also have semantic meaning. It happened because the depth map, which has been produced from depth sensor usually have a coarse and empty value. Consequently, it can be make artifact and holes on the surface, when we reconstruct it to 3D directly. In this paper, we present a method for solving this problem by using implicit surface representation. The key idea for represent implicit surface is by using radial basis function (RBF) and to avoid the trivial solution that the implicit function is zero everywhere, we need to defined on-surface point and off-surface point. Based on our simulation results using captured face as an input, we can produce smooth 3D face and fill the holes on the 3D face surface, since RBF is good for interpolation and holes filling. Modified anisotropic diffusion is used to produced smoothed surface.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.7 no.2
• /
• pp.91-100
• /
• 2011

Free viewpoint TV can provide multi-angle view point images for viewer needs. In the real world, But all angle view point images can not be captured by camera. Only a few any angle view point images are captured by each camera. Group of the captured images is called multi-view image. Therefore free viewpoint TV wants to production of virtual sub angle view point images form captured any angle view point images. Interpolation methods are known of this problem general solution. To product interpolated view point image of correct angle need to depth image of multi-view image. Unfortunately, multi-view video including depth image is necessary to develop a new compression encoding technique for storage and transmission because of a huge amount of data. Layered depth image is an efficient representation method of multi-view video data. This method makes a data structure that is synthesis of multi-view color and depth image. This paper proposed enhanced compression method using layered depth image representation and H.264/AVC video coding technology. In experimental results, confirmed high compression performance and good quality reconstructed image.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2011.11a
• /
• pp.8-10
• /
• 2011

3D 콘텐츠를 획득하는 여러 가지 방법 중 2D-plus-Depth 구조는 다시점 영상을 얻을 수 있는 장점 때문에 최근 이에 관한 연구가 활발히 진행되고 있다. 이 구조를 통해서 고품질의 3D영상을 얻기 위해서는 무엇보다 고품질의 깊이 영상을 구현하는 것이 중요하다. 깊이 영상을 얻기 위해서 Time-of-Flight(ToF)방식의 깊이 센서가 활용되고 있는데 이 깊이 센서는 실시간으로 깊이 정보를 획득할 수 있지만 낮은 해상도와 노이즈가 발생한다는 단점이 있다. 따라서 깊이 영상의 특성을 보존하는 상환 변환을 하여야지만 고품질의 3D 콘텐츠를 제작할 수 있다. 주로 깊이 영상의 해상도를 높이기 위해서 Joint Bilateral Upsampling(JBU) 방식이 사용되고 있다. 하지만 이 방식은 4배 이상의 고 해상도 깊이 영상을 획득하는 데에는 적합하지 않다. 따라서 고해상도의 깊이 영상을 얻기 위해서 보간법을 수행하여 가이드 영상을 만든 후 Bilateral Filtering(BF)을 처리함으로써 영상의 품질을 향상시킨다. 본 논문에서는 2D-plus-Depth 구조에서 얻은 컬러 영상과 깊이 영상을 결합한 보간법을 통해서 깊이 영상의 특성을 살린 가이드 영상을 구현하는 방법을 제안한다. 실험 결과는 제안 방법이 기존 보간법보다 경계 영역 및 평활한 영역에서 깊이 영상의 특성을 잘 보존하는 것을 보여준다.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.43 no.4 s.310
• /
• pp.58-66
• /
• 2006

In this paper, we apply DCM(Dilation of Color and Motion information) mask and Active Contour Models(Snakes) to extract facial outline in moving pictures with complex background. First, we propose DCM mask which is made by applying morphology dilation and AND operation to combine facial color and motion information, and use this mask to detect facial region without complex background and to remove noise in image energy. Also, initial curves are automatically set according to rotational degree estimated with geometric ratio of facial elements to overcome the demerit of Active Contour Models which is sensitive to initial curves. And edge intensity and brightness are both used as image energy of snakes to extract contour at parts with weak edges. For experiments, we acquired total 480 frames with various head-poses of sixteen persons with both eyes shown by taking pictures in inner space and also by capturing broadcasting images. As a result, it showed that more elaborate facial contour is extracted at average processing time of 0.28 seconds when using interpolated initial curves according to facial rotation degree and using combined image energy of edge intensity and brightness.

• Journal of Biomedical Engineering Research
• /
• v.24 no.4
• /
• pp.259-266
• /
• 2003

Non-rigid registration between different modality images with shape deformation can be used to diagnosis and study for inter-patient image registration, longitudinal intra-patient registration, and registration between a patient image and an atlas image. This paper proposes a hierarchical registration method using bodily tissue based segmentation for registration between color images and CT images of the Visible Human leg areas. The cross-sectional color images and the axial CT images are segmented into three distinctive bodily tissue regions, respectively: fat, muscle, and bone. Each region is separately registered hierarchically. Bounding boxes containing bodily tissue regions in different modalities are initially registered. Then, boundaries of the regions are globally registered within range of searching space. Local boundary segments of the regions are further registered for non-rigid registration of the sampled boundary points. Non-rigid registration parameters for the un-sampled points are interpolated linearly. Such hierarchical approach enables the method to register images efficiently. Moreover, registration of visibly distinct bodily tissue regions provides accurate and robust result in region boundaries and inside the regions.

• Journal of Broadcast Engineering
• /
• v.26 no.6
• /
• pp.714-724
• /
• 2021

The point cloud content is immersive content recorded by acquiring points and colors corresponding to the real environment and objects having three-dimensional location information. When a point cloud content consisting of three-dimensional points having position and color information is enlarged and rendered, the gap between the points widens and an empty hole occurs. In this paper, we propose a method for improving the quality of point cloud contents through inverse transformation-based interpolation using depth information for holes by finding holes that occur due to the gap between points when expanding the point cloud. The points on the back are rendered between the holes created by the gap between the points, acting as a hindrance to applying the interpolation method. To solve this, remove the points corresponding to the back side of the point cloud. Next, a depth map at the point in time when an empty hole is generated is extracted. Finally, inverse transform is performed to extract pixels from the original data. As a result of rendering content by the proposed method, the rendering quality improved by 1.2 dB in terms of average PSNR compared to the conventional method of increasing the size to fill the blank area.

• Journal of Korea Society of Industrial Information Systems
• /
• v.23 no.1
• /
• pp.1-12
• /
• 2018

This paper presents a material estimation method using dual-energy X-ray images generated as a result of cargo inspection system in MeV region. We use new discrimination curve using logarithmic function rather than four discrimination curves commonly used in existing estimation algorithms. We also propose an atomic number estimation using the probability distribution of the logarithmic curve rather than linear interpolation. When the probability distribution is used as a weight, we used two methods of using the weight for the two nearest reference materials and the weight for all the reference materials. Experimental results showed that the atomic number estimation of materials using the probability distribution as a weight is more accurate than the existing methods. In order to visualize the estimated atomic number, the HSI model was used for color the resulting image.

• Journal of the Institute of Convergence Signal Processing
• /
• v.2 no.4
• /
• pp.16-21
• /
• 2001

In this paper a virtual form of 3 dimensional face is synthesized from the two sheets of 2 dimensional photographs In this case two sheets of 2D face photographs, the front and the side photographs are used First of all a standard model for a general face is created and from this model the feature points which represents a construction of face are densely defined on part of ears. eyes, a nose and a lip but the other parts. for example, forehead, chin and hair are roughly determined because of flat region or the less individual points. Thereafter the side photograph is connected symmetrically on the left and right sides of the front image and it is gradually synthesized by use of affine transformation method. In order to remove the difference of color and brightness from the junction part, a linear interpolation method is used. As a result it is confirmed that the proposed model which general model of a face can be obtain the 3D virtual image of the individual face.

• Journal of the Korea Computer Graphics Society
• /
• v.3 no.2
• /
• pp.27-34
• /
• 1997

3-D image modeling is in high demand for automated visual inspection and non-destructive testing. It also can be useful in biomedical research, medical therapy, surgery planning, and simulation of critical surgery (i.e. cranio-facial). Image processing and image analysis are used to enhance and classify medical volumetric data. Analyzing medical volumetric data is very difficult In this paper, we propose a new image modeling method based on tetrahedrization to improve the visualization of three-dimensional medical volumetric data. In this method, the trivariate piecewise linear interpolation is applied through the constructed tetrahedral domain. Also, visualization methods including iso-surface, color contouring, and slicing are discussed. This method can be useful to the correct and speedy analysis of medical volumetric data, because it doesn't have the ambiguity problem of Marching Cubes algorithm and achieves the data reduction. We expect to compensate the degradation of an accuracy by using an adaptive sub-division of tetrahedrization based on least squares fitting.

• Journal of the Institute of Electronics Engineers of Korea SD
• /
• v.46 no.7
• /
• pp.53-60
• /
• 2009

Motion estimation for H.264/AVC video CODEC is very complex and requires a huge amount of computational efforts because it uses multiple reference frames and variable block sizes. We propose the architecture of high-performance integer-pixel motion estimation circuit based on fast algorithms for multiple reference frame selection, block matching, block mode decision and motion vector estimation. We also propose the architecture of high-performance interpolation circuit for sub-pixel motion estimation. We described the RTL circuit in Verilog HDL and synthesized the gate-level circuit using 130nm standard cell library. The integer-pixel motion estimation circuit consists of 77,600 logic gates and four $32\times8\times32$-bit dual-port SRAM's. It has tile maximum operating frequency of 161MHz and can process up to 51 D1 (720$\times$480) color in go frames per second. The fractional motion estimation circuit consists of 22,478 logic gates. It has the maximum operating frequency of 200MHz and can process up to 69 1080HD (1,920$\times$1,088) color image frames per second.