• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.17 no.8
• /
• pp.2068-2082
• /
• 2023

With the rapid development of deep learning, Depth Map Super-Resolution (DMSR) method has achieved more advanced performances. However, when the upsampling rate is very large, it is difficult to capture the structural consistency between color features and depth features by these DMSR methods. Therefore, we propose a color-image guided DMSR method based on iterative depth feature enhancement. Considering the feature difference between high-quality color features and low-quality depth features, we propose to decompose the depth features into High-Frequency (HF) and Low-Frequency (LF) components. Due to structural homogeneity of depth HF components and HF color features, only HF color features are used to enhance the depth HF features without using the LF color features. Before the HF and LF depth feature decomposition, the LF component of the previous depth decomposition and the updated HF component are combined together. After decomposing and reorganizing recursively-updated features, we combine all the depth LF features with the final updated depth HF features to obtain the enhanced-depth features. Next, the enhanced-depth features are input into the multistage depth map fusion reconstruction block, in which the cross enhancement module is introduced into the reconstruction block to fully mine the spatial correlation of depth map by interleaving various features between different convolution groups. Experimental results can show that the two objective assessments of root mean square error and mean absolute deviation of the proposed method are superior to those of many latest DMSR methods.

• Smart Media Journal
• /
• v.1 no.3
• /
• pp.22-28
• /
• 2012

As the smart media becomes more popular, the demand for high-quality 3D images and depth maps is increasing. However, performance of the current technologies to acquire depth maps is not sufficient. The depth maps from stereo matching methods have low accuracy in homogeneous regions. The depth maps from depth cameras are noisy and have low-resolution due to technical limitations. In this paper, we introduce the state-of-the-art algorithms for depth map enhancement and up-sampling from conventional methods using only depth maps to the latest algorithms referring to both depth maps and their corresponding color images. We also present depth map enhancement algorithms for hybrid camera systems in detail.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.17 no.12
• /
• pp.2927-2936
• /
• 2013

In this paper, we propose a noise reduction and hole removal algorithm in order to improve the quality of depth images when they are used for creating 3D contents. In the proposed algorithm, the depth image and the corresponding color image are both used. First, an intensity image is generated by converting the RGB color space into the HSI color space. By estimating the difference of distance and depth between reference and neighbor pixels from the depth image and difference of intensity values from the color image, they are used to remove noise in the proposed algorithm. Then, the proposed hole filling method fills the detected holes with the difference of euclidean distance and intensity values between reference and neighbor pixels from the color image. Finally, we apply a parallel structure of GPGPU to the proposed algorithm to speed-up its processing time for real-time applications. The experimental results show that the proposed algorithm performs better than other conventional algorithms. Especially, the proposed algorithm is more effective in reducing edge blurring effect and removing noise and holes.

• Journal of the Korean Society of Clothing and Textiles
• /
• v.30 no.1 s.149
• /
• pp.59-70
• /
• 2006

This study has analyzed females' motives and psychological experiences related to appearance-enhancement seeking behavior(weight control practice and cosmetic surgery). In this study, in-depth interviews were carried out to 11 females who had experienced weight control practices and cosmetic surgery in June 2001. There is social standard in ideal body image. One perceive a physical idea and own body through society(mass media, reference group), others and clothing, and recognize the ideal body and internalize the social standard as own worth. The discrepancies between ideal body image internalized as standards of own worth and real body image became a setup for body dissatisfaction. Increasing in body dissatisfaction, rejection of own body grow, furthermore body is perceived with distortion. In order to remove a negative body image and to reach ideal body image, appearance-enhancement seeking behavior such as weight control and cosmetic surgery is made. By appearance enhancing, one come to closer to ideal image of which one pursuit oneself. Therefore body satisfaction feeling increase, self·esteem rise, manner of life and character change to with affirmation. Otherwise, strengthening of appearance-concern and of appearance enhancement seeking desire has the possibility of developing into bulimia and cosmetic surgery addiction. Also, the standard of beauty in appearance rise by degrees, and that produces motives of appearance-enhancement seeking behavior.

• KIPS Transactions on Computer and Communication Systems
• /
• v.5 no.9
• /
• pp.237-246
• /
• 2016

DIBR (Depth Image Based Rendering) is a multimedia technology that generates the virtual multi-view images using a color image and a depth image, and it is used for creating glasses-less 3-dimensional display contents. This research describes the effect of depth accuracy about the objective quality of DIBR-based multi-view images. It first evaluated the minimum depth quantization bit that enables the minimum distortion so that people cannot recognize the quality degradation. It then presented the comparative analysis of non-uniform domain-division quantization versus regular linear quantization to find out how effectively express the accuracy of the depth information in same quantization levels according to scene properties.

• Journal of the Korea Society of Computer and Information
• /
• v.17 no.4
• /
• pp.51-58
• /
• 2012

Recently, 3D technology based on depth image is widely used in various fields including 3D space recognition, image acquisition, interaction, and games. Depth camera is used in order to produce depth image, various types of effort are made to improve quality of the depth image. In this paper, we suggests using area-based Canny edge detector to improve depth image in applying 3D technology based on depth camera. The suggested method provides improved depth image with pre-processing and post-processing by fixing image quality deterioration, which may take place in acquiring depth image in a limited environment. For objective image quality evaluation, we have confirmed that the image is improved by 0.42dB at maximum, by applying and comparing improved depth image to virtual view reference software. In addition, with DSCQS(Double Stimulus Continuous Quality Scale) evaluation method, we are reassured of the effectiveness of improved depth image through objective evaluation of subjective quality.

• Journal of Information Display
• /
• v.13 no.3
• /
• pp.101-106
• /
• 2012

This study was conducted to enhance the cubic effect by representing an image with a sense of three-dimensional (3D) depth, using chromostereopsis, among the characteristics of human visual perception. An algorithm that enhances the cubic effect, based on the theory that the cubic effect of the chromostereoptic effect and the chromostereoptic reversal effect depends on the lightness of the background, classifies the layers of the 3D image input into the foreground, middle, and background layers according to the depth of the image input. It suits the characteristics of human visual perception because it controls the color factor that was adaptively detected through experiments on each layer; and it can achieve an enhanced cubic effect that is suitable for the characteristics of the image input.

• Journal of Broadcast Engineering
• /
• v.16 no.4
• /
• pp.584-595
• /
• 2011

Recently, RGB images and depth maps have been supplied to academic fields. The depth maps are utilized to the generation of stereoscopic images in the diverse formats according to the users' preference. A variety of methods that use depth maps have been introduced so far. One of applications is a medical field. In this area, the improvement of the perceptual quality of 2D medical images has gained much interest. In this paper, we propose a novel scheme that expands the conventional method to 3D stereoscopic image, thereby achieving the perceptual depth quality improvement as well as 3D stereoscopic perception enhancement at the same time. For this, contrast transformation as well as depth darkening are proposed and their performance is validated through the subjective test. Subjective experiments peformed for stereoscopic enhancement as well as visual fatigue validate that the proposed method achieves better 3D perception than the usage of the original stereoscopic image and suggests the limitation in terms of the visual fatigue.

• Proceedings of the IEEK Conference
• /
• 2006.06a
• /
• pp.311-312
• /
• 2006

In this paper, a real-time stereoscopic image conversion method using a single frame from a 2-D image is proposed. If original image is too much dark, it is difficult to create correct luminance value. So stereoscopic image is generated after applied image enhancement algorithm to original image. The Stereoscopic image is generated by creating depth map using vertical position information and parallax processing.

• Transactions of the Korean Society of Mechanical Engineers
• /
• v.19 no.6
• /
• pp.1431-1438
• /
• 1995

In this paper, we present a multiple-view stereo matching method in case of moving in the direction of optical axis with stereo camera. Also we analyze the obtainable depth precision to show that multiple-view stereo increases the virtual baseline with single-view stereo. This method decides candidate points for correspondence in each image pair and then search for the correct combinations of correspondences among them using the geometrical consistency they must satisfy. Adantages of this method are capability in increasing the accuracy in matching by using the multiple stereo images and less computation due to local processing. This method computes 3-D depth by averaging the depth obtained in each multiple-view stereo. We show that the resulting depth has more precision than depth obtainable by each independent stereo when the position of image feature is uncertain due to image noise. This paper first defines a multipleview stereo agorithm in case of moving in the direction of optical axis with stereo camera and analyze the obtainable precision of computed depth. Then we represent the effect of removing the incorrect matching candidate and precision enhancement with experimental result.