• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2012.11a
• /
• pp.25-28
• /
• 2012

본 논문에서는 키넥트(Kinect)에서 획득한 깊이 영상의 품질을 향상시키는 기법을 제안한다. 키넥트는 마이크로소프트사에서 출시한 카메라로 깊이 영상과 컬러 영상을 획득 할 수 있다. 하지만 적외선 패턴을 이용한 깊이 영상의 획득 방법의 한계로 인해 객체의 경계 주변으로 홀 및 잡음이 생긴다. 따라서 정확한 깊이 영상을 얻기 위해서는 깊이 영상의 품질 향상이 필수적이다. 일반적으로 깊이 영상의 홀을 채울 때, 인페인팅(inpainting) 또는 결합형 양방향 필터(joint bilateral filter) 등의 기법을 사용한다. 그러나 이러한 기법들의 경우 한 장의 영상만을 이용하기 때문에 객체 경계 주변의 흔들림 현상을 보정할 수 없다. 제안하는 기법에서는 먼저 수행속도가 빠른 가우시안 필터를 이용하여 경계 주변의 홀을 채운다. 이전 프레임의 컬러 영상을 그레이 영상으로 변환한 다음에 그레이 영상과 깊이 영상의 값의 변화를 분석하여 흔들림 화소를 찾아 이전 깊이 영상들 중 최대 화소 값으로 변환함으로써 깊이 영상의 경계 흔들림 현상을 줄일 수 있다. 실험을 통해 제안하는 기법이 기존의 방법들 보다 우수하다는 것을 확인하였다.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2016.10a
• /
• pp.764-765
• /
• 2016

다양한 체험 중 인체의 신비에 관심이 있는 아이들을 위한 교육 목적의 중강현실을 마이크로소프트 키넥트 장비를 활용해서 구현하였다. 기존에 책의 이미지와 마네킹을 통해 인체 장기의 구조를 학습하는 방법에서 한 단계 발전시켜 아이들의 상체에 증강현실로 인체 장기 구조 이미지를 보여줌으로써 색다른 체험을 제공하는 흥미로운 학습 방법을 제시하고 있다. 추가적인 기능으로, 아이들의 성장 발달에 도움을 주는 게임 및 추억을 간직할 수 있는 촬영 기능도 제공하고 있다. 이 기법은 건강 교육 체험에 활용하여 흡연자의 폐와 과음한 사람의 간 등을 당사자의 상체에 중강현실로 보여주어 건강하지 못한 인체 장기 구조를 체험해 기존 방식보다 더욱 현실감이 있는 체험적인 건강 교육으로 활용될 것으로 기대한다.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.38C no.10
• /
• pp.920-927
• /
• 2013

Chroma key technique which composes images by separating an object from its background in specific color has restrictions on color and space. Especially, unlike general chroma key technique, image composition for stereo 3D display requires natural image composition method in 3D space. The thesis attempted to compose images in 3D space using depth keying method which uses high resolution depth information. High resolution depth map was obtained through camera calibration between the DSLR and Kinect sensor. 3D mesh model was created by the high resolution depth information and mapped with RGB color value. Object was converted into point cloud type in 3D space after separating it from its background according to depth information. The image in which 3D virtual background and object are composed obtained and played stereo 3D images using a virtual camera.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.38C no.5
• /
• pp.409-419
• /
• 2013

Kinect released by Microsoft in November 2010 is a motion sensing camera in xbox360 and gives depth and color images. However, Kinect camera also generates holes and noise around object boundaries in the obtained images because it uses infrared pattern. Also, boundary flickering phenomenon occurs. Therefore, we propose a real-time virtual-view video synthesis algorithm which results in a high-quality virtual view by solving these problems. In the proposed algorithm, holes around the boundary are filled by using the joint bilateral filter. Color image is converted into intensity image and then flickering pixels are searched by analyzing the variation of intensity and depth images. Finally, boundary flickering phenomenon can be reduced by converting values of flickering pixels into the maximum pixel value of a previous depth image and virtual views are generated by applying 3D warping technique. Holes existing on regions that are not part of occlusion region are also filled with a center pixel value of the highest reliability block after the final block reliability is calculated by using a block based gradient searching algorithm with block reliability. The experimental results show that the proposed algorithm generated the virtual view image in real-time.

• Journal of the Computational Structural Engineering Institute of Korea
• /
• v.31 no.4
• /
• pp.207-213
• /
• 2018

This paper investigates applicability of Microsoft $Kinect^{(R)}$, RGB-depth camera, to implement a 3D image and spatial information for sensing a target. The relationship between the image of the Kinect camera and the pixel coordinate system is formulated. The calibration of the camera provides the depth and RGB information of the target. The intrinsic parameters are calculated through a checker board experiment and focal length, principal point, and distortion coefficient are obtained. The extrinsic parameters regarding the relationship between the two Kinect cameras consist of rotational matrix and translational vector. The spatial images of 2D projection space are converted to a 3D images, resulting on spatial information on the basis of the depth and RGB information. The measurement is verified through comparison with the length and location of the 2D images of the target structure.

• Journal of the Computational Structural Engineering Institute of Korea
• /
• v.32 no.1
• /
• pp.29-35
• /
• 2019

In this paper, a low-cost dynamic measurement system using the RGB-depth camera, Microsoft $Kinect^{(R)}$ v2, is proposed for measuring time-varying free surface motion of liquid dampers used in building vibration mitigation. Various experimental studies are conducted consecutively: performance evaluation and validation of the $Kinect^{(R)}$ v2, real-time monitoring using the $Kinect^{(R)}$ v2 SDK(software development kits), point cloud acquisition of liquid free surface in the 3D space, comparison with the existing video sensing technology. Utilizing the proposed $Kinect^{(R)}$ v2-based measurement system in this study, dynamic behavior of liquid in a laboratory-scaled small tank under a wide frequency range of input excitation is experimentally analyzed.

• Physical Therapy Korea
• /
• v.26 no.1
• /
• pp.1-7
• /
• 2019

Background: The Microsoft Kinect which is a low-cost gaming device has been studied as a promise clinical gait analysis tool having satisfactory reliability and validity. However, its accuracy is only guaranteed when it is properly positioned in front of a subject. Objects: The purpose of this study was to identify the error when the Kinect was positioned at a $45^{\circ}$ angle to the longitudinal walking plane compare with those when the Kinect was positioned in front of a subject. Methods: Sixteen healthy adults performed two testing sessions consisting of walking toward and $45^{\circ}$ obliquely the Kinect. Spatiotemporal outcome measures related to stride length, stride time, step length, step time and walking speed were examined. To assess the error between Kinect and 3D motion analysis systems, mean absolute errors (MAE) were determined and compared. Results: MAE of stride length, stride time, step time and walking speed when the Kinect set in front of subjects were investigated as .36, .04, .20 and .32 respectively. MAE of those when the Kinect placed obliquely were investigated as .67, .09, .37, and .58 respectively. There were significant differences in spatiotemporal outcomes between the two conditions. Conclusion: Based on our study experience, positioning the Kinect directly in front of the person walking towards it provides the optimal spatiotemporal data. Therefore, we concluded that the Kinect should be placed carefully and adequately in clinical settings.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.25 no.5
• /
• pp.637-644
• /
• 2021

In general, in the fields of computer vision, robotics, and augmented reality, the importance of 3D space and 3D object detection and recognition technology has emerged. In particular, since it is possible to acquire RGB images and depth images in real time through an image sensor using Microsoft Kinect method, many changes have been made to object detection, tracking and recognition studies. In this paper, we propose a method to improve the quality of 3D reconstructed images by processing images acquired through a depth-based (RGB-Depth) camera on a multi-view camera system. In this paper, a method of removing noise outside an object by applying a mask acquired from a color image and a method of applying a combined filtering operation to obtain the difference in depth information between pixels inside the object is proposed. Through each experiment result, it was confirmed that the proposed method can effectively remove noise and improve the quality of 3D reconstructed image.

• Journal of Broadcast Engineering
• /
• v.19 no.5
• /
• pp.640-655
• /
• 2014

Many of today's video systems have additional depth camera to provide extra features such as 3D support. Thanks to these changes made in multimedia system, it is now much easier to obtain depth information of the video. Depth information can be used in various areas such as object classification, background area recognition, and so on. With depth information, we can achieve even higher coding efficiency compared to only using conventional method. Thus, in this paper, we propose the 2D video coding algorithm which uses depth information on top of the next generation 2D video codec HEVC. Background area can be recognized with depth information and by performing HEVC with it, coding complexity can be reduced. If current CU is background area, we propose the following three methods, 1) Earlier stop split structure of CU with PU SKIP mode, 2) Limiting split structure of CU with CU information in temporal position, 3) Limiting the range of motion searching. We implement our proposal using HEVC HM 12.0 reference software. With these methods results shows that encoding complexity is reduced more than 40% with only 0.5% BD-Bitrate loss. Especially, in case of video acquired through the Kinect developed by Microsoft Corp., encoding complexity is reduced by max 53% without a loss of quality. So, it is expected that these techniques can apply real-time online communication, mobile or handheld video service and so on.