• Journal of the Institute of Electronics and Information Engineers
• /
• v.52 no.7
• /
• pp.93-99
• /
• 2015

In this paper, we propose a gaze correction method for realistic video teleconferencing. Typically, cameras used in teleconferencing are installed at the side of the display monitor, but not in the center of the monitor. This system makes it too difficult for users to contact each eyes. Therefore, eys contact is the most important in the immersive videoconferencing. In the proposed method, we use the stereo camera and the depth camera to correct the eye contact. The depth camera is the kinect camera, which is the relatively cheap price, and estimate the depth information efficiently. However, the kinect camera has some inherent disadvantages. Therefore, we fuse the kinect camera with stereo camera to compensate the disadvantages of the kinect camera. Consecutively, for the gaze-corrected image, view synthesis is performed by 3D warping according to the depth information. Experimental results verify that the proposed system is effective in generating natural gaze-corrected images.

• Korean Journal of Computational Design and Engineering
• /
• v.21 no.1
• /
• pp.9-19
• /
• 2016

Applying human engineering simulation to analyzing work capability and movements of operators during manufacturing is highly demanded. However, difficulty in modeling digital human required for simulation makes engineers to be reluctant to utilize human simulation for their tasks. This paper addresses such problem on human engineering simulation by developing the technology to automatize human modeling with multiple Kinects at different depths. The Kinects enable us to acquire the movements of digital human which are essential data for implementing human engineering simulation. In this paper, we present a system for modeling automation of digital human. Especially, the system provides a way of generating the digital model of workers' movement and position using multiple Kinects which cannot be generated by single Kinect. Lastly, we verify the effects of the developed system in terms of modeling time and accuracy by applying the system to four different scenarios. In conclusion, the proposed system makes it possible to generate the digital human model easily and reduce costs and time for human engineering simulation.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.25 no.4
• /
• pp.412-417
• /
• 2015

Kinect sensor has two output data which are produced from red green blue (RGB) sensor and depth sensor, it is called color image and depth map, respectively. Although this device's prices are cheapest than the other devices for three-dimensional (3D) reconstruction, we need extra work for reconstruct a smooth 3D data and also have semantic meaning. It happened because the depth map, which has been produced from depth sensor usually have a coarse and empty value. Consequently, it can be make artifact and holes on the surface, when we reconstruct it to 3D directly. In this paper, we present a method for solving this problem by using implicit surface representation. The key idea for represent implicit surface is by using radial basis function (RBF) and to avoid the trivial solution that the implicit function is zero everywhere, we need to defined on-surface point and off-surface point. Based on our simulation results using captured face as an input, we can produce smooth 3D face and fill the holes on the 3D face surface, since RBF is good for interpolation and holes filling. Modified anisotropic diffusion is used to produced smoothed surface.

• Journal of information and communication convergence engineering
• /
• v.12 no.4
• /
• pp.208-214
• /
• 2014

In this paper, in order to solve the problems of a narrow viewing angle and the flip effect in a three-dimensional (3D) integral imaging display, we propose an improved system by using an eye tracking method based on the Kinect sensor. In the proposed method, we introduce two types of calibration processes. First process is to perform the calibration between two cameras within Kinect sensor to collect specific 3D information. Second process is to use a space calibration for the coordinate conversion between the Kinect sensor and the coordinate system of the display panel. Our calibration processes can provide the improved performance of estimation for 3D position of the observer's eyes and generate elemental images in real-time speed based on the estimated position. To show the usefulness of the proposed method, we implement an integral imaging display system using the eye tracking process based on our calibration processes and carry out the preliminary experiments by measuring the viewing angle and flipping effect for the reconstructed 3D images. The experimental results reveal that the proposed method extended the viewing angles and removed the flipping images compared with the conventional system.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.9 no.10
• /
• pp.1103-1109
• /
• 2014

The latest CCTV camera are network camera in many cases. In this case when transmitting high-quality image by internet, it could be a large load on the internet because the amount of image data is very large. In this study, we propose a method which can reduce the video traffic in this case, and evaluate its performance. We used a method for transmitting and extracting a gesture information using ToF camera such as Kinect in certain circumstances. There may be restrictions on the application of the proposed method because it depends on the performance of the ToF camera. However, it can be applied efficiently to the security or safety management of a small interior space such as a home or office.

• Journal of Korea Multimedia Society
• /
• v.17 no.2
• /
• pp.248-256
• /
• 2014

This paper designs a serious game for rehabilitation of patients with body pains because they sit down for a long time in the same position, or less physical movement. Activity-based game induces to player improvements in physical exercise with fun elements of the game through entertainment to help the body function and substantially increases the player's commitment during challenging goal. This research is a game design that combines the treatment of color and movement of body to the rhythm of the music. We constructed with XNA Game Studio and KINECT interface with gesture recognition technology. We need to research of evaluation system and test for the actual effect of the treatment and advanced functions of game playes like adding various musics and variety of motion.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.9 no.7
• /
• pp.2585-2598
• /
• 2015

Hand posture recognition has played a very important role in Human Computer Interaction (HCI) and Computer Vision (CV) for many years. The challenge arises mainly due to self-occlusions caused by the limited view of the camera. In this paper, a robust hand posture recognition approach based on 3D point cloud from two RGB-D sensors (Kinect) is proposed to make maximum use of 3D information from depth map. Through noise reduction and registering two point sets obtained satisfactory from two views as we designed, a multi-viewed hand posture point cloud with most 3D information can be acquired. Moreover, we utilize the accurate reconstruction and classify each point cloud by directly matching the normalized point set with the templates of different classes from dataset, which can reduce the training time and calculation. Experimental results based on posture dataset captured by Kinect sensors (from digit 1 to 10) demonstrate the effectiveness of the proposed method.

• Journal of Korea Multimedia Society
• /
• v.16 no.12
• /
• pp.1393-1402
• /
• 2013

Hand gesture is one of the most popular communication methods in everyday life. In human-computer interaction applications, hand gesture recognition provides a natural way of communication between humans and computers. There are mainly two methods of hand gesture recognition: glove-based method and vision-based method. In this paper, we propose a vision-based hand gesture recognition method using Kinect. By using the depth information is efficient and robust to achieve the hand detection process. The finger labeling makes the system achieve pose classification according to the finger name and the relationship between each fingers. It also make the classification more effective and accutate. Two kinds of gesture sets can be recognized by our system. According to the experiment, the average accuracy of American Sign Language(ASL) number gesture set is 94.33%, and that of general gestures set is 95.01%. Since our system runs in real-time and has a high recognition rate, we can embed it into various applications.

• Journal of Advanced Navigation Technology
• /
• v.17 no.2
• /
• pp.247-254
• /
• 2013

The task of 3D gesture recognition for controlling equipments is highly challenging due to the propagation of 3D smart TV recently. In this paper, the AdaBoost algorithm is applied to 3D gesture recognition by using Kinect sensor. By tracking time interval trajectory of hand, wrist and arm by Kinect, AdaBoost algorithm is used to train and classify 3D gesture. Experimental results demonstrate that the proposed method can successfully extract trained gestures from continuous hand, wrist and arm motion in real time.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.14 no.6
• /
• pp.125-130
• /
• 2014

In recent years, the IT conversions have rapidly developed along the development of the information technologies and devices. The overuse of IT devices caused by this trend has weakened the physical condition of children these days, compared to the past, therefore a study for this problem is necessary. This study intends to improve the health of children, easy to lack physical activities caused by the addiction to PC and smart phones, by proposing a health care application for them using Kinect. This application will introduce some simple aerobic/anaerobic exercises that could be done in home and will help children to forget the boredom by exercising alone and to coach them by using it.