• Journal of Digital Contents Society
• /
• v.13 no.2
• /
• pp.235-245
• /
• 2012

This paper introduce a quiz game contents based on gesture interface. We analyzed the off-line quiz games, extracted its presiding components, and digitalized them so that the proposed game contents is able to substitute for the off-line quiz games. We used the Kinect camera to obtain the depth images and performed the preprocessing including vertical human segmentation, head detection and tracking and hand detection, and gesture recognition for hand-up, hand vertical movement, fist shape, pass and fist-and-attraction. Especially, we defined the interface gestures designed as a metaphor for natural gestures in real world so that users are able to feel abstract concept of movement, selection and confirmation tangibly. Compared to our previous work, we added the card compensation process for completeness, improved the vertical hand movement and the fist shape recognition methods for the example selection and presented an organized test to measure the recognition performance. The implemented quiz application program was tested in real time and showed very satisfactory gesture recognition results.

• Journal of Digital Convergence
• /
• v.11 no.7
• /
• pp.157-163
• /
• 2013

In this paper, we propose a vision and depth information based real-time hand gesture interface method using finger joint estimation. For this, the areas of left and right hands are segmented after mapping of the visual image and depth information image, and labeling and boundary noise removal is performed. Then, the centroid point and rotation angle of each hand area are calculated. Afterwards, a circle is expanded at following pattern from a centroid point of the hand to detect joint points and end points of the finger by obtaining the midway points of the hand boundary crossing and the hand model is recognized. Experimental results that our method enabled fingertip distinction and recognized various hand gestures fast and accurately. As a result of the experiment on various hand poses with the hidden fingers using both hands, the accuracy showed over 90% and the performance indicated over 25 fps. The proposed method can be used as a without contacts input interface in HCI control, education, and game applications.

• International Journal of Internet, Broadcasting and Communication
• /
• v.7 no.1
• /
• pp.15-19
• /
• 2015

The depth information of an image is used in a variety of applications including 2D/3D conversion, multi-view extraction, modeling, depth keying, etc. There are various methods to acquire depth information, such as the method to use a stereo camera, the method to use the depth camera of flight time (TOF) method, the method to use 3D modeling software, the method to use 3D scanner and the method to use a structured light just like Microsoft's Kinect. In particular, the depth camera of TOF method measures the distance using infrared light, whereas TOF sensor depends on the sensitivity of optical light of an image sensor (CCD/CMOS). Thus, it is mandatory for the existing image sensors to get an infrared light image by bundling several pixels; these requirements generate a phenomenon to reduce the resolution of an image. This thesis proposed a measure to acquire a high-resolution image through gradual area movement while acquiring a low-resolution image through pixel bundling method. From this measure, one can obtain an effect of acquiring image information in which illumination intensity (lux) and resolution were improved without increasing the performance of an image sensor since the image resolution is not improved as resolving a low-illumination intensity (lux) in accordance with the gradual pixel bundling algorithm.

• Journal of Korea Society of Industrial Information Systems
• /
• v.18 no.1
• /
• pp.37-45
• /
• 2013

Almost of stroke patients who experience aftereffects such as motor, sensory and cognitive disorders have to take some rehabilitation therapies. It is known that the consistent training for rehabilitation therapy in their home is more effective than rehabilitation therapy in hospital. A few home training programs were developed but these programs don't give any appropriate feedback messages to the client. Therefore, we developed a home training program which can provide appropriate feedback message to the clients using the Kinect sensor which can analyze user's 3-D dimensional motion. With this development, the client can obtain some feedback messages such as the knowledges of performance, results and self-controlled feedback. The program will be more effective than any existing programs.

• Journal of the Korea Convergence Society
• /
• v.11 no.3
• /
• pp.85-93
• /
• 2020

This study is to examine the randomized controlled trials abroad studies on ICT-based convergence studies in the elderly, and to investigate the types and effects of ICT-based interventions. Eight studies that meet the selection criteria were selected from 326 studies identified by three databases and hand-searching. As a result of this study, the most commonly used ICT were the three internet, followed by two tablets and mobile phones, one twoway videoconferencing, one Kinect, one robot, and one Blood Glucose Monitoring System. These results could be used for ICT-based convergence studies in Korea, and further studies should be conducted with higher quality studies such as randomized controlled trials.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.12 no.2
• /
• pp.121-130
• /
• 2012

This paper proposes an intuitive real-time robot control system using human body movement. Recently, it has been developed that motion generation for humanoid robots with reflecting human body movement, which is measured by a motion capture. However, in the existing studies about robot control system by human body movement, the detailed structure information of a robot, for example, degrees of freedom, the range of motion and forms, must be examined in order to calculate inverse kinematics. In this study, we have proposed Associative Motion Generation as humanoid robot motion generation method which does not need the detailed structure information. The associative motion generation system is composed of two neural networks: nonlinear principal component analysis and Jordan recurrent neural network, and the associative motion is generated with the following three steps. First, the system learns the correspondence relationship between an indication and a motion using training data. Second, associative values are extracted for associating a new motion from an unfamiliar indication using nonlinear principal component analysis. Last, the robot generates a new motion through calculation by Jordan recurrent neural network using the associative values. In this paper, we propose a real-time humanoid robot control system based on Associative Motion Generation, that enables user to control motion intuitively by human body movement. Through the task processing and subjective evaluation experiments, we confirmed the effective usability and affective evaluations of the proposed system.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.9 no.11
• /
• pp.1317-1322
• /
• 2014

To complete an image, it is needed to go through the process to capture the actual actor's motion and compose it with virtual environment. Due to the excessive cost for production or lack of post-processing technology, however, it is mostly conducted by manual labor. The actor plays his role depending on his own imagination at the virtual chromakey studio, and at that time, he has to move considering the possible collision with or reaction to an object that does not exist. And in the process of composition applying CG, when the actor's motion does not go with the virtual environment, the original image may have to be discarded and it is necessary to remake the film. The current study suggested and realized depth-based real-time 3D virtual image composition system to reduce the ratio of remaking the film, shorten the production time, and lower the production cost. As it is possible to figure out the mutual collision or reaction by composing the virtual background, 3D model, and the actual actor in real time at the site of filming, the actor's wrong position or acting can be corrected right there instantly.

• KIPS Transactions on Software and Data Engineering
• /
• v.7 no.4
• /
• pp.135-144
• /
• 2018

The domestic pigsty environment is highly vulnerable to the spread of respiratory diseases such as foot-and-mouth disease because of the small space. In order to manage this issue, a variety of studies have been conducted to automatically analyze behavior of individual pigs in a pig pen through a video surveillance system using a camera. Even though it is required to correctly segment touching pigs for tracking each pig in complex situations such as aggressive behavior, detecting the correct boundaries among touching pigs using Kinect's depth information of lower accuracy is a challenging issue. In this paper, we propose a segmentation method using motion information of the touching pigs. In addition, our proposed method can be applied for detecting tracking errors in case of tracking individual pigs in the complex environment. In the experimental results, we confirmed that the touching pigs in a pig farm were separated with the accuracy of 86%, and also confirmed that the tracking errors were detected accurately.

• Journal of IKEEE
• /
• v.23 no.1
• /
• pp.74-79
• /
• 2019

As the desire for healthcare increases due to the ageing population and the well-being boom, interest in fitness is increasing. People go to the fitness center to exercise, but many people do not know how to exercise, so they often make the order of exercise and the exercise posture wrong. This not only reduces the effectiveness of the exercise, but also increases the risk of injury. This paper describes the development process of fitness system using smart mirror. This system allows people to follow the motion by themselves in front of the smart mirror, and if the exercise posture goes wrong, in real time it checks and corrects for the wrong point. By using this system, people will be able to exercise by themselves in the right posture without the help of a trainer. Also, as a result, people will be able to exercise at any time they want without the constraint of time commitment with a trainer and the cost will be reduced.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.24 no.7
• /
• pp.866-872
• /
• 2020

Indoor location-based services provide a service based on the distance between an object and a person. Recently, indoor location-based services are often implemented using inexpensive depth sensors such as Kinect. The depth sensor provides a function to measure the position of a person, but the position of an object must be acquired manually using a tool. To acquire a 3D position of an object, it requires 3D interaction, which is difficult to a general user. GUI(Graphical User Interface) is relatively easy to a general user but it is hard to gather a 3D position. This study proposes the Interactive LOcation Context Authoring Toolkit(ILOCAT), which enables a general user to easily acquire a 3D position of an object in real space using GUI. This paper describes the interaction design and implementation of ILOCAT.