• Journal of Satellite, Information and Communications
• /
• v.9 no.1
• /
• pp.57-64
• /
• 2014

Recently, many human-friendly communication methods have been studied for human-machine interface(HMI) without using any physical devices. One of them is the vision-based gesture recognition that this paper deals with. In this paper, we define some gestures for interaction with objects in a predefined virtual world, and propose an efficient method to recognize them. For preprocessing, we detect and track the both hands, and extract their silhouettes from the low-resolution hand images captured by a webcam. We modeled skin color by two Gaussian distributions in RGB color space and use blob-matching method to detect and track the hands. Applying the foodfill algorithm we extracted hand silhouettes and recognize the hand shapes of Thumb-Up, Palm and Cross by detecting and analyzing their modes. Then, with analyzing the context of hand movement, we recognized five predefined one-hand or both-hand gestures. Assuming that one main user shows up for accurate hand detection, the proposed gesture recognition method has been proved its efficiency and accuracy in many real-time demos.

• Journal of the Ergonomics Society of Korea
• /
• v.36 no.5
• /
• pp.385-394
• /
• 2017

Objective: The aim of this study is to investigate how to design effective virtual reality-based training (i.e., virtual training) in maritime safety and to present methods for enhancing interface fidelity by employing immersive interaction and 3D user interface (UI) design. Background: Emerging virtual reality technologies and hardware enable to provide immersive experiences to individuals. There is also a theory that the improvement of fidelity can improve the training efficiency. Such a sense of immersion can be utilized as an element for realizing effective training in the virtual space. Method: As an immersive interaction, we implemented gesture-based interaction using leap motion and Myo armband type sensors. Hand gestures captured from both sensors are used to interact with the virtual appliance in the scenario. The proposed 3D UI design is employed to visualize appropriate information for tasks in training. Results: A usability study to evaluate the effectiveness of the proposed method has been carried out. As a result, the usability test of satisfaction, intuitiveness of UI, ease of procedure learning, and equipment understanding showed that virtual training-based exercise was superior to existing training. These improvements were also independent of the type of input devices for virtual training. Conclusion: We have shown through experiments that the proposed interaction design results are more efficient interactions than the existing training method. The improvement of interface fidelity through intuitive and immediate feedback on the input device and the training information improve user satisfaction with the system, as well as training efficiency. Application: Design methods for an effective virtual training system can be applied to other areas by which trainees are required to do sophisticated job with their hands.

• Journal of the Korea Convergence Society
• /
• v.10 no.4
• /
• pp.107-113
• /
• 2019

The highest percentage of single-person households is older than 60. Many of them live in dilapidated residential space because they are in difficult economic situations. The windows of them often don't exist or don't function properly as windows. As a result, they are suffering from social problems such as depression, solitude. This paper proposes an interactive window interface that reflects external environmental information for older people in their 60s or older of one household living in a dilapidated residential space. This content utilizes an inexpensive TV or PC monitor that doesn't require extra space and cost. Recognizing a user's hand through intuitive touch-sensing technology, which doesn't require much help from older people, this content provides weather videos and temperature information that reflect current external environment. Alert notification sound and SMS service are provided in preparation for more critical user emergencies. This content enables users to feel emotional stability and respond quickly to emergencies.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.13 no.10
• /
• pp.4801-4806
• /
• 2012

There are still problems have to solve for safety of driving comparing to the upgraded convenience of advanced vehicle. Most traffic accident is by uncareful driving cause of interface operations which are directive reasons of it in controlling the complicate multimedia device. According to interesting in smart automobile, various approaches for safe driving have been studied. The current multimedia interface embedded in vehicle is lacking the safety due to loss the sense and operation capacity by instantaneous view movement. In this paper, we propose a safe dialing system for safe driving to control dial and search dictionary by hand-gesture. The proposed system improved the user convenience and safety in automobile operation using intuitive gesture and TTS(Text to Speech).

• Journal of the Institute of Electronics Engineers of Korea SC
• /
• v.44 no.4 s.316
• /
• pp.48-54
• /
• 2007

Hand shape is one of important elements in Korean Sign Language (KSL), which is a communication method for the deaf. To express sign motion in a virtual reality environment based on OpenGL, we need an editor which can insert and modify sign motion data. However, it is very difficult that people, who lack knowledge of sign 1anguage, exactly edit and express hand shape using the existing editors. We also need a program to efficiently construct and store the hand shape data because the number of data is very large in a sign word dictionary. In this paper we developed a KSL hand shape editor to easily construct and edit hand shape by a graphical user interface (GUI), and to store it in a database. Hand shape codes are used in a sign word editor to synthesize sign motion and decreases total amount of KSL data.

• Journal of Korea Multimedia Society
• /
• v.14 no.5
• /
• pp.607-613
• /
• 2011

In this paper, we propose a hand image segmentation method using the dynamic threshold values on input images with various lighting and background attributes. First, a moving hand silhouette is extracted using the camera input difference images, Next, based on the R,G,B histogram analysis of the extracted hand silhouette area, the threshold interval for each R, G, and B is calculated on run-time. Finally, the hand area is segmented using the thresholding and then a morphology operation, a connected component analysis and a flood-fill operation are performed for the noise removal. Experimental results on various input images showed that our hand segmentation method provides high level of accuracy and relatively fast stable results without the need of the fixed threshold values. Proposed methods can be used in the user interface of mixed reality applications.

• Journal of the HCI Society of Korea
• /
• v.3 no.1
• /
• pp.1-7
• /
• 2008

Recently researchers have studied mobile physiological sensing device. However, previous works focused on multiple and real time physiological sensing method, instead of aesthetic shape of sensing devices, sensing comfort during monitoring and sensing reliability against the hand motion artifact. In this work, we propose a stone shaped physiological sensing device to monitor the physiological status in a daily life which maximize the aesthetic feeling and sensing comfort and sensing reliability. We proposed stepwise user centered design process for user centric physiological sensing device and evaluated appropriate sensing positions against the hand motion artifacts and pressure from sensors. From the usability test and experiments, we verified the proposed sensing device provides the aesthetic appeals, sensing comfort and sensing reliability. We expect that this work can be applied in the various health care applications in near future.

• 제어로봇시스템학회:학술대회논문집
• /
• 2005.06a
• /
• pp.957-962
• /
• 2005

Today, the elderly is increasing gradually in the Republic of Korea society and this problem will be more serious in the near future. Therefore, engineering support for aged people is required. We are establishing a new field of healthcare engineering for elderly people and aiming to support for aged people and disabled people using adaptive control and instrument technology. In this paper, the goal is to implement the shared control of a robot mobility aid for the elderly. As using this type of assistive technology to be useful by its intended user community, it supports elderly people and handicapped people to live independently in their private homes. The interface transforms the force applied by the user into the robot's motion. Devices like buttons, joysticks, and levers already exist for relaying user input; however, they require hand displacement that would loosen or otherwise release the user's hold. Such interfaces make operation very difficult and potentially unsafe. Therefore, we propose a shared control system. It's safe more than joysticks and buttons. The shared control is a means of registering the user's intention through physical interaction. It's an important component in the development of robotic elderly assistant. The concept of shared control describes a system which is two or more independent control systems. We are using that the three component blocks consist of pressure sensor (flexible force sensor), circuit of measurement and transfer function. Experimental trials of this paper have been tested at the indoor environment. The robot is able to know the user intended direction through haptic device were logged along with the robot's force sensor.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.20 no.5
• /
• pp.599-604
• /
• 2019

This study examined how the characteristics of smartphone affect the functional performance of smartphones. In particular, this study focused on an understanding of the correlation between smartphone functional factors and usage habits. Functionality is defined as 11 kinds of functional elements. The characteristics of the smartphones were defined as the hardware characteristics and the user habits characteristics. Eighty subjects were organized to collect actual data by the smartphone function. The actual time required to perform each function was measured and observed five times for each functional element. Regression analysis was performed using Minitab ver.14 by classifying the measured values of the functional elements as dependent variables, the hardware characteristics collected through the questionnaire, and the user's usage habits as 12 independent variables. Overall, it is difficult to conclude that demographic and hardware characteristics of smartphone users have a significant effect on the performance. On the other hand, the variables related to smartphone usage habits have had a great impact on the performance of smartphone tasks, and as a result, the task execution time has increased. In simple input variables or viewing variables, the effects on usability was relatively small, but in all active variables, the execution time increased 10% - 30% in all tasks except for phone calls, seeking phone numbers, and dictionary search. Thus far, if the smartphone user interface has been provided uniformly in a large and simple manner, users with various usage habits can be utilized even if the input method and task processing method are more complicated and various interface types are provided.

• Journal of Korea Multimedia Society
• /
• v.16 no.6
• /
• pp.720-734
• /
• 2013

In this paper, we suggest an augmented reality authoring tool system that users can easily make augmented reality contents using hand gesture and marker-based interaction methods. The previous augmented reality authoring tools are focused on augmenting a virtual object and to interact with this kind of augmented reality contents, user used the method utilizing marker or sensor. We want to solve this limited interaction method problem by applying marker based interaction method and gesture interaction method using depth sensing camera, Kinect. In this suggested system, user can easily develop simple form of marker based augmented reality contents through interface. Also, not just providing fragmentary contents, this system provides methods that user can actively interact with augmented reality contents. This research provides two interaction methods, one is marker based method using two markers and the other is utilizing marker occlusion. In addition, by recognizing and tracking user's bare hand, this system provides gesture interaction method which can zoom-in, zoom-out, move and rotate object. From heuristic evaluation about authoring tool and compared usability about marker and gesture interaction, this study confirmed a positive result.