• Journal of KIISE
• /
• v.43 no.11
• /
• pp.1307-1314
• /
• 2016

Virtual Hangul keyboards like Chun-Ji-In, Narat-Gul, and QWERTY are based on eyesight recognition, in which input letter positions are fixed in the smartphone environment. The input method of a fixed-position style is not very convenient for visually impaired individuals. In order to resolve the issue of inconvenience of the Hangul input system, we propose a new paradigm of the finger-touch based Hangul input system that does not need eyesight recognition of input buttons. For the convenience of learning the touch-motion based keyboard, finger touches are designed by considering the shape and frequencies of Hangul vowels and consonants together with the preference of fingers. The base position is decided by the first touch of the screen, and the finger-touch keyboard is used in the same way for all the other touch-style devices, regardless of the differences in size and operation system. In this input method, unique finger-touch motions are assigned for Hangul letters that significantly reduce the input errors.

• Journal of Korea Multimedia Society
• /
• v.13 no.8
• /
• pp.1235-1244
• /
• 2010

Most emerging smart phones support capacitive touch sensors. It renders existing gesture-based interfaces not suitable since they were developed for the resistive touch sensors and pen-based input. Unlike the flick gestures from the existing gesture interfaces, the finger flick gesture used in this paper reduces the workload about half by selecting the target and the command to perform on the target at a single touch input. With the combination with multi-touch interface, it supports various menu commands without having to learn complex gestures, and is suitable for the touch-based devices hence it minimizes input error. This research designs and implements the multi-touch and flick interface to provide an effective file management system on the smart phones with capacitive touch input. The evaluation proves that the suggested interface is superior to the existing methods on the capacitive touch input devices.

• Journal of the Ergonomics Society of Korea
• /
• v.35 no.6
• /
• pp.569-580
• /
• 2016

Objective: This study aims to identify the most effective keyboard layout in the area of performance for securing usability in a smart watch-using environment and to verify the usability of touch keyboard calibrated by hand. Background: It is necessary to understand the environmental characteristics in using the smart watch and to secure the usability of touch keyboard based on this understanding in order to take account of the users who use the touch screen in the extreme input conditions caused by the small screen of a smart watch. Method: 30 participants in this study were required to input characters using the QWERTY keyboard and 3x4 keypad (Naratgul, Chunjiin), which were familiar with them, in order to grasp the keyboard layout suitable in the smart watch- using environment; the performance (error rate, performance time) of this case was measured. In addition, 30 participants in this study were required to input the characters setting the QWERTY keyboard with calibrated touch area and the one with uncalibrated touch area, based on the characteristics of touch behavior, by finger typing the keyboard, with the performance (error rate and performance time) of this case measured. Results: QWERTY keyboard (93.3sec) is found to be 31.2% faster than Naratgul keyboard, a kind of 3x4 keypad, and 43.6% faster than Chunjiin keyboard, in the area of efficiency, in the results of the usability evaluation regarding the keyboard layout. QWERTY keyboard with calibrated touch area (7.5%) is found to be 23.5% improved compared to the QWERTY keyboard with uncalibrated touch area (9.8%) in the area of accuracy (error rate). The results of the usability evaluation regarding the QWERTY keyboard with touch area calibrated by finger typing the keyboard and QWERTY keyboard with calibrated touch area (80.7sec) is found to be 5.7% improved compared to QWERTY keyboard with uncalibrated touch area (85.6sec) in the area of efficiency (performance time). Conclusion: QWERTY keyboard is found to have an effective layout in the area of efficiency in the smart watch-using environment, and its improved usability is verified in the areas of accuracy and efficiency in the QWERTY keyboard with a touch area calibrated by finger typing the keyboard. Application: The results of this study may be used to set up the basic touch keyboard of the smart watch. The input usability is expected to secure the smart watch-using environment, which is an extreme input condition by applying QWERTY keyboard with touch area calibrated by finger typing the keyboard.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 2001.04a
• /
• pp.125-130
• /
• 2001

Skilled typists can type characters or words without looking at keyboard, relying on the finger's relative position. If the relative positions of the fingers can be identified, a virtual keyboard may be accomplished by applying the concept of "DataGlove" or "FingerRing". The virtual keyboard may be efficient as a new mobile input device supporting QWERTY keyboard layout. For the purpose of investigating skilled typing pattern, in this paper the touch-positions of the fingers are measured with a touchscreen while five skilled typists type a long sentence. From these measurements it can be observed that the groups of touch-positions are classified into alphabet characters. Though there are some overlapped groups we can find constant distances capable of being discriminated among the groups from investigation of the change of touch-position for touch-time. Based on the analysis, the prediction algorithm of the constant distance is proposed and evaluated, which is useful for realization of a portable virtual keyboard.le virtual keyboard.

• Journal of the Ergonomics Society of Korea
• /
• v.29 no.4
• /
• pp.541-546
• /
• 2010

The gesture 'Flick' is the most fundamental and important part for efficient interactions in the touch screen that are being extensively applied to mobile phones. This study investigated users' satisfaction of the flick operation in representative touch phones, and measured their performances with established three measures: gap between finger and initial cursor, the number of moved lists per 0.2 seconds, and the number of moved lists after ten continuous flicks. The measurement was performed with high speed camera and motion analysis software. The flick movement in mobile phone with high users' satisfaction showed that the gap between finger and cursor positions was less and the speed reached high within 0.6 seconds quickly and then was drastically slow down. Especially, maximal and common time intervals between continuous flicks were measured with an experiment. Based on the evaluation and measurement, several design guidelines for efficient flick performances were suggested.

• Journal of Internet Computing and Services
• /
• v.17 no.6
• /
• pp.41-51
• /
• 2016

The appearance of 3D-Touch interface provided the basis of a new interaction method between the users and the mob ile interface. However, only a few smartphones provide 3D-Touch features, and most of the 2D-Touch devices does not provide any means of applying the 3D-Touch interactions. This results in different user experiences between the two interaction methods. Thus, this research proposes the Virtual Force Touch method, which allows the users to utilize the 3D-Touch Interface on 2D-Touch based smart devices. This paper propose the suitable virtual force touch mechanism that is possible to realize users' inputs by calculating and analysis the force touch area of users' finger. This proposal is designed on customized smartphone device which has 2D-Touch sensors.

• Journal of the Korea Society of Computer and Information
• /
• v.17 no.12
• /
• pp.219-228
• /
• 2012

In this paper, we propose a paper keyboard piano implementation using the finger movement detection with the 3D image data from a kinect. Keyboard pattern and keyboard depth information are extracted from the color image and depth image to detect the touch event on the paper keyboard and to identify the touched key. Hand region detection error is unavoidable when using the simple comparison method between input depth image and background depth image, and this error is critical in key touch detection. Skin color is used to minimize the error. And finger tips are detected using contour detection with area limit and convex hull. Finally decision of key touch is carried out with the keyboard pattern information at the finger tip position. The experimental results showed that the proposed method can detect key touch with high accuracy. Paper keyboard piano can be utilized for the easy and convenient interface for the beginner to learn playing piano with the PC-based learning software.

• Journal of the Ergonomics Society of Korea
• /
• v.32 no.2
• /
• pp.179-187
• /
• 2013

Objective: The purpose of this study is to extract GOMS manual operator, except for an experiment with participants. Background: The GOMS model has advantage of rapid modeling which is suitable for the environment of technology development which has a short life cycle products with a fast pace. The GOMS model was originally designed for desktop environment so that it is not adequate for implementing into the latest HCI environment such as small touch screen device. Therefore, this research proposed GOMS manual operator extraction methodology which is excluded experimental method. And flick Gesture was selected to explain application of proposed methodology to extract new operator. Method: Divide into start to final step of hand gesture needed to extract as an operator through gesture task analysis. Then apply the original GOMS operator to each similar step of gesture and modify the operator for implementation stage based on existing Fitts' law research. Steps that are required to move are modified based on the Fitts' law developed in touch screen device. Finally, new operator can be derived from using these stages and a validation experiment, performed to verify the validity of new operator and methodology by comparing human performance. Results: The average movement times of the participants' performance and the operator which is extracted in case study are not different significantly. Also the average of movement times of each type of view study is not different significantly. Conclusion: In conclusion, the result of the proposed methodology for extracting new operator is similar to the result of the experiment with their participants. Furthermore the GOMS model included the operator by the proposed methodology in this research could be applied successfully to predict the user's performance. Application: Using this methodology could be applied to develop new finger gesture in the touch screen. Also this proposed methodology could be applied to evaluate the usability of certain system rapidly including the new finger gesture performance.

• Journal of the Ergonomics Society of Korea
• /
• v.31 no.5
• /
• pp.629-636
• /
• 2012

Objective: The purpose of this study is to compare the characteristics of single and double finger gestures related on the web browser and to extract the appropriate finger gestures. Background: As electronic equipment emphasizes miniaturization for improving portability various interfaces are being developed as input devices. Electronic devices are made smaller, the gesture recognition technology using the touch-based interface is favored for easy editing. In addition, user focus primarily on the simplicity of intuitive interfaces which propels further research of gesture based interfaces. In particular, the fingers in these intuitive interfaces are simple and fast which are users friendly. Recently, the single and double finger gestures are becoming more popular so more applications for these gestures are being developed. However, systems and software that employ such finger gesture lack consistency in addition to having unclear standard and guideline development. Method: In order to learn the application of these gestures, we performed the sketch map method which happens to be a method for memory elicitation. In addition, we used the MIMA(Meaning in Mediated Action) method to evaluate gesture interface. Results: This study created appropriate gestures for intuitive judgment. We conducted a usability test which consisted of single and double finger gestures. The results showed that double finger gestures had less performance time faster than single finger gestures. Single finger gestures are a wide satisfaction difference between similar type and difference type. That is, single finger gestures can judge intuitively in a similar type but it is difficult to associate functions in difference type. Conclusion: This study was found that double finger gesture was effective to associate functions for web navigations. Especially, this double finger gesture could be effective on associating complex forms such as curve shaped gestures. Application: This study aimed to facilitate the design products which utilized finger and hand gestures.

• Journal of the Korea Society of Computer and Information
• /
• v.22 no.9
• /
• pp.65-71
• /
• 2017

This paper proposes a smart phone authentication method based on user's behavior and habit that is an authentication method against shoulder surfing attack and brute force attack. As smart phones evolve not only storage of personal data but also a key means of financial services, the importance of personal information security in smart phones is growing. When user authentication of smart phone, pattern authentication method is simple to use and memorize, but it is prone to leak and vulnerable to attack. Using the features of the smart phone pattern method of the user, the pressure applied when touching the touch pad with the finger, the size of the area touching the finger, and the time of completing the pattern are used as feature vectors and applied to user authentication security. First, a smart phone user models and stores three parameter values as prototypes for each section of the pattern. Then, when a new authentication request is made, the feature vector of the input pattern is obtained and compared with the stored model to decide whether to approve the access to the smart phone. The experimental results confirm that the proposed technique shows a robust authentication security using subjective data of smart phone user based on habits and behaviors.