• Journal of Korea Multimedia Society
• /
• v.23 no.12
• /
• pp.1454-1463
• /
• 2020

An important factor in eye-tracking PC interface for general paralyzed patients is the implementation of the mouse interface, for manipulating the GUI. With a successfully implemented mouse interface, users can generate mouse events exactly at the point of their choosing. However, it is difficult to define this interaction in the eye-tracking interface. This problem has been defined as the Midas touch problem and has been a major focus of eye-tracking research. There have been many attempts to solve this problem using blink, voice input, etc. However, it was not suitable for general paralyzed patients because some of them cannot wink or speak. In this paper, we propose a mouth-pop-up, eye-tracking mouse interface that solves the Midas touch problem as well as becoming a suitable interface for general paralyzed patients using a common RGB camera. The interface presented in this paper implements a mouse interface that detects the opening and closing of the mouth to activate a pop-up menu that the user can select the mouse event. After implementation, a performance experiment was conducted. As a result, we found that the number of malfunctions and the time to perform tasks were reduced compared to the existing method.

• Journal of Korea Multimedia Society
• /
• v.14 no.9
• /
• pp.1210-1220
• /
• 2011

In this paper, we suggest a haptic mouse system as an immersive interface between virtual environment and a human operator. The proposed haptic mouse creates vibrotacitle and thermal sensation to increase the immersion. The vibrotactile module is composed of eccentric motors and a solenoid actuator, and the thermal module consists of a thin-film resistance temperature detector and a Peltier thermoelectric heat pump. In order to evaluate the proposed haptic mouse system, we develop a simple racing game and conduct an experiment. The result of the experiment shows that the proposed haptic mouse system can improve the sense of reality in virtual environment and can be used as an effective interface between virtual environment and a human operator.

• Proceedings of the Korean Institute of Intelligent Systems Conference
• /
• 2003.09a
• /
• pp.138-141
• /
• 2003

This paper proposes conceptual fuzzy sets for picture reference system with visual user interface and command recognition system without keyboard and mouse. The picture reference system consists of the associative picture database, the visual user interface and command recognition system. The associative picture database searches pictures by using conceptual fuzzy sets. To show pictures attractive, the visual user interface provides some visual effect functions. The command recognition unit, without keyboard and mouse, captures user's hand by camera and informs it to the system as a command. We implement and evaluate the picture reference system.

• Journal of Biomedical Engineering Research
• /
• v.24 no.5
• /
• pp.411-419
• /
• 2003

This paper aims at developing 'gyro-mouse' which provides decent and comfortable human-computer interface that supports the usage of such software as an internet-browser in PC for the people paralyzed in upper limbs. This interface operates on information collected from head movement to get the cursor control. The interface is composed of two modules. One is hardware module in which the head horizontal and vertical angular velocities are detected and transmitted into PC. The other is a PC software that translates the received data into movement and click signals of the mouse. The ANN (artificial neural network) learns the quick nodding pattern of each user as click input so that it can provide user-friendly interface. The performance of the system was evaluated by three indices that are click recognition rate. error in cursor position control. and click rate of the moving target box. The performance result of the gyro-mouse was compared with that of the optical-mouse to assess the efficiency of the gyro-mouse. The average click recognition rate was 93%, average error in cursor position control was 1.4∼5 times of optical mouse. and the click rate with 50 pixels target box was 40%(30 clicks/min) to that of optical mouse. The click rate increased monotonously with the number of trial from 35% to 44%. The suggested system is expected to provide a new possibility to communicate with the society.

• Journal of the Ergonomics Society of Korea
• /
• v.29 no.5
• /
• pp.763-770
• /
• 2010

The use of web widgets on desktop and mobile devices has been increasing rapidly. Web widgets provide access to activities and information from various sources across the web. As the number of supported widgets increases, managing widgets and finding relevant or interesting widgets becomes more complex. In addition, interacting with widgets in web service systems can be difficult, especially for novice users. Up to this point, there has been little research on web widget usability. This paper performs an experimental study regarding user interfaces of web widgets based on the mouse tracking and work-flow analysis. In the experiment, four sites providing widget services are chosen - iGoogle, Netvibes, My yahoo, and Wizard. The experiment participants perform three assigned tasks in the chosen sites, and their mouse operations are recorded using Camtasia, a screen casting software. Mouse tracking analysis is performed based on the recorded data in order to analyze common user behaviors. In addition, work-flow diagrams representing the operational flows to carry out the given tasks in each web site are constructed so as to visually and systematically analyze detailed usage patterns. The experimental study results presented in this paper can contribute to developing guidelines for highly usable and accessible interface design of web widgets.

• Journal of Korea Multimedia Society
• /
• v.6 no.3
• /
• pp.469-480
• /
• 2003

The accurate user- authentication technology is being raised as one of the most important in this current society, which is, so called, information society. Most authentication technology is used to identify users by using the special characteristics of users. This paper has established an e-commerce shopping mall based on conventional e-commerce systems. It also suggested and established the user authentication interface that uses the mouse gesture, which is the new authentication of what users have. The user authentication interface using the mouse gesture generates the status of recognition directly on the screen by comparing the stored pattern values with the unique pattern values that users entered. When users purchase products through the shopping mall and enter their another signature information together with payment information, security can be more increased. Experimental results show that our mouse gesture interface may be useful to provide more security to e-commerce server.

• Proceedings of the KIEE Conference
• /
• 2006.07d
• /
• pp.1821-1823
• /
• 2006

This paper presents a development of interface device for electro-oculogram(EOG) signal and it's application to the wireless mouse of wearable PC. The interface device is composed of five bio-electrodes for detecting oculomotor motion, several band-pass filters, instrumentation amplifier and a microprocessor. we have first analyzed impedance characteristics between skin and a bio-electrode. since the impedance highly depends on human face, it's magnitude differs from person. this interface device was applied to develop a wireless mouse for wearable PC, as a Bio Machine Interface(BMI). Where in the prompt on PC monitor is controlled by only EOG signals. this system was implemented in a Head Mount Display(HMD) unit. experimental results show the accuracy of above 90%.

• Journal of Korea Multimedia Society
• /
• v.20 no.2
• /
• pp.396-403
• /
• 2017

In recent years, the use of touch screens has expanded, and devices such as remote controllers have been developed in various ways to control and access contents at long range. The wireless-based touch screen is used in classroom, seminar room, and remote video conversation in addition to the TV remote control. The purpose of the study is to design a smart phone-based intuitive interface that can perform the role of a wireless mouse and a wireless keyboard at range using Bluetooth and to develop an application that integrates functions of a mouse and a keyboard. Firstly, touch interaction model for controlling software such as PowerPoint by connecting to a general PC on a smart phone has been studied. The most simple touch operation interface is used to reproduce the function of existing devices and design more simply. The studies of the extension of interfaces with various functions are important, but development of optimized interfaces for users will become more important in the future. In this sense, this study is valuable.

• Journal of Internet Computing and Services
• /
• v.16 no.6
• /
• pp.11-21
• /
• 2015

As growing interest in Human-Computer Interaction(HCI), research on HCI has been actively conducted. Also with that, research on Natural User Interface/Natural User eXperience(NUI/NUX) that uses user's gesture and voice has been actively conducted. In case of NUI/NUX, it needs recognition algorithm such as gesture recognition or voice recognition. However these recognition algorithms have weakness because their implementation is complex and a lot of time are needed in training because they have to go through steps including preprocessing, normalization, feature extraction. Recently, Kinect is launched by Microsoft as NUI/NUX development tool which attracts people's attention, and studies using Kinect has been conducted. The authors of this paper implemented hand-mouse interface with outstanding intuitiveness using the physical features of a user in a previous study. However, there are weaknesses such as unnatural movement of mouse and low accuracy of mouse functions. In this study, we designed and implemented a hand mouse interface which introduce a new concept called 'Virtual monitor' extracting user's physical features through Kinect in real-time. Virtual monitor means virtual space that can be controlled by hand mouse. It is possible that the coordinate on virtual monitor is accurately mapped onto the coordinate on real monitor. Hand-mouse interface based on virtual monitor concept maintains outstanding intuitiveness that is strength of the previous study and enhance accuracy of mouse functions. Further, we increased accuracy of the interface by recognizing user's unnecessary actions using his concentration indicator from his encephalogram(EEG) data. In order to evaluate intuitiveness and accuracy of the interface, we experimented it for 50 people from 10s to 50s. As the result of intuitiveness experiment, 84% of subjects learned how to use it within 1 minute. Also, as the result of accuracy experiment, accuracy of mouse functions (drag(80.4%), click(80%), double-click(76.7%)) is shown. The intuitiveness and accuracy of the proposed hand-mouse interface is checked through experiment, this is expected to be a good example of the interface for controlling the system by hand in the future.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.13 no.8
• /
• pp.1721-1728
• /
• 2009

Future computer interface was interchanged with person's hands or eyes from traditional mouse. In this research, I developed glove type radio mouse using gyro sensor that is replaced mouse cursor movement with persons's hand movement. Introducing a mobile sensor network technology based on bluetooth, radio mouse connected to computer system wirelessly for overcoming wire mouse's activity restrictions. Also, using USB port interface made be easy to install and to use. Developed glove type radio mouse was confirmed in the possibility of using as well as an input pointing device for presentations or games that needed many kinds of user interaction.