• Proceedings of the IEEK Conference
• /
• 1998.10a
• /
• pp.1289-1292
• /
• 1998

HCI(human computer interface) technologies have been often implemented using mouse, keyboard and joystick. Because mouse and keyboard are used only in limited situation, More natural HCI methods such as speech based method and gesture based method recently attract wide attention. In this paper, we present multi-modal input system to control Windows system for practical use of multi-media computer. Our multi-modal input system consists of three parts. First one is virtual-hand mouse part. This part is to replace mouse control with a set of gestures. Second one is Windows control system using speech recognition. Third one is Windows control system using gesture recognition. We introduce neural network and HMM methods to recognize speeches and gestures. The results of three parts interface directly to CPU and through Windows.

• 제어로봇시스템학회:학술대회논문집
• /
• 1996.10b
• /
• pp.1527-1530
• /
• 1996

Telerobot system is being developed for the application to nuclear power plants by Korea Atomic Energy Research Institute. Human-machine interaction and interface are very important elements of telerobotic systems. The main purpose of this study is developing a control system based on 3-D graphic techniques for the easy user interface and realistic visual I information supply. This system possesses the abilities for (1) virtual work, environment modelling and simulation, (2) kinematic animation include redundant behavior (3) interfacing with a real robot system, (4) transformation between real and virtual mode within the same graphics system. This system is especially focused on enhancing the overall efficiency and reliably of nozzle dam installation task inside water chamber of steam generator in nuclear power plant.

• International Journal of Fuzzy Logic and Intelligent Systems
• /
• v.14 no.2
• /
• pp.105-112
• /
• 2014

The International Maritime Organization has determined that more than 80% of maritime accidents are caused by human error. A variety of methods have been considered to reduce maritime accidents caused by such human error. Navigators operate by observing surrounding maritime situations and analyzing information using various navigational devices. This study proposes a system to ensure safe navigation by assisting navigators through the delivery of maritime safety information (MSI) between land and sea. In the future, supplementing the system through long-term on-the-ship tests is necessary by defining MSI in relation to maritime service portfolio regions.

• Proceedings of the Korea Association of Information Systems Conference
• /
• 2000.11a
• /
• pp.12-15
• /
• 2000

An SADT-based methodology is presented for systematically analyzing the container working process in container terminal, as well as an object-oriented design method for an integrated information system for container terminal resource planning and management. Our design architecture is composed of four levels, activity interface, activity PDCA control, human resource management, and facility resource management. Especially, the consideration of the human resource management level makes it possible to support cooperative tasks, to make the authority and responsibility on a task clear, and to extremely promote the balance between human and facility resources. Finally, The system architecture is suggested for Virtual Container Terminal, in which a planned container working process is simulated for previous feasibility check, work orders are transferred to control real devices, and to manage the entire process and related data.

• Journal of the Ergonomics Society of Korea
• /
• v.7 no.2
• /
• pp.31-44
• /
• 1988

If an error occurs in the automatic mode when the advanced teleoperator system performs a task in hostile environment then the automatic mode changes into the manual mode. The operation by the control program and the operation by a human recover the error in the manual mode. The system resumes the automatic mode and continues the given task. It is necessary to improve the manual mode in order to make the best use of a man-robot system, as a part of the human interface technique. Therefore, the error recovery task is performed by combining the operation by the control program representing autonomy of a robot and the operation by a human representing versatility of a human operator effectively in the view point of human factors engineering. The geometric inverse kinematics is used for the calculation of the robot joint values in the operation by the control program. The singularity operation error and the parameter operation error often occur in this procedure. These two operation errors increase the movement time of the robot and the coordinate reading time, during the error recovery task. A singularity algorithm, parameter algorithm and fuzzy control are studied so as to remove the disadvantages of geometric inverse kinematics. And the geometric straight line motion is studied so as to improve the disadvantages of the operation by a human.

• Proceedings of the KIEE Conference
• /
• 2007.07a
• /
• pp.1777-1778
• /
• 2007

In this paper, We design and implement a humanoid robot, With Educational purpose, which can collaborate and communicate with human. We present an affective human-robot communication system for a humanoid robot, D2, which we designed to communicate with a human through dialogue. D2 communicates with humans by understanding and expressing emotion using facial expressions, voice, gestures and posture. Interaction between a human and a robot is made possible through our affective communication framework. The framework enables a robot to catch the emotional status of the user and to respond appropriately. As a result, the robot can engage in a natural dialogue with a human. According to the aim to be interacted with a human for voice, gestures and posture, the developed Educational humanoid robot consists of upper body, two arms, wheeled mobile platform and control hardware including vision and speech capability and various control boards such as motion control boards, signal processing board proceeding several types of sensors. Using the Educational humanoid robot D2, we have presented the successful demonstrations which consist of manipulation task with two arms, tracking objects using the vision system, and communication with human by the emotional interface, the synthesized speeches, and the recognition of speech commands.

• Journal of Korean Society of Industrial and Systems Engineering
• /
• v.20 no.41
• /
• pp.203-212
• /
• 1997

The interface of computer software has to promote human-computer interaction. The one quality of interface to promote HCI should be evaluted with regard to user's information processing. The usability of interface is one of the main components of it's quality, and it is straightforwardly concerned with learnability, especially when users want to use a software at the first stage. In this paper, word processors, wide spreadly used in OA environments is studied in respect to menu structure on the interface. An cognitive menu structure is suggested by user's conceptual network of the main functions of word processor. Two word processors is selected to compare with the cognitive menu structure and to evalute learnabilities by teaming model.

• Journal of the HCI Society of Korea
• /
• v.10 no.2
• /
• pp.21-26
• /
• 2015

NUI (Natural User Interface) system interprets the user's natural movement or the signals from human body to the machine. sEMG (surface electromyogram) can be observed when there is any effort in muscle even without actual movement, which is impossible with camera and accelerometer based NUI system. In sEMG based movement recognition system, the minimal number of electrodes is preferred to minimize the inconvenience. We analyzed the decrease in recognition accuracy as decreasing the number of electrodes. For the four kinds of movement intention without movement, extension (up), flexion (down), abduction (right), and adduction (left), the multilayer perceptron classifier was used with the features of RMS (Root Mean Square) from sEMG. The classification accuracy was 91.9% in four channels, 87.0% in three channels, and 78.9% in two channels. To increase the accuracy in two channels of sEMG, RMSs from previous time epoch (50-200 ms) were used in addition. With the RMSs from 150 ms, the accuracy was increased from 78.9% to 83.6%. The decrease in accuracy with minimal number of electrodes could be compensated partly by utilizing more features in previous RMSs.

• Archives of design research
• /
• v.17 no.2
• /
• pp.5-14
• /
• 2004

Introducing human capacities of control and sensation which have been overlooked into Human-Computer Interaction(HCI), Ubiquitous computing, Augmented Reality and others have been researched recently. New vision of HCI has embodied in Tangible User Interface(TUI). TUI allows users to grasp and manipulate bits with everyday physical object and architectural surface and also TUI enables user to be aware of background object at the periphery of human perception using ambient display media such of light, sound, airflow and water movement. Tangibles, physical object which constitutes TUI system, is the physical object embodied digital bit. Tangibles is not only input device but also the configuration of computing. To get feedback of computing result, user controls the system with Tangibles as action and the system represents reaction in response to User's action. User appreciates digital representation (sound, graphic information) and physical representation (form, size, location, direction etc.) for reaction. TUI's characters require the consideration about both user's action and system's reaction. Therefore we have to need the method to be concerned about physical object and interaction which can be combined with action, reaction and feedback.

• Journal of the Ergonomics Society of Korea
• /
• v.16 no.3
• /
• pp.1-10
• /
• 1997

This paper is concerned with the development and evaluation of the camera calibration method for a real-time head tracking system. Tracking of head movements is important in the design of an eye-controlled human/computer interface and the area of virtual environment. We proposed a video-based head tracking system. A camera was mounted on the subject's head and it took the front view containing eight 3-dimensional reference points(passive retr0-reflecting markers) fixed at the known position(computer monitor). The reference points were captured by image processing board. These points were used to calculate the position (3-dimensional) and orientation of the camera. A suitable camera calibration method for providing accurate extrinsic camera parameters was proposed. The method has three steps. In the first step, the image center was calibrated using the method of varying focal length. In the second step, the focal length and the scale factor were calibrated from the Direct Linear Transformation (DLT) matrix obtained from the known position and orientation of the camera. In the third step, the position and orientation of the camera was calculated from the DLT matrix, using the calibrated intrinsic camera parameters. Experimental results showed that the average error of camera positions (3- dimensional) is about $0.53^{\circ}C$, the angular errors of camera orientations are less than $0.55^{\circ}C$and the data aquisition rate is about 10Hz. The results of this study can be applied to the tracking of head movements related to the eye-controlled human/computer interface and the virtual environment.