• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.01a
• /
• pp.290-293
• /
• 2009

In this paper, we propose a method to estimate pointing region in real-world from images of cameras. In general, arm-pointing gesture encodes a direction which extends from user's fingertip to target point. In the proposed work, we assume that the pointing ray can be approximated to a straight line which passes through user's face and fingertip. Therefore, the proposed method extracts two end points for the estimation of pointing direction; one from the user's face and another from the user's fingertip region. Then, the pointing direction and its target region are estimated based on the 2D-3D projective mapping between camera images and real-world scene. In order to demonstrate an application of the proposed method, we constructed an ICGS (interactive cinema guiding system) which employs two CCD cameras and a monitor. The accuracy and robustness of the proposed method are also verified on the experimental results of several real video sequences.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.45 no.2
• /
• pp.29-36
• /
• 2008

In this paper we propose a real-time method to estimate a pointing region from two camera images. In general, a pointing target exists in the face direction when a human points to something. Therefore, we regard the direction of pointing as the straight line that connects the face position with the fingertip position. First, the method extracts two points in the face and the fingertips region by using detecting the skin color of human being. And we used the 3D geometric information to obtain a pointing detection and its region. In order to evaluate the performance, we have build up an ICIGS(Interactive Cinema Information Guiding System) with two camera and a beam project.

• The Journal of Korea Robotics Society
• /
• v.4 no.2
• /
• pp.139-146
• /
• 2009

This paper describes how a person extracts a unknown object with pointing gesture while interacting with a robot. Using a stereo vision sensor, our proposed method consists of two stages: the detection of the operators' face, the estimation of the pointing direction, and the extraction of the pointed object. The operator's face is recognized by using the Haar-like features. And then we estimate the 3D pointing direction from the shoulder-to-hand line. Finally, we segment an unknown object from 3D point clouds in estimated region of interest. On the basis of this proposed method, we implemented an object registration system with our mobile robot and obtained reliable experimental results.

• Journal of the Korean Society for Industrial and Applied Mathematics
• /
• v.10 no.2
• /
• pp.67-80
• /
• 2006

In this paper, we propose a new pointing device that is replaced a mouse as the pointing device with. For reducing the existing pointing device's problem which had marker and high-cost, we develop a new pointing device using computer vision like as a similar human vision system. The proposed system first carries out a real-time movement tracking system using image data which are segmented by color modeling, and finally does the pointing action by 3-D coordinate calculated from stereo geometry information resulting from stereo matching of the segmented region.

• Journal of the Ergonomics Society of Korea
• /
• v.19 no.3
• /
• pp.39-49
• /
• 2000

During human-computer interaction(HCI), people typically send inputs to computers through electromechanical pointing devices. Many applied studies have therefore evaluated cursor-positioning movements made with various pointing devices. Though there were so many studies about performance of various pointing devices, it was nearly impossible to compare device performance each other until the Fitts' law was applied. It does appear that Fitts' law may predict performance reasonably well for the one C-D gain level. But in varying C-D gain levels, Fitts' law could not predict movement time. This study investigated the effects of C-D gain in mouse movement time and suggested a revised Fitts' model including C-D gain as an independent variable. The revised Fitts' model may use to measure the performance of various devices in varying C-D gain levels.

• Journal of the Korean Society of Manufacturing Technology Engineers
• /
• v.24 no.6
• /
• pp.703-709
• /
• 2015

In this work, a robot aimed at grapping and delivering an object by using a simple finger-pointing command from a hand- or arm-handicapped person is introduced. In this robot system, a Leap Motion sensor is utilized to obtain the finger-motion data of the user. In addition, a Kinect sensor is also used to measure the 3D (Three Dimensional)-position information of the desired object. Once the object is pointed at through the finger pointing of the handicapped user, the exact 3D information of the object is determined using an image processing technique and a coordinate transformation between the Leap Motion and Kinect sensors. It was found that the information obtained is transmitted to the robot controller, and that the robot eventually grabs the target and delivers it to the handicapped person successfully.

• Journal of the Korea Society of Computer and Information
• /
• v.19 no.8
• /
• pp.35-44
• /
• 2014

This paper proposes a 3D pointing interface that is designed for the efficient application of a hand mouse. The proposed method uses depth images to secure high-quality results even in response to changes in lighting and environmental conditions and uses the normal vector of the palm of the hand to perform 3D pointing. First, the hand region is detected and tracked using the existing conventional method; based on the information thus obtained, the region of the palm is predicted and the region of interest is obtained. Once the region of interest has been identified, this region is approximated by the plane equation and the normal vector is extracted. Next, to ensure stable control, interpolation is performed using the extracted normal vector and the intersection point is detected. For stability and efficiency, the dynamic weight using the sigmoid function is applied to the above detected intersection point, and finally, this is converted into the 2D coordinate system. This paper explains the methods of detecting the region of interest and the direction vector and proposes a method of interpolating and applying the dynamic weight in order to stabilize control. Lastly, qualitative and quantitative analyses are performed on the proposed 3D pointing method to verify its ability to deliver stable control.

• Journal of the Ergonomics Society of Korea
• /
• v.19 no.1
• /
• pp.49-61
• /
• 2000

An experiment was designed to evaluate Fitts' law for the three-dimensional virtual pointing task and to compare the three input devices; Spaceball, Spacemouse, and 3D-Mouse. The result showed that Fitts law fitted poorly for the three-dimensional pointing tasks with relatively low coefficients of determinant. Three reasons, high degree-of-freedom, dynamic egocentric viewpoint change, and clutching problem were discussed to explain the poor fitness of Fitts' law. In terms of device comparison, the 3D-Mouse was superior to the other input devices. Also, the stereoscopic display significantly increased the performance. The results of this study can be used for the design of virtual control tasks and the selection of suitable input devices.

• Proceedings of the IEEK Conference
• /
• 2007.07a
• /
• pp.353-354
• /
• 2007

This paper proposes the method which estimates the pointing region at the real world. This paper uses the technique to easily calibrate a camera of Z. Zhang. First, we calculate the projection matrix of each camera by the technique. Next, we estimate the location of the shoulder and the fingertip. Then we compute the pointing region in 3D real world by using projection matrix of each camera. Experiment result showed that the error between estimated point and the plane center point is less than 5cm.

• Journal of the Korea Society of Computer and Information
• /
• v.12 no.5
• /
• pp.83-92
• /
• 2007

In this paper, we present a design and implementation of three dimensional pointing device using Inertial Navigation System(INS) that acquires coordinates and location information without environmental dependancy. The INS measures coordinates based on the data from gyroscope and accelerometer and corrects the measured data from accelerometer using Kalman-Filter. In order to implement the idea of three dimensional pointing device, we choose a three dimensional Space-recognition mouse and use RFIC wireless communication to send a measured data to receiver for printing out the coordinate on display equipment. Based on INS and Kalman-Filter theoretical knowledge, we design and implement a three dimensional pointing device and verified the usability as an input device that can capture a human's move. also, we describe the applicability of this device in ubiquitous computing environment.