• Title/Summary/Keyword: hand tracking

Search Result 349, Processing Time 0.027 seconds

Motion Plane Estimation for Real-Time Hand Motion Recognition (실시간 손동작 인식을 위한 동작 평면 추정)

  • Jeong, Seung-Dae;Jang, Kyung-Ho;Jung, Soon-Ki
    • The KIPS Transactions:PartB
    • /
    • v.16B no.5
    • /
    • pp.347-358
    • /
    • 2009
  • In this thesis, we develop a vision based hand motion recognition system using a camera with two rotational motors. Existing systems were implemented using a range camera or multiple cameras and have a limited working area. In contrast, we use an uncalibrated camera and get more wide working area by pan-tilt motion. Given an image sequence provided by the pan-tilt camera, color and pattern information are integrated into a tracking system in order to find the 2D position and direction of the hand. With these pose information, we estimate 3D motion plane on which the gesture motion trajectory from approximately forms. The 3D trajectory of the moving finger tip is projected into the motion plane, so that the resolving power of the linear gesture patterns is enhanced. We have tested the proposed approach in terms of the accuracy of trace angle and the dimension of the working volume.

A Dynamic Hand Gesture Recognition System Incorporating Orientation-based Linear Extrapolation Predictor and Velocity-assisted Longest Common Subsequence Algorithm

  • Yuan, Min;Yao, Heng;Qin, Chuan;Tian, Ying
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.9
    • /
    • pp.4491-4509
    • /
    • 2017
  • The present paper proposes a novel dynamic system for hand gesture recognition. The approach involved is comprised of three main steps: detection, tracking and recognition. First, the gesture contour captured by a 2D-camera is detected by combining the three-frame difference method and skin-color elliptic boundary model. Then, the trajectory of the hand gesture is extracted via a gesture-tracking algorithm based on an occlusion-direction oriented linear extrapolation predictor, where the gesture coordinate in next frame is predicted by the judgment of current occlusion direction. Finally, to overcome the interference of insignificant trajectory segments, the longest common subsequence (LCS) is employed with the aid of velocity information. Besides, to tackle the subgesture problem, i.e., some gestures may also be a part of others, the most probable gesture category is identified through comparison of the relative LCS length of each gesture, i.e., the proportion between the LCS length and the total length of each template, rather than the length of LCS for each gesture. The gesture dataset for system performance test contains digits ranged from 0 to 9, and experimental results demonstrate the robustness and effectiveness of the proposed approach.

Tolerance Analysis on 3-D Object Modeling Errors in Model-Based Camera Tracking (모델 기반 카메라 추적에서 3차원 객체 모델링의 허용 오차 범위 분석)

  • Rhee, Eun Joo;Seo, Byung-Kuk;Park, Jong-Il
    • Journal of Broadcast Engineering
    • /
    • v.18 no.1
    • /
    • pp.1-9
    • /
    • 2013
  • Accuracy of the 3-D model is essential in model-based camera tracking. However, 3-D object modeling requires dedicated and complicated procedures for precise modeling without any errors. Even if a 3-D model contains a certain level of errors, on the other hand, the tracking errors cause by the modeling errors can be different from its perceptual errors; thus, it is an important aspect that the camera tracking can be successful without precise 3-D modeling if the modeling errors are within the user's permissible range. In this paper, we analyze the tolerance of 3-D object modeling errors by comparing computational matching errors with perceptual matching errors through user evaluations, and also discuss permissible ranges of 3-D object modeling errors.

Soccer Ball Tracking Robust Against Occlusion (가려짐에 강인한 축구공 추적)

  • Lee, Kwon;Lee, Chulhee
    • Journal of Broadcast Engineering
    • /
    • v.17 no.6
    • /
    • pp.1040-1047
    • /
    • 2012
  • In this paper, we propose a ball tracking algorithm robust against occlusion in broadcasting soccer video sequences. Soccer ball tracking is a challenging task due to occlusion, fast motion and fast direction changes. Many works have been proposed based on ball trajectory. However, this approach requires heavy computational complexity. We propose a ball tracking algorithm with occlusion handling capability. Initial ball location is calculated using the circular hough transform. Then, the ball is tracked using template matching. Occlusion is handled by matching score. In occlusion cases, we generate a set of ball candidates. The ball candidates which exist in the previous frame were removed. On the other hand, the new appearing candidate is determined as the ball. Experiments with several broadcasting soccer video sequences show that the proposed method efficiently handles the occlusion cases.

DESIGN OF A LOAD FOLLOWING CONTROLLER FOR APR+ NUCLEAR PLANTS

  • Lee, Sim-Won;Kim, Jae-Hwan;Na, Man-Gyun;Kim, Dong-Su;Yu, Keuk-Jong;Kim, Han-Gon
    • Nuclear Engineering and Technology
    • /
    • v.44 no.4
    • /
    • pp.369-378
    • /
    • 2012
  • A load-following operation in APR+ nuclear plants is necessary to reduce the need to adjust the boric acid concentration and to efficiently control the control rods for flexible operation. In particular, a disproportion in the axial flux distribution, which is normally caused by a load-following operation in a reactor core, causes xenon oscillation because the absorption cross-section of xenon is extremely large and its effects in a reactor are delayed by the iodine precursor. A model predictive control (MPC) method was used to design an automatic load-following controller for the integrated thermal power level and axial shape index (ASI) control for APR+ nuclear plants. Some tracking controllers employ the current tracking command only. On the other hand, the MPC can achieve better tracking performance because it considers future commands in addition to the current tracking command. The basic concept of the MPC is to solve an optimization problem for generating finite future control inputs at the current time and to implement as the current control input only the first control input among the solutions of the finite time steps. At the next time step, the procedure to solve the optimization problem is then repeated. The support vector regression (SVR) model that is used widely for function approximation problems is used to predict the future outputs based on previous inputs and outputs. In addition, a genetic algorithm is employed to minimize the objective function of a MPC control algorithm with multiple constraints. The power level and ASI are controlled by regulating the control banks and part-strength control banks together with an automatic adjustment of the boric acid concentration. The 3-dimensional MASTER code, which models APR+ nuclear plants, is interfaced to the proposed controller to confirm the performance of the controlling reactor power level and ASI. Numerical simulations showed that the proposed controller exhibits very fast tracking responses.

Development of Path Tracking Algorithm and Variable Look Ahead Distance Algorithm to Improve the Path-Following Performance of Autonomous Tracked Platform for Agriculture (농업용 무한궤도형 자율주행 플랫폼의 경로 추종 및 추종 성능 향상을 위한 가변형 전방 주시거리 알고리즘 개발)

  • Lee, Kyuho;Kim, Bongsang;Choi, Hyohyuk;Moon, Heechang
    • The Journal of Korea Robotics Society
    • /
    • v.17 no.2
    • /
    • pp.142-151
    • /
    • 2022
  • With the advent of the 4th industrial revolution, autonomous driving technology is being commercialized in various industries. However, research on autonomous driving so far has focused on platforms with wheel-type platform. Research on a tracked platform is at a relatively inadequate step. Since the tracked platform has a different driving and steering method from the wheel-type platform, the existing research cannot be applied as it is. Therefore, a path-tracking algorithm suitable for a tracked platform is required. In this paper, we studied a path-tracking algorithm for a tracked platform based on a GPS sensor. The existing Pure Pursuit algorithm was applied in consideration of the characteristics of the tracked platform. And to compensate for "Cutting Corner", which is a disadvantage of the existing Pure Pursuit algorithm, an algorithm that changes the LAD according to the curvature of the path was developed. In the existing pure pursuit algorithm that used a tracked platform to drive a path including a right-angle turn, the RMS path error in the straight section was 0.1034 m and the RMS error in the turning section was measured to be 0.2787 m. On the other hand, in the variable LAD algorithm, the RMS path error in the straight section was 0.0987 m, and the RMS path error in the turning section was measured to be 0.1396 m. In the turning section, the RMS path error was reduced by 48.8971%. The validity of the algorithm was verified by measuring the path error by tracking the path using a tracked robot platform.

Skin Color Based Hand and Finger Detection for Gesture Recognition in CCTV Surveillance (CCTV 관제에서 동작 인식을 위한 색상 기반 손과 손가락 탐지)

  • Kang, Sung-Kwan;Chung, Kyung-Yong;Rim, Kee-Wook;Lee, Jung-Hyun
    • The Journal of the Korea Contents Association
    • /
    • v.11 no.10
    • /
    • pp.1-10
    • /
    • 2011
  • In this paper, we proposed the skin color based hand and finger detection technology for the gesture recognition in CCTV surveillance. The aim of this paper is to present the methodology for hand detection and propose the finger detection method. The detected hand and finger can be used to implement the non-contact mouse. This technology can be used to control the home devices such as home-theater and television. Skin color is used to segment the hand region from background and contour is extracted from the segmented hand. Analysis of contour gives us the location of finger tip in the hand. After detecting the location of the fingertip, this system tracks the fingertip by using only R channel alone, and in recognition of hand motions to apply differential image, such as the removal of useless image shows a robust side. We explain about experiment which relates in fingertip tracking and finger gestures recognition, and experiment result shows the accuracy above 96%.

Path Tracking Control Using a Wavelet Based Fuzzy Neural Network for Mobile Robots

  • Oh, Joon-Seop;Park, Yoon-Ho
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.4 no.1
    • /
    • pp.111-118
    • /
    • 2004
  • In this paper, we present a novel approach for the structure of Fuzzy Neural Network(FNN) based on wavelet function and apply this network structure to the solution of the tracking problem for mobile robots. Generally, the wavelet fuzzy model(WFM) has the advantage of the wavelet transform by constituting the fuzzy basis function(FBF) and the conclusion part to equalize the linear combination of FBF with the linear combination of wavelet functions. However, it is very difficult to identify the fuzzy rules and to tune the membership functions of the fuzzy reasoning mechanism. Neural networks, on the other hand, utilize their learning capability for automatic identification and tuning. Therefore, we design a wavelet based FNN structure(WFNN) that merges these advantages of neural network, fuzzy model and wavelet transform. The basic idea of our wavelet based FNN is to realize the process of fuzzy reasoning of wavelet fuzzy system by the structure of a neural network and to make the parameters of fuzzy reasoning be expressed by the connection weights of a neural network. And our network can automatically identify the fuzzy rules by modifying the connection weights of the networks via the gradient descent scheme. To verify the efficiency of our network structure, we evaluate the tracking performance for mobile robot and compare it with those of the FNN and the WFM.

Direct Adaptive Control System for Path Tracking of Mobile Robot Based on Wavelet Fuzzy Neural Network (이동 로봇의 경로 추종을 위한 웨이블릿 퍼지 신경 회로망 기반 직접 적응 제어 시스템)

  • Oh, Joon-Seop;Park, Jin-Bae;Choi, Yoon-Ho
    • Proceedings of the KIEE Conference
    • /
    • 2004.07d
    • /
    • pp.2432-2434
    • /
    • 2004
  • In this paper, we present a novel approach for the structure of Fuzzy Neural Network(FNN) based on wavelet function and apply this network structure to the solution of the tracking problem for mobile robots. Generally, the wavelet fuzzy model(WFM) has the advantage of the wavelet transform by constituting fuzzy basis function(FBF) and the conclusion part to equalize the linear combination of FBF with the linear combination of wavelet functions. However, it is very difficult to identify the fuzzy rules and to tune the membership functions of the fuzzy reasoning mechanism. Neural networks, on the other hand, utilize their learning capability for automatic identification and tuning. Therefore, we design a wavelet based FNN structure(WFNN) that merges these advantages of neural network, fuzzy model and wavelet. To verify the efficiency of our network structure, we evaluate the tracking performance for mobile robot and compare it with those of the FNN and the WFM.

  • PDF

Optical Tracking of Three-Dimensional Brownian Motion of Nanoparticles

  • Choi C. K.;Kihm K.D.
    • Journal of the Korean Society of Visualization
    • /
    • v.3 no.1
    • /
    • pp.3-19
    • /
    • 2005
  • Novel optical techniques are presented for three-dimensional tracking of nanoparticles; Optical Serial Sectioning Microscopy (OSSM) and Ratiometric Total Internal Reflection Fluorescent Microscopy (R-TIRFM). OSSM measures optically diffracted particle images, the so-called Point Spread Function (PSF), and dotermines the defocusing or line-of-sight location of the imaged particle measured from the focal plane. The line-of-sight Brownian motion detection using the OSSM technique is proposed in lieu of the more cumbersome two-dimensional Brownian motion tracking on the imaging plane as a potentially more effective tool to nonintrusively map the temperature fields for nanoparticle suspension fluids. On the other hand, R-TIRFM is presented to experimentally examine the classic theory on the near-wall hindered Brownian diffusive motion. An evanescent wave field from the total internal reflection of a 488-nm bandwidth of an argon-ion laser is used to provide a thin illumination field of an order of a few hundred nanometers from the wall. The experimental results show good agreement with the lateral hindrance theory, but show discrepancies from the normal hindrance theory. It is conjectured that the discrepancies can be attributed to the additional hindering effects, including electrostatic and electro-osmotic interactions between the negatively charged tracer particles and the glass surface.

  • PDF