• Title/Summary/Keyword: Visual tracking

Search Result 527, Processing Time 0.025 seconds

A Study on Feature-Based Visual Servoing Control of Robot System by Utilizing Redundant Feature

  • Han, Sung-Hyun;Hideki Hashimoto
    • Journal of Mechanical Science and Technology
    • /
    • v.16 no.6
    • /
    • pp.762-769
    • /
    • 2002
  • This paper presents how effective it is to use many features for improving the speed and accuracy of visual servo systems. Some rank conditions which relate the image Jacobian to the control performance are derived. The focus is to describe that the accuracy of the camera position control in the world coordinate system is increased by utilizing redundant features in this paper. It is also proven that the accuracy is improved by increasing the number of features involved. Effectiveness of the redundant features is evaluated by the smallest singular value of the image Jacobian which is closely related to the accuracy with respect to the world coordinate system. Usefulness of the redundant features is verified by the real time experiments on a Dual-Arm robot manipulator made by Samsung Electronic Co. Ltd..

Visual Attention by Screen Vectors: Independent, Continuing, Converging, and Diverging Vectors

  • Kwon, Mahnwoo;Lee, Jiyoun;Bae, Soyoung
    • Journal of Korea Multimedia Society
    • /
    • v.18 no.10
    • /
    • pp.1251-1260
    • /
    • 2015
  • The measurement and evaluation of an audience's visual attention are crucial processes for the scientific production of various contents and services. It has been alleged that a vector exists between objects on a screen, but this has not been explored empirically. This study tested whether or not there are any positive correlations between screen vectors and viewers' eye movements. Participants were exposed to four groups of pictures representing an independent vector, continuing vector, converging vector, and diverging vector. The results showed that vectors on screens induced viewers' eye movements to the vector object by the directivity of the visual stimuli.

Fuzzy Neural Network-based Visual Servoing : part I (퍼지 신경망을 이용한 시각구동(I))

  • 김태원;서일홍
    • The Transactions of the Korean Institute of Electrical Engineers
    • /
    • v.43 no.6
    • /
    • pp.1010-1019
    • /
    • 1994
  • It is shown that there exists a nonlinear mapping which transforms image features and their changes to the desired camera motion without measuring of the relative distance between the camera and the object. This nonlinear mapping can eliminate several difficulties occurring in computing the inverse of the feature Jacobian as in the usual feature-based visual feedback control methods. Instead of analytically deriving the closed form of this mapping, a Fuzzy Membership Function-based Neural Network (FMFNN) incorporating a Fuzzy-Neural Interpolating Network is used to approximate the nonlinear mapping. Several FMFNN's are trained to be capable of tracking a moving object in the whole workspace along the line of sight. For an effective implementation of the proposed FMF network, an image feature selection process is investigated. Finally, several numerical examples are presented to show the validity of the proposed visual servoing method.

  • PDF

Performance Evaluation of Visual Path Following Algorithm (영상 교시기반 주행 알고리듬 성능 평가)

  • Choi, I-Sak;Ha, Jong-Eun
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.17 no.9
    • /
    • pp.902-907
    • /
    • 2011
  • In this paper, we deal with performance evaluation of visual path following using 2D and 3D information. Visual path follow first teaches driving path by selecting milestone images then follows the same route by comparing the milestone image and current image. We follow the visual path following algorithm of [8] and [10]. In [8], a robot navigated with 2D image information only. But in [10], local 3D geometries are reconstructed between the milestone images in order to achieve fast feature prediction which allows the recovery from tracking failures. Experimental results including diverse indoor cases show performance of each algorithm.

Design of Visual Servo Controller using Color Coordinate System Transformation in Mobile Robot (컬러 좌표계 변환을 이용한 이동로봇의 시각 서보 제어기의 설계)

  • 노창균;이기철;이양희;박민용
    • Proceedings of the IEEK Conference
    • /
    • 1999.11a
    • /
    • pp.629-632
    • /
    • 1999
  • In this paper, color coordinate system transformation based visual servo controller has been considered. Mobile robot always has a position error and an orientation error resulted from wheel slipping etc.. Even more, the errors have accumulative properties. So feedback from environments is important. In this paper, by using color model faster land mark extraction can be achieved. And the global position and the orientation of mobile robot can be known by only two land marks positions in image coordinate system. Finally, the adoption of visual information in path tracking problem makes visual servo control.

  • PDF

Visual Servoing of Robot Manipulators using Pruned Recurrent Neural Networks (저차원화된 리커런트 뉴럴 네트워크를 이용한 비주얼 서보잉)

  • 김대준;이동욱;심귀보
    • Proceedings of the Korean Institute of Intelligent Systems Conference
    • /
    • 1997.11a
    • /
    • pp.259-262
    • /
    • 1997
  • This paper presents a visual servoing of RV-M2 robot manipulators to track and grasp moving object, using pruned dynamic recurrent neural networks(DRNN). The object is stationary in the robot work space and the robot is tracking and grasping the object by using CCD camera mounted on the end-effector. In order to optimize the structure of DRNN, we decide the node whether delete or add, by mutation probability, first in case of delete node, the node which have minimum sum of input weight is actually deleted, and then in case of add node, the weight is connected according to the number of case which added node can reach the other nodes. Using evolutionary programming(EP) that search the struture and weight of the DRNN, and evolution strategies(ES) which train the weight of neuron, we pruned the net structure of DRNN. We applied the DRNN to the Visual Servoing of a robot manipulators to control position and orientation of end-effector, and the validity and effectiveness of the pro osed control scheme will be verified by computer simulations.

  • PDF

Investigation of the visual search patterns of the cockpit displays for the ergonomic cockpit design (인간공학적 조종실 설계를 위한 계기 탐색 형태에 관한 연구)

  • Song Young-Woong;Lee Jong-Seon
    • Journal of the Korea Safety Management & Science
    • /
    • v.8 no.2
    • /
    • pp.71-80
    • /
    • 2006
  • There are many display panels in the flight cockpit and pilots get various flight information from those displays. The ergonomic layout of the displays must be determined based upon frequency of use and sequence of use. This study investigated the visual search patterns of the six display groups(one head-up-display: HUD, two multi function displays: MFDs, one engine group: EG, one flight display group: FD and others) in a fighting aircraft. Four expert pilots conducted Imaginary flight in the physical mock-up and the eye movements were collected using eye tracking system. Data of dwell time, frequency of use, and eye movement path were collected. Pilots spent most of time on HUD(55.2%), and others (21.6%), FD(14.2%), right MFD(4.7%), EG(3.2%), and left MFD(1.1%) in descending order. Similarly HUD(42.8%) and others(30.0%) were the most frequently visited displays. These data can be used in the layout of cockpit displays and the determination of optimal visual search pattern.

Design of Visual Servo Controller using Color Coordinate System Transformation in Mobile Robot

  • Noh, Chang-Kyun;Park, Mignon
    • Proceedings of the IEEK Conference
    • /
    • 2000.07b
    • /
    • pp.591-595
    • /
    • 2000
  • In this paper color coordinate system transformation based visual servo controller has been considered Mobile robot always has a position error and an orientation error resulted from wheel slipping etc.. Even more, the errors have accumulative properties. So feedback from environments is important. In this paper by using color model faster land mark extraction can be achieved. And the global position and the orientation of mobile robot can be known by only two land mark positions in image coordinate system. Finally, the adoption of visual information in path tracking problem makes visual servo control.

  • PDF

Infrared Visual Inertial Odometry via Gaussian Mixture Model Approximation of Thermal Image Histogram (열화상 이미지 히스토그램의 가우시안 혼합 모델 근사를 통한 열화상-관성 센서 오도메트리)

  • Jaeho Shin;Myung-Hwan Jeon;Ayoung Kim
    • The Journal of Korea Robotics Society
    • /
    • v.18 no.3
    • /
    • pp.260-270
    • /
    • 2023
  • We introduce a novel Visual Inertial Odometry (VIO) algorithm designed to improve the performance of thermal-inertial odometry. Thermal infrared image, though advantageous for feature extraction in low-light conditions, typically suffers from a high noise level and significant information loss during the 8-bit conversion. Our algorithm overcomes these limitations by approximating a 14-bit raw pixel histogram into a Gaussian mixture model. The conversion method effectively emphasizes image regions where texture for visual tracking is abundant while reduces unnecessary background information. We incorporate the robust learning-based feature extraction and matching methods, SuperPoint and SuperGlue, and zero velocity detection module to further reduce the uncertainty of visual odometry. Tested across various datasets, the proposed algorithm shows improved performance compared to other state-of-the-art VIO algorithms, paving the way for robust thermal-inertial odometry.

A Study on the Visual Concentration and EEG Concentration on Cafe Facade (카페 파사드의 선호도에 따른 시각적 주의집중 및 뇌파 주의집중도 분석)

  • Kim, Sang-Hee;Lee, Jeong-Ho
    • Korean Institute of Interior Design Journal
    • /
    • v.25 no.3
    • /
    • pp.60-69
    • /
    • 2016
  • This experimental study measures the emotional and physiological responses of customers as to cafe facade design. It is done through eye-tracking and EEG response experiments. Specifically, their visual concentration and EEG concentration are analyzed in line with their facade preferences. The findings are as follows. First, the correlation between their facade preferences and visual concentration on facades is as follows: Highly preferable facades have a lower visual concentration frequency than the less preferable facades. Second, an analysis of $12{\times}12$ lattice division of facades shows that all facades have a high visual concentration for signs. The exceptions are F(6), F(7), F(8), and F(10). There is no correlation between the facade preferences and visual concentration behaviors for particular facade elements. Third, an analysis of prefrontal lobe's facade concentration shows that there is no correlation between the preferences and EEG concentration. However, there are big differences in the prefrontal lobe activity of 12 subjects depending on the facade. In particular, nine of them (3, 9, 13, 14, 15, 28, 36, 38, 43) show an activated prefrontal lobe as to the highly preferable facades-F(1), F(2), F(3), and F(4). However, such activation is not detected on the less preferable facades-F(9), F(10), F(11), and F(12).