• 제목/요약/키워드: Visual tracking

검색결과 525건 처리시간 0.023초

Human-Robot Interaction in Real Environments by Audio-Visual Integration

  • Kim, Hyun-Don;Choi, Jong-Suk;Kim, Mun-Sang
    • International Journal of Control, Automation, and Systems
    • /
    • 제5권1호
    • /
    • pp.61-69
    • /
    • 2007
  • In this paper, we developed not only a reliable sound localization system including a VAD(Voice Activity Detection) component using three microphones but also a face tracking system using a vision camera. Moreover, we proposed a way to integrate three systems in the human-robot interaction to compensate errors in the localization of a speaker and to reject unnecessary speech or noise signals entering from undesired directions effectively. For the purpose of verifying our system's performances, we installed the proposed audio-visual system in a prototype robot, called IROBAA(Intelligent ROBot for Active Audition), and demonstrated how to integrate the audio-visual system.

다중 카메라 시스템을 위한 전방위 Visual-LiDAR SLAM (Omni-directional Visual-LiDAR SLAM for Multi-Camera System)

  • 지샨 자비드;김곤우
    • 로봇학회논문지
    • /
    • 제17권3호
    • /
    • pp.353-358
    • /
    • 2022
  • Due to the limited field of view of the pinhole camera, there is a lack of stability and accuracy in camera pose estimation applications such as visual SLAM. Nowadays, multiple-camera setups and large field of cameras are used to solve such issues. However, a multiple-camera system increases the computation complexity of the algorithm. Therefore, in multiple camera-assisted visual simultaneous localization and mapping (vSLAM) the multi-view tracking algorithm is proposed that can be used to balance the budget of the features in tracking and local mapping. The proposed algorithm is based on PanoSLAM architecture with a panoramic camera model. To avoid the scale issue 3D LiDAR is fused with omnidirectional camera setup. The depth is directly estimated from 3D LiDAR and the remaining features are triangulated from pose information. To validate the method, we collected a dataset from the outdoor environment and performed extensive experiments. The accuracy was measured by the absolute trajectory error which shows comparable robustness in various environments.

투영적 모듈화 능동 형태 모델에 기반한 영상 추적 기법 (Visual Tracking Technique Based on Projective Modular Active Shape Model)

  • 김원
    • 한국시뮬레이션학회논문지
    • /
    • 제18권2호
    • /
    • pp.77-89
    • /
    • 2009
  • 영상 추적 기법은 현대 사회의 주요한 분야에서 필요로 하는 중요한 기술로 여겨지는 핵심 기술 중의 하나이다. 특히 물체의 외곽선 추적은 물체의 외형 정보를 파악하면서 빠른 추적을 할 수 있다는 측면에서 필요한 기술인데, 목표물 주변의 에지에 영향을 받기 쉬우며 연약 에지가 발생하였을 때 추적에 실패하는 경우가 발생한다. 이를 극복하기 위하여 이 연구에서는 카메라가 장착된 이동 로봇의 6자유도 운동을 가상적으로 발생시켜 PDM을 얻어내고, 이를 기반으로 모듈적으로 능동 형태 모델을 구성하여 추적 시스템을 설계하여 보다 국부적 최소점에 대하여 강인한 특성을 갖는 영상 추적기를 제안한다. 제안된 방법의 유효성을 보이기 위하여 실제 이동 로봇에서 관측되는 영상에 대하여 영상 추적 실험을 수행하였으며, 이를 다른 주요한 기법들과 비교하여 그 우수성을 확인하였다.

실제 이미지에서 현저성과 맥락 정보의 영향을 고려한 시각 탐색 모델 (Visual Search Model based on Saliency and Scene-Context in Real-World Images)

  • 최윤형;오형석;명노해
    • 대한산업공학회지
    • /
    • 제41권4호
    • /
    • pp.389-395
    • /
    • 2015
  • According to much research on cognitive science, the impact of the scene-context on human visual search in real-world images could be as important as the saliency. Therefore, this study proposed a method of Adaptive Control of Thought-Rational (ACT-R) modeling of visual search in real-world images, based on saliency and scene-context. The modeling method was developed by using the utility system of ACT-R to describe influences of saliency and scene-context in real-world images. Then, the validation of the model was performed, by comparing the data of the model and eye-tracking data from experiments in simple task in which subjects search some targets in indoor bedroom images. Results show that model data was quite well fit with eye-tracking data. In conclusion, the method of modeling human visual search proposed in this study should be used, in order to provide an accurate model of human performance in visual search tasks in real-world images.

Spatial Histograms for Region-Based Tracking

  • Birchfield, Stanley T.;Rangarajan, Sriram
    • ETRI Journal
    • /
    • 제29권5호
    • /
    • pp.697-699
    • /
    • 2007
  • Spatiograms are histograms augmented with spatial means and covariances to capture a richer description of the target. We present a particle filtering framework for region-based tracking using spatiograms. Unlike mean shift, the framework allows for non-differentiable similarity measures to compare two spatiograms; we present one such similarity measure, a combination of a recent weighting scheme and histogram intersection. Experimental results show improved performance with the new measure as well as the importance of global spatial information for tracking. The performance of spatiograms is compared with color histograms and several texture histogram methods.

  • PDF

시각적 피드백에 따른 발목 움직임 조절 도구를 이용한 자가 운동이 노인의 발목 움직임 조절과 균형 능력에 미치는 영향: 사례 연구 (The Effect of a Self-exercise with Ankle Movement Control Device through Visual Feedback on Ankle Movement and Balance Ability for the Elderly: Case-study)

  • 조선영;신수정
    • 대한지역사회작업치료학회지
    • /
    • 제3권2호
    • /
    • pp.25-32
    • /
    • 2013
  • 목적 : 본 연구는 일반노인에게 시각적 피드백에 따른 발목 움직임 조절 도구를 사용하여 자가 운동을 시행하였을 때 노인의 발목 움직임 조절과 균형능력에 미치는 영향을 알아보고자 하였다. 연구방법 : 이 연구는 사례 연구(case-study)로써, 사전-사후 검사를 실시하였다. 80세인 일반 여성 노인에게 2주 동안 매일 오전, 오후 20분 동안 자가 운동을 실시하였다. 사전, 사후 검사로는 발목 조절 움직임 평가를 위한 Tracking 검사, 균형 능력 측정을 위한 한발로 서기 시간 측정과 Timed up-And-Go검사를 시행하였다. 결과 : 대상자는 Tracking 검사에서 발목 조절 움직임의 향상을 보였다. 균형 능력 평가에서는 한발로 서기유지 시간은 증가하였으나, Timed up-And-Go검사는 변화가 없었다. 결론 : 시각적 피드백에 따른 발목 조절 움직임 도구를 이용한 자가 운동은 노인의 발목 움직임 조절과 균형을 향상 시켰다.

  • PDF

시선추적 장치를 활용한 부정적 감정표현 이모티콘의 시각적 주의집중도 분석 (Analysis of Visual Attention in Negative Emotional Expression Emoticons using Eye-Tracking Device)

  • 박민희;권만우;황미경
    • 한국멀티미디어학회논문지
    • /
    • 제24권11호
    • /
    • pp.1580-1587
    • /
    • 2021
  • Currently, the development and sale of various emoticons has given users a wider range of choices, but a systematic and specific approach to the recognition and use of emoticons by actual users is lacking. Therefore, this study tried to investigate the subjective perception and visual attention concentration of actual users on negative emotional expression emoticons through a survey and eye tracking experiment. First, as a result of subjective recognition analysis, it was found that emoticons are frequently used because their appearance is important, and they can express various emotions in a fun and interesting way. In particular, it was found that emoticons that express negative emotions are often used because they can indirectly express negative emotions through various and concretely expressed visual elements. Next, as a result of the eye tracking experiment, it was found that the negative emotional expression emoticons focused on the large elements that visually emphasized or emphasized the emotional expression elements, and it was found that the focus was not only on the facial expression but also on the physical behavioral responses and language of expression of emotions. These results will be used as basic data to understand users' perceptions and utilization of the diversified emoticons. In addition, for the long-term growth and activation of the emoticon industry market in the future, continuous research should be conducted to understand the various emotions of real users and to develop differentiated emoticons that can maximize the empathy effect appropriate to the situation.

Macro-Micro Manipulation with Visual Tracking and its Application to Wheel Assembly

  • Cho Changhyun;Kang Sungchul;Kim Munsang;Song Jae-Bok
    • International Journal of Control, Automation, and Systems
    • /
    • 제3권3호
    • /
    • pp.461-468
    • /
    • 2005
  • This paper proposes a wheel-assembly automation system, which assembles a wheel into a hub of a vehicle hung to a moving hanger in a car manufacturing line. A macro-micro manipulator control strategy is introduced to increase the system bandwidth and tracking accuracy to ensure insertion tolerance. A camera is equipped at the newly designed wheel gripper, which is attached at the center of the end-effector of the macro-micro manipulator and is used to measure position error of the hub of the vehicle in real time. The redundancy problem in the macro-micro manipulator is solved without complicated calculation by assigning proper functions to each part so that the macro part tracks the velocity error while the micro part regulates the fine position error. Experimental results indicate that tracking error satisfies the insertion tolerance of assembly $({\pm}1mm)$, and thus it is verified that the proposed system can be applied to the wheel assembly task on a moving hanger in the manufacturing line.

Invariant-Feature Based Object Tracking Using Discrete Dynamic Swarm Optimization

  • Kang, Kyuchang;Bae, Changseok;Moon, Jinyoung;Park, Jongyoul;Chung, Yuk Ying;Sha, Feng;Zhao, Ximeng
    • ETRI Journal
    • /
    • 제39권2호
    • /
    • pp.151-162
    • /
    • 2017
  • With the remarkable growth in rich media in recent years, people are increasingly exposed to visual information from the environment. Visual information continues to play a vital role in rich media because people's real interests lie in dynamic information. This paper proposes a novel discrete dynamic swarm optimization (DDSO) algorithm for video object tracking using invariant features. The proposed approach is designed to track objects more robustly than other traditional algorithms in terms of illumination changes, background noise, and occlusions. DDSO is integrated with a matching procedure to eliminate inappropriate feature points geographically. The proposed novel fitness function can aid in excluding the influence of some noisy mismatched feature points. The test results showed that our approach can overcome changes in illumination, background noise, and occlusions more effectively than other traditional methods, including color-tracking and invariant feature-tracking methods.