• Title/Summary/Keyword: Depth Tracking

Search Result 275, Processing Time 0.033 seconds

A method of improving the quality of 3D images acquired from RGB-depth camera (깊이 영상 카메라로부터 획득된 3D 영상의 품질 향상 방법)

  • Park, Byung-Seo;Kim, Dong-Wook;Seo, Young-Ho
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.25 no.5
    • /
    • pp.637-644
    • /
    • 2021
  • In general, in the fields of computer vision, robotics, and augmented reality, the importance of 3D space and 3D object detection and recognition technology has emerged. In particular, since it is possible to acquire RGB images and depth images in real time through an image sensor using Microsoft Kinect method, many changes have been made to object detection, tracking and recognition studies. In this paper, we propose a method to improve the quality of 3D reconstructed images by processing images acquired through a depth-based (RGB-Depth) camera on a multi-view camera system. In this paper, a method of removing noise outside an object by applying a mask acquired from a color image and a method of applying a combined filtering operation to obtain the difference in depth information between pixels inside the object is proposed. Through each experiment result, it was confirmed that the proposed method can effectively remove noise and improve the quality of 3D reconstructed image.

3D Fingertip Estimation based on the TOF Camera for Virtual Touch Screen System (가상 터치스크린 시스템을 위한 TOF 카메라 기반 3차원 손 끝 추정)

  • Kim, Min-Wook;Ahn, Yang-Keun;Jung, Kwang-Mo;Lee, Chil-Woo
    • The KIPS Transactions:PartB
    • /
    • v.17B no.4
    • /
    • pp.287-294
    • /
    • 2010
  • TOF technique is one of the skills that can obtain the object's 3D depth information. But depth image has low resolution and fingertip occupy very small region, so, it is difficult to find the precise fingertip's 3D information by only using depth image from TOF camera. In this paper, we estimate fingertip's 3D location using Arm Model and reliable hand's 3D location information that is modified by hexahedron as hand model. Using proposed method we can obtain more precise fingertip's 3D information than using only depth image.

Design, Implementation and Navigation Test of Manta-type Unmanned Underwater Vehicle

  • Kim, Joon-Young;Ko, Sung-Hyub;Cho, So-Hyung;Lee, Seung-Keon;Sohn, Kyoung-Ho
    • International Journal of Ocean System Engineering
    • /
    • v.1 no.4
    • /
    • pp.192-197
    • /
    • 2011
  • This paper describes the mathematical modeling, control algorithm, system design, hardware implementation and experimental test of a Manta-type Unmanned Underwater Vehicle (MUUV). The vehicle has one thruster for longitudinal propulsion, one rudder for heading angle control and two elevators for depth control. It is equipped with a pressure sensor for measuring water depth and Doppler Velocity Log for measuring position and angle. The vehicle is controlled by an on-board PC, which runs with the Windows XP operating system. The dynamic model of 6DOF is derived including the hydrodynamic forces and moments acting on the vehicle, while the hydrodynamic coefficients related to the forces and moments are obtained from experiments or estimated numerically. We also utilized the values obtained from PMM (Planar Motion Mechanism) tests found in the previous publications for numerical simulations. Various controllers such as PID, Sliding mode, Fuzzy and $H{\infty}$ are designed for depth and heading angle control in order to compare the performance of each controller based on simulation. In addition, experimental tests are carried out in a towing tank for depth keeping and heading angle tracking.

Recognition method of multiple objects for virtual touch using depth information (깊이 정보를 이용한 가상 터치에서 다중 객체 인식 방법)

  • Kwon, Soon-Kak;Lee, Dong-Seok
    • Journal of Korea Society of Industrial Information Systems
    • /
    • v.21 no.1
    • /
    • pp.27-34
    • /
    • 2016
  • In this paper, we propose how to recognize a multi-touch in the virtual touch type. Virtual touch has an advantage that it is installed only simple depth camera compared to the physical touch manners and it can be implemented with low cost for extracting an object exactly from only the difference of the depth values between the object and background. However, the accuracy for implementing the multi-touch has lowered. This paper presents a method to increase the accuracy of the multi-touch through the algorithms of binarization, labelling, and object tracking for multi-object recognition. Simulation results show that the proposed method can provide a variety of multi-touch events.

An LQR Controller for Autonomous Underwater Vehicle (무인잠수정의 LQR 제어기 설계)

  • Bae, Seol B.;Shin, Dong H.;Kwon, Soon T.;Joo, Moon G.
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.20 no.2
    • /
    • pp.132-137
    • /
    • 2014
  • In this paper, An LQR controller is proposed for way-point tracking of AUV (Autonomous Underwater Vehicle). The LQR controller aims at tracking a series of way-points which operator registers arbitrarily in advance. It consists of a depth controller and a steering controller and AUV's surge speed is assumed varying to consider the dynamic environment of the underwater. In order to show the performance, a conventional state feedback controller is compared with the proposed controller by the simulation using Matlab/Simulink. The parameters of AUV developed by the author's laboratory are used. In the simulation, we verify that the LQR controller can track all the way-points within 1 m error range under the varying surge speed, which proves the robustness of the LQR controller.

A study on visual tracking of the underwater mobile robot for nuclear reactor vessel inspection

  • Cho, Jai-Wan;Kim, Chang-Hoi;Choi, Young-Soo;Seo, Yong-Chil;Kim, Seung-Ho
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2003.10a
    • /
    • pp.1244-1248
    • /
    • 2003
  • This paper describes visual tracking procedure of the underwater mobile robot for nuclear reactor vessel inspection, which is required to find the foreign objects such as loose parts. The yellowish underwater robot body tends to present a big contrast to boron solute cold water of nuclear reactor vessel, tinged with indigo by Cerenkov effect. In this paper, we have found and tracked the positions of underwater mobile robot using the two color information, yellow and indigo. The center coordinates extraction procedures are as follows. The first step is to segment the underwater robot body to cold water with indigo background. From the RGB color components of the entire monitoring image taken with the color CCD camera, we have selected the red color component. In the selected red image, we extracted the positions of the underwater mobile robot using the following process sequences; binarization, labelling, and centroid extraction techniques. In the experiment carried out at the Youngkwang unit 5 nuclear reactor vessel, we have tracked the center positions of the underwater robot submerged near the cold leg and the hot leg way, which is fathomed to 10m deep in depth.

  • PDF

Development of Tennis Training Machine in Ourdoor Environment with Human Tracking (사용자 추적 기능을 가진 야외용 테니스 훈련용 장치 개발)

  • Yang, Jeong-Yean
    • The Journal of the Korea Contents Association
    • /
    • v.20 no.3
    • /
    • pp.424-431
    • /
    • 2020
  • This paper focused on the development of sports robot that detects a human player and shots a serve ball automatically. When robot technologies apply to the sports machine, the domain problems occurs such as outdoor environments and playing condition to recognize the visual and the vocal modalities. Gaussian mixture model and Kalman filter are used to detect the player's position in the left, right, and depth direction and to avoid the noises caused by the player's posture variation around the net. The sports robot is designed by the pan-tilt structure to shot a serve ball by pneumatic control under the multi layered software architecture. Finally, the proposed tracking and the machine performance are discussed by experimental results.

Path Planning for AGVs with Path Tracking (경로 추적 방식의 AGV를 위한 경로 계획)

  • Do, Joo-Cheol;Kim, Jung-Min;Jung, Kyung-Hoon;Woo, Seung-Beom;Kim, Sung-Shin
    • The Journal of Korea Robotics Society
    • /
    • v.5 no.4
    • /
    • pp.332-338
    • /
    • 2010
  • This paper presents a study of path-planning method for AGV(automated guided vehicle) based on path-tracking. It is important to find an optimized path among the AGV techniques. This is due to the fact that the AGV is conditioned to follow the predetermined path. Consequently, the path-planning method is implemented directly affects the whole AGV operation in terms of its performance efficiency. In many existing methods are used optimization algorithms to find optimized path. However, such methods are often prone with problems in handling the issue of inefficiency that exists in system's operation due to inherent undue time delay created by heavy load of complex computation. To solve such problems, we offer path-planning method using modified binary tree. For the purpose of our experiment, we initially designed a AGV that is equiped with laser navigation, two encoders, a gyro sensor that is meant to be operated within actual environment with given set of constrictions and layout for the AGV testing. The result of our study reflects the fact that within such environments, the proposed method showed improvement in its efficiency in finding optimized path.

Predictive Control of an Efficient Human Following Robot Using Kinect Sensor (Kinect 센서를 이용한 효율적인 사람 추종 로봇의 예측 제어)

  • Heo, Shin-Nyeong;Lee, Jang-Myung
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.20 no.9
    • /
    • pp.957-963
    • /
    • 2014
  • This paper proposes a predictive control for an efficient human following robot using Kinect sensor. Especially, this research is focused on detecting of foot-end-point and foot-vector instead of human body which can be occluded easily by the obstacles. Recognition of the foot-end-point by the Kinect sensor is reliable since the two feet images can be utilized, which increases the detection possibility of the human motion. Depth image features and a decision tree have been utilized to estimate the foot end-point precisely. A tracking point average algorithm is also adopted in this research to estimate the location of foot accurately. Using the continuous locations of foot, the human motion trajectory is estimated to guide the mobile robot along a smooth path to the human. It is verified through the experiments that detecting foot-end-point is more reliable and efficient than detecting the human body. Finally, the tracking performance of the mobile robot is demonstrated with a human motion along an 'L' shape course.

Basin-scale DAD Analysis using Grid-based Rain Search Method (격자기반의 호우탐색기법을 이용한 유역기반의 DAD 분석)

  • Kim, Youngkyu;Yu, Wansik;Kim, Yeonsu;Jeong, Anchul;Jung, Kwansue
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2017.05a
    • /
    • pp.236-236
    • /
    • 2017
  • 본 연구에서는 강우의 시공간성을 파악할 수 있는 격자기반의 Average-point Tracking 프로그램을 이용하여 호우의 DAD(Depth-Area-Duration)를 분석하였다. IPCC 5차보고서에 따르면 1950년 이래로 다수의 극한 기상 및 기후 변화가 관측되었다. 그 중 일부는 인간의 활동과 관련된 것으로 많은 지역에서의 극한 호우 현상의 증가가 손꼽힌다. 이러한 극한 호우 현상 증가와 일부 저수지의 유출 증가 경향은 지역적 규모에서 홍수의 위험이 더 커졌음을 의미한다(Kim et al., 2016). 최근 이상기후 현상의 증가에 따른 강우양상의 변화로 게릴라성 집중 호우와 태풍의 빈도가 증가하고 있지만, 우리나라의 호우의 특성은 방위 및 진행방향에 따른 해석이 매우 복잡하여 강우를 정형화하기에 어려운 특징을 보인다. 또한 지속시간이 긴 호우의 경우에는 호우의 범위가 한반도 전체가 되는 특성 때문에 강우의 시 공간성과 관련된 관측 자료는 부족하며, 이러한 특성을 고려한 연구 또한 미진한 실정이다. 만약, 태풍과 같이 호우이동이 뚜렷한 경우, 기존의 적용되고 있는 유역중심의 DAD 분석 방법으로는 DAD 관계를 명확히 표현하기 어려우며 유역면적이 증가할수록 유역의 면적평균강우량의 오차도 증가하기 때문에 DAD 분석의 정확도는 낮아지게 된다. 따라서 본 연구에서는 호우의 형태와 이동을 고려하기 위해 시간에 따른 호우를 격자로 나누어 격자를 증가시키면서 면적평균최대강우량을 산정할 수 있는 Average-point Tracking 방법을 이용하여 DAD 분석을 실시하였다.

  • PDF