• Title/Summary/Keyword: Depth Tracking

Search Result 275, Processing Time 0.024 seconds

Sinkhole Tracking by Deep Learning and Data Association (딥 러닝과 데이터 결합에 의한 싱크홀 트래킹)

  • Ro, Soonghwan;Hoai, Nam Vu;Choi, Bokgil;Dung, Nguyen Manh
    • The Journal of Korean Institute of Information Technology
    • /
    • v.17 no.6
    • /
    • pp.17-25
    • /
    • 2019
  • Accurate tracking of the sinkholes that are appearing frequently now is an important method of protecting human and property damage. Although many sinkhole detection systems have been proposed, it is still far from completely solved especially in-depth area. Furthermore, detection of sinkhole algorithms experienced the problem of unstable result that makes the system difficult to fire a warning in real-time. In this paper, we proposed a method of sinkhole tracking by deep learning and data association, that takes advantage of the recent development of CNN transfer learning. Our system consists of three main parts which are binary segmentation, sinkhole classification, and sinkhole tracking. The experiment results show that the sinkhole can be tracked in real-time on the dataset. These achievements have proven that the proposed system is able to apply to the practical application.

A Novel Segment Extraction and Stereo Matching Technique using Color, Motion and Initial Depth from Depth Camera (컬러, 움직임 정보 및 깊이 카메라 초기 깊이를 이용한 분할 영역 추출 및 스테레오 정합 기법)

  • Um, Gi-Mun;Park, Ji-Min;Bang, Gun;Cheong, Won-Sik;Hur, Nam-Ho;Kim, Jin-Woong
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.34 no.12C
    • /
    • pp.1147-1153
    • /
    • 2009
  • We propose a novel image segmentation and segment-based stereo matching technique using color, depth, and motion information. Proposed technique firstly splits reference images into foreground region or background region using depth information from depth camera. Then each region is segmented into small segments with color information. Moreover, extracted segments in current frame are tracked in the next frame in order to maintain depth consistency between frames. The initial depth from the depth camera is also used to set the depth search range for stereo matching. Proposed segment-based stereo matching technique was compared with conventional one without foreground and background separation and other conventional one without motion tracking of segments. Simulation results showed that the improvement of segment extraction and depth estimation consistencies by proposed technique compared to conventional ones especially at the static background region.

Applying differential techniques for 2D/3D video conversion to the objects grouped by depth information (2D/3D 동영상 변환을 위한 그룹화된 객체별 깊이 정보의 차등 적용 기법)

  • Han, Sung-Ho;Hong, Yeong-Pyo;Lee, Sang-Hun
    • Journal of the Korea Academia-Industrial cooperation Society
    • /
    • v.13 no.3
    • /
    • pp.1302-1309
    • /
    • 2012
  • In this paper, we propose applying differential techniques for 2D/3D video conversion to the objects grouped by depth information. One of the problems converting 2D images to 3D images using the technique tracking the motion of pixels is that objects not moving between adjacent frames do not give any depth information. This problem can be solved by applying relative height cue only to the objects which have no moving information between frames, after the process of splitting the background and objects and extracting depth information using motion vectors between objects. Using this technique all the background and object can have their own depth information. This proposed method is used to generate depth map to generate 3D images using DIBR(Depth Image Based Rendering) and verified that the objects which have no movement between frames also had depth information.

Depth-of-Field based Post-Processing Framework for Multipurpose Applications (다목적 애플리케이션을 위한 피사계 심도 기반 후처리 프레임워크)

  • Kim, Donghui;Kim, Jong-Hyun
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2021.01a
    • /
    • pp.253-256
    • /
    • 2021
  • 본 논문에서는 합성곱 신경망을 통해 학습된 DoF(피사계 심도, Depth of field) 네트워크 아키텍처를 이용하여 객체 인식, 시점 추적, 문자 인식, 비사실적 렌더링 등 다양한 애플리케이션에 적용할 수 있는 사후 필터링 기법에 대해 살펴본다. 일반적으로 영상은 포커싱과 아웃포커싱에 의해 사용자의 관심표현이 결정되며, 이를 이용하여 영상 내 중요도를 판단한다. 영상 내에는 수많은 콘텐츠들이 혼재되어 있기 때문에 사용자가 집중적으로 보고 있는 콘텐츠를 찾아내기 어렵다. 본 논문에서는 사용자가 흥미롭고 집중적으로 보고 있는 영역을 DoF 네트워크로 학습시키고, 이를 통해 이전 기법으로는 표현할 수 없었던 DoF 기반 객체 인식, 시점 추적, 문자 인식, 비사실적 렌더링을 효율적으로 표현해낸다.

  • PDF

Foreground segmentation and tracking from sequential stereo images for 3D object modeling (3차원 물체 모델링을 위한 연속된 스테레오 이미지 상에서의 전경 영역 분리 및 추적)

  • Han, In-Kyu;Kim, Hyoung-Nyoun;Kim, Kyung-Koo;Park, Ji-Hyung
    • Journal of the HCI Society of Korea
    • /
    • v.6 no.1
    • /
    • pp.9-16
    • /
    • 2011
  • The previous researches of 3D object modeling have been performed in a limited environment where a target object only exists. However, in order to model an object in the real environment, we need to consider a dynamic environment, which has various objects and a frequently changing background. Therefore, this paper presents a segmentation and tracking method for a foreground which includes a target object in the dynamic environment. By using depth information than color information, the foreground region can be segmented and tracked more robustly. In addition, the foreground region can be tracked on the sequential images by referring depth distributions of the foreground region because both the position and the status in the consecutive images of the foreground region are almost unchanged. Experimental results show that our proposed method can robustly segment and track the foreground region in various conditions of the real environment. Moreover, as an application of the proposed method, it is presented a method for modeling an object extracting the object regions from the foreground region that is segmented and tracked.

  • PDF

Study of Retrieving the Aerosol Size Distribution from Aerosol Optical Depths (에어로졸 광학깊이를 이용한 에어로졸 크기분포 추출 연구)

  • Kim, Dukhyeon
    • Korean Journal of Optics and Photonics
    • /
    • v.29 no.4
    • /
    • pp.139-148
    • /
    • 2018
  • In this study, aerosol size distributions were retrieved from aerosol optical depth measured over a range of 10 wavelengths from 250 to 1100 nm. The 10 wavelengths were selected where there is no absorption of atmospheric gases. To obtain the solar spectrum, a home-made solar tracking system was developed and calibrated. Using this solar tracking system, total optical depths (TODs) were extracted for the 10 wavelengths using the Langley plot method, and aerosol optical depths (AODs) were obtained after removing the effects of gas absorption and Rayleigh scattering from the TODs. The algorithm for retrieving aerosol size distributions was suggested by assuming a bimodal aerosol size distribution. Aerosol size distributions were retrieved and compared under various arbitrary atmospheric conditions. Finally, we found that our solar tracking spectrometer is useful for retrieving the aerosol size distribution, even though we have little information about the aerosol's refractive index.

Bilateral Filtering-based Mean-Shift for Robust Face Tracking (양방향 필터 기반 Mean-Shift 기법을 이용한 강인한 얼굴추적)

  • Choi, Wan-Yong;Lee, Yoon-Hyung;Jeong, Mun-Ho
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.8 no.9
    • /
    • pp.1319-1324
    • /
    • 2013
  • The mean shift algorithm has achieved considerable success in object tracking due to its simplicity and robustness. It finds local minima of a similarity measure between the color histograms or kernel density estimates of the target and candidate image. However, it is sensitive to the noises due to objects or background having similar color distributions. In addition, occlusion by another object often causes a face region to change in size and position although a face region is a critical clue to perform face recognition or compute face orientation. We assume that depth and color are effective to separate a face from a background and a face from objects, respectively. From the assumption we devised a bilateral filter using color and depth and incorporate it into the mean-shift algorithm. We demonstrated the proposed method by some experiments.

A study on the design of a path tracker and depth controller for autonomous underwater vehicles (무인 수중운동체의 경로추적기와 심도제어기 설계 연구)

  • Yang, Seung-Yun;Lee, Man-Hyung
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.4 no.1
    • /
    • pp.45-55
    • /
    • 1998
  • In this paper, a robust path tracker and depth controller of Autonomous Underwater Vehicle based on sliding mode control is presented. We have also designed augmented equivalent control inputs by analyzing the sliding mode with the reaching mode. This can enhance the reaching rate, and improve chattering problems, that is, noise caused by the control plane actuator of the vehicle, which is one of the problems that occur when sliding mode control is used. Also to resolve the steady state error generated in the path tracker under current effect, a modified sliding plane is constructed. Also a redesigned sliding plane and control input using transformation matrix is proposed to do easy design of MIMO depth controller. For state variables that cannot be measured directly, reduced order sliding mode control is used to design an observer. The performance of designed path tracker and depth controller is investigated by computer simulation. The results show that the proposed control system has robust performance to parameter variation, modelling error and disturbance.

  • PDF

Study on Dynamics Modeling and Depth Control for a Supercavitating Underwater Vehicle in Transition Phase (초공동 수중운동체의 천이구간 특성을 고려한 동역학 모델링 및 심도제어 연구)

  • Kim, Seon Hong;Kim, Nakwan
    • Journal of the Society of Naval Architects of Korea
    • /
    • v.51 no.1
    • /
    • pp.88-98
    • /
    • 2014
  • A supercavitation is modern technology that can be used to reduce the frictional resistance of the underwater vehicle. In the process of reaching the supercavity condition which cavity envelops whole vehicle body, a vehicle passes through transition phase from fully-wetted to supercaviting operation. During this phase of flight, unsteady hydrodynamic forces and moments are created by partial cavity. In this paper, analytical and numerical investigations into the dynamics of supercavitating vehicle in transition phase are presented. The ventilated cavity model is used to lead rapid supercavity condition, when the cavitation number is relatively high. Immersion depth of fins and body, which is decided by the cavity profile, is calculated to determine hydrodynamical effects on the body. Additionally, the frictional drag reduction associated by the downstream flow is considered. Numerical simulation for depth tracking control is performed to verify modeling quality using PID controller. Depth command is transformed to attitude control using double loop control structure.

ROI Based Object Extraction Using Features of Depth and Color Images (깊이와 칼라 영상의 특징을 사용한 ROI 기반 객체 추출)

  • Ryu, Ga-Ae;Jang, Ho-Wook;Kim, Yoo-Sung;Yoo, Kwan-Hee
    • The Journal of the Korea Contents Association
    • /
    • v.16 no.8
    • /
    • pp.395-403
    • /
    • 2016
  • Recently, Image processing has been used in many areas. In the image processing techniques that a lot of research is tracking of moving object in real time. There are a number of popular methods for tracking an object such as HOG(Histogram of Oriented Gradients) to track pedestrians, and Codebook to subtract background. However, object extraction has difficulty because that a moving object has dynamic background in the image, and occurs severe lighting changes. In this paper, we propose a method of object extraction using depth image and color image features based on ROI(Region of Interest). First of all, we look for the feature points using the color image after setting the ROI a range to find the location of object in depth image. And we are extracting an object by creating a new contour using the convex hull point of object and the feature points. Finally, we compare the proposed method with the existing methods to find out how accurate extracting the object is.