• 반도체디스플레이기술학회지
• /
• 제15권2호
• /
• pp.66-69
• /
• 2016

Recently, augmented reality and virtual reality in the ICT sector have been highlighted. So also interested in related HMD areas to facilitate contact with the VR content is being attend. This paper proposes a method for implementing to the virtual reality through the mobile HMD device with the real time 360 image. This system is required the real time 360 image streaming server configuration and image processing for augmented reality and virtual reality. The configuration of the streaming server is configured the DB server to store images and the relay server that can relay images to other devices. Augmented image processing module is composed based on markerless tracking, and there are four modules that are recognition, tracking, detecting and learning module. Also, the purpose of this paper is shown the augmented 360 image processing through the Mobile HMD.

• Smart Structures and Systems
• /
• 제17권6호
• /
• pp.935-956
• /
• 2016

With the help of advanced image acquisition and processing technology, the vision-based measurement methods have been broadly applied to implement the structural monitoring and condition identification of civil engineering structures. Many noncontact approaches enabled by different digital image processing algorithms are developed to overcome the problems in conventional structural dynamic displacement measurement. This paper presents three kinds of image processing algorithms for structural dynamic displacement measurement, i.e., the grayscale pattern matching (GPM) algorithm, the color pattern matching (CPM) algorithm, and the mean shift tracking (MST) algorithm. A vision-based system programmed with the three image processing algorithms is developed for multi-point structural dynamic displacement measurement. The dynamic displacement time histories of multiple vision points are simultaneously measured by the vision-based system and the magnetostrictive displacement sensor (MDS) during the laboratory shaking table tests of a three-story steel frame model. The comparative analysis results indicate that the developed vision-based system exhibits excellent performance in structural dynamic displacement measurement by use of the three different image processing algorithms. The field application experiments are also carried out on an arch bridge for the measurement of displacement influence lines during the loading tests to validate the effectiveness of the vision-based system.

• 정보처리학회논문지B
• /
• 제10B권3호
• /
• pp.329-338
• /
• 2003

실시간 영상에서 객체 추적은 수년간 컴퓨터 비전 및 여러 실용적 응용 분야에서 관심을 가지는 주제 중 하나이다. 하지만 배경영상의 잡음을 객체로 인식하는 오류로 인하여 추출하고자 하는 객체를 찾지 못하는 경우가 있다. 본 논문에서는 실시간 영상에서 적응적 배경영상을 이용하여 객체를 추출하고 추적하는 방법을 제안한다. 입력되는 영상에서 배경영역의 잡음을 제거하고 조명에 강인한 객체 추출을 위하여 객체영역이 아닌 배경영역 부분을 실시간으로 갱신함으로써 적응적 배경영상을 생성한다. 그리고 배경영상과 카메라로부터 입력되는 입력영상과의 차를 이용하여 객체를 추출한다 추출된 객체의 내부점을 이용하여 최소사각영역을 설정하고, 이를 통해 객체를 추적한다. 아울러 제안방법의 성능에 대한 실험결과를 기존 추적알고리즘과 비교, 분석하여 평가한다.

• IEIE Transactions on Smart Processing and Computing
• /
• 제1권2호
• /
• pp.78-87
• /
• 2012

In this paper, we address the tracking problem caused by camera motion and rolling shutter effects associated with CMOS sensors in consumer handheld cameras, such as mobile cameras, digital cameras, and digital camcorders. A modified particle filtering method is proposed for simultaneously tracking objects and compensating for the effects of camera motion. The proposed method uses an elastic registration algorithm (ER) that considers the global affine motion as well as the brightness and contrast between images, assuming that camera motion results in an affine transform of the image between two successive frames. By assuming that the camera motion is modeled globally by an affine transform, only the global affine model instead of the local model was considered. Only the brightness parameter was used in intensity variation. The contrast parameters used in the original ER algorithm were ignored because the change in illumination is small enough between temporally adjacent frames. The proposed particle filtering consists of the following four steps: (i) prediction step, (ii) compensating prediction state error based on camera motion estimation, (iii) update step and (iv) re-sampling step. A larger number of particles are needed when camera motion generates a prediction state error of an object at the prediction step. The proposed method robustly tracks the object of interest by compensating for the prediction state error using the affine motion model estimated from ER. Experimental results show that the proposed method outperforms the conventional particle filter, and can track moving objects robustly in consumer handheld imaging devices.

• 대한전자공학회논문지SP
• /
• 제48권5호
• /
• pp.16-22
• /
• 2011

본 논문에서는 배경 차분에 의해 객체를 검출하고 확률적으로 표본화된 입자 필터링(particle filtering)기법을 사용한 다중객체 추적 기법을 제안한다. 확률적으로 표본화된 입자들을 사용하여 다중 객체에 독립적으로 적용할 때 발생하는 계산 복잡도(computational complexity)를 감소시키는 동시에 안정적인 추적을 가능하게 하였다. 객체의 색상정보를 사용한 히스토그램 분포에 의한 관측 모델(observation model)을 구성하고 객체의 움직임 정보를 위해 동적 모델을 공식화하여 영상을 해석하였다. 전체적인 추적 시스템은 베이시언 최대 우도 기법(Bayesian maximum likelihood method)을 근간으로 하되, 입자 필터링을 객체 추적에 적용하여 실용적인 현실 객체 추적 상황에도 강건하게 대처할 수 있음을 실험을 통해서 증명하였다.

• International Journal of Control, Automation, and Systems
• /
• 제1권4호
• /
• pp.495-502
• /
• 2003

This paper focuses on the implementation of an efficient tracking method of a moving object using optimal representative blocks by way of a pan-tilt camera. The key idea is derived from the fact that when the image size of a moving object is shrunk in an image frame according to the distance between the mobile robot camera and the object in motion, the tracking performance of a moving object can be improved by reducing the size of representative blocks according to the object image size. Motion estimations using Edge Detection (ED) and Block-Matching Algorithm (BMA) are regularly employed to track objects by vision sensors. However, these methods often neglect the real-time vision data since these schemes suffer from heavy computational load. In this paper, a representative block able to significantly reduce the amount of data to be computed, is defined and optimized by changing the size of representative blocks according to the size of the object in the image frame in order to improve tracking performance. The proposed algorithm is verified experimentally by using a two degree-of- freedom active camera mounted on a mobile robot.

• 전자공학회논문지
• /
• 제49권10호
• /
• pp.209-216
• /
• 2012

본 논문에서는 실시간 적외선 감시시스템을 위하여 표적 영상의 평균 밝기, 면적, 종횡비로 구성된 영상특징들을 이용한 새로운 추적 방법을 제시한다. 지상 표적의 영상특징들의 시간적 변화는 수학적으로 지수함수적 상관함수를 갖는 랜덤프로세서로 모델링할 수 있다. 기존의 추적 필터에서 사용되어져 온 표적의 운동을 표현하는 표적의 위치, 속도성분뿐만 아니라, 표적의 기하학적 영상특징들을 모두 포함하는 상태벡터의 이산시간 동역학방정식 및 측정방정식을 유도했다. 시뮬레이션 결과 기존의 표적 위치 및 속도정보만 이용한 경우보다 제안된 추적방법이 추적정확도가 월등히 높음을 알 수 있었다.

• 한국멀티미디어학회논문지
• /
• 제24권2호
• /
• pp.305-311
• /
• 2021

One of the highly reliable object tracking methods is to trace objects by associating objects detected by deep learning. The detected object is represented by a rectangular box. The box has information such as location and size. Since the tracker has motion information of the object in addition to the location and size, knowing additional information about the motion of the detected box can increase the reliability of object tracking. In this paper, we present a new method of reliably estimating the moving direction of the detected object in underground parking lot. First, the frame difference image is binarized for detecting motion energy, change due to the object motion. Then, a cumulative binary image is generated that shows how the motion energy changes over time. Next, the moving direction of the detected box is estimated from the accumulated image. We use a new cost function to accurately estimate the direction of movement of the detected box. The proposed method proves its performance through comparative experiments of the existing methods.

• 한국항행학회논문지
• /
• 제5권1호
• /
• pp.26-36
• /
• 2001

시 변환 영상에서 가장 중요한 문제 중의 하나는 자동 목표 추적이다. 본 논문에서는 퍼지 예측을 이용한 이동물체의 위치예측 및 추적 기법을 제안한다. 먼저, 누적 차영상을 이용하여 물체와 배경을 분리한 다음 이동물체를 추출한다. 그리고 추출된 물체에 무게 중심법을 이용하여 물체의 중심점을 추출하고 추출된 물체에 가변 크기 탐색창을 사용하여 추적 성능을 높일 수 있는 기법을 제안한다. 또한 효율적인 물체 추적을 위한 조건으로 비선형적인 예측이 필요한데 본 논문에서는 다음 프레임에서의 물체의 위치를 예측하기 위해 퍼지 예측 방법을 제안한다. 실험을 통해 제안된 퍼지 예측 시스템이 여러 상황하에서 이동물체를 안정적으로 추적함을 보인다.

• 대한인간공학회지
• /
• 제16권3호
• /
• pp.1-10
• /
• 1997

This paper is concerned with the development and evaluation of the camera calibration method for a real-time head tracking system. Tracking of head movements is important in the design of an eye-controlled human/computer interface and the area of virtual environment. We proposed a video-based head tracking system. A camera was mounted on the subject's head and it took the front view containing eight 3-dimensional reference points(passive retr0-reflecting markers) fixed at the known position(computer monitor). The reference points were captured by image processing board. These points were used to calculate the position (3-dimensional) and orientation of the camera. A suitable camera calibration method for providing accurate extrinsic camera parameters was proposed. The method has three steps. In the first step, the image center was calibrated using the method of varying focal length. In the second step, the focal length and the scale factor were calibrated from the Direct Linear Transformation (DLT) matrix obtained from the known position and orientation of the camera. In the third step, the position and orientation of the camera was calculated from the DLT matrix, using the calibrated intrinsic camera parameters. Experimental results showed that the average error of camera positions (3- dimensional) is about $0.53^{\circ}C$, the angular errors of camera orientations are less than $0.55^{\circ}C$and the data aquisition rate is about 10Hz. The results of this study can be applied to the tracking of head movements related to the eye-controlled human/computer interface and the virtual environment.