• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.8 no.6
• /
• pp.1524-1529
• /
• 2007

In this paper, automatic shot panorama construction method is presented. For construction of panorama image, conventional panoramic techniques manually took two panorama members, but the proposed method automatically takes panorama members according to moving camera and constructs panorama image. The panorama members are automatically selected and taken by tracking region over image stream form camera. Matching region for panorama including the tracking region in the members is selected and applied by invariant feature panoramic method. Our method can automatically shot panorama members and has merit of high processing speed. In the experiments, it was shown that the algorithm required about 0.89 second in processing time, about two times shorter than existing invariant feature based one(6), for color images of $320{\times}240$ size.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.45 no.3
• /
• pp.55-63
• /
• 2008

This paper presents a panorama background generation and object tracking technique using a Pan-Tilt-Zoom camera. The proposed method estimates local motion vectors rapidly using phase correlation matching at the prespecified multiple local regions, and it makes minimized estimation error by vector quantization. We obtain the required image patches, by estimating the overlapped region using local motion vectors, we can then project the images to cylinder and realign the images to make the panoramic image. The object tracking is performed by extracting object's motion and by separating foreground from input image using background subtraction. The proposed PTZ-based object tracking method can efficiently generated a stable panorama background, which covers up to 360 degree FOV The proposed algorithm is designed for real-time implementation and it can be applied to many commercial applications such as object shape detection and face recognition in various surveillance video systems.

• Journal of Korea Multimedia Society
• /
• v.21 no.2
• /
• pp.289-299
• /
• 2018

The 360 degree panoramas are picture of a wide range of images on one screen, so we can see a fairly wide range at a time. In particular, cylinderical panoramas are the most widely used spherical image, and its left and right viewing angles reach 360 degree, so you can observe front, rear, left, and right at once. Using 360 degree panorama, all directions can be monitored at the same time, so all directions can be effectively monitored compared to other methods. In this paper, we develop a system to recognize and track the movement of moving objects on a 360 degree panorama, and then present and verify the experimental results. For this goals, first, we developed a system to recognize moving objects in 360 degree panorama using DoF(Difference of Frame) algorithm. Second, based on the TLD algorithm, we developed an application that can track a specific single moving object in a 360 degree panorama and presented the experimental results.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.42 no.5 s.305
• /
• pp.79-84
• /
• 2005

In this paper, we developed an omni-directional surveillance and motion detection method. The fish-eye lens provides a wide field of view image. Using this image, the equi-distance model for the fish-eye lens is applied to get the perspective and panorama images. Generally, we must consider the trade-off between resolution and field of view of an image from a camera. To enhance the resolution of the result images, some kind of interpolation methods are applied. Also the moving edge method is used to detect moving objects for the object tracking.

• Journal of information and communication convergence engineering
• /
• v.2 no.1
• /
• pp.52-57
• /
• 2004

In this paper, we propose a panorama-based object tracking scheme for wide-view surveillance systems that can detect and track moving objects with a pan-tilt camera. A dynamic mosaic of the background is progressively integrated in a single image using the camera motion information. For the camera motion estimation, we calculate affine motion parameters for each frame sequentially with respect to its previous frame. The camera motion is robustly estimated on the background by discriminating between background and foreground regions. The modified block-based motion estimation is used to separate the background region. Each moving object is segmented by image subtraction from the mosaic background. The proposed tracking system has demonstrated good performance for several test video sequences.

• The Journal of the Korea Contents Association
• /
• v.17 no.3
• /
• pp.42-52
• /
• 2017

Panorama image is a single image obtained by combining images taken at several viewpoints through matching of corresponding points. Existing panoramic image generation methods that find the corresponding points are extracting local invariant feature points in each image to create descriptors and using descriptor matching algorithm. In the case of video sequence, frames may be a lot, so therefore it may costs significant amount of time to generate a panoramic image by the existing method and it may has done unnecessary calculations. In this paper, we propose a method to quickly create a single panoramic image from a video sequence. By assuming that there is no significant changes between frames of the video such as in locally, we use the FAST algorithm that has good repeatability and high-speed calculation to extract feature points and the Lucas-Kanade algorithm as each feature point to track for find the corresponding points in surrounding neighborhood instead of existing descriptor matching algorithms. When homographies are calculated for all images, homography is changed around the center image of video sequence to warp images and obtain a planar panoramic image. Finally, the spherical panoramic image is obtained by performing inverse transformation of the spherical coordinate system. The proposed method was confirmed through the experiments generating panorama image efficiently and more faster than the existing methods.

• Journal of Broadcast Engineering
• /
• v.20 no.5
• /
• pp.728-737
• /
• 2015

Stitching algorithm obtain a descriptor of the feature points extracted from multiple images, and create a single image through the matching process between the each of the feature points. In this paper, a feature extraction and matching techniques for the creation of a high-speed panorama using video input is proposed. Features from Accelerated Segment Test(FAST) is used for the feature extraction at high speed. A new feature point matching process, different from the conventional method is proposed. In the matching process, by tracking region containing the feature point through the Mean shift vector required for matching is obtained. Obtained vector is used to match the extracted feature points. In order to remove the outlier, the RANdom Sample Consensus(RANSAC) method is used. By obtaining a homography transformation matrix of the two input images, a single panoramic image is generated. Through experimental results, we show that the proposed algorithm improve of speed panoramic image generation compared to than the existing method.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.45 no.6
• /
• pp.108-116
• /
• 2008

In this paper, we propose the algorithm for making panoramic background and object tacking using pan-tilt-zoom camera. We draw an analogy relation between images for cylinder projection, rearrange of images, stitching, and blending. We can then make the panoramic background, and can track the object use the panoramic background. After generated the background, the proposed algorithm tracks the moving object. Therefore it can detect the wide area, and it tracks the object continuously. So the proposed algorithm is able to use at wide area to detect and track the object.

• The Journal of Information Technology
• /
• v.7 no.2
• /
• pp.93-104
• /
• 2004

Sports scene is characterized by large amount of global motion due to pan and zoom of camera motion, and includes many small objects moving independently. Some short period of sports games is thrilling to televiewers, and important to producers. At the same time that kinds of scenes exhibit exceptionally dynamic motions and it is very difficult to analyze the motions with conventional algorithms. In this thesis, several algorithms are proposed for global motion analysis on these dynamic scenes. It is shown that proposed algorithms worked well for motion compensation and panorama synthesis. When cascading the inter frame motions, accumulated errors are unavoidable. In order to minimize these errors, interpolation method of motion vectors is introduced. Affined transform or perspective projection transform is regarded as a square matrix, which can be factorized into small amount of motion vectors. To solve factorization problem, we preposed the adaptation of Newton Raphson method into vector and matrix form, which is also computationally efficient. Combining multi frame motion estimation and the corresponding interpolation in hierarchical manner enhancement algorithm of motion parameters is proposed, which is suitable for motion compensation and panorama synthesis. The proposed algorithms are suitable for special effect rendering for broadcast system, video indexing, tracking in complex scenes, and other fields requiring global motion estimation.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.6 no.3
• /
• pp.835-854
• /
• 2012

In this paper, we propose a novel positioning system for indoor navigation which helps a user navigate easily to desired destinations in an unfamiliar indoor environment using his mobile phone. The system requires only the user's mobile phone with its basic equipped sensors such as a camera and a compass. The system tracks user's positions and orientations using a vision-based approach that utilizes $360^{\circ}$ panoramic images captured in the environment. To improve the robustness of the vision-based method, we exploit a digital compass that is widely installed on modern mobile phones. This hybrid solution outperforms existing mobile phone positioning methods by reducing the error of position estimation to around 0.7 meters. In addition, to enable the proposed system working independently on mobile phone without the requirement of additional hardware or external infrastructure, we employ a modified version of a fast and robust feature matching scheme using Histogrammed Intensity Patch. The experiments show that the proposed positioning system achieves good performance while running on a mobile phone with a responding time of around 1 second.