• Journal of Multimedia Information System
• /
• v.6 no.1
• /
• pp.7-14
• /
• 2019

This work presents a virtual prototyping design approach for an area-based image stitching hardware. The virtual hardware obtained from virtual prototyping is equivalent to the conceptual algorithm, yet the conceptual blocks are linked to the actual circuit components including the memory, logic gates, and arithmetic units. Through the proposed method, the overall structure, size, and computation speed of the actual hardware can be estimated in the early design stage. As a result, the optimized virtual hardware facilitates the hardware implementation by eliminating trail design and redundant simulation steps to optimize the hardware performance. In order to verify the feasibility of the proposed method, the virtual hardware of an image stitching platform has been realized, where it required 10,522,368 clock cycles to stitch two $1280{\times}1024$ sized images. Furthermore, with a clock frequency of 250MHz, the estimated computation time of the proposed virtual hardware is 0.877sec, which is 10x faster than the software-based image stitch platform using MATLAB.

• Journal of Broadcast Engineering
• /
• v.25 no.6
• /
• pp.882-897
• /
• 2020

Recently, the use of immersive media contents representing Panorama and 360° video is increasing. Since the viewing angle is limited to generate the content through a general camera, image stitching is mainly used to combine images taken with multiple cameras into one image having a wide field of view. However, if the parallax between the cameras is large, parallax distortion may occur in the stitched image, which disturbs the user's content immersion, thus an image stitching overcoming parallax distortion is required. The existing Seam Optimization based image stitching method to overcome parallax distortion uses energy function or object segment information to reflect the location information of objects, but the initial seam generation location, background information, performance of the object detector, and placement of objects may limit application. Therefore, in this paper, we propose an image stitching method that can overcome the limitations of the existing method by adding a weight value set differently according to the type of object to the energy value using object detection based on deep learning.

• Journal of Broadcast Engineering
• /
• v.22 no.1
• /
• pp.51-61
• /
• 2017

This paper proposes a method to generate panoramic images by combining conventional feature extraction algorithms (e.g., SIFT, SURF, MPEG-7 CDVS) with sensed data from an inertia sensor to enhance the stitching results. The challenge of image stitching increases when the images are taken from two different mobile phones with no posture calibration. Using inertia sensor data obtained by the mobile phone, images with different yaw angles, pitch angles, roll angles are preprocessed and adjusted before performing stitching process. Performance of stitching (e.g., feature extraction time, inlier point numbers, stitching accuracy) between conventional feature extraction algorithms is reported along with the stitching performance with/without using the inertia sensor data.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2022.07a
• /
• pp.507-508
• /
• 2022

현재 코로나-19로 인해 많은 사람들이 실내외 사진 촬영에 대한 불편함을 호소하며, 2022년 5월 기준 야외 마스크에 대한 의무 착용이 해제되었지만, 여전히 야외에서 마스크를 착용하는 사람들이 대다수 존재한다. 또한 코로나 발생 후 약 2, 3년간 소중한 가족들 및 지인들과의 찍은 중요한 사진들이 마스크를 착용한 채 그대로 남아있다. 본 논문에서는 파노라마 기술인 Image Stitching 기술을 활용하여 마스크 제거 사진 생성 연구에 대해 기술한다. 본 연구를 통해 사용자들의 실내외 마스크 착용 시 촬영에 대한 불편함을 해소하고 이전 마스크 착용 사진들을 복원함으로써 만족감을 높일 수 있을 것으로 기대한다.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.14 no.4
• /
• pp.1648-1672
• /
• 2020

There are several types of image registration in the sense of stitching separated images that overlap each other. One of these is feature-based registration by a common feature descriptor. In this study, we generate a mosaic of images using feature-based registration for drone aerial images. As a feature descriptor, we apply the scale-invariant feature transform descriptor. In order to investigate the authenticity of the feature points and to have the mapping function, we employ the sample consensus method; we consider the sensed image's inherent characteristic such as the geometric congruence between the feature points of the images to propose a novel hypothesis estimation of the mapping function of the stitching via some optimally chosen initial candidate inliers in the sample consensus method. Based on the experimental results, we show the efficiency of the proposed method compared with benchmark methodologies of random sampling consensus method (RANSAC); the well-ordering property defined in the context and the extensive stitching examples have supported the utility. Moreover, the sample consensus scheme proposed in this study is uncomplicated and robust, and some fatal miss stitching by RANSAC is remarkably reduced in the measure of the pixel difference.

• Journal of the Semiconductor & Display Technology
• /
• v.23 no.1
• /
• pp.56-60
• /
• 2024

In this paper, we propose a SIFT feature-based dynamic stitching algorithm for image calibration and correction of a 360-degree surround view system. The existing surround view system requires a lot of processing time and money because in the process of image calibration and correction. The traditional marker patterns are placed around the vehicle and correction is performed manually. Therefore, in this study, images captured with four fisheye cameras mounted on the surround view system were distorted and then matched with the same feature points in adjacent images through SIFT-based feature point extraction to enable image stitching without a fixed marker pattern.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.40 no.7
• /
• pp.1387-1394
• /
• 2015

Along with the development of network transmission technology, the IPTV market is growing in fast pace. Additionally the UHD resolution broadcasting system along with user experience (UX) that provides better service to user has attracted attention recently since there are not enough research has been done with differentiated the UX that can enhance the UX yet. Therefore we proposed a low complexity syntax level image stitching implementation technique that run with multi-view services, which makes possibility to view multiple channel or video contents on the screen at the same time. Simulation results have demonstrated the liability and effectiveness of the proposed algorithm by showing that capability of generating more than 80 frames per second by stitching four Full-HD size videos into UHD frame.

• Korean Journal of Optics and Photonics
• /
• v.26 no.1
• /
• pp.44-53
• /
• 2015

Since the technology of current image sensors is limited to the megapixel class, it is necessary to use an image-stitching technique to create a gigapixel image from hundreds or thousands of photos taken by a megapixel image sensor. In this paper, we investigate the entire process of gigapixel camera technology employing a robotic panoramic head plus a stitching technique, and analyze the gigapixel camera technologies of Duke University and BAE Systems from the viewpoint of optical design structure. Hopefully this knowledge will lead to a new optical structure for a gigapixel camera. Meanwhile, we also perceive the need for additional image processing to reduce the noise of photos with a background of fog and mist, taken far from the camera lens.

• Journal of the Korea institute for structural maintenance and inspection
• /
• v.26 no.5
• /
• pp.30-42
• /
• 2022

Due to the increase in construction of tunnels, the burdens of maintenance works for tunnel structures have been increasing in Korea. In addition, the increase of traffic volume and aging of materials also threatens the safety of tunnel facilities, therefore, maintenance costs are expected to increase significantly in the future. Accordingly, automated condition assessment technologies like image-based tunnel scanning system for inspection and diagnosis of tunnel facilities have been proposed. For image-based tunnel scanning system, it is key to create a planar image through stitching of multiple images captured by tunnel scanning system. In this study, performance of feature-based stitching algorithms suitable for stitching tunnel scanning images was evaluated. In order to find a suitable algorithm SIFT, ORB, and BRISK are compared. The performance of the proposed algorithm was determined by the number of feature extraction, calculation speed, accuracy of feature matching, and image stitching result. As for stitching performance, SIFT algorithm was the best in all parts of tunnel image. ORB and BRISK also showed satisfactory performance and short calculation time. SIFT can be used to generate precise planar images. ORB and BRISK also showed satisfactory stitching results, confirming the possibility of being used when real-time stitching is required.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.7 no.10
• /
• pp.2464-2478
• /
• 2013

Image stitching techniques produce an image with a wide field-of-view by aligning multiple images with a narrow field-of-view. While conventional algorithms successfully stitch images with a small parallax, structure misalignment may occur when input images contain a large parallax. This paper presents an image stitching algorithm that aligns images with a large parallax by regional linear warping. To this end, input images are first approximated as multiple planar surfaces, and different linear warping is applied to each planar surface. For approximating input images as multiple planar surfaces, the concept of dominant edges is introduced. Dominant edges are defined as conspicuous edges of lines in input images, and extracted dominant edges identify the boundaries of each planar surface. Dominant edge extraction is conducted by detecting distinct changes of local characteristics around strong edge pixels. Experimental results show that the proposed algorithm successfully stitches images with a large parallax without structure misalignment.