• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.11 no.9
• /
• pp.4527-4548
• /
• 2017

This paper proposes a method to generate panoramic images by combining conventional feature extraction algorithms (e.g., SIFT, SURF, MPEG-7 CDVS) with sensed data from inertia sensors to enhance the stitching results. The challenge of image stitching increases when the images are taken from two different mobile phones with no posture calibration. Using inertia sensor data obtained by the mobile phone, images with different yaw, pitch, and roll angles are preprocessed and adjusted before performing stitching process. Performance of stitching (e.g., feature extraction time, inlier point numbers, stitching accuracy) between conventional feature extraction algorithms is reported along with the stitching performance with/without using the inertia sensor data. In addition, the stitching accuracy of video data was improved using the same sensed data, with discrete calculation of homograph matrix. The experimental results for stitching accuracies and speed using sensed data are presented in this paper.

• Journal of Broadcast Engineering
• /
• v.22 no.1
• /
• pp.51-61
• /
• 2017

This paper proposes a method to generate panoramic images by combining conventional feature extraction algorithms (e.g., SIFT, SURF, MPEG-7 CDVS) with sensed data from an inertia sensor to enhance the stitching results. The challenge of image stitching increases when the images are taken from two different mobile phones with no posture calibration. Using inertia sensor data obtained by the mobile phone, images with different yaw angles, pitch angles, roll angles are preprocessed and adjusted before performing stitching process. Performance of stitching (e.g., feature extraction time, inlier point numbers, stitching accuracy) between conventional feature extraction algorithms is reported along with the stitching performance with/without using the inertia sensor data.

• Journal of IKEEE
• /
• v.20 no.4
• /
• pp.420-423
• /
• 2016

In this paper, we proposed an implementation of panoramic image stitching that operates in real time at the embedded environment by applying ROI based PROSAC algorithm using the directionality of the image. The conventional panoramic image stitching applies SURF or SIFT algorithm which contains unnecessary computation and a lots of data to detect feature points. In this paper, we use the direction of the input image and we proposed the method of reducing the unnecessary computation by using ROI. We use a gyro sensor and an acceleration sensor. Output data from gyro and acceleration sensors can be calibrated by complementary filter. The calibration does not affect the operating time of the proposed image stitching algorithm in embedded environment. Therefore, it is possible to operate in real-time.

• Journal of Broadcast Engineering
• /
• v.22 no.6
• /
• pp.713-723
• /
• 2017

Since the panoramic image can overcome the limitation of the viewing angle of the camera and have a wide field of view, it has been studied effectively in the fields of computer vision and stereo camera. In order to generate a panoramic image, stitching images taken by a plurality of general cameras instead of using a wide-angle camera, which is distorted, is widely used because it can reduce image distortion. The image stitching technique creates descriptors of feature points extracted from multiple images, compares the similarities of feature points, and links them together into one image. Each feature point has several hundreds of dimensions of information, and data processing time increases as more images are stitched. In particular, when a panorama is generated on the basis of an image photographed by a plurality of unspecified cameras with respect to an object, the extraction processing time of the overlapping feature points for similar images becomes longer. In this paper, we propose a preprocessing process to efficiently process stitching based on an image obtained from a number of unspecified cameras for one object or environment. In this way, the data processing time can be reduced by pre-grouping images based on camera sensor information and reducing the number of images to be stitched at one time. Later, stitching is done hierarchically to create one large panorama. Through the grouping preprocessing proposed in this paper, we confirmed that the stitching time for a large number of images is greatly reduced by experimental results.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2019.11a
• /
• pp.73-75
• /
• 2019

360°VR 영상은 카메라에서 촬영된 여러 영상들을 이어 붙이는 작업인 스티칭(Stitching)을 통하여 만들 수 있다. 스티칭은 영상들을 이어 붙이기 위해 각 영상의 특징점을 추출하는 특징점 추출, 특징점간 유사도를 비교하여 유사한 특징점끼리 매칭시키는 특징점 매칭, 특징점 매칭 과정에서 획득한 호모그래피 매트릭스를 이용한 이미지 와핑, 각 영상 간의 부자연스러운 경계선을 제거하는 블렌딩 과정을 거친다. 고품질의 360°VR 영상을 획득하기 위해서는 영상의 개수를 증가시킬 필요가 있고, 이로 인해 스티칭 과정에서 소요되는 시간이 증가한다. 본 논문에서는 카메라 센서 정보를 이용해 유사한 영상끼리 클러스터링하여, 한번에 스티칭이 진행되는 영상의 수를 감소시키고, 멀티 스레드를 이용하여 각 그룹의 스티칭을 병렬적으로 진행한 뒤, 최종적으로 스티칭하여 최종 360°VR 영상을 획득하는 과정을 제안한다.

• Current Optics and Photonics
• /
• v.5 no.4
• /
• pp.362-369
• /
• 2021

Absolute position sensors are widely used in machine tools and precision measuring instruments because measurement errors are not accumulated, and position measurements can be performed without initialization. The laser speckle-based absolute position sensor, in particular, has advantages in terms of simple system configuration and high measurement accuracy. Unlike traditional absolute position sensors, it does not require an expensive physical length scale; instead, it uses a laser speckle image database to measure a moving surface position. However, there is a problem that a huge database is required to store information in all positions on the surface. Conversely, reducing the size of the database also decreases the accuracy of position measurements. Therefore, in this paper, we propose a new method to measure the surface position with high precision while reducing the size of the database. We use image stitching and approximation methods to reduce database size and speed up measurements. The absolute position error of the proposed method was about 0.27 ± 0.18 ㎛, and the average measurement time was 25 ms.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2017.06a
• /
• pp.256-259
• /
• 2017

파노라마 영상은 카메라 시야각의 제한을 극복하여 넓은 시야를 가질 수 있으므로 컴퓨터 비전, 스테레오 카메라 등의 분야에서 효율적으로 연구되고 있다. 파노라마 영상을 생성하기 위해서는 영상 스티칭 기술이 필요하다. 영상 스티칭 기술은 여러 영상에서 추출한 특징점의 디스크립터를 생성하고, 특징점들 간의 유사도를 비교하여 영상들을 이어 붙여 큰 하나의 영상으로 만드는 것이다. 각각의 특징점은 수십 수백차원의 정보를 가지고 있고, 스티칭 할 영상이 많아질수록 데이터 처리 시간이 증가하게 된다. 본 논문에서는 이를 해결 하기 위해서 전처리 과정으로 겹치는 영역이 많을 것이라고 예상되는 영상들을 그룹화 하는 방법을 제안한다. 카메라 센서 정보를 기반으로 영상들을 미리 그룹화 하여 한 번에 스티칭 할 영상의 수를 줄임으로써 데이터 처리 시간을 줄일 수 있다. 후에 계층적으로 스티칭 하여 하나의 큰 파노라마를 만든다. 실험 결과를 통해 제안한 방법이 기존의 스티칭 처리 시간 보다 짧아진 것을 검증하였다.

• 한국HCI학회:학술대회논문집
• /
• 2006.02a
• /
• pp.355-361
• /
• 2006

In large scale environments like airport, museum, large warehouse and department store, autonomous mobile robots will play an important role in security and surveillance tasks. Robotic security guards will give the surveyed information of large scale environments and communicate with human operator with that kind of data such as if there is an object or not and a window is open. Both for visualization of information and as human machine interface for remote control, a 3D model can give much more useful information than the typical 2D maps used in many robotic applications today. It is easier to understandable and makes user feel like being in a location of robot so that user could interact with robot more naturally in a remote circumstance and see structures such as windows and doors that cannot be seen in a 2D model. In this paper we present our simple and easy to use method to obtain a 3D textured model. For expression of reality, we need to integrate the 3D models and real scenes. Most of other cases of 3D modeling method consist of two data acquisition devices. One for getting a 3D model and another for obtaining realistic textures. In this case, the former device would be 2D laser range-finder and the latter device would be common camera. Our algorithm consists of building a measurement-based 2D metric map which is acquired by laser range-finder, texture acquisition/stitching and texture-mapping to corresponding 3D model. The algorithm is implemented with laser sensor for obtaining 2D/3D metric map and two cameras for gathering texture. Our geometric 3D model consists of planes that model the floor and walls. The geometry of the planes is extracted from the 2D metric map data. Textures for the floor and walls are generated from the images captured by two 1394 cameras which have wide Field of View angle. Image stitching and image cutting process is used to generate textured images for corresponding with a 3D model. The algorithm is applied to 2 cases which are corridor and space that has the four wall like room of building. The generated 3D map model of indoor environment is shown with VRML format and can be viewed in a web browser with a VRML plug-in. The proposed algorithm can be applied to 3D model-based remote surveillance system through WWW.