• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.01a
• /
• pp.233-237
• /
• 2009

This paper represents a new approach which addresses quality degradation of a synthesized view, when a virtual camera moves forward. Generally, interpolation technique using only two neighboring views is used when a virtual view is synthesized. Because a size of the object increases when the virtual camera moves forward, most methods solved this by interpolation in order to synthesize a virtual view. However, as it generates a degraded view such as blurred images, we prevent a synthesized view from being blurred by using more cameras in multiview camera configuration. That is, we solve this by applying super-resolution concept which reconstructs a high resolution image from several low resolution images. Therefore, data fusion is executed by geometric warping using a disparity of the multiple images followed by deblur operation. Experimental results show that the image quality can further be improved by reducing blur in comparison with interpolation method.

• Journal of Broadcast Engineering
• /
• v.25 no.3
• /
• pp.439-448
• /
• 2020

In this paper, we propose a modified optimization algorithm for point cloud matching of multi-view RGB-D cameras. In general, in the computer vision field, it is very important to accurately estimate the position of the camera. The 3D model generation methods proposed in the previous research require a large number of cameras or expensive 3D cameras. Also, the methods of obtaining the external parameters of the camera through the 2D image have a large error. In this paper, we propose a matching technique for generating a 3D point cloud and mesh model that can provide omnidirectional free viewpoint using 8 low-cost RGB-D cameras. We propose a method that uses a depth map-based function optimization method with RGB images and obtains coordinate transformation parameters that can generate a high-quality 3D model without obtaining initial parameters.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.28 no.3
• /
• pp.369-375
• /
• 2010

Since multi-view images can be utilized for 3D visualization and surveying as well, a system calibration is an essential procedure. The cameras in the system are mounted to the holder and their locations and attitudes are relatively fixed. Therefore, the locations and the attitudes of the perspective centers of the four oblique looking cameras can be calculated using the location and attitude of the nadir looking camera and the boresight values between the cameras. In this regard, this research is focusing on the analysis of the relative location and attitude between the nadir and oblique looking cameras based on the results of the exterior orientation parameters after the aerial triangulation of the real multiview images. We acquired high standard deviations of the relative locations between the nadir and oblique cameras. Standard deviations of the relative attitudes between the cameras were low when only the exterior orientations of the oblique looking cameras were allowed to be adjusted. Moreover, low standard deviations of the relative attitudes came when we considered not all the exterior orientations of the cameras but the attitudes of them only.

• Korean Institute of Interior Design Journal
• /
• v.23 no.2
• /
• pp.71-79
• /
• 2014

The purpose of this study is to elucidate that photo, which has been used as original photo's purpose of information transfer in modern age, is now used as romantic reproduction which is the communication methods of architect's idea and thought through photographic vision which is beyond photograph own capabilities. The photos of Mies van der Rohe and Le Corbusier's architectural works are taken as an example for studying and analysing the way of deliverying the concept of creative work in the functional spaces in the modern era. It looked at the way of modern archirecture configuration, which architects wanted to show by pictures, such as concurrency, movement, sense of exhibition and concept of time-space and planarity on photographic vision such as multiview, movement, daily life exclusion, scenography and perspective loss. Reflecting that, I presents Le Corbusier and Mies van der Rohe's intention through photo by analyzing their picture of architecture by way of photograph techniques-camera position moving, over exposure, photomontage, silhouette technic and overlap technic. Mies van der Rohe and Le corbusier demonstrated the change and manipulation of the their architectural photos in different point of view. They express their architectural theories by photos of their works and overcome the limitation of expression of constructed building designed by them. The photos of architects's works in the case study with photos and descriptions introduce to their design concept. The design concept of the architects have become ideal concept for many contemporary architects and keep reproducing through the photos of their architectural works.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2014.10a
• /
• pp.822-823
• /
• 2014

The usual method of generating an image for a multiview display system requires acquiring a color image and depth information of a reference camera. Then, intermediate images, generated using DIBR method, will be captured at a number of different viewpoints and composed to construct an multiview image. When such intermediate views are generated, several holes would be shown because some hidden parts are shown when the screenshot is taken at different angle. Previous research tried to solve this problem by creating a new hole-filling algorithm or enhancing the depth information. This paper describes a new method of enhancing the intermediate view images by applying the Ball Pivoting algorithm, which constructs meshes from a point cloud. When the new method is applied to the Microsoft's "Ballet" and "Break Dancer" data sets, PSNR comparison shows that about 0.18~1.19 increasement. This paper will explaing the new algorithm and the experiment method and results.

• Journal of Broadcast Engineering
• /
• v.21 no.1
• /
• pp.36-42
• /
• 2016

Recently, many 3D contents have been produced through the multiview camera system. In this system, since a difference of the viewpoint between color and depth cameras is inevitable, the camera parameter plays the important role to adjust the viewpoint as a preprocessing step. The conventional camera calibration method is inconvenient to users since we need to choose pattern features manually after capturing a planar chessboard with various poses. Therefore, we propose a semi-auto camera calibration method using a circular sampling and an homography estimation. Firstly, The proposed method extracts the candidates of the pattern features from the images by FAST corner detector. Next, we reduce the amount of the candidates by the circular sampling and obtain the complete point cloud by the homography estimation. Lastly, we compute the accurate position having the sub-pixel accuracy of the pattern features by the approximation of the hyper parabola surface. We investigated which factor affects the result of the pattern feature detection at each step. Compared to the conventional method, we found the proposed method released the inconvenience of the manual operation but maintained the accuracy of the camera parameters.

• Journal of the Institute of Electronics Engineers of Korea SC
• /
• v.49 no.4
• /
• pp.10-16
• /
• 2012

For high speed visual inspection in semiconductor industries, it is essential to acquire two-dimensional images on regions of interests with a large field of view (FOV) and a high resolution simultaneously. In this paper, an imaging system is newly proposed to achieve high quality image in terms of precision and FOV, which is composed of single lens, a beam splitter, two camera sensors, and stereo image grabbing board. For simultaneously acquired object images from two camera sensors, Zhang's camera calibration method is applied to calibrate each camera first of all. Secondly, to find a mathematical mapping function between two images acquired from different view cameras, the matching matrix from multiview camera geometry is calculated based on their image homography. Through the image homography, two images are finally registered to secure a large inspection FOV. Here the inspection system of using multiple images from multiple cameras need very fast processing unit for real-time image matching. For this purpose, parallel processing hardware and software are utilized, such as Compute Unified Device Architecture (CUDA). As a result, we can obtain a matched image from two separated images in real-time. Finally, the acquired homography is evaluated in term of accuracy through a series of experiments, and the obtained results shows the effectiveness of the proposed system and method.

• The Journal of Korean Institute of Communications and Information Sciences
• /
• v.31 no.2C
• /
• pp.166-174
• /
• 2006

In this paper, a new stereo object tracking system using the disparity motion vector is proposed. In the proposed method, the time-sequential disparity motion vector can be estimated from the disparity vectors which are extracted from the sequence of the stereo input image pair and then using these disparity motion vectors, the area where the target object is located and its location coordinate are detected from the input stereo image. Being based on this location data of the target object, the pan/tilt embedded in the stereo camera system can be controlled and as a result, stereo tracking of the target object can be possible. From some experiments with the 2 frames of the stereo image pairs having 256$\times$256 pixels, it is shown that the proposed stereo tracking system can adaptively track the target object with a low error ratio of about 3.05$\%$ on average between the detected and actual location coordinates of the target object.

• Proceedings of the Korean Information Science Society Conference
• /
• 2008.06c
• /
• pp.450-455
• /
• 2008

다시점 비디오는 여러 개의 시점(view-point)을 이용하여 현장감과 몰입감을 제공하는 새로운 형태의 멀티미디어 서비스이다. 시점의 개수가 증가함에 따라 방대한 양의 영상 데이터로 인한 영상 획득, 저장 전송 및 재현 시 문제가 발생한다. 또한 현재의 다시점 비디오에 관한 연구는 고정된 카메라로 환경이 제한되어 있다. 본 논문에서는 유동적인 카메라 환경에서 최적의 상관관계를 가지는 영상을 획득하기 위한 방법을 제안한다. 제안하는 방법은 영상의 일부분만을 선택하여 중복성을 먼저 측정하고, 중복성의 척도에 따라 사용자와의 상호작용을 통하여 높은 상관관계를 가지는 다시점 영상을 획득할 수 있다. 또한 영상 획득 시 카메라간의 조명 차이에 의해 발생되는 부정확성을 감소시키기 위해 영상 마스킹을 적용한다. 마스킹된 영상에 에지 검출 방법을 적용하여 변위 추정을 함으로써 계산 복잡도를 줄였다.

• Journal of the Institute of Electronics Engineers of Korea SP
• /
• v.47 no.6
• /
• pp.127-136
• /
• 2010

In multi-view video, illumination disharmony between neighboring views can occur on account of different location of each camera and imperfect camera calibration, and so on. Such discrepancy can be the cause of the performance decrease of multi-view video coding by mismatch of inter-view prediction which refer to the pictures obtained from the neighboring views at the same time. In this paper, we propose an efficient histogram-based prefiltering algorithm to compensate mismatches between the luminance and chrominance components in multi-view video for improving its coding efficiency. To compensate illumination variation efficiently, all camera frames of a multi-view sequence are adjusted to a predefined reference through the histogram matching. A Cosited filter that is used for chroma subsampling in many video encoding schemes is applied to each color component prior to histogram matching to improve its performance. The histogram matching is carried out in the RGB color space after color space converting from YCbCr color space. The effective color conversion skill that has respect to direction of edge and range of pixel value in an image is employed in the process. Experimental results show that the compression ratio for the proposed algorithm is improved comparing with other methods.