• Journal of Electrical Engineering and Technology
• /
• v.10 no.5
• /
• pp.2189-2196
• /
• 2015

Stereo matching algorithm is usually used to obtain a disparity map from a pair of images. However, the disparity map obtained by using stereo matching contains lots of noise and error regions. In this paper, we propose a virtual-view synthesis algorithm using disparity refinement in order to improve the quality of the synthesized image. First, the error region is detected by examining the consistency of the disparity maps. Then, motion information is acquired by applying optical flow to texture component of the image in order to improve the performance. Then, the occlusion region is found using optical flow on the texture component of the image in order to improve the performance of the optical flow. The refined disparity map is finally used for the synthesis of the virtual view image. The experimental results show that the proposed algorithm improves the quality of the generated virtual-view.

• Journal of the HCI Society of Korea
• /
• v.4 no.2
• /
• pp.9-16
• /
• 2009

3D stereo display systems gain more interests recently. Multiple-view autostereoscopic display system enables observers to watch stereo image from multiple viewpoints not wearing specific devices such as shutter glasses or HMD. Therefore, the Multiple-view autostereoscopic display is being spotlighted in the field of virtual reality, mobile, 3D TV and so on. However, one of the critical disadvantages of the system is that observer can enjoy the system only in a small designated area where the system is designed to work properly. This research provides an effective way of GPU based rendering technique to present seamless 3D stereo experiences from an arbitrary observer's view position.

• Journal of the Korea Computer Graphics Society
• /
• v.16 no.4
• /
• pp.1-10
• /
• 2010

We present a method to reproduce in-between views from captured stereo images to control depth feeling that a user can perceive on a 3D display. The stereo images captured from a pair of cameras have a fixed viewpoint and a screen parallax which depend on the physical position and the distance between the cameras. In this paper, we produce stereo images of an intermediate viewpoint between two original cameras by a view interpolation on the input stereo images. Furthermore, the camera separation of the reproduced stereo images can be controlled by a linear interpolation coefficient used by the view interpolation. By using the proposed method, stereo images can be reproduced where the depth feeling and a three dimensional effect is suitable for the individual's eye separation or the characteristic of an application.

• Journal of Broadcast Engineering
• /
• v.25 no.5
• /
• pp.798-807
• /
• 2020

As technologies using digital camera have been developed, 3D images can be constructed from the pictures captured by using multiple cameras. The 3D image data is represented in a form of point cloud which consists of 3D coordinate of the data and the related attributes. Various techniques have been proposed to construct the point cloud data. Among them, Structure-from-Motion (SfM) and Multi-view Stereo (MVS) are examples of the image-based technologies in this field. Based on the conventional research, the point cloud data generated from SfM and MVS may be sparse because the depth information may be incorrect and some data have been removed. In this paper, we propose an efficient algorithm to enhance the point cloud so that the density of the generated point cloud increases. Simulation results show that the proposed algorithm outperforms the conventional algorithms objectively and subjectively.

• Journal of Multimedia Information System
• /
• v.9 no.3
• /
• pp.183-190
• /
• 2022

Image-based 3D object detection is one of the important and difficult problems in autonomous driving and robotics, and aims to find and represent the location, dimension and orientation of the object of interest. It generates three dimensional (3D) bounding boxes with only 2D images obtained from cameras, so there is no need for devices that provide accurate depth information such as LiDAR or Radar. Image-based methods can be divided into three main categories: monocular, stereo, and multi-view 3D object detection. In this paper, we investigate the recent state-of-the-art models of the above three categories. In the multi-view 3D object detection, which appeared together with the release of the new benchmark datasets, NuScenes and Waymo, we discuss the differences from the existing monocular and stereo methods. Also, we analyze their performance and discuss the advantages and disadvantages of them. Finally, we conclude the remaining challenges and a future direction in this field.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.50 no.12
• /
• pp.159-167
• /
• 2013

In stereo-view system, variations of target camera position or lighting conditions cause discrepancies on the luminance and chrominance components of stereo views. These discrepancies lead to inaccurate frame view prediction and low quality of 3 D video coding. In this paper, an efficient histogram interval calibration method is proposed for stereo-view coding, so as to compensate for the luminance component of target view. First the proposed method is analyzed by the histogram of the target image frame. Then, it divide two sections of histogram of that frame to correct the color discrepancies. Secondly, each section of the target frame is corrected the luminance component by identify the maximum matching region between the reference frame and the target frame. We have verified our proposed histogram matching method in comparison with the other color correction ones. Experimental results show that it can correct better luminance calibration results of PSNR(Peak Signal to Noise Ratio) and has less computation time.

• The Bulletin of The Korean Astronomical Society
• /
• v.39 no.1
• /
• pp.73-73
• /
• 2014

Several geometrical models (e.g., cone and flux rope models) have been suggested to infer 3-D parameters of CMEs using multi-view observations (STEREO/SECCHI) and single-view observations (SOHO/LASCO). To prepare for when only single view observations are available, we have made a test whether the cone model parameters from single-view observations are consistent with those from multi-view ones. For this test, we select 35 CMEs which are identified as CMEs, whose angular widths are larger than 180 degrees, by one spacecraft and as limb CMEs by the other ones. For this we use SOHO/LASCO and STEREO/SECCHI data during the period from 2010 December to 2011 July when two spacecraft were separated by $90{\pm}10$ degrees. In this study, we compare 3-D parameters of these CMEs from three different methods: (1) a triangulation method using the STEREO/SECCHI and SOHO/LASCO data, (2) a Graduated Cylindrical Shell (GCS) flux rope model using the STEREO/SECCHI data, and (3) an ice cream cone model using the SOHO/LASCO data. The parameters used for comparison are radial velocities, angular widths and source location (angle ${\gamma}$ between the propagation direction and the plan of the sky). We find that the radial velocities and the ${\gamma}$-values from three methods are well correlated with one another (CC > 0.8). However, angular widths from the three methods are somewhat different. The correlation coefficients are relatively not good (CC > 0.4). We also find that the correlation coefficients between the locations from the three methods and the active region locations are larger than 0.9, implying that most of the CMEs are radially ejected.

• Proceedings of the IEEK Conference
• /
• 2006.06a
• /
• pp.437-438
• /
• 2006

Virtual view synthesis is essential for 3DTV systems, which utilizes the motion parallax cue. In this paper, we propose a multi-step view synthesis algorithm to efficiently reconstruct an arbitrary view from limited number of known views of a 3D scene. We describe an efficient image rectification procedure which guarantees that an interpolation process produce valid views. This rectification method can deal with all possible camera motions. The idea consists of using a polar parameterization of the image around the epipole. Then, to generate intermediate views, we use an efficient dense disparity estimation algorithm considering features of stereo image pairs. Main concepts of the algorithm are based on the region dividing bidirectional pixel matching. The estimated disparities are used to synthesize intermediate view of stereo images. We use computer simulation to show the result of the proposed algorithm.

• Journal of information and communication convergence engineering
• /
• v.12 no.3
• /
• pp.173-180
• /
• 2014

This paper investigates the robustness of watermarking techniques for stereo or multi-view images generated from texture and depth images. A three-dimensional (3D) warping technique is applied to texture and depth images to generate stereo or multi-view images for a 3D display. By using the 3D warping technique, in this paper, we developed watermarking techniques and evaluated the robustness of these techniques that can extract watermarks from texture images even when the viewpoints are moved. A depth image is used to generate a stereo image with the largest viewpoint difference to the left and right. The overlapping region in the stereo image that does not disappear after warping is then obtained, and DWT is applied to this region to embed a watermark in the LL sub-band. The proposed watermarking techniques were found to yield bit error rates of about 3%-16% when they were applied to stereo images generated from texture and depth images. Furthermore, the results showed that the copyright could be seen when the extracted watermark was visually confirmed.

• Proceedings of the IEEK Conference
• /
• 2003.07e
• /
• pp.2295-2298
• /
• 2003

The correspondence problem for stereo image matching plays an important role in expanding view points as multi view video applications become more popular. The conventional disparity estimation algorithms have limitation to find exact disparities because they consider not image features but similiar intensity points. Thus we propose an efficient disparity estimation algorithm considering features of stereo image pairs. As simulation results, our proposed method confirms better intermediate views than the existing block-matching methods.