• ETRI Journal
• /
• v.44 no.1
• /
• pp.10-23
• /
• 2022

Despite the significant progress in camera pose estimation and structure-from-motion reconstruction from unstructured images, methods that exploit a priori information on camera arrangements have been overlooked. Conventional state-of-the-art methods do not exploit the geometric structure to recover accurate camera poses from a set of patch images in an array for mosaic-based imaging that creates a wide field-of-view image by sewing together a collection of regular images. We propose a camera pose estimation framework that exploits the array-structured image settings in each incremental reconstruction step. It consists of the two-way registration, the 3D point outlier elimination and the bundle adjustment with a constraint term for consistent rotation vectors to reduce reprojection errors during optimization. We demonstrate that by using individual images' connected structures at different camera pose estimation steps, we can estimate camera poses more accurately from all structured mosaic-based image sets, including omnidirectional scenes.

• Journal of Broadcast Engineering
• /
• v.25 no.2
• /
• pp.265-274
• /
• 2020

Free-viewpoint video service is a technology that allows users to watch at any angle, location and distance through interaction. In this paper, the free-viewpoint video services are defined in four viewing modes: Inward view, outward view, 3D object view and first person view. And we developed and implemented a new integrated program that plays all the suggested views. In the contents of girl band performances and basketball games, multi-view cameras suitable for each viewing mode are installed to acquire media, and data stored on the server is streamed over the network, making it available for viewing. Users can freely choose four viewing modes, space location, angle and so on, and the media data such as images and sounds are provided to them by rendering appropriately for the selected the viewpoint. Our system is expected to be a scalable free-viewpoint video service player as well as provide users with immersion and presence by combining various viewing modes.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2019.06a
• /
• pp.140-143
• /
• 2019

본 논문에서는 사용자 시점에 대응하는 고화질 360 비디오 제공을 위해 다시점 360 비디오 중복성 제거기법을 적용하고 잔여 비디오를 하나의 영상으로 병합하여 압축 후 전송하는 시스템을 구현한다. 사용자 움직임 적응적 360 비디오 스트리밍을 지원하는 three degrees of freedom plus (3DoF+)를 위한 시스템은 다시점에서 촬영된 다수의 고화질 360 비디오 전송을 요구한다. 이에 대한 방안으로 다시점 비디오 간 중복성 제거를 위한 3D warping 을 기반으로 하는 뷰 간 중복성 제거 기술과 비디오 복원에 필요한 타일들만 추출 및 병합해주는 잔여 뷰 병합 기술에 대한 구현 내용을 설명한다. 제안된 시스템을 기반으로 다시점 360 비디오 전송을 수행하면, 기존 high-efficiency video coding (HEVC)을 사용하여 전송했을 때 대비 최대 20.14%의 BD-rate 감소가 가능함을 확인하였다.

• Journal of the Institute of Electronics Engineers of Korea CI
• /
• v.49 no.3
• /
• pp.27-33
• /
• 2012

Tele-presence and tele-operation techniques are used to build up an immersive scene and control environment for the distant user. This paper presents a novel tele-presence system using the camera tracking based on planar homography. In the first step, the user wears the HMD(head mounted display) with the camera and his/her head motion is estimated. From the panoramic image by the omni-directional camera mounted on the mobile robot, a viewing image by the user is generated and displayed through HMD. The homography of 3D plane with markers is used to obtain the head motion of the user. For the performance evaluation, the camera tracking results by ARToolkit and the homography based method are compared with the really measured positions of the camera.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.52 no.7
• /
• pp.93-99
• /
• 2015

In this paper, we propose a gaze correction method for realistic video teleconferencing. Typically, cameras used in teleconferencing are installed at the side of the display monitor, but not in the center of the monitor. This system makes it too difficult for users to contact each eyes. Therefore, eys contact is the most important in the immersive videoconferencing. In the proposed method, we use the stereo camera and the depth camera to correct the eye contact. The depth camera is the kinect camera, which is the relatively cheap price, and estimate the depth information efficiently. However, the kinect camera has some inherent disadvantages. Therefore, we fuse the kinect camera with stereo camera to compensate the disadvantages of the kinect camera. Consecutively, for the gaze-corrected image, view synthesis is performed by 3D warping according to the depth information. Experimental results verify that the proposed system is effective in generating natural gaze-corrected images.

• Proceedings of the Korea Contents Association Conference
• /
• 2008.05a
• /
• pp.28-32
• /
• 2008

The displays and the interactive interfaces are important factors to enhance immersion in the VR experience pavilion. In the VR experience pavilion displaying 3D Virtual environment, it is difficult to have multi-display with single viewpoint because of the field of view. Also it costs a lot to construct a large size display. The interaction device between user and VR environment necessary to immersion has used mainly the touchscreens with the restricted display area or the button-based input devices so far. In this paper, we suggest a method for constructing extensible multi-display which are showing VR environment in realtime and a method for interaction using a ZA Sensor which is wireless and guarantees the user's unrestricted movement. The proposed method can make a VR experience pavilion more immersive at less cost.

• Journal of the Korean Society of Radiology
• /
• v.15 no.1
• /
• pp.45-54
• /
• 2021

This study was written to create educational content in non-destructive fields based on Mixed Reality. Currently, in the field of radiation, there is almost no content for educational Mixed Reality-based educational content. And in the field of non-destructive inspection, the working environment is poor, the number of employees is often 10 or less for each manufacturer, and the educational infrastructure is not built. There is no practical training, only practical training and safety education to convey information. To solve this, it was decided to develop non-destructive worker education content based on Mixed Reality. This content was developed based on Microsoft's HoloLens 2 HMD device. It is manufactured based on the resolution of 1280 ⁎ 720, and the resolution is different for each device, and the Side is created by aligning the Left, Right, Bottom, and TOP positions of Anchor, and the large image affects the size of Atlas. The large volume like the wallpaper and the upper part was made by replacing it with UITexture. For UI Widget Wizard, I made Label, Buttom, ScrollView, and Sprite. In this study, it is possible to provide workers with realistic educational content, enable self-directed education, and educate with 3D stereoscopic images based on reality to provide interesting and immersive education. Through the images provided in Mixed Reality, the learner can directly operate things through the interaction between the real world and the Virtual Reality, and the learner's learning efficiency can be improved. In addition, mixed reality education can play a major role in non-face-to-face learning content in the corona era, where time and place are not disturbed.