• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2020.07a
• /
• pp.10-13
• /
• 2020

최근 초고화질 영상, 가상현실 등 프리미엄 콘텐츠에 대한 요구가 커지면서 360° VR과 8K TV 등의 시장이 확대되고 있다. 360° VR 영상을 만드는 데에 스티칭 기술이 사용되고 있고, 8K 영상을 촬영할 수 있는 장비는 매우 제한적이기 때문에 스티칭 기술을 통해 콘텐츠를 확보하려는 노력이 이어지고 있다. 스티칭 기술은 여러 영상을 합성하여 기존 카메라의 좁은 시야각 문제를 해결하고 보다 넓은 시야각의 영상을 만드는 기술이다. 최근에는 해당 분야에 관한 연구가 진행됨에 따라 이미지를 넘어 동영상 스티칭에 대한 연구가 주로 진행되고 있다, 기존 동영상 스티칭 방식은 이미지 스티칭 방식을 프레임마다 반복하기 때문에 시간이 오래 걸린다는 단점이 있다. 컴퓨터 비전 분야에서는 딥러닝을 활용하여 객체가 존재할 것으로 예측되는 부분에 사각형 모양의 경계 상자(Bounding box)를 생성하는 객체 탐지(Object detection) 분야에 관한 많은 연구가 이루어져 왔고 이를 기반으로 객체의 경계선을 검출하여 해당 영역만을 구분하는 객체 분할(Instance segmentation)에 대한 연구 또한 진행 중이다. 본 논문에서는 앞서 말한 스티칭 속도 문제를 해결하기 위하여 빠른 속도로 객체 분할이 가능한 YOLACT를 이용하여 스티칭 속도를 개선하는 방안을 제안한다.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.23 no.9
• /
• pp.1104-1109
• /
• 2019

Business utilization of holograms is widely used as a similar hologram. The use of holograms has been proposed in many cases. In this paper, we present an outline of similar holograms using up to 3 or 4 facets, and express the similar holograms using the results produced by 3D modeling for a building from dealing with the representation of buildings from hololens to pseudo-hologram by using 3D modeling results. In addition, to reflect the real image of the disadvantage of modeling, we propose a method to enhance the 3D expression of the object by reflecting the actual building surface on the 3D model through photographing. Virtual building seen by the human eye can be virtually shown in space through a hologram among various methods shown in a virtual space such as AR / VR / MR. Through this study, it will be possible to express holograms of various materials such as buildings or cultural properties with enhanced realism.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.25 no.6
• /
• pp.807-812
• /
• 2021

In order to be able to interact with the user to experience it as if it were real in virtual reality contents, input/output devices that make them feel the five senses of humans are required . In virtual reality (VR), devices that stimulate sight and hearing are the most representative. For a more realistic experience, suits and gloves that stimulate the sense of touch have recently been released, but there are not many cases applied to actual contents due to the limitation of device . In this paper, we analyze a virtual reality glove that can detect hand movement and touch in a virtual world. Based on the analysis, we propose an algorithm that can sense the intensity of collision with a VR object by tactile sense by improving the UI/UX using the vibration of the feedback method used in the existing virtual reality glove. In addition, the system implemented by the algorithm is applied to an actual case.

• Journal of the Korea Computer Graphics Society
• /
• v.28 no.3
• /
• pp.31-43
• /
• 2022

Recently, metaverse is rapidly expanding its area as a platform that can be applied to various fields. In particular, the function that allows many users to interact in a three-dimensional space allows VR/AR-based educational content to be used as a more advanced concept. Due to the nature of engineering education, it is often based on three-dimensional objects. In the case of a three-dimensional object, it is difficult to explain through two-dimensional videos or documents, and it becomes more difficult to express when the process of changing the object is included. The three-dimensional space of the metaverse can improve this difficulty based on real-time rendering. Another characteristic of engineering education is that there are many invisible elements. Although it is involved in the movement of objects due to electromagnetic fields, magnetic fields, and forces, it is the main reason for increasing learning difficulty because it is invisible. These problems can also help learning because they can be visually represented in the metaverse space. In this paper, the results of the establishment of the metaverse platform for engineering education and the real-time lecture contents produced based on it are described, and the applied results and lecture evaluation are discussed. Lectures using a total of 9 metaverse contents were conducted, and 90% of the positive lecture evaluation results were obtained.

• Journal of KIISE:Software and Applications
• /
• v.33 no.10
• /
• pp.851-861
• /
• 2006

The paper proposes a novel unsupervised video object segmentation algorithm for image sequences with low depth-of-field (DOF), which is a popular photographic technique enabling to represent the intention of photographer by giving a clear focus only on an object-of-interest (OOI). The proposed algorithm largely consists of two modules. The first module automatically extracts OOIs from the first frame by separating sharply focused OOIs from other out-of-focused foreground or background objects. The second module tracks OOIs for the rest of the video sequence, aimed at running the system in real-time, or at least, semi-real-time. The experimental results indicate that the proposed algorithm provides an effective tool, which can be a basis of applications, such as video analysis for virtual reality, immersive video system, photo-realistic video scene generation and video indexing systems.

• Journal of Broadcast Engineering
• /
• v.24 no.5
• /
• pp.849-858
• /
• 2019

Recent developments in computer graphics technology and image processing technology have increased interest in point cloud technology for inputting real space and object information as three-dimensional data. In particular, point cloud technology can accurately provide spatial information, and has attracted a great deal of interest in the field of autonomous vehicles and AR (Augmented Reality)/VR (Virtual Reality). However, in order to provide users with 3D point cloud contents that require more data than conventional 2D images, various technology developments are required. In order to solve these problems, an international standardization organization, MPEG(Moving Picture Experts Group), is in the process of discussing efficient compression and transmission schemes. In this paper, we provide a region division transfer method of 3D point cloud content through extension of existing MPEG-DASH (Dynamic Adaptive Streaming over HTTP)-SRD (Spatial Relationship Description) technology, quality parameters are further defined in the signaling message so that the quality parameters can be selectively determined according to the user's request. We also design a verification platform for ROUTE (Real Time Object Delivery Over Unidirectional Transport)/DASH based heterogeneous network environment and use the results to validate the proposed technology.

• The KIPS Transactions:PartA
• /
• v.15A no.3
• /
• pp.141-149
• /
• 2008

In this research we present a novel method which combines and visualizes the design model and the FDM-based simulation result of solidification. Moreover we employ VR displays and visualize stereoscopic images to provide an effective analysis environment. First we reconstruct the solidification simulation result to a rectangular mesh model using a conventional simulation software. Then each point color of the reconstructed model represents a temperature value of its position. Next we map the two models by finding the nearest point of the reconstructed model for each point of the design model and then assign the point color of the design model as that of the reconstructed model. Before this mapping we apply mesh subdivision because the design model is composed of minimum number of points and that makes the point distribution of the design model not uniform compared with the reconstructed model. In this process the original shape is preserved in the manner that points are added to the mesh edge which length is longer than a predefined threshold value. The implemented system visualizes the solidification simulation data on the design model, which allows the user to understand the object geometry precisely. The immersive and realistic working environment constructed with use of VR display can support the user to discover the defect occurrence faster and more effectively.

• Proceedings of KOSOMES biannual meeting
• /
• 2003.11a
• /
• pp.53-57
• /
• 2003

The last goof if the study is to develop a law cost and a readily available Virtual Reality (VR) based Ship Handling Simulator using Personal Computer. This paper mainly describes procedures and methods to control the dynamic motions if the 3D ship object with maneuvering coefficients in a virtual navigation world The creation if virtual navigation world, the mathematical background q a ship control, and the construction of the system are also discussed.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2018.05a
• /
• pp.481-483
• /
• 2018

AR은 VR과 달리 실세계 공간의 객체에 대한 서비스를 제공하므로 서비스 개발을 방해하는 많은 요인들이 발생한다. 이를 보완하기위해 비주얼 마커, SLAM, 객체인식 등 여러 AR 기술이 존재한다. 본 논문은 AR 기술 중에서 객체인식의 정확도 향상을 위해 지역가변 이진화(Local variable binarization)와 색상의 군집화를 사용해서 이미지에서 객체를 추출하는 방법을 제안한다. 지역 가변화는 픽셀을 순차적으로 읽어 들이면서 픽셀 주위의 값의 평균을 구하고, 이 값을 해당 픽셀의 임계 값으로 사용하는 알고리즘이다. 픽셀마다 주위 색상 값에 의해 임계 값이 변화되므로 윤곽선 표현이 기존의 이진화보다 뚜렷이 나타난다. 색상의 군집화는 객체의 중요색상과 배경의 중요색상을 중심으로 유사한 색상끼리 군집화 하는 것이다. 객체 내에서 가장 많이 나온 값과 객체 외에 가장 많이 나온 값을 각 각 기준으로 색조와 채도의 값을 Euclidean 거리를 사용해 객체의 색상과 배경 색상을 분리했다.

• Journal of the Semiconductor & Display Technology
• /
• v.20 no.4
• /
• pp.6-9
• /
• 2021

The 3D industry is drawing attention for its applications in various markets, including architecture, media, VR/AR, metaverse, imperial broadcast, and etc.. The current feature of the architecture we are introducing is to make 3D models more easily created and modified than conventional ones. Existing methods for generating 3D models mainly obtain values using specialized equipment such as RGB-D cameras and Lidar cameras, through which 3D models are constructed and used. This requires the purchase of equipment and allows the generated 3D model to be verified by the computer. However, our framework allows users to collect data in an easier and cheaper manner using cell phone cameras instead of specialized equipment, and uses 2D data to proceed with 3D modeling on the server and output it to cell phone application screens. This gives users a more accessible environment. In addition, in the 3D modeling process, object classification is attempted through deep learning without user intervention, and mesh and texture suitable for the object can be applied to obtain a lively 3D model. It also allows users to modify mesh and texture through requests, allowing them to obtain sophisticated 3D models.