• Proceedings of the Korean Information Science Society Conference
• /
• 2006.06a
• /
• pp.226-228
• /
• 2006

In this paper we describe a simulation and development framework for designing mobile 3D graphics architectures. We are developing a simple and flexible simulation and verification environment (SVE) that uses gITrace's ability to intercept and redirect an OpenGL/ES streams. In combination wlth gITrace to trace OpenGL/ES commands, the SVE simulates the behavior of mobile 3D graphics pipeline during playback of traces, and then produces the second geometry trace that can be used as a test vector for the Verilog/HDL RT-level model. By comparing the frame-by-frame results, we can conduct architectural verification. To demonstrate the functionality of the SVE, we show the implementation of the verified mobile 3D architecture on a FPGA board. For this, we also present an application development environment (ADE) includes a mobile graphics API and a device driver interface (DDI). The proposed two software environments, the SVE and the ADE could be used fer developing and testing mobile applications, architectural study and speculative hardware designs.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2005.05a
• /
• pp.201-204
• /
• 2005

현재의 세계적인 트렌드인 HCI(Human Computer Interaction)에서 사용자의 기호나 의견 등을 반영하는 인터렉티브 미디어(Interactive Media)는 빠질 수 없는 주제다. 본 연구팀은 모바일 단말환경에서 사용자의 인터렉션을 통한 서비스를 제공할 수 있는 IMS(Interactive Media System)를 설계하고, 이를 PDA 상에 구현하였다. 기존의 연구들이 보여주는 링크의 형태로만 미디어를 지원하는 방식은 CPU 등의 자원이 부족한 모바일 환경에서는 부담이 될 수 있다. IMS 는 이를 벗어나 내부적으로 미디어 오브젝트를 지원하는 방식을 사용하여 모바일 환경에 적합하게 연산속도를 개선하고 있다. 또한 이러한 방식으로 인하여 생길 수 있는 문제인 미디어 포맷의 지원에 대한 제약을 극복하기 위해 확장성 있는 구조로 설계되어 이미지와 텍스트, 백터그래픽 만을 제공하던 단순한 시스템에서 H.264 와 MPEG4 AAC 와 같은 여러 모듈들이 더해졌다. 또한 OpenGL 모듈이 추가되고 3D 오브젝트들이 새롭게 정의됨으로써 IMS 는 IML 을 통해 마크업 언어차원에서 3D 그래픽을 지원할 수 있게 되었고 2D 와 3D 를 함깨 사용한 다양한 비쥬얼 구성이 가능하게 되었다. 본 논문에서는 IMS 의 확장성 있는 구조와 OpenGL 을 추가하고 새로운 미디어 오브젝트를 정의하는 과정 등을 다루며 언급한 내용을 자세히 소개한다.

• KIPS Transactions on Software and Data Engineering
• /
• v.6 no.12
• /
• pp.581-586
• /
• 2017

This paper proposes a GPU based water surface animation and rendering technique for interactive applications such as games. On the water surface, a lot of physical phenomenon occurs including reflection and refraction depending on the viewing direction. When we represent the water surface, not only showing them in real time, but also make them adjusted automatically. In our implementation, we are able to capture the reflection and refraction through render-to-texture technique and then modify the texture coordinates for applying separate DU/DV map. Also, we make the amount of ratio between reflection and refraction change automatically based on Fresnel formula. All proposed method are implemented using OpenGL 3D graphics API.

• Journal of the Korean Society for Aeronautical & Space Sciences
• /
• v.34 no.6
• /
• pp.67-74
• /
• 2006

In this paper, a tiled display system is developed to get a high-resolution image in visualization of large-scale structural analysis data with low-resolution display devices and low-cost cluster computer system. Concerning the hardware system, some of the crucial points are investigated, and a new beam-projector positioner is designed and manufactured to resolve the keystone phenomena which result in distorted image. In the development of tiled display software, Qt and OpenGL are utilized for GUI and rendering, respectively. To obtain the entire tiled image, LAM-MPI is utilized to synchronize the several sub-images produced from each cluster computer node.

• Journal of KIISE:Computer Systems and Theory
• /
• v.33 no.11
• /
• pp.853-858
• /
• 2006

In this paper, we propose a practical method for hardware-accelerated rendering of the depth image-based representation(DIBR) of 3D graphic object using graphic processing unit(GPU). The proposed method overcomes the drawbacks of the conventional rendering, i.e. it is slow since it is hardly assisted by graphics hardware and surface lighting is static. Utilizing the new features of modem GPU and programmable shader support, we develop an efficient hardware-accelerating rendering algorithm of depth image-based 3D object. Surface rendering in response of varying illumination is performed inside the vertex shader while adaptive point splatting is performed inside the fragment shader. Experimental results show that the rendering speed increases considerably compared with the software-based rendering and the conventional OpenGL-based rendering method.

• Journal of Korea Game Society
• /
• v.10 no.1
• /
• pp.157-165
• /
• 2010

This paper presents a novel real-time rendering algorithm based on spherical coordinate system of the object using convex hull. While OpenGL rendering pipeline touches all vertices of an object, the proposed method takes account the only visible vertices by examining the visible triangles of the object. In order to determine the visible areas of the object in its spherical coordinate representation, the proposed method uses 3D geometric relation of 6 plane equations of the camera frustum and the bounding sphere of the object. In addition, we compute the convex hull of the object and its maximum side factors for hidden surface removal. Simulation results showed that the quality of result image is almost same compared to original image and rendering performance is greatly improved.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.17 no.8
• /
• pp.1891-1898
• /
• 2013

To efficiently execute 3D graphic APIs, such as OpenGL and Direct3D, special purpose arithmetic unit(SFU) which supports floating-point sine, cosine, reciprocal, inverse square root, base-two exponential, and logarithmic operations is designed. The SFU uses second order minimax approximation method and lookup table method to satisfy both error less than 2 ulp(unit in the last place) and high speed operation. The designed circuit has about 2.3-ns delay time under 65nm CMOS standard cell library and consists of about 23,300 gates. Due to its maximum performance of 400 MFLOPS and high accuracy, it can be efficiently applicable to mobile 3D graphics application.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2015.10a
• /
• pp.1459-1460
• /
• 2015

안경을 제작하기 위하여 안경테 혹은 렌즈의 사이즈를 측정하는 기계를 취형기라 하며, 측정된 데이터를 사용하여 렌즈를 절삭하는 기계를 옥습기라 한다. 본 논문에서는 취형기를 통해 획득한 데이터를 3D 시각화 하는 방법에 대하여 서술한다. 취형기의 탐침자에서 획득된 데이터는 1024개, 즉 데이터당 약 $0.352^{\circ}$에 해당하는 각도로 획득한 데이터로 구성되며, 각 데이터는 취형기 중심에서 경계까지의 거리와 렌즈 혹은 안경테의 높이 데이터를 포함한다. 해당 데이터는 취형기에서 얻은 원통좌표계 형식의 원시 데이터 형태에서 OpenGL에서 사용하기 좋은 3차원 데이터 형식으로 나타낼 수 있도록 재가공하여 X, Y, Z 축 기반의 3차원 직교좌표계 형식으로 변환한다. 그 후, OpenGL을 사용하여 3D로 시각화하였다. 해당 데이터를 회전할 수 있도록 하기 위하여 쿼터니언 기반의 ArcBall을 사용하여 회전 가능하게 하였으며, 3D 시각화 된 결과를 확대/축소할 수 있게 하였다. 디스플레이에서 실제와 같은 크기로 출력하기 위하여 DPI를 활용한 축척 계산법을 사용하였고, 출력결과의 더 나은 시각화를 위하여 평균보간법을 사용하였다.

• The Journal of the Institute of Internet, Broadcasting and Communication
• /
• v.16 no.4
• /
• pp.117-123
• /
• 2016

A hand-gesture interface to manipulate a 3D object of augmented reality is implemented by recognizing the user hand-gesture in this paper. Proposed method extracts the hand region from real image, and creates augmented object by hand marker recognized user hand-gesture. Also, 3D object manipulation corresponding to user hand-gesture is performed by analyzing a hand region ratio, a numbet of finger and a variation ratio of hand region center. In order to evaluate the performance of the our proposed method, after making a 3D object by using the OpenGL library, all processing tasks are implemented by using the Intel OpenCV library and C++ language. As a result, the proposed method showed the average 90% recognition ratio by the user command-modes successfully.

• Journal of Broadcast Engineering
• /
• v.27 no.3
• /
• pp.341-350
• /
• 2022

In this paper, we propose a deep learning based on-device augmented reality (AR) system in which multiple input images are used to implement the correct occlusion in a real environment. The proposed system is composed of three technical steps; camera pose estimation, depth estimation, and object augmentation. Each step employs various mobile frameworks to optimize the processing on the on-device environment. Firstly, in the camera pose estimation stage, the massive computation involved in feature extraction is parallelized using OpenCL which is the GPU parallelization framework. Next, in depth estimation, monocular and multiple image-based depth image inference is accelerated using the mobile deep learning framework, i.e. TensorFlow Lite. Finally, object augmentation and occlusion handling are performed on the OpenGL ES mobile graphics framework. The proposed augmented reality system is implemented as an application in the Android environment. We evaluate the performance of the proposed system in terms of augmentation accuracy and the processing time in the mobile as well as PC environments.