• Journal of Broadcast Engineering
• /
• v.27 no.3
• /
• pp.341-350
• /
• 2022

In this paper, we propose a deep learning based on-device augmented reality (AR) system in which multiple input images are used to implement the correct occlusion in a real environment. The proposed system is composed of three technical steps; camera pose estimation, depth estimation, and object augmentation. Each step employs various mobile frameworks to optimize the processing on the on-device environment. Firstly, in the camera pose estimation stage, the massive computation involved in feature extraction is parallelized using OpenCL which is the GPU parallelization framework. Next, in depth estimation, monocular and multiple image-based depth image inference is accelerated using the mobile deep learning framework, i.e. TensorFlow Lite. Finally, object augmentation and occlusion handling are performed on the OpenGL ES mobile graphics framework. The proposed augmented reality system is implemented as an application in the Android environment. We evaluate the performance of the proposed system in terms of augmentation accuracy and the processing time in the mobile as well as PC environments.

• Korean Journal of Remote Sensing
• /
• v.28 no.2
• /
• pp.245-253
• /
• 2012

The public and civilian demands regarding 3D geo-spatial information processing on mobile device including smartphone are increasing. But there are few actual implementations or application cases. This work is to present some results by a prototype implementation of 3D terrain information visualization function with satellite image and DEM using HTML5 WebGL, which is a web-based graphic library under the standardization process. This is a useful standard for cross-platform operation for 3D graphic rendering without other plug-in modules. As the results, in the different types of operating system or browser in a personal computer or a smartphone, it shows same rendering results, as long as they support HTML5 WebGL. As well;geo-metadata search and identification functions for data sets for 3D terrain visualization process are added in this implementation for the practical aspect.

• Journal of information and communication convergence engineering
• /
• v.6 no.3
• /
• pp.285-288
• /
• 2008

Most of multimedia processors for 2D/3D graphics acceleration use a lot of integer/floating point arithmetic units. We present a new architecture with an efficient ALU, built in a smaller chip size. It reduces instruction cycles significantly based on a foundation of multi-thread operation, variable length instruction words, dual phase operation, and phase instruction's coordination. We can decrease the number of instruction cycles up to 50%, and can achieve twice better performance.

• Proceedings of the IEEK Conference
• /
• 2006.06a
• /
• pp.987-988
• /
• 2006

This paper presents a design and MPW implementation of 3D Graphics Floating Point IPs. Designed IPs include adder, subtractor, multiplier, divider, and reciprocal unit. The IPs have pipelined structures. The IPs meet the accuracy required in OpenGL ES. The operation frequency of the IPs is 100MHz. The IPs can be efficiently used in 3D graphics accelerators.

• Journal of the Institute of Electronics Engineers of Korea SD
• /
• v.43 no.2 s.344
• /
• pp.24-33
• /
• 2006

The effective geometry processing IP architecture for mobile SoC that has real time 3D graphics acceleration performance in mobile information system is proposed. Base on the proposed IP architecture, we design the floating point arithmetic unit needed in geometry process and the floating point geometry processor supporting the 3D graphic international standard OpenGL-ES. The geometry processor is implemented by 160k gate area in a Xilinx-Vertex FPGA and we measure the performance of geometry processor using the actual 3D graphic data at 80MHz frequency environment The experiment result shows 1.5M polygons/sec processing performance. The power consumption is measured to 83.6mW at Hynix 0.25um CMOS@50MHz.

• Journal of Navigation and Port Research
• /
• v.40 no.6
• /
• pp.369-374
• /
• 2016

Recently, due to the rapid development of smart computing technology, there have been a lot of studies on 3D navigation, and consequently the advanced commercial 3D navigation system and 3D VTS system are on the market. Even the 3D technology is well known and wide spreaded, unfortunately, the secret of code behind is still unleashed. The purpose of this paper is to show the basic methodologies to display ENC features under 3D display environment to meet the requirement of S-52 standards. The OpenGL ES is used to develop 3D ENC Viewer for further use on mobile platforms and web based vessel monitoring system. P articularly, area object triangulation, complex line drawing, polygon pattern filling and symbol drawing by texture mapping are explained in detail. The result of performance test is shown as table for correlation of SENC file size to display speed.

• Journal of KIISE
• /
• v.44 no.6
• /
• pp.573-580
• /
• 2017

Despite the recent remarkable advances in the computing power of mobile devices, the heat and battery problems still restrict their performances, particularly compared to PCs. Therefore, in the application of the ray-tracing technique for high-quality rendering, the consideration of a method that traces only the secondary rays while the effects of the primary rays are generated through rasterization-based OpenGL ES rendering is worthwhile. Given that most of the rendering time is for the secondary-ray processing in such a method, a new volume-grid technique for dynamic scenes that enhances the tracing performance of the secondary rays with a low coherence is proposed here. The proposed method attempts to model all of the possible spatial secondary rays in a fixed number of sampling rays, thereby alleviating the visitation problem regarding all of the cells along the ray in a uniform grid. Also, a hybrid rendering pipeline that speeds up the overall rendering performance by exploiting the mobile-device CPU and GPU is presented.

• Journal of the Institute of Electronics Engineers of Korea SD
• /
• v.46 no.3
• /
• pp.20-25
• /
• 2009

We propose hardware architecture of floating-point square root and inverse square root arithmetic units using lookup tables. They are used for lighting engines and shader processor for 3D graphic processing. The architecture is based on Taylor series expansion and consists of lookup tables and correction units so that the size of look-up tables are reduced. It can be applied to 32 bit floating point formats of IEEE-754 and reduced 24 bit floating point formats. The square root and inverse square root arithmetic units for 32 bit and 24 bit floating format number are designed as the proposed architecture. They can operation in a single cycle, and satisfy the precision of $10^{-5}$ required by OpenGL 1.x ES. They are designed using Verilog-HDL and the RTL codes are verified using an FPGA.

• Journal of the Korea Computer Graphics Society
• /
• v.28 no.2
• /
• pp.21-28
• /
• 2022

ASTC is one of the standard texture formats supported in OpenGL ES 3.2 and Vulkan 1.0 (and later versions), and it has been increasingly used on mobile platforms (Android and iOS). ASTC's most important feature is the block size configuration, thereby providing a trade-off between compression quality and rates. With the higher number of textures, however, it is difficult to manually determine the optimal block sizes of each texture. To solve the problem, we present a new approach based on PSNR values to automatically determine the ASTC block size. A brute-force approach, which compresses a texture on all block sizes and compares the PSNR values of the compressed textures, can increase the compression time by up to 14 times. In contrast, our three-step approach minimizes the compression-time overhead. According to our experiments on a texture set including 64 various textures, our method determined the block sizes from 4×4 to 12×12 and reduced the size of compressed files by 68%.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2013.11a
• /
• pp.1470-1473
• /
• 2013

본 논문에서는 안드로이드 플랫폼에서 3D 타이포그래피를 쉽게 표현할 수 있도록 지원하는 라이브러리를 설계 구현하였다. 현재까지 모바일 플랫폼에서 3D 타이포그래피를 지원하기 위한 라이브러리는 iOS에서 사용가능한 FTGL ES만이 공개되었고 이를 직접 안드로이드 플랫폼에서 사용할 수 없으며 제공되는 3D 표현 기능 또한 제한적이었다. 본 연구에서는 iOS용 FTGL ES를 안드로이드 플랫폼에서 사용할 수 있도록 변환하고 OpenGL ES기능을 활용하여 다양한 3D 폰트 표현을 지원할 수 있는 3D 폰트 라이브러리를 개발하였다. Freetype 라이브러리를 통해 폰트의 Glyph 정보들을 얻고 이를 이용해 테두리, 양각, 음각 등 다양한 3D 문자 표현 기능을 구현하였고, 공간상에서 문자들의 배치를 수학적으로 모델링하여 다양한 3D 문자 배치 기능을 구현하였다. 개발된 3D 폰트 라이브러리를 이용하여 다양하게 문자들을 3D 공간에 표현할 수 있으면서, 기존 3D 타이포그래피 표현 방법들에 비해 더 쉽고 빠르게 3D 타이포그래피를 표현할 수 있도록 지원한다.