• Smart Media Journal
• /
• v.11 no.11
• /
• pp.25-31
• /
• 2022

Deep learning-based image processing is essential for autonomous vehicles. To process road images in real-time in a System-on-Chip (SoC) environment, we need to execute deep learning models on a NPU (Neural Procesing Units) specialized for deep learning operations. In this study, we imported seven open-source image processing deep learning models, that were developed on GPU servers, to Texas Instrument Deep Learning (TIDL) NPU environment. We confirmed that the models imported in this study operate normally in the SoC virtual environment through performance evaluation and visualization. This paper introduces the problems that occurred during the migration process due to the limitations of NPU environment and how to solve them, and thereby, presents a reference case worth referring to for developers and researchers who want to port deep learning models to SoC environments.

• Journal of Ocean Engineering and Technology
• /
• v.37 no.6
• /
• pp.247-255
• /
• 2023

Interference and collisions often occur in the loading process at shipyards. Existing simulation methods focus primarily on resource processes and schedules, and there is a lack of real-time reflection in the complex and highly variable loading process. This study aims to develop a spatial environment incorporating real-time product data, such as hulls, and confirms its effectiveness by simulating various construction scenarios. As a method, a near real-time spatial environment based on broadband laser scanning was established, with the situation of loading heavy cargo assumed when converting an existing ship into an LNG dual-fuel propulsion ship. A case study simulation of near-real-time cargo loading processes was then conducted using Unity 3D to confirm the interference and collision risks within the spatial environment. The results indicated that interference occurred in structures previously not identified in the design data, and a collision occurred during the loading object erection phase. The simulation confirmed that the identification of interference and collision risks during the erection phase highlights the need for a relocation or removal process of potential hazards before erection takes place. An improved erection simulation that integrates near real-time data could effectively prevent interference and collision risks.

• Journal of the Korean Society of Radiology
• /
• v.17 no.5
• /
• pp.725-733
• /
• 2023

The purpose of this study is to evaluate the effectiveness of virtual grid software (VGS). The purpose of this study is to evaluate the changes in energy and object thickness by dividing the use of VGS into two cases (Without-VGS) without using a movable grid. We attempted to determine the effectiveness of VGS by acquiring images using a chest phantom and a thigh phantom and analyzing SNR and CNR. In the chest phantom and femoral phantom, the tube flow was fixed at 2.5 mAs, and the tube voltage was changed by 10 kVp from 60 to 100 kVp to measure SNR and CNR, and SNR was about 1.09 to 8.86% higher in the chest phantom than in Without-VGS, and CNR was 4.18 to 14.56% higher in the VGS than in Without-VGS. And in the femoral phantom, SNR was about 9.78 to 18.05% higher in VGS than in Without-VGS, and CNR was 21.07 to 44.44% higher in VGS than in Without-VGS. The tube voltage was fixed at 70 kVp in the chest phantom and the femoral phantom, and the amount of tube current was changed at 2.5 to 16 mAs, respectively, and after X-ray irradiation, SNR and CNR were measured in the chest phantom, which was about 1.49 to 11.11% higher in VGS than in Without-VGS, and CNR was 4.76 to 13.40% higher in VGS than in Without-VGS. And in the femoral phantom, SNR was about 2.22 to 17.38% higher in VGS than in Without-VGS, and CNR was 13.85 to 40.46% higher in VGS than in Without-VGS. Therefore, if an inspection is required with a mobile X-ray imaging device, it is believed that good image quality can be obtained by using VGS in an environment where it is difficult to use a mobile grid, and it is believed that the use of mobile X-ray devices can be increased.

• Korean Journal of Heritage: History & Science
• /
• v.39
• /
• pp.351-378
• /
• 2006

With the development of media, the methods for the documentation of intangible cultural heritage have been also developed and diversified. As well as the previous analogue ways of documentation, the have been recently applying new multi-media technologies focusing on digital pictures, sound sources, movies, etc. Among the new technologies, the documentation of intangible cultural heritage using the method of 'Motion Capture' has proved itself prominent especially in the fields that require three-dimensional documentation such as dances and performances. Motion Capture refers to the documentation technology which records the signals of the time varing positions derived from the sensors equipped on the surface of an object. It converts the signals from the sensors into digital data which can be plotted as points on the virtual coordinates of the computer and records the movement of the points during a certain period of time, as the object moves. It produces scientific data for the preservation of intangible cultural heritage, by displaying digital data which represents the virtual motion of a holder of an intangible cultural heritage. National Research Institute of Cultural Properties (NRICP) has been working on for the development of new documentation method for the Important Intangible Cultural Heritage designated by Korean government. This is to be done using 'motion capture' equipments which are also widely used for the computer graphics in movie or game industries. This project is designed to apply the motion capture technology for 3 years- from 2005 to 2007 - for 11 performances from 7 traditional dances of which body gestures have considerable values among the Important Intangible Cultural Heritage performances. This is to be supported by lottery funds. In 2005, the first year of the project, accumulated were data of single dances, such as Seungmu (monk's dance), Salpuri(a solo dance for spiritual cleansing dance), Taepyeongmu (dance of peace), which are relatively easy in terms of performing skills. In 2006, group dances, such as Jinju Geommu (Jinju sword dance), Seungjeonmu (dance for victory), Cheoyongmu (dance of Lord Cheoyong), etc., will be documented. In the last year of the project, 2007, education programme for comparative studies, analysis and transmission of intangible cultural heritage and three-dimensional contents for public service will be devised, based on the accumulated data, as well as the documentation of Hakyeonhwadae Habseolmu (crane dance combined with the lotus blossom dance). By describing the processes and results of motion capture documentation of Salpuri dance (Lee Mae-bang), Taepyeongmu (Kang seon-young) and Seungmu (Lee Mae-bang, Lee Ae-ju and Jung Jae-man) conducted in 2005, this report introduces a new approach for the documentation of intangible cultural heritage. During the first year of the project, two questions have been raised. First, how can we capture motions of a holder (dancer) without cutoffs during quite a long performance? After many times of tests, the motion capture system proved itself stable with continuous results. Second, how can we reproduce the accurate motion without the re-targeting process? The project re-created the most accurate motion of the dancer's gestures, applying the new technology to drew out the shape of the dancers's body digital data before the motion capture process for the first time in Korea. The accurate three-dimensional body models for four holders obtained by the body scanning enhanced the accuracy of the motion capture of the dance.

• Journal of KIISE:Software and Applications
• /
• v.36 no.6
• /
• pp.471-478
• /
• 2009

Recently, researches for user interface are remarkably processed due to the explosive growth of 3-dimensional contents and applications, and the spread class of computer user. This paper proposes a novel method to manipulate windows efficiently using only the intuitive motion of hand. Previous methods have some drawbacks such as burden of expensive device, high complexity of gesture recognition, assistance of additional information using marker, and so on. To improve the defects, we propose a novel visual touchless interface. First, we detect hand region using hue channel in HSV color space to control window using hand. The distance transform method is applied to detect centroid of hand and curvature of hand contour is used to determine position of fingertips. Finally, by using the hand motion information, we recognize hand gesture as one of predefined seven motions. Recognized hand gesture is to be a command to control window. In the proposed method, user can manipulate windows with sense of depth in the real environment because the method adopts stereo camera. Intuitive manipulation is also available because the proposed method supports visual touch for the virtual object, which user want to manipulate, only using simple motions of hand. Finally, the efficiency of the proposed method is verified via an application based on our proposed interface.

• Proceedings of the Korea Society of Design Studies Conference
• /
• 2004.05a
• /
• pp.44-45
• /
• 2004

With the development of informational machinery and tools in the modern industrial society, the image is expressed diversely as tools of informational transmission and artistic communication. This image is revival equipment and transmissional media in which sound and light are comprehensively formed. The image's intuitive and sensational expressivity can revive subjects and express a fiction, a reality, a nonfiction, and a virtual reality as a communication tool that has synchronicity and the medium of meaning. Because of this, the domain of the image will be gradually extended in the future, and the world of cognizance that can be detected across our living space will absorb the image diversely and react. In this context, the investigator examined what influence image media and equipments have in space as spatial equipments, based on the recognition of cerrelation among the image, space, and mankind, namely, the environmental meaning the mage and the space contain. Therefore, this study was conducted from the aspects of relationship establishment between image equipments that are ever expansive to a variety of domains and the space that accommodates the equipments. As study findings, the influences the image equipments have on space and their expressional features are presented in three aspects: 'the expressional medium of mutual synergy','metaphysical ultra-epithelial space constituent',' and 'object'. This study seems to be meaningful in that we can expect the spatial approach method by purposes and spatial layout of image structures, with this study, through analyzing the meaning of relationship between image equipments and space.

• The KIPS Transactions:PartD
• /
• v.12D no.2 s.98
• /
• pp.233-246
• /
• 2005

To enhance the user response time of content-based retrieval service for multimedia information, several multi-dimensional index schemes have been proposed. M-tree, a well-known multidimensional index scheme is of metric space access method, and is based on the distance between objects in the metric space. However, since the overlap between index spaces of nodes might enlarge the number of nodes of M-tree accessed for query processing, the user response time for content-based multimedia information retrieval grows longer. In this paper, we propose a node split algorithm which is able to reduce the sire of overlap between index spaces of nodes in M-tree. In the proposed scheme, we choose a virtual center point as the routing object and entry redistribution as the postprocessing after node split in order to reduce the radius of index space of a node, and finally in order to reduce the overlap between the index spaces of routing nodes. From the experimental results, we can see the proposed split algorithm reduce the overlap between index space of nodes and finally enhance the user response time for similarity-based query processing.

• Journal of Broadcast Engineering
• /
• v.11 no.4 s.33
• /
• pp.471-482
• /
• 2006

In this paper, we propose a new scheme to generate multi-view images utilizing depth map decomposition and adaptive edge smoothing. After carrying out smooth filtering based on an adaptive window size to regions of edges in the depth map, we decompose the smoothed depth map into four types of images: regular mesh, object boundary, feature point, and number-of-layer images. Then, we generate 3-D scenes from the decomposed images using a 3-D mesh triangulation technique. Finally, we extract multi-view images from the reconstructed 3-D scenes by changing the position of a virtual camera in the 3-D space. Experimental results show that our scheme generates multi-view images successfully by minimizing a rubber-sheet problem using edge smoothing, and renders consecutive 3-D scenes in real time through information decomposition of depth maps. In addition, the proposed scheme can be used for 3-D applications that need the depth information, such as depth keying, since we can preserve the depth data unlike the previous unsymmetric filtering method.

• 한국HCI학회:학술대회논문집
• /
• 2008.02b
• /
• pp.158-164
• /
• 2008

This study was conducted for raising the considering the dynamical context of mobile phone use environment in the mobile-phone research. For this I identified the characteristic of the mobile phone use. The first characteristic is that the mobile phone is the context sensitive device. Also, it reflects the user's life pattern because it is the very personal device. I defined the context of mobile phone use with the basis on this identification of those characteristics. I referenced the definition, 'situational context', defining the mobile phone use context. Also, I set up the research scope within the user task that is influential from the situational context, I named this kind of task as the 'contextual task'. I developed the Contextual Task Model in this study. I named the model as the 'ESR Model'. The reason that I developed this contextual task model is that this model can help novice designers and designers unfamiliar with an application domain understand the user behavior and user centered design. And also this model can be effective to communicate each other, I identified the user's contextual tasks three kinds of model. First, the Extend Model includes user tasks that related to extending from user physical working space to the virtual level. Second model is Synchronize Model, which includes issues that lesson the blocking when use several functions at a time or sequentially. Third model is Replace Model, which is come from the characteristic of user life pattern to use the mobile phone. Finally, I proposed an application of this model, CIQ. Through the process to make CIQ I proved the effectiveness of this ESR Model.

• Spatial Information Research
• /
• v.18 no.1
• /
• pp.57-67
• /
• 2010

Recently, 2D GIS technology is applied for urban facility management. However, urban facilities are located in 3D space and the information loss is occurring during data abstraction from 3D urban facility to 2D object. Also, the number of urban facilities is increasing steadily and most of urban facilities are located in underground space in the city. Therefore 2D urban facility management system has a limitation on visualization and management for a large number of urban facilities. In this paper, a multi-dimensions urban facility management system based on multi-texture technology is proposed. The proposed system reduces the information loss and improves the readability of information by visualizing urban facilities on 3D virtual space. A multi-texturing technology is applied for integrating of 2D vector data and 3D raster data, and a multi-thread technology is used for improving speed and performance of the system. The proposed technology can be used as a guideline for urban facility monitoring as providing visual information of a facility status with 3D image and facility data.