• KIPS Transactions on Software and Data Engineering
• /
• v.9 no.3
• /
• pp.109-122
• /
• 2020

In recent, projection mapping, which has attracted high attention in the field of realistic media, is regarded as a technology to increase the users' immersion. However, most existing methods perform projection mapping on static objects. In this paper, we developed a technology to track the movements of users and dynamically map the media contents to the users' bodies. The projected media content is built by predefined gestures just using the user's bare hands without the special devices. An interactive immersive media system has been implemented by integrating these dynamic projection mapping technologies and gesture-based drawing technologies. The proposed realistic media system recognizes the movements and open / closed states of the user 's hands, selects the functions necessary to draw a picture. The users can freely draw the picture by changing the color of the brush using the colors of any real objects. In addition, the user's drawing is dynamically projected on the user's body, allowing the user to design and wear his t-shirt in real-time.

• Annual Conference of KIPS
• /
• 2020.05a
• /
• pp.633-634
• /
• 2020

본 논문에서는 미디어영상을 기반한 무대 공연의 다양한 미디어 효과를 분석하고, 무대 공연을 위한 제스처 기반 동적 프로젝션 맵핑 프레임워크를 설계 구현한다. 이를 위하여, 동적 프로젝션 맵핑 기반 기존 공연에서 공연자의 제스처와 이에 따른 미디어 효과를 분석하고, 동적 프로젝션 맵핑기술을 효율적으로 구현하기 위하여 모션 히스토리 이미지를 이용한 CNN(Convolutional Neural Network) 기반의 제스처 인식 기술을 구현한다. 또한, 구현된 제스처인식 기술을 기반으로 공연자의 서로 다른 제스처와 미디어 효과를 매칭시킬 수 있는 프레임 워크 구현 내용을 소개한다.

• Proceedings of the Korea Multimedia Society Conference
• /
• 2012.05a
• /
• pp.292-295
• /
• 2012

본 연구는 촬영을 통해 얻어진 투사면을 이용하여 투사면과 프로젝터 사이의 거리를 측정하고, 이미지 내에서 투사면이 가질 수 있는 영상의 원근 왜곡을 보정하는 프로젝션 맵핑에 대한 영상처리 기술을 제안한다. 그리하여, 결과적으로 프로젝터의 초기 설치에 소요되는 시간을 줄이고 변화된 투사면에 적합하게 프로젝션 맵핑이 이뤄짐에 따라 프로젝션 맵핑의 완성도를 높이고자 한다.

• Annual Conference of KIPS
• /
• 2016.10a
• /
• pp.719-721
• /
• 2016

본 논문에서는 프로젝션 맵팽 시에 요구되는 다양한 장비와 기술에 대한 학습시간을 최소화하여 초보자도 빠른 시간 안에 정교하면서도 다양한 연출이 가능한 맵핑 작업을 할 수 있도록 프로젝션 맵핑 프레임워크를 제안하였으며, 역동적인 연출을 위해서 여러 개의 비디오 클립을 동적으로 디스플레이하는 형태를 보다 쉽게 정의하고 수행할 수 있도록 하는 프레임워크를 설계하였다. 제안 프레임워크에서 구성 파일의 몇 가지 속성값을 간단히 변경하는 것만으로 다중 비디오 클립을 이용한 다양한 형태의 동적 디스플레이를 모드를 연출 할 수 있었다.

• Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology
• /
• v.7 no.6
• /
• pp.897-906
• /
• 2017

Projection Mapping, also known as Spatial Augmented Reality(SAR) has attracted much attention recently and used for many division, which can augment physical objects with projected various virtual replications. However, conventional approaches towards projection mapping have faced some limitations. Target objects' geometric transformation property does not considered, and movements of flexible objects-like paper are hard to handle, such as folding and bending as natural interaction. Also, precise registration and tracking has been a cumbersome process in the past. While there have been many researches on Projection Mapping on static objects, dynamic projection mapping that can keep tracking of a moving flexible target and aligning the projection at interactive level is still a challenge. Therefore, this paper propose a new method using Unity3D and ARToolkit for high-speed robust tracking and dynamic projection mapping onto non-rigid deforming objects rapidly and interactively. The method consists of four stages, forming cubic bezier surface, process of rendering transformation values, multiple marker recognition and tracking, and webcam real time-lapse imaging. Users can fold, curve, bend and twist to make interaction. This method can achieve three high-quality results. First, the system can detect the strong deformation of objects. Second, it reduces the occlusion error which reduces the misalignment between the target object and the projected video. Lastly, the accuracy and the robustness of this method can make result values to be projected exactly onto the target object in real-time with high-speed and precise transformation tracking.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2018.06a
• /
• pp.105-106
• /
• 2018

본 논문에서는 동적 프로젝션 맵핑을 구현하기 위하여 3차원 공간의 깊이 정보와 대상 객체의 색상영상에서의 특징점을 추출하여 3차원 공간상에서 움직이는 2차원 평면 객체의 자세를 안정적으로 추정하는 기법을 제안한다. 제안 기법은 타겟 이미지를 출력하여 타겟 이미지 보다 큰 평면 패널에 부착하고, 이 평면 패널을 3차원 공간상에서 움직이는 환경에서 타겟 이미지의 자세를 안정적으로 추정하기 위하여 고안되었다. 제안 기법에서는 우선 패널이 움직일 수 있는 깊이 영역을 지정하여 해당 깊이 영역에 존재하는 2차원 패널을 추출하고, 패널의 사각영역을 추출한다. 또한, 색상 영상에 SURF 알고리즘을 적용하여 2차원 평면상에 부착된 타겟 이미지의 영역을 색상 특징을 기반으로 함께 추출하여 패널의 사각 영역과 타겟 이미지의 상대적인 위치 정보를 추출한다. 셋업 단계에서 추출된 타겟 이미지의 상대적인 위치 정보를 이용하여, 조명의 변화에 의하여 순간적으로 타겟 이미지의 특징점 추적에 실패한 경우, 패널의 사각 영역에 의해 계산된 타겟 이미지의 상대적 위치 정보를 계산하여 자세 추정에 사용함으로써 움직이는 타겟 이미지의 3차원 자세를 안정적으로 추정할 수 있도록 하였다.

• Journal of Internet of Things and Convergence
• /
• v.10 no.2
• /
• pp.85-91
• /
• 2024

In this paper, we studied projection mapping, which is being utilized as a digital canvas beyond space and time for theme parks, mega events, and exhibition performances. Since the existing projection technology used for fixed objects has the limitation that it is difficult to map moving objects in terms of utilization, it is urgent to develop a technology that can track and map moving objects and a real-time dynamic projection mapping system based on dynamically moving objects so that it can respond to various markets such as performances, exhibitions, and theme parks. In this paper, we propose a system that can track real-time objects in real time and eliminate the delay phenomenon by developing hardware and performing high-speed image processing. Specifically, we develop a real-time object image analysis and projection focusing control unit, an integrated operating system for a real-time object tracking system, and an image processing library for projection mapping. This research is expected to have a wide range of applications in the technology-intensive industry that utilizes real-time vision machine-based detection technology, as well as in the industry where cutting-edge science and technology are converged and produced.

• Journal of the Korea Computer Graphics Society
• /
• v.23 no.3
• /
• pp.115-122
• /
• 2017

As the era of the fourth industrial revolution began, augmented reality showed infinite possibilities throughout society. However, current augmented reality systems such as head-mount display and hand-held display systems suffer from various problems such as weariness and nausea, and thus space-augmented reality, which is a projector-based augmented reality technology, is attracting attention. Spacial augmented reality requires precise tracking of dynamic objects to project virtual images in order to increase realism of augmented reality and induce user 's immersion. The infrared sensor-based precision tracking algorithm developed in this paper demonstrates very robust tracking performance with an average error rate of less than 1.5% and technically opens the way towards advanced augmented reality technologies such as tracking for arbitrary objects, and Socially, by easy-to-use tracking algorithms for non-specialists, it allows designers, students, and children to easily create and enjoy their own augmented reality content.

• Journal of Broadcast Engineering
• /
• v.25 no.4
• /
• pp.545-559
• /
• 2020

In this paper, we propose a content creation framework that enables users without programming experience to easily create interactive media content that responds to user gestures. In the proposed framework, users define the gestures they use and the media effects that respond to them by numbers, and link them in a text-based configuration file. In the proposed framework, the interactive media content that responds to the user's gesture is linked with the dynamic projection mapping module to track the user's location and project the media effects onto the user. To reduce the processing speed and memory burden of the gesture recognition, the user's movement is expressed as a gray scale motion history image. We designed a convolutional neural network model for gesture recognition using motion history images as input data. The number of network layers and hyperparameters of the convolutional neural network model were determined through experiments that recognize five gestures, and applied to the proposed framework. In the gesture recognition experiment, we obtained a recognition accuracy of 97.96% and a processing speed of 12.04 FPS. In the experiment connected with the three media effects, we confirmed that the intended media effect was appropriately displayed in real-time according to the user's gesture.