• Title/Summary/Keyword: Markerless

Search Result 80, Processing Time 0.028 seconds

Comparative Analysis of Markerless Facial Recognition Technology for 3D Character's Facial Expression Animation -Focusing on the method of Faceware and Faceshift- (3D 캐릭터의 얼굴 표정 애니메이션 마커리스 표정 인식 기술 비교 분석 -페이스웨어와 페이스쉬프트 방식 중심으로-)

  • Kim, Hae-Yoon;Park, Dong-Joo;Lee, Tae-Gu
    • Cartoon and Animation Studies
    • /
    • s.37
    • /
    • pp.221-245
    • /
    • 2014
  • With the success of the world's first 3D computer animated film, "Toy Story" in 1995, industrial development of 3D computer animation gained considerable momentum. Consequently, various 3D animations for TV were produced; in addition, high quality 3D computer animation games became common. To save a large amount of 3D animation production time and cost, technological development has been conducted actively, in accordance with the expansion of industrial demand in this field. Further, compared with the traditional approach of producing animations through hand-drawings, the efficiency of producing 3D computer animations is infinitely greater. In this study, an experiment and a comparative analysis of markerless motion capture systems for facial expression animation has been conducted that aims to improve the efficiency of 3D computer animation production. Faceware system, which is a product of Image Metrics, provides sophisticated production tools despite the complexity of motion capture recognition and application process. Faceshift system, which is a product of same-named Faceshift, though relatively less sophisticated, provides applications for rapid real-time motion recognition. It is hoped that the results of the comparative analysis presented in this paper become baseline data for selecting the appropriate motion capture and key frame animation method for the most efficient production of facial expression animation in accordance with production time and cost, and the degree of sophistication and media in use, when creating animation.

Study on Establishment of Deoksugung Palace, Tourist Information Services using Augmented Reality(AR) Technology (증강현실(AR) 기술을 이용한 덕수궁 관광안내서비스 구축방안 연구)

  • Oh, Sung-hwan;Kim, Ki-duk
    • Korean Journal of Heritage: History & Science
    • /
    • v.46 no.2
    • /
    • pp.26-45
    • /
    • 2013
  • Sudden increase exceeding 30million in the number of smart phone users, and rising interest in the technology of augmented reality, is now trying to combine it with AR technology in other areas very much. The field of cultural heritage, which has been constructed by the Internet and 3D technology, is not unusual and this field is now rapidly changing thanks to the AR technology which can make users experience cultural heritage with high reality. The Palaces in Seoul, however, use fragmentary tools of information - lack of heritage commentators, leaflet, etc, even though the number of visitors is gradually increasing. Therefore, three-dimensional and comprehensive cultural heritage information service is needed with the guidance in the mobile era. This study utilizes the AR technology for building the Deoksugung Tourist Information Service Application(App.) applying the markerless-based recognition technology which is a more advanced tool than the location-based AR technology. This new AR technology can switch perceived real images such as the tablet of the King in the Palace of in the real world, patterns and pedestals into virtual world, which can reproduce the damaged cultural assets as 3D. This also composes photos of the past with the current buildings, which can increase people's interest and absorption of the contents, and helps them understand and be aware of Korean traditional culture and cultural heritage effectively. In addition, convergence between IT new technology, Augmented Reality(AR) and humanities through storytelling based implementation of cultural heritage in smart phone is attempted to demonstrate that there is strength in which augmented reality technique exerts infinite creativity based on actual reality world.

Cyberspace Coordinate Create for Augmented Reality (증강현실을 위한 가상 공간좌표 생성)

  • Ban, KyeongJin;Ryu, NamHoon;Kim, KyeongOk;Han, JeaJung;Kim, EungKon
    • Proceedings of the Korea Contents Association Conference
    • /
    • 2009.05a
    • /
    • pp.765-769
    • /
    • 2009
  • The Augmented Reality of existing for the interaction which the object and background is smooth used the data glove or marker. It is inconvenient to a use and it occurs the result of immersion feeling decrease. Immersion it will wind from Augmented Reality and the hazard which it strengthens the removal of the additional entry device which stands is necessary. It recognizes the space coordinates which is accurate even from the condition where the hazard marker which will reach does not attach in necessity. Immersion feeling improvement from Augmented Reality wearing the hazard additional entry device it proposes the space coordinate creation technique of the virtuality description below for a interaction without from the present paper. The method which is proposed the image which it acquires the object of virtuality reflected at 2D space and the characteristic line about under extracting the space coordinate which reflects about under calculating it reflected. The application is possible in markerless Augmented Reality and the mobile Augmented Reality.

  • PDF

A Study on the Analysis of Background Object Using Deep Learning in Augmented Reality Game (증강현실 게임에서 딥러닝을 활용한 배경객체 분석에 관한 연구)

  • Kim, Han-Ho;Lee, Dong-Lyeor
    • Journal of Convergence for Information Technology
    • /
    • v.11 no.11
    • /
    • pp.38-43
    • /
    • 2021
  • As the number of augmented reality games using augmented reality technology increases, the demands of users are also increasing. Game technologies used in augmented reality games are mainly games using MARKER, MARKERLESS, GPS, etc. Games using this technology can augment the background and other objects. To solve this problem, we want to help develop augmented reality games by analyzing objects in the background, which is an important element of augmented reality. To analyze the background in the augmented reality game, the background object was analyzed by applying a deep learning model using TensorFlow Lite in the UNITY engine. Using this result, we obtained the result that augmented objects can be placed in the game according to the types of objects analyzed in the background. By utilizing this research, it will be possible to develop advanced augmented reality games by augmenting objects that fit the background.

Markerless camera pose estimation framework utilizing construction material with standardized specification

  • Harim Kim;Heejae Ahn;Sebeen Yoon;Taehoon Kim;Thomas H.-K. Kang;Young K. Ju;Minju Kim;Hunhee Cho
    • Computers and Concrete
    • /
    • v.33 no.5
    • /
    • pp.535-544
    • /
    • 2024
  • In the rapidly advancing landscape of computer vision (CV) technology, there is a burgeoning interest in its integration with the construction industry. Camera calibration is the process of deriving intrinsic and extrinsic parameters that affect when the coordinates of the 3D real world are projected onto the 2D plane, where the intrinsic parameters are internal factors of the camera, and extrinsic parameters are external factors such as the position and rotation of the camera. Camera pose estimation or extrinsic calibration, which estimates extrinsic parameters, is essential information for CV application at construction since it can be used for indoor navigation of construction robots and field monitoring by restoring depth information. Traditionally, camera pose estimation methods for cameras relied on target objects such as markers or patterns. However, these methods, which are marker- or pattern-based, are often time-consuming due to the requirement of installing a target object for estimation. As a solution to this challenge, this study introduces a novel framework that facilitates camera pose estimation using standardized materials found commonly in construction sites, such as concrete forms. The proposed framework obtains 3D real-world coordinates by referring to construction materials with certain specifications, extracts the 2D coordinates of the corresponding image plane through keypoint detection, and derives the camera's coordinate through the perspective-n-point (PnP) method which derives the extrinsic parameters by matching 3D and 2D coordinate pairs. This framework presents a substantial advancement as it streamlines the extrinsic calibration process, thereby potentially enhancing the efficiency of CV technology application and data collection at construction sites. This approach holds promise for expediting and optimizing various construction-related tasks by automating and simplifying the calibration procedure.

Moible GPU based Speed-up Method for Augmented Reality Object Recognition System (모바일 GPU 기반 증강현실 객체 인식 고속화)

  • Baek, A-Ram;Lee, Kang-Woon;Choi, Hae-Chul
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2013.06a
    • /
    • pp.389-390
    • /
    • 2013
  • 모바일에서의 증강현실(Augmented Reality :AR) 어플리케이션은 디바이스의 구조상 많은 제약사항이 있기 때문에 데스크탑 환경에 비교하여 접근성이 낮다. 이러한 문제점을 해결하기 위해 다양한 방법의 연구가 진행되고 있다. 본 논문에서는 모바일 기기의 처리량을 줄이기 위해 프로그래밍 가능한 GPU(Graphic Processing Unit)를 이용, 영상처리 알고리즘을 병렬로 처리하고 고속화하여 모바일 AR 어플리케이션의 접근성을 높이는 비마커(Markerless)기반 객체 인식 시스템을 구현한다.

  • PDF

Mobile Augmented Reality Technique Development and prospect (모바일 증강현실 기술 발전과 전망)

  • Joo, Heon-Sik
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2012.01a
    • /
    • pp.213-215
    • /
    • 2012
  • 본 논문에서는 모바일 휴대 장치의 증가에 따른 증강현실 기술 적용과 발전 전망을 나타내었다. 증강현실 기술 발전에 따른 대안을 몇 가지 나타내었다. 첫째는 모바일 증강현실 서비스 응용 개발 및 사용에 따른 국내외 소프트웨어 구조 기술 표준이 제정되어야 하며, 둘째는 중앙처리장치, 기억장치 및 해상도 등 H/W에 따른 이식성에 제한을 받지 않는 강건한 추적 기술이 개발되어야 하며, 셋째는 마커를 사용하지 않는 경우에 추적 속도와 정확도의 정보가 이루어지는 강건한 Markerless 2D, 3D 추적 기술이 개발되어야함을 나타내었다. 이밖에 증강현실 화상 처리를 위한 전용 DSP 또는 GPU의 성능 향상과 증강현실 특화에 따른 사용자 상호 작용 기술에 대한 연구 및 개발이 필요 됨을 나타내었다.

  • PDF

Jitter Correction of the Face Motion Capture Data for 3D Animation

  • Lee, Junsang;Han, Soowhan;Lee, Imgeun
    • Journal of the Korea Society of Computer and Information
    • /
    • v.20 no.9
    • /
    • pp.39-45
    • /
    • 2015
  • Along with the advance of digital technology, various methods are adopted for capturing the 3D animating data. Especially, in 3D animation production market, the motion capture system is widely used to make films, games, and animation contents. The technique quickly tracks the movements of the actor and translate the data to use as animating character's motion. Thus the animation characters are able to mimic the natural motion and gesture, even face expression. However, the conventional motion capture system needs tricky conditions, such as space, light, number of camera etc. Furthermore the data acquired from the motion capture system is frequently corrupted by noise, drift and surrounding environment. In this paper, we introduce the post production techniques to stabilizing the jitters of motion capture data from the low cost handy system based on Kinect.

Design of Image Tracking System for Marker Diversity in Argumented Reality (증강현실 마커 다양성을 위한 영상 트래킹 시스템 설계)

  • Song, Jae-Gu;Jung, Sung-Mo;Lim, Ji-Hoon;Kim, Seok-Soo
    • Proceedings of the KAIS Fall Conference
    • /
    • 2010.05a
    • /
    • pp.225-227
    • /
    • 2010
  • 최근 증강현실(Augmented Reality, AR) 기술의 중요성이 인식되면서 다양한 분야의 서비스에 기술 도입사례가 등장하고 있다. AR에 있어 마커 검출 기술은 가장 기본이 되는 중요한 기술이다. 하지만 마커 기반의 증강현실 시스템은 그 오차가 매우 크고 이로 인해 센서정보와 같은 다양한 보조적 정보를 요구하게 된다. 따라서 본 연구에서는 마커사용의 한계를 극복하기 위한 마커리스 트래킹(Markerless Tracking Technology)기술을 연구 하여 실시간 영상에서 목표로 하는 사물을 추적하여 증강현실 서비스로 도입하기 위한 시스템은 설계하였다. 본 시스템은 기존에 도입된 명함 분석, 자동차 번호판 인식 등 제한된 서비스의 한계를 극복하고 보다 다양한 연구 분야에 활용될 것이다.

  • PDF

Markerless Augmentation of Virtual Object Using Bare-Hand (손동작을 이용한 가상 물체 증강)

  • Kim, Il-Moek;Jung, Kyung-Boo;Choi, Byung-Uk
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2010.06b
    • /
    • pp.212-215
    • /
    • 2010
  • 본 논문은 카메라 영상을 통해 사용자의 손동작을 인식하여 가상의 물체를 증강시키는 인터페이스를 제안한다. 사용자는 영상의 일부를 원형으로 그려주는 특정한 손동작을 취하여 영역을 선택하고 시스템은 이를 인식하여 물체를 증강 시킨다. 손동작을 인식하기 위하여 먼저 손 외곽선을 찾아낸 후, 찾아낸 외곽선의 곡률을 계산하여 손가락의 위치를 알아낸다. 알아낸 손가락의 상대적인 위치와 개수를 이용하여 손동작을 구분한다. 또한 적은 연산량으로도 안정적으로 물체를 증강 시킬 수 있도록 이전 프레임에서 자세추정에 사용된 특징점들을 이용하여 현재 프레임에서 필요한 인라이어를 찾아 낼 수 있는 방법을 제시한다.

  • PDF