• Title/Summary/Keyword: 3-D Warping

Search Result 99, Processing Time 0.024 seconds

Korean Digit Recognition Under Noise Environment Using Spectral Mapping Training (스펙트럼사상학습을 이용한 잡음환경에서의 한국어숫자음인식)

  • Lee, Ki-Young
    • The Journal of the Acoustical Society of Korea
    • /
    • v.13 no.3
    • /
    • pp.25-32
    • /
    • 1994
  • This paper presents the Korean digit recognition method under noise environment using the spectral mapping training based on static supervised adaptation algorithm. In the presented recognition method, as a result of spectral mapping from one space of noisy speech spectrum to another space of speech spectrum without noise, spectral distortion of noisy speech is improved, and the recognition rate is higher than that of the conventional method using VQ (vector quatization) and DTW(dynamic time warping) without noise processing, and even when SNR level is 0dB, the recognition rate is 10 times of that using the conventional method. It has been confirmed that the spectral mapping training has an ability to improve the recognition performance for speech in noise environment.

  • PDF

Implementing 3DoF+ 360 Video Compression System for Immersive Media (실감형 미디어를 위한 3DoF+ 360 비디오 압축 시스템 구현)

  • Jeong, Jong-Beom;Lee, Soonbin;Jang, Dongmin;Lee, Sangsoon;Ryu, Eun-Seok
    • Journal of Broadcast Engineering
    • /
    • v.24 no.5
    • /
    • pp.743-754
    • /
    • 2019
  • System for three degrees of freedom plus (3DoF+) and 6DoF requires multi-view high resolution 360 video transmission to provide user viewport adaptive 360 video streaming. In this paper, we implement 3DoF+ 360 video compression system which removes the redundancy between multi-view videos and merges the residual into one video to provide high quality 360 video corresponding to an user's head movement efficiently. Implementations about 3D warping based redundancy removal method between 3DoF+ 360 videos and residual extraction and merger are explained in this paper. With the proposed system, 20.14% of BD-rate reduction in maximum is shown compared to traditional high-efficiency video coding (HEVC) based system.

A Study on the VR Payment System using Hand Gesture Recognition (손 제스쳐 인식을 활용한 VR 결제 시스템 연구)

  • Kim, Kyoung Hwan;Lee, Won Hyung
    • Journal of the Korean Society for Computer Game
    • /
    • v.31 no.4
    • /
    • pp.129-135
    • /
    • 2018
  • Electronic signatures, QR codes, and bar codes are used in payment systems used in real life. Research has begun on the payment system implemented in the VR environment. This paper proposes a VR electronic sign system that uses hand gesture recognition to implement an existing payment system in a VR environment. In a VR system, you can not hit the keyboard or touch the mouse. There can be several ways to configure a payment system with a VR controller. Electronic signage using hand gesture recognition is one of them, and hand gesture recognition can be classified by the Warping Methods, Statistical Methods, and Template Matching methods. In this paper, the payment system was configured in VR using the $p algorithm belonging to the Template Matching method. To create a VR environment, we implemented a paypal system where actual payment is made using Unity3D and Vive equipment.

Foreground Segmentation and High-Resolution Depth Map Generation Using a Time-of-Flight Depth Camera (깊이 카메라를 이용한 객체 분리 및 고해상도 깊이 맵 생성 방법)

  • Kang, Yun-Suk;Ho, Yo-Sung
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.37C no.9
    • /
    • pp.751-756
    • /
    • 2012
  • In this paper, we propose a foreground extraction and depth map generation method using a time-of-flight (TOF) depth camera. Although, the TOF depth camera captures the scene's depth information in real-time, it has a built-in noise and distortion. Therefore, we perform several preprocessing steps such as image enhancement, segmentation, and 3D warping, and then use the TOF depth data to generate the depth-discontinuity regions. Then, we extract the foreground object and generate the depth map as of the color image. The experimental results show that the proposed method efficiently generates the depth map even for the object boundary and textureless regions.

H.264 Encoding Technique of Multi-view Video expressed by Layered Depth Image (계층적 깊이 영상으로 표현된 다시점 비디오에 대한 H.264 부호화 기술)

  • Shin, Jong-Hong;Jee, Inn-Ho
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.14 no.2
    • /
    • pp.43-51
    • /
    • 2014
  • Multi-view video including depth image is necessary to develop a new compression encoding technique for storage and transmission, because of a huge amount of data. Layered depth image is an efficient representation method of multi-view video data. This method makes a data structure that is synthesis of multi-view color and depth image. This efficient method to compress new contents is suggested to use layered depth image representation and to apply for video compression encoding by using 3D warping. This paper proposed enhanced compression method using layered depth image representation and H.264/AVC video coding technology. In experimental results, we confirmed high compression performance and good quality of reconstructed image.

Generation of ROI Enhanced High-resolution Depth Maps in Hybrid Camera System (복합형 카메라 시스템에서 관심영역이 향상된 고해상도 깊이맵 생성 방법)

  • Kim, Sung-Yeol;Ho, Yo-Sung
    • Journal of Broadcast Engineering
    • /
    • v.13 no.5
    • /
    • pp.596-601
    • /
    • 2008
  • In this paper, we propose a new scheme to generate region-of-interest (ROI) enhanced depth maps in the hybrid camera system, which is composed of a low-resolution depth camera and a high-resolution stereoscopic camera. The proposed method creates an ROI depth map for the left image by carrying out a three-dimensional (3-D) warping operation onto the depth information obtained from the depth camera. Then, we generate a background depth map for the left image by applying a stereo matching algorithm onto the left and right images captured by the stereoscopic camera. Finally, we merge the ROI map with the background one to create the final depth map. The proposed method provides higher quality depth information on ROI than the previous methods.

A study on Recognition of Inpatient Room Acoustic Pattern for Hospital safety (병원안전을 위한 입원실 음향패턴 인식 관한 연구)

  • Ryu, Han-Sul;Ahn, Jong-Young
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.21 no.3
    • /
    • pp.169-173
    • /
    • 2021
  • Currently, safety accidents in hospitals are steadily occurring. In particular, safety accidents of elderly patients with weak immunity, such as nursing hospitals, continue to occur, and countermeasures are needed. Most accidents are caused by patient movement. As a method of reducing safety accidents by analyzing and recognizing the sound of the inpatient room according to the movement of the patient, this paper classifies the sound pattern for sound recognition in the hospital inpatient room using DTW (Dynamic Time Warping), an algorithm applicable to time-series pattern recognition. It was analyzed by applying it to the inpatient room environment.

3D Spatial Info Development using Layered Depth Images (계층적 깊이 영상을 활용한 3차원 공간정보 구현)

  • Song, Sang-Hun;Jo, Myung-Hee
    • Proceedings of the KSRS Conference
    • /
    • 2007.03a
    • /
    • pp.97-102
    • /
    • 2007
  • 3차원 공간정보는 2차원에 비해 공간적 현실감이 뛰어나기 때문에 최근 경관분석,도시 계획 및 웹(Web) 을 통한 지도 서비스 분야 등에서 이에 대한 관심이 증가하고 있으나,3차원 공간 정보의 기하학적 특성상 기존의 2차원 공간정보에 비해 데이터 량이 방대해 지고 있으며 이를 활용한 또 다른 콘텐츠 제작과 빠르고 효율적인 처리에 많은 문제점을 가지고 있다. 본 논문에서는 이러한 문제점을 해결하기 위한 방법으로 위성 및 항공으로부터 획득한 DEM(Digital Elevation Model)을 이용하여 생성된 3차 원의 지형정보와 도시 모델링 및 텍스처 맵핑 과정을 통해 획득한 정보를 기반으로 하여 각각의 위치에 카메라를 설정하고, 설정된 카메라 위치를 기반으로 Camera Matrix를 구한다. 이렇게 획득한 카메라의 정보엔 깊이 정보를 포함하고 있는데,깊이 정보를 기반으로 하여 3차원의 워핑(Warping)작업을 통해 계층적 핍이 영상(LDI)를 생성하고,생성된 계층적 깊이 영상을 이용하여 3차원의 공간정보를 구현한다.

  • PDF

Gesture interface with 3D accelerometer for mobile users (모바일 사용자를 위한 3 차원 가속도기반 제스처 인터페이스)

  • Choe, Bong-Whan;Hong, Jin-Hyuk;Cho, Sung-Bae
    • 한국HCI학회:학술대회논문집
    • /
    • 2009.02a
    • /
    • pp.378-383
    • /
    • 2009
  • In these days, many systems are equipped with people to infer their intention and provide the corresponding service. People always carry their own mobile device with various sensors, and the accelerator takes a role in this environment. The accelerator collects motion information, which is useful for the development of gesture-based user interfaces. Generally, it needs to develop an effective method for the mobile environment that supports relatively less computational capability since huge computation is required to recognize time-series patterns such as gestures. In this paper, we propose a 2-stage motion recognizer composed of low-level and high-level motions based on the motion library. The low-level motion recognizer uses the dynamic time warping with 3D acceleration data, and the high-level motion is defined linguistically with the low-level motions.

  • PDF

Analytical Simulation of the Seismic Response of a High-Rise RC Building Model (고층 철근콘크리트 건축구조모델의 지진응답에 대한 해석적 모사)

  • Lee, Han-Seon;Lee, Jeong-Jae;Jung, Dong-Wook
    • Journal of the Earthquake Engineering Society of Korea
    • /
    • v.12 no.5
    • /
    • pp.1-10
    • /
    • 2008
  • A series of shaking table tests were conducted on a 1:12 scale model using scaled Taft N21E earthquake records to investigate the seismic performance of a 17-story high-rise reinforced concrete building structure with a high degree of torsional eccentricity and soft-story irregularities in the bottom two stories. The main characteristics of the behaviors were: (1) a sudden change of the predominant vibration mode from the mode of translation and torsion to the torsional mode after the flexible side underwent a substantial inelastic deformation; (2) an abrupt increase in the torsional stiffness during this change of modes; (3) a warping behavior of the wall in the torsional mode; and (4) a unilateral overturning moment in the transverse direction to the table excitations. In this study, efforts were made to simulate the above characteristics using a nonlinear analysis program, Perform3D. The advantages and limitations are presented with the nonlinear models available in this software, as they are related to the correlation between analysis and test results.