• Journal of Sensor Science and Technology
• /
• v.25 no.6
• /
• pp.388-393
• /
• 2016

MPEG-V(ISO/IEC 23005) standardizes normative sensory effects metadata and sensory devices command for adapting the sensory effects between the virtual world and the real world. MPEG-V(Virtual) standardization has been carried out by 3DG(Dimensional Graphics) ad-hoc group inside MPEG Working Group(ISO IEC JTC1/SC29/WG11). For the scent effect, one of the sensory effects within MPEG-V, we proposed an olfactory interaction model including electronic nose and scent display to the ad-hoc group. Recently, we proposed types and elements related to the electronic nose as a sensor defined in MPEG-V standard for olfactory interaction. At the 114th MPEG meeting, the types and elements were consequently reflected on MPEG-V CD(Committee Draft) 4th edition. In this paper, we implement an electronic nose system applicable to MPEG-V standard by using MPEG-V schema, encoder, and decoder in order to assess their adequacy.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2000.11b
• /
• pp.101-106
• /
• 2000

We propose a method of the efficient injection of the MPEG-4 data into MPEG-2 A/V stream. The proposed method is to transmit MPEG-4 data synchronized with MPEG-2 A/V stream using MPEG-2 Transport Stream Protocol so that the user can decode MPEG-4 data on time at the client side, after extracting IOD (Initia1 Object Descriptor), OD (Object Descriptor), BIFS (Binary Format for Scone) and media data from mp4 file.

• Journal of Broadcast Engineering
• /
• v.16 no.5
• /
• pp.714-721
• /
• 2011

MPEG audio uses the masking effect, high frequency component synthesis based on spectral band replication, and channel expansion based on parametric stereo for efficient compression of audio signals. In this paper, we present an overview of the state-of-the-art channel expansion technology in MPEG audio. We also present technical overviews and application examples to broadcasting services for HE-AAC v.2, MPEG Surround, spatial audio object coding (SAOC), and unified speech and audio coding (USAC) which are MPEG audio codecs based on the channel expansion technology.

• Journal of Broadcast Engineering
• /
• v.21 no.3
• /
• pp.330-340
• /
• 2016

This paper explains about the structure of multiple sensorial media application format (ISO/IEC 23000-17), which is newly standardized as a project of MPEG-A. This format facilitates effective storage, playing, and management of media with multiple sensorial effects. The ISO base media file format from MPEG-4 Part 12 and sensory effect metadata (SEM) from MPEG-V Part 3 are used to composed the multiple sensorial media application format. In this paper, a fragmentation method to break a SEM XML document into valid SEM samples is presented. Several binarization methods to compress the SEM samples are compared and evaluated as well. The compression ratio and processing time using the MPEG-V binary representation and the Binary MPEG format for XML (BiM) are superior to the gzip compression.

• Journal of Broadcast Engineering
• /
• v.24 no.4
• /
• pp.660-669
• /
• 2019

Recently, with the development of three-dimensional scanning devices and multi-dimensional array cameras, research is continuously conducted on techniques for handling three-dimensional data in application fields such as AR (Augmented Reality) / VR (Virtual Reality) and autonomous traveling. In particular, in the AR / VR field, content that expresses 3D video as point data has appeared, but this requires a larger amount of data than conventional 2D images. Therefore, in order to serve 3D point cloud content to users, various technological developments such as highly efficient encoding / decoding and storage, transfer, etc. are required. In this paper, V-PCC bit stream created using V-PCC encoder proposed in MPEG-I (MPEG-Immersive) V-PCC (Video based Point Cloud Compression) group, It is defined by the MPEG-DASH (Dynamic Adaptive Streaming over HTTP) standard, and provides to be composed of segments. Also, in order to provide the user with the information of the 3D coordinate system, the depth information parameter of the signaling message is additionally defined. Then, we design a verification platform to verify the technology proposed in this paper, and confirm it in terms of the algorithm of the proposed technology.

• Broadcasting and Media Magazine
• /
• v.14 no.2
• /
• pp.113-122
• /
• 2009

RoSE(representation of sensory effects)기술은 A/V미디어에서 제공하는 시청각 효과 이외에 바람/향기/진동 등의 실감효과를 팬/발향기/진동의자 등의 다양한 디바이스와 연동시킴으로써 미디어의 실감효과를 극대화하는 기술이다. 2007년 10월 82차 MPEG회의에 처음 제안된 RoSE프레임워크는 SE(sensory effects), USP(user sensory preferences), SDC(sensory device capabilities), SDCom(sensory device commands)의 표준아이템이 상호 연동하는 시스템 구조를 갖는다. 지난 2월 87차 MPEG로잔(Lausanne)미팅에서는 이들을 현실과 가상을 연결하는 인터페이스 표준을 정하는 MPEG-V(ISO/IEC 23005) 프로젝트의 Part 2(control information)와 Part 3(sensory information)으로 분리 배치하고 오는 7월 89차 런던 미팅에서 CD(committee drait)를 목표로 표준화를 진행하고 있다. 본 논문에서는 XML에 기반한 이들 4개의 표준 아이템 구성을 살펴보고 현재까지 MPEG 에서 진행되어 온 RoSE표준화 과정을 소개한다.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2020.07a
• /
• pp.510-512
• /
• 2020

In this paper, we reviewed the method on the codec-agnostic design of MPEG V-PCC. The codec-agnostic approach designed V-PCC can use any video codec for compression. Thus, adoption with other codecs beside HEVC has not been systematically discussed. Through the analysis of the design issues that related to MPEG EVC and JPEG. We provided a strategy on choosing and targeting different video codecs for V-PCC.

• Journal of Advanced Navigation Technology
• /
• v.21 no.6
• /
• pp.666-673
• /
• 2017

In this paper, we propose a 360 content pilot service platform of cultural assets based on MPEG-V standard realistic media testbed. MPEG-V is that the standard format of sensory effect metadata(SEM) such like wind, light and flash, and communication protocol between sensory effect machines are defined, and it is possible to increase the sense of presence and immersion with 360 VR content. The proposed platform consists of software which is composed of the content player and the sensory effect reappearance server, and hardware which is the sensory effect machines. Also, the pilot service case using the proposed platform, and the features and advantages of the proposed platform are described.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2021.06a
• /
• pp.154-156
• /
• 2021

최근 3차원 영상이 다양한 분야에서 활용되고 있으며, 이에 따라 3차원 영상에 대한 압축과 전송 방안에 대한 연구가 활발히 진행되고 있다. 국제 표준화 기구인 ISO/IEC 산하 Moving Picture Expert Group(MPEG)에서는 기존의 2차원 비디오 코덱을 이용하여 고밀도 포인트 클라우드 압축하는 방안인 V-PCC와 3DoF+ 영상을 압축하기 위한 방안인 MPEG Immersive Video(MIV)를 표준화 중에 있다. V-PCC와 MIV는 압축 방법의 유사성으로 인해 동일한 Volumetric Visual Video-based Coding(V3C) 형식으로 저장된다. 압축된 V3C 데이터를 효과적으로 저장하여 이용하기 위해서는 ISO based Media File Format(ISOBMFF) 캡슐화 과정이 필수적이다. 본 논문에서는 MPEG의 Carriage of V3C data 표준에 따라 V3C 데이터를 ISOBMFF로 캡슐화 실험을 진행하였으며, 실험에 대한 검증을 위하여 생성된 ISOBMFF 데이터를 V3C 데이터로 복원한 뒤, 디코딩 하여 확인하였다.

• Proceedings of the Korean Information Science Society Conference
• /
• 2000.10b
• /
• pp.260-262
• /
• 2000

MPEG-4에서는 다양한 객체를 취급하기 위하여 시스템 부분(Part1)이 차지하는 비중이 MPEG-1이나 MPEG-2에서 보다 훨씬 높아졌다. 이러한 MPEG-4의 시스템 부분을 구현한 참조 모델을 IM1이라고 한다. IM1에는 다양한 오디오/비디오(A/V) 객체를 수용하기 위하여 디코더 프레임워크를 마련하고, 어떤 A/V 객체든 이 프레임워크에 맞추어 디코더를 구현하면 IM1 프리젠터에서 플레이가 가능토록 하고 있다. 현재 IM1 버전 3.8에서는 H.263 비디오, G.723 오디오, JPEG 이미지, AAC 오디오를 지원하고 있다. 이 논문에서는 MPEG-4 비디오 디코더를 IM1 디코더 프레임워크를 맞추어 설계, 수정한 내용을 기술하였다.