• Title/Summary/Keyword: 실감 콘텐츠 생성

Search Result 59, Processing Time 0.023 seconds

Haptic Media Broadcasting (촉각방송)

  • Cha, Jong-Eun;Kim, Yeong-Mi;Seo, Yong-Won;Ryu, Je-Ha
    • Broadcasting and Media Magazine
    • /
    • v.11 no.4
    • /
    • pp.118-131
    • /
    • 2006
  • With rapid development in ultra fast communication and digital multimedia, the realistic broadcasting technology, that can stimulate five human senses beyond the conventional audio-visual service is emerging as a new generation broadcasting technology. In this paper, we introduce a haptic broadcasting system and related core system and component techniques by which we can 'touch and feel' objects in an audio-visual scene. The system is composed of haptic media acquisition and creation, contents authoring, in the haptic broadcasting, the haptic media can be 3-D geometry, dynamic properties, haptic surface properties, movement, tactile information to enable active touch and manipulation and passive movement following and tactile effects. In the proposed system, active haptic exploration and manipulation of a 3-D mesh, active haptic exploration of depth video, passive kinesthetic interaction, and passive tactile interaction can be provided as potential haptic interaction scenarios and a home shopping, a movie with tactile effects, and conducting education scenarios are produced to show the feasibility of the proposed system.

A Study on Immersive Media Technology in the Metaverse World

  • Lee, Kyoung-A
    • Journal of the Korea Society of Computer and Information
    • /
    • v.26 no.9
    • /
    • pp.73-79
    • /
    • 2021
  • As the importance of online virtual space grows due to Corona Pandemic, interest in virtual space utilization technology is increasing, causing a boom in the growth of the untact technology and related content industry, and accelerating the transition to Metaverse era, a new virtual convergence platform based on virtual and reality. This study analyzed ZEPETO, a Metaverse platform and found that it provides a creative space through Built-it and ZEPETO Studio, and offers items and contents with active economic activity. This is the result of an analysis centered on ZEPETO, so it varies depending on the Metaverse platform. We look to find key items to activate a Metaverse platform and how to make best use of virtual assets crated in Metaverse in reality through Metaverse related technologies.

Automatic Electronic Medical Record Generation System using Speech Recognition and Natural Language Processing Deep Learning (음성인식과 자연어 처리 딥러닝을 통한 전자의무기록자동 생성 시스템)

  • Hyeon-kon Son;Gi-hwan Ryu
    • The Journal of the Convergence on Culture Technology
    • /
    • v.9 no.3
    • /
    • pp.731-736
    • /
    • 2023
  • Recently, the medical field has been applying mandatory Electronic Medical Records (EMRs) and Electronic Health Records (EHRs) systems that computerize and manage medical records, and distributing them throughout the entire medical industry to utilize patients' past medical records for additional medical procedures. However, the conversations between medical professionals and patients that occur during general medical consultations and counseling sessions are not separately recorded or stored, so additional important patient information cannot be efficiently utilized. Therefore, we propose an electronic medical record system that uses speech recognition and natural language processing deep learning to store conversations between medical professionals and patients in text form, automatically extracts and summarizes important medical consultation information, and generates electronic medical records. The system acquires text information through the recognition process of medical professionals and patients' medical consultation content. The acquired text is then divided into multiple sentences, and the importance of multiple keywords included in the generated sentences is calculated. Based on the calculated importance, the system ranks multiple sentences and summarizes them to create the final electronic medical record data. The proposed system's performance is verified to be excellent through quantitative analysis.

Performance Analysis of 3D-HEVC Video Coding (3D-HEVC 비디오 부호화 성능 분석)

  • Park, Daemin;Choi, Haechul
    • Journal of Broadcast Engineering
    • /
    • v.19 no.5
    • /
    • pp.713-725
    • /
    • 2014
  • Multi-view and 3D video technologies for a next generation video service are widely studied. These technologies can make users feel realistic experience as supporting various views. Because acquisition and transmission of a large number of views require a high cost, main challenges for multi-view and 3D video include view synthesis, video coding, and depth coding. Recently, JCT-3V (joint collaborative team on 3D video coding extension development) has being developed a new standard for multi-view and 3D video. In this paper, major tools adopted in this standard are introduced and evaluated in terms of coding efficiency and complexity. This performance analysis would be helpful for the development of a fast 3D video encoder as well as a new 3D video coding algorithm.

3D Stereo Display of Spatial Data from Various Sensors (다양한 센서로부터 획득한 공간데이터의 3D 입체 디스플레이)

  • Park, So-Young;Yun, Seong-Goo;Lee, Young-Wook;Lee, Dong-Cheon
    • Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
    • /
    • v.28 no.6
    • /
    • pp.669-676
    • /
    • 2010
  • Visualization requires for effective analysis of the spatial data collected by various sensors. The best way to convey 3D digital spatial information which is modeling of the real world to the users, realistic 3D visualization and display technology. Since most of the display is based on 2D or 2.5D projection to the plane, there is limitation in representing real world in 3D space. In this paper, data from airborne LiDAR for topographic mapping, Flashi-LiDAR as emerging sensor with great potential to 3D data acquisition, and multibeam echo-sounder for underwater measurement, were stereoscopically visualized. 3D monitors are getting popular and could be information media and platform in geoinformatics. Therefore, study on creating 3D stereoscopic contents of spatial information is essential for new technology of stereo viewing systems.

Fast Stereoscopic 3D Broadcasting System using x264 and GPU (x264와 GPU를 이용한 고속 양안식 3차원 방송 시스템)

  • Choi, Jung-Ah;Shin, In-Yong;Ho, Yo-Sung
    • Journal of Broadcast Engineering
    • /
    • v.15 no.4
    • /
    • pp.540-546
    • /
    • 2010
  • Since the stereoscopic 3-dimensional (3D) video that provides users with a realistic multimedia service requires twice as much data as 2-dimensional (2D) video, it is difficult to construct the fast system. In this paper, we propose a fast stereoscopic 3D broadcasting system based on the depth information. Before the transmission, we encode the input 2D+depth video using x264, an open source H.264/AVC fast encoder to reduce the size of the data. At the receiver, we decode the transmitted bitstream in real time using a compute unified device architecture (CUDA) video decoder API on NVIDIA graphics processing unit (GPU). Then, we apply a fast view synthesis method that generates the virtual view using GPU. The proposed system can display the output video in both 2DTV and 3DTV. From the experiment, we verified that the proposed system can service the stereoscopic 3D contents in 24 frames per second at most.

Light-Weight Mobile VR Platform using HMD with 6 Axis (6 축센서를 갖는 HMD 경량 모바일 VR Platform)

  • Kang, Yunhee;Kang, JungJu
    • Journal of Platform Technology
    • /
    • v.6 no.2
    • /
    • pp.3-9
    • /
    • 2018
  • Recently VR environment is used in many areas including mobile learning, smart factory. However HMD(head-mounted display) is required to a dedicated and expensive system with high-end specification. When designing a VR system, it is needed to handle performance, mobility and usability. Many VR applications need to handle diverse sensors and user inputs continuously in a streaming manner. In this paper we design a VR mobile platform and implement a low-cost mobile VR HMD running on the platform. The VR HMD supports 3D contents delivery in a mobile manner. It is used to detect the motion detection based on angle value of a VR player from accelerator and gyro sensor. The MPU-6050, 6-axis sensor, is used to get a sensory value and the sensory value is taken as an input to a VR rendering server on a Unity game engine that is generated 3D images.

A Study on the Method of Creating Realistic Content in Audience-participating Performances using Artificial Intelligence Sentiment Analysis Technology (인공지능 감정분석 기술을 이용한 관객 참여형 공연에서의 실감형 콘텐츠 생성 방식에 관한 연구)

  • Kim, Jihee;Oh, Jinhee;Kim, Myeungjin;Lim, Yangkyu
    • Journal of Broadcast Engineering
    • /
    • v.26 no.5
    • /
    • pp.533-542
    • /
    • 2021
  • In this study, a process of re-creating Jindo Buk Chum, one of the traditional Korean arts, into digital art using various artificial intelligence technologies was proposed. The audience's emotional data, quantified through artificial intelligence language analysis technology, intervenes in various object forms in the projection mapping performance and affects the big story without changing it. If most interactive arts express communication between the performer and the video, this performance becomes a new type of responsive performance that allows the audience to directly communicate with the work, centering on artificial intelligence emotion analysis technology. This starts with 'Chuimsae', a performance that is common only in Korean traditional art, where the audience directly or indirectly intervenes and influences the performance. Based on the emotional information contained in the performer's 'prologue', it is combined with the audience's emotional information and converted into the form of images and particles used in the performance to indirectly participate and change the performance.

A Study on Realistic 360 Degree Panorama Webtoon-Metaverse Service

  • Lee, Byong-Kwon;Jung, Doo-Yong
    • Journal of the Korea Society of Computer and Information
    • /
    • v.27 no.10
    • /
    • pp.147-153
    • /
    • 2022
  • Most of the metaverse service is a gamification type of metaverse solution composed by placing 3D objects on a 360 panoramic world base. However, the metaverse webtoon service is lacking in implementation and research. In this study, a method for realizing a 2D flat image form in a 3D space and a realistic 360-degree panoramic webtoon metaverse service were studied. The research process consisted of basic storytelling and design work for webtoon production, panoramic image creation to convert the produced image into 360-degree form, and content creation process for viewing 360-degree directions. Finally, we implemented shading and material work with game engine tools so that you can enjoy virtual reality-based webtoons. The webtoon-based metaverse study studied the process of creating a 360-degree panoramic webtoon from content that can only be viewed in 2D format. Accordingly, it is thought that webtoons will also be presented as a standard for the production and implementation method for the metaverse service.