• Title/Summary/Keyword: 실감

Search Result 947, Processing Time 0.036 seconds

Perceptual Video Coding using Deep Convolutional Neural Network based JND Model (심층 합성곱 신경망 기반 JND 모델을 이용한 인지 비디오 부호화)

  • Kim, Jongho;Lee, Dae Yeol;Cho, Seunghyun;Jeong, Seyoon;Choi, Jinsoo;Kim, Hui-Yong
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2018.06a
    • /
    • pp.213-216
    • /
    • 2018
  • 본 논문에서는 사람의 인지 시각 특성 중 하나인 JND(Just Noticeable Difference)를 이용한 인지 비디오 부호화 기법을 제안한다. JND 기반 인지 부호화 방법은 사람의 인지 시각 특성을 이용해 시각적으로 인지가 잘 되지 않는 인지 신호를 제거함으로 부호화 효율을 높이는 방법이다. 제안된 방법은 기존 수학적 모델 기반의 JND 기법이 아닌 최근 각광 받고 있는 데이터 중심(data-driven) 모델링 방법인 심층 신경망 기반 JND 모델 생성 기법을 제안한다. 제안된 심층 신경망 기반 JND 모델은 비디오 부호화 과정에서 입력 영상에 대한 전처리를 통해 입력 영상의 인지 중복(perceptual redundancy)를 제거하는 역할을 수행한다. 부호화 실험에서 제안된 방법은 동일하거나 유사한 인지화질을 유지한 상태에서 평균 16.86 %의 부호화 비트를 감소 시켰다.

  • PDF

An User Controllable Object Audio File Format and Audio Scene Description (사용자 기반 실감 객체 오디오 파일 포맷 및 오디오 장면 묘사 기법)

  • Cho, Choong-Sang;Kim, Je-Woo
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.47 no.5
    • /
    • pp.25-33
    • /
    • 2010
  • Multi-media service has been changed into user based audio services, which service supports actively user's preference and interaction with the users. In the market, multi-media products which can support the highest audio-quality by using lossless audio technology have been released and object audio music which user can select the objects has been serviced. In this paper, we design user's preference information based object audio file format and audio scene description for storage and transmission media. The designed file format is designed based on MPEG-4 file format because high-quality audio codecs in MPEG-4 audio can be easily used and the track of file format can be flexibly controlled depend on the number of the instrument in music. The encoded audio data of each objects and encoded audio scene description by binary encoding that has independent track are packed in a file. The scene description for storage media is consist of full and object scene description, the scene description for transmission media has an essential description for object audio operation and a specific description for real audio sound. The designed file format based simulator is developed and it generates an object audio file with several scene descriptions. Also, the real audio sound is serviced by the interaction with user and the unpacked scene description.

Perceptions of the Middle School Gifted-students and Pre-teachers About the Convergence Class Programs Using Realistic Contents (실감형 콘텐츠를 활용한 융합 수업 프로그램에 대한 중학교 영재 학생 및 예비 교사의 인식 조사)

  • Kim, Eun-Ji;Kim, Hyun-Kyung
    • Journal of the Korean Chemical Society
    • /
    • v.66 no.2
    • /
    • pp.96-106
    • /
    • 2022
  • The purpose of this study is to investigate the effect of science-centered convergence class program using realistic contents such as virtual reality and augmented reality on class satisfaction, scientific attitudes and the perception of the gifted students in middle school. After developing the convergence class program including realistic contents using smart devices, we applied it to the gifted students. We analyzed the class satisfaction, scientific attitude and perception of the gifted students through questionnaires. In addition, a survey was conducted on the pre-teachers to investigate and analyze the class satisfaction, scientific attitude of the science class program to students and the perception of science classes using realistic contents. As a result, both students and pre-teachers were positively aware of class satisfaction by science class program using realistic contents. In particular, it was positive in that the class can induce learning motivation and interest. On the other hand, it was pointed out that the low-quality App and lack of infra for smart devices were disadvantages. In addition, pre-teachers lack confidence and information about class using the realistic contents, but they recognize the need of classes using realistic contents for students and education for pre-teachers. Based on this, it obtained suggestions on the preparation of facilities and equipment in schools for future education, development of contents that can be used for convergence class, development of programs and teaching·learning materials using realistic contents, and education for pre-teachers.

Production of fusion-type realistic contents using 3D motion control technology (3D모션 컨트롤 기술을 이용한 융합형 실감 콘텐츠 제작)

  • Jeong, Sun-Ri;Chang, Seok-Joo
    • Journal of Convergence for Information Technology
    • /
    • v.9 no.4
    • /
    • pp.146-151
    • /
    • 2019
  • In this paper, we developed a multi-view video content based on real-world technology and a pilot using the production technology, and provided realistic contents production technology that can select a desired direction at a user 's view point by providing users with various viewpoint images. We also created multi-view video contents that can indirectly experience local cultural tourism resources and produced cyber tour contents based on multi-view video (realistic technology). This technology development can be used to create 3D interactive real-world contents that are used in all public education fields such as libraries, kindergartens, elementary schools, middle schools, elderly universities, housewives classrooms, lifelong education centers, The domestic VR market is still in it's infancy, and it's expected to develop in combination with the 3D market related to games and shopping malls. As the domestic educational trend and the demand for social public education system are growing, it is expected to increase gradually.

Unmanned Vehicle-based Realistic Content Training Course Design (무인이동체 기반 실감 콘텐츠 교육 과정 설계)

  • Jin, Young-Hoon;Lee, MyounJae
    • Journal of Internet of Things and Convergence
    • /
    • v.8 no.2
    • /
    • pp.49-54
    • /
    • 2022
  • Immersive contents is content that provides a realistic experience by maximizing the user's five senses, and includes virtual reality, augmented reality, and mixed reality. In order to provide a sense of reality to users in immersive content, it is necessary to provide realistic visual images, hearing, and touch. However, due to the rapid change in the environment for developing immersive content, experts in training human resources are having difficulties in designing the curriculum. In this study, we propose a series of educational courses that use drones to acquire and process real-world measurement data and apply the derived data to VR, AR, and MR to help experts in training immersive content develop talent. The design of training process composes through demand survey and analysis of companies, students, and local communities. This study can be a useful resource for education experts who want to train immersive contents manpower.

Case Study on Realistic Content Development Process of Public Enterprise - Focus on case of Korea Industrial Complex Corporation Gallery - (공기업의 실감콘텐츠 개발 프로세스 사례연구 - 한국산업단지공단 홍보관 사례를 중심으로-)

  • Chung, Hae Won;Cho, Woo Ri
    • The Journal of the Convergence on Culture Technology
    • /
    • v.10 no.2
    • /
    • pp.91-97
    • /
    • 2024
  • Recently, with the rapid development of digital media technology, Realistic content that stimulates users' five senses is being used in various fields. This study focused on the case of the development of the Korea Industrial Complex Corporation's public relations center as the subject of the study to study the realistic content development process of public enterprises. First, the realistic content development process was divided into 10 stages and practical guidelines were presented to help develop realistic content in the future by presenting important development points and methods at each stage. Second, among the realistic content development processes, the importance of storytelling was analyzed at the scenario stage. Third, various methods of displaying content were analyzed. In the case of the Korea Industrial Complex Corporation's public relations center, it was proposed in three ways: story video, experience video, and media wall. It is suggested that the role of branding, promotion, and PR can be performed in one public relations center through an effective development process.

Design and Implementation of Mobile Vision-based Augmented Galaga using Real Objects (실제 물체를 이용한 모바일 비전 기술 기반의 실감형 갤러그의 설계 및 구현)

  • Park, An-Jin;Yang, Jong-Yeol;Jung, Kee-Chul
    • Journal of Korea Game Society
    • /
    • v.8 no.2
    • /
    • pp.85-96
    • /
    • 2008
  • Recently, research on augmented games as a new game genre has attracted a lot of attention. An augmented game overlaps virtual objects in an augmented reality(AR) environment, allowing game players to interact with the AR environment through manipulating real and virtual objects. However, it is difficult to release existing augmented games to ordinary game players, as the games generally use very expensive and inconvenient 'backpack' systems: To solve this problem, several augmented games have been proposed using mobile devices equipped with cameras, but it can be only enjoyed at a previously-installed location, as a ‘color marker' or 'pattern marker’ is used to overlap the virtual object with the real environment. Accordingly, this paper introduces an augmented game, called augmented galaga based on traditional well-known galaga, executed on mobile devices to make game players experience the game without any economic burdens. Augmented galaga uses real object in real environments, and uses scale-invariant features(SIFT), and Euclidean distance to recognize the real objects. The virtural aliens are randomly appeared around the specific objects, several specific objects are used to improve the interest aspect, andgame players attack the virtual aliens by moving the mobile devices towards specific objects and clicking a button of mobile devices. As a result, we expect that augmented galaga provides an exciting experience without any economic burdens for players based on the game paradigm, where the user interacts with both the physical world captured by a mobile camera and the virtual aliens automatically generated by a mobile devices.

  • PDF

Evaluation of Teachers and Students on VR/AR Contents in the Science Digital Textbook: Focus on the Earth and Universe Area for the 8th Grade (과학 디지털 교과서 실감형 콘텐츠에 대한 교사와 학생의 평가 -중학교 2학년 지구와 우주 영역 콘텐츠를 중심으로-)

  • Hyun-Jung Cha;Seok-Hyun Ga;Hye-Gyoung Yoon
    • Journal of The Korean Association For Science Education
    • /
    • v.43 no.2
    • /
    • pp.59-72
    • /
    • 2023
  • This study analyzed a group interview with six earth science teachers and eight middle school students to find out the evaluations and criteria they use to evaluate VR/AR contents (two virtual reality content and two augmented reality contents) in middle school science digital textbook. The study found the VR/AR contents were evaluated on four criteria as follows: VR/AR media characteristics; technical operation; user interface; and teaching-learning design. The evaluations can be summarized by each criterion. First, regarding VR/AR media characteristics, interesting features of VR/AR contents were considered relatively advantageous compared to other media like videos. However, its shortage of visual presence and inconvenience of using markers were mentioned as shortcomings. Second, in the technical operation criteria, teachers and students found the following conditions as technically challenging: failing to properly operate on a particular OS; huge volumes of contents in the application; and frequent freezing when using the application. Third, poor intuitiveness and lack of flexibility were found as negative aspects in user interface. Fourth, regarding teaching-learning design, the teachers evaluated whether the VR/AR contents delivered scientifically accurate information; whether they incorporated class goals set by teachers; and whether they can help students' inquiry. It turned out teachers gave negative feedbacks on VR/AR contents. The students evaluated VR/AR contents by assessing whether they help them with learning science but concluded they did not regard them necessary in science learning at school. Based on the findings, this study discusses which development direction VR/AR contents should take to be useful in teaching and learning science.

Synthesis of Realistic Facial Expression using a Nonlinear Model for Skin Color Change (비선형 피부색 변화 모델을 이용한 실감적인 표정 합성)

  • Lee Jeong-Ho;Park Hyun;Moon Young-Shik
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2006.06a
    • /
    • pp.121-123
    • /
    • 2006
  • 얼굴의 표정은 얼굴의 구성요소 같은 기하학적 정보와 조명이나 주름 같은 세부적인 정보들로 표현된다. 얼굴 표정은 기하학적 변형만으로는 실감적인 표정을 생성하기 힘들기 때문에 기하학적 변형과 더불어 텍스쳐 같은 세부적인 정보도 함께 변형해야만 실감적인 표현을 할 수 있다. 표정비율이미지 (Expression Ratio Image)같은 얼굴 텍스처의 세부적인 정보를 변형하기 위한 기존 방법들은 조명에 따른 피부색의 변화를 정확히 표현할 수 없는 단점이 있다. 따라서 본 논문에서는 이러한 문제를 해결하기 위해 서로 다른 조명 조건에서도 실감적인 표정 텍스처 정보를 적용할 수 있는 비선형 피부색 모델 기반의 표정 합성 방법을 제안한다. 제안된 방법은 동적 외양 모델을 이용한 자동적인 얼굴 특징 추출과 와핑을 통한 표정 변형 단계, 비선형 피부색 변화 모델을 이용한 표정 생성 단계, Euclidean Distance Transform (EDT)에 의해 계산된 혼합 비율을 사용한 원본 얼굴 영상과 생성된 표정의 합성 등 총 3 단계로 구성된다. 실험결과는 제안된 방법이 다양한 조명조건에서도 자연스럽고 실감적인 표정을 표현한다는 것을 보인다.

  • PDF