• Journal of the Korea Society of Computer and Information
• /
• v.29 no.6
• /
• pp.31-38
• /
• 2024

This study proposes a novel approach to enhancing the social inclusion and participation of individuals with developmental disabilities. Utilizing cutting-edge virtual reality (VR) technology, we designed and developed a metaverse simulator that enables individuals with developmental disabilities to safely and conveniently experience indoor handicapped handball sports. This simulator provides an environment where individuals with disabilities can experience and practice handball matches. For the modeling and animation of handball players, we employed advanced modeling and motion capture technologies to accurately replicate the movements required in handball matches. Additionally, we ported various training programs, including basic drills, penalty throws, and target games, onto XR (Extended Reality) devices. Through this research, we have explored the development of immersive assistive tools that enable individuals with developmental disabilities to more easily participate in activities that may be challenging in real-life scenarios. This is anticipated to broaden the scope of social participation for individuals with developmental disabilities and enhance their overall quality of life.

• International Journal of Internet, Broadcasting and Communication
• /
• v.16 no.1
• /
• pp.106-123
• /
• 2024

This article takes the talk show "Beast Town" as an example to introduce the overall technical solution, technical difficulties and countermeasures for the combination of cartoon virtual characters and virtual studio technology, providing reference and experience for the multi-scenario application of digital humans. Compared with the live broadcast that combines reality and reality, we have further upgraded our virtual production technology and digital human-driven technology, adopted industry-leading real-time virtual production technology and monocular camera driving technology, and launched a virtual cartoon character talk show - "Beast Town" to achieve real Perfectly combined with virtuality, it further enhances program immersion and audio-visual experience, and expands infinite boundaries for virtual manufacturing. In the talk show, motion capture shooting technology is used for final picture synthesis. The virtual scene needs to present dynamic effects, and at the same time realize the driving of the digital human and the movement with the push, pull and pan of the overall picture. This puts forward very high requirements for multi-party data synchronization, real-time driving of digital people, and synthetic picture rendering. We focus on issues such as virtual and real data docking and monocular camera motion capture effects. We combine camera outward tracking, multi-scene picture perspective, multi-machine rendering and other solutions to effectively solve picture linkage and rendering quality problems in a deeply immersive space environment. , presenting users with visual effects of linkage between digital people and live guests.

• Journal of Information Technology Applications and Management
• /
• v.30 no.1
• /
• pp.21-32
• /
• 2023

This study presents a way to design picture books that allow children to experience indirectly through realistic media at home and educational institutions for children whose direct experiences and activities are reduced offline in the post-COVID-19 era. The development and popularization of realistic media such as AR continues to be grafted and developed in the picture book field, and the advantage of this picture book is that children at the stage before learning letters can feel the story and character situation of the book through the experience of AR and QR animation in the picture book. In this process, you can get access to imaginary areas that can not be experienced in flat-panel illustrations with spatial animation to help improve the scalability and literacy of the story contained on the page. Children's education through realistic animation can increase the learning effect and needs to continue after COVID-19. Therefore, by presenting the process of viewing and experiencing picture books using AR and QR, the result of the study suggests that the design process of realistic picture books is not just a combination of technology, but a process of expanding children's perception and imagination. This study aims to find out how visual perception is designed differently by analyzing the differences and characteristics of each animation design, focusing on the AR and QR picture book "Where am I?" published by the researcher, and to contribute to the active introduction and development of realistic animation in the field of children's picture books and education.

• Journal of the Korean Society of Clothing and Textiles
• /
• v.42 no.5
• /
• pp.823-838
• /
• 2018

The article surveys the technique and characteristics of contemporary fashion exhibitions in terms of fashion museography and fashion curation. The article reviewed both a literature study on the history of fashion exhibition focused on the display technique as well as a case study of domestic and international contemporary fashion exhibitions. The results of the article is as follows. Fashion brand exhibitions are about building competitive business advantage by planning differentiated contents. It gives viewers a brand fantasy and increases brand loyalty. This type mainly displays the latest collections on the commercial purpose as well as uses diverse mediums and high technology to make a spectacular space that provides an immersive experience to the viewer. Second, the museum fashion exhibition focuses on the roles of fashion in terms of social, cultural and artistic aspects that also focus on public education. The presentation technique emphasizes careful collection conservation rather than celebrate fashion business. The article is to encourage a further scholar discourse of fashion curatorial practice and theory.

• 한국HCI학회:학술대회논문집
• /
• 2006.02a
• /
• pp.230-237
• /
• 2006

본 논문은 스포츠 방송의 몰입감 증대를 위한 진동촉감 제시 시스템 및 장치를 제안하며, 촉감 정보를 효과적으로 전달하기 위한 촉감제시 방법론 및 제어 알고리즘을 제안한다. 최근 디지털 컨텐츠의 전달에 있어 오감을 통한 정보 전달의 관심이 증대됨에 따라, 대중을 대상으로 다양한 정보를 전달하는 디지털 매체에서의 시청각과 더불어 촉감 제시의 역할과 중요성이 증대되었다. 따라서 본 논문에서는 실시간으로 동적인 현장 상황을 실감 있게 전달하는 스포츠 방송에서의 햅틱 효과와 역할 그리고 가능한 시나리오를 정의하고, 진동촉감 제시 장비를 설계하여 촉감 정보 표현에 대한 기초 연구를 수행하였다. 또한 제안된 촉감을 이용한 스포츠 방송 시나리오 중 축구 방송을 기반으로 사용자 촉감 인지 실험을 수행하였으며, 실험 결과를 바탕으로 축구 방송 시스템을 구축하여 실감방송 전시회 시연을 통해 진동촉감 시스템 및 촉감 제시 방법론을 검증하였다. 촉감이 인간의 오감 중 시청각 다음으로 정보를 인지하는 중요한 감각 체계인 만큼 많은 양의 정보를 대중에게 전달하는 방송 시스템에서 시청각과 더불어 효과적인 정보 전달 체계로써 기여할 것이라고 여겨진다.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.11 no.2
• /
• pp.982-1004
• /
• 2017

The recent advances in the field of augmented reality (AR) have shown that the technology is a fundamental part of modern immersive interactive systems for the achievement of user engagement and a dynamic user experience. This survey paper presents the descriptions of a variety of the new AR explorations, and the issues that are relevant to the contemporary development of the fundamental technologies and applications are discussed. Most of the literature regarding the pertinent topics-taxonomy, the core tracking and sensing technologies, the hardware and software platforms, and the domain-specific applications-are then chronologically surveyed, and in varying detail, this is supplemented with the cited papers. This paper portrays the diversity of the research regarding the AR field together with an overview of the benefits and the limitations of the competing and complementary technologies.

• Journal of Korea Game Society
• /
• v.16 no.3
• /
• pp.65-76
• /
• 2016

The paradigm of the human experience through computer as a medium is moving from cultural interface to cultural software. Mod represents this paradigm shift in digital game culture. Until now, Digital game play focused on the immersive agency in the process of achieving the goals of the game. On the other hand, In Mod, play focus on generative agency in the process of creating and solving problems in game world. Through Mod, original game perceived as transformable data and creative material. Transformation and generation of such a game content through the user's Mod presents a sustainable model of the digital game.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.12 no.12
• /
• pp.5936-5954
• /
• 2018

Eight out of the top ten the largest technology companies in the world are involved in some way with the coming mobile VR revolution since Facebook acquired Oculus. This trend has allowed the technology related with mobile VR to achieve remarkable growth in both academic and industry. Therefore, the importance of reproducing the acoustic expression for users to experience more realistic is increasing because auditory cues can enhance the perception of the complicated surrounding environment without the visual system in VR. This paper presents a audio downmixing system for auralization based on hardware, a stage of sound rendering pipelines that can reproduce realiy-like sound but requires high computation costs. The proposed system is verified through an FPGA platform with the special focus on hardware architectural designs for low power and real-time. The results show that the proposed system on an FPGA can downmix maximum 5 sources in real-time rate (52 FPS), with 382 mW low power consumptions. Furthermore, the generated 3D sound with the proposed system was verified with satisfactory results of sound quality via the user evaluation.

• Journal of Internet Computing and Services
• /
• v.23 no.1
• /
• pp.19-29
• /
• 2022

Natural user interface (NUI) is used for the natural motion interface without using a specific device or tool like a mouse, keyboards, and pens. Recently, as non-contact sensor-based interaction technologies for recognizing human motion, gestures, voice, and gaze have been actively studied, an environment has been prepared that can provide more diverse contents based on various interaction methods compared to existing methods. However, as the number of sensors device is rapidly increasing, the system using a lot of sensors can suffer from a lack of computational resources. To address this problem, we proposed a real-time multi-device control system for natural interactive platform. In the proposed system, we classified two types of devices as the HC devices such as high-end commercial sensor and the LC devices such astraditional monitoring sensor with low-cost. we adopt each device manager to control efficiently. we demonstrate a proposed system works properly with user behavior such as gestures, motions, gazes, and voices.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2020.07a
• /
• pp.397-400
• /
• 2020

본 논문에서는 문화유산 현장에서의 몰입형 교육을 위한 VST(Video See-through) 방식의 HMD(Head Mounted Display) 기반 XR(eXtended Reality) 체험 프레임워크를 제안한다. 매장문화재적 요소가 강한 문화유산 현장의 경우 실물이 남아있지 않아 교육 및 체험 측면에서 흥미로운 정보 전달이 어렵다. 최근 모바일 기기의 대중적인 확산에 따라 이를 이용해 문화유산 현장에 소실된 문화유산을 AR(Augmented Reality)로 복원 및 시각화하거나 관련 정보를 제공하는 연구들이 이루어졌으며, 나아가 OST(Optical See-through) 방식의 안경형 AR 디스플레이를 활용하는 사례들도 등장했다. 그러나 이러한 연구들은 기기의 특성으로 인해 몰입감과 사용성 측면에서 한계점을 보였으며, 단순히 소실된 문화유산의 복원된 모습을 정적으로 시각화하는 것에 그쳐 문화유산 현장에 내재된 동적인 역사 스토리를 재현한다는 측면에서 부족한 점이 있었다. 본 논문에서는 문화유산 현장에서 VST-HMD를 이용하여 AR 기반의 정적 문화유산 시각화뿐만 아니라 VR(Virtual Reality) 기반의 동적 역사 스토리 애니메이션을 제공하는 XR 체험 프레임워크를 제안하여 더욱 몰입감 있고 만족스러운 문화유산 교육을 제공하는 방안에 대해 검토한다.