• 제목/요약/키워드: First Order Motion

검색결과 569건 처리시간 0.031초

Toward 6 Degree-of-Freedom Video Coding Technique and Performance Analysis (6 자유도 전방위 몰입형 비디오의 압축 코덱 개발 및 성능 분석)

  • Park, Hyeonsu;Park, Sang-hyo;Kang, Je-Won
    • Journal of Broadcast Engineering
    • /
    • 제24권6호
    • /
    • pp.1035-1052
    • /
    • 2019
  • Recently, as the demand for immersive videos increases, efficient video processing techniques for omnidirectional immersive video is actively developed by MPEG-I. While the omnidirectional video provides a larger degree of freedom for a free viewpoint, the size of the video increases significantly. Furthermore, in order to compress 6 degree-of-freedom (6 DoF) videos that support motion parallax, it is required to develop a codec to yield better coding efficiency. In this paper, we develop a 6 DoF codec using Versatile Video Coding (VVC) as the next generation video coding standard. To the authors' best knowledge, this is the first VVC-based 6 DoF video codec toward the future ISO/IEC 23090 Part 7 (Metadata for Immersive Media (Video)) MPEG-I standardization. The experiments were conducted on the seven test video sequences specified in Common Test Condition (CTC) in two operation modes of TMIV (Test Model for Immersive Media) software. It is demonstrated that the proposed codec improves coding performance around 33.8% BD-rate reduction in the MIV (Metadata for Immersive Video) mode and 30.2% BD-rate reduction in the MIV view mode as compared to the state-of-the-art TMIV reference software. We also show the performance comparisons using Immersive Video PSNR (IV-PSNR) and Mean Structural Similarity (MSSIM).

FBX Format Animation Generation System Combined with Joint Estimation Network using RGB Images (RGB 이미지를 이용한 관절 추정 네트워크와 결합된 FBX 형식 애니메이션 생성 시스템)

  • Lee, Yujin;Kim, Sangjoon;Park, Gooman
    • Journal of Broadcast Engineering
    • /
    • 제26권5호
    • /
    • pp.519-532
    • /
    • 2021
  • Recently, in various fields such as games, movies, and animation, content that uses motion capture to build body models and create characters to express in 3D space is increasing. Studies are underway to generate animations using RGB-D cameras to compensate for problems such as the cost of cinematography in how to place joints by attaching markers, but the problem of pose estimation accuracy or equipment cost still exists. Therefore, in this paper, we propose a system that inputs RGB images into a joint estimation network and converts the results into 3D data to create FBX format animations in order to reduce the equipment cost required for animation creation and increase joint estimation accuracy. First, the two-dimensional joint is estimated for the RGB image, and the three-dimensional coordinates of the joint are estimated using this value. The result is converted to a quaternion, rotated, and an animation in FBX format is created. To measure the accuracy of the proposed method, the system operation was verified by comparing the error between the animation generated based on the 3D position of the marker by attaching a marker to the body and the animation generated by the proposed system.

Detection of The Real-time Weather Information from a Vehicle Black Box (차량용 블랙박스 영상에서의 실시간 기상정보 검지)

  • Kang, Ju-mi;Lee, Jaesung
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 한국정보통신학회 2014년도 추계학술대회
    • /
    • pp.320-323
    • /
    • 2014
  • Today is going with the advancement of intelligent transportation systems and traffic environment and helping to provide safe and convenient service through a mobile device work with the popularization of the vehicle black box. The traffic flow by a variety of causes is constantly changing, it is often unable to prepare the driver, depending on external factors can not be controlled by the power of the public, leading to a major accident. The system needs to pass the real-time weather data in the inter-operator to prevent this. The proposed detection algorithm weather information delivered real-time weather information for this paper. The weather condition is detected by using the contrast between the histogram of the motion of the wiper and the clear day algorithm. In general, the wiper is worked in extreme weather conditions that will have a value different contrast due to rain or snow. Situation was considered clear, snowy conditions, such as using it on a rainy situation. First, designated as ROI (Region Of Interest) of the minimum area that can be detected in order to reduce the amount of calculation for the wiper, the wiper, which was detected through the operation of the threshold Thresholding the brightness of the vehicle wiper. In addition, we distinguish the value of each meteorological situation by using contrast. Results was obtained to 80% for the snow conditions, a rainy situation.

  • PDF

A Study of VR Interaction for Non-contact Hair Styling (비대면 헤어 스타일링 재현을 위한 VR 인터렉션 연구)

  • Park, Sungjun;Yoo, Sangwook;Chin, Seongah
    • The Journal of the Convergence on Culture Technology
    • /
    • 제8권2호
    • /
    • pp.367-372
    • /
    • 2022
  • With the recent advent of the New Normal era, realistic technologies and non-contact technologies are receiving social attention. However, the hair styling field focuses on the direction of the hair itself, individual movements, and modeling, focusing on hair simulation. In order to create an improved practice environment and demand of the times, this study proposed a non-contact hair styling VR system. In the theoretical review, we studied the existing cases of hair cut research. Existing haircut-related research tend to be mainly focused on force-based feedback. Research on the interactive haircut work in the virtual environment as addressed in this paper has not been done yet. VR controllers capable of finger tracking the movements necessary for beauty enable selection, cutting, and rotation of beauty tools, and built a non-contact collaboration environment. As a result, we conducted two experiments for interactive hair cutting in VR. First, it is a haircut operation for synchronization using finger tracking and holding hook animation. We made position correction for accurate motion. Second, it is a real-time interactive cutting operation in a multi-user virtual collaboration environment. This made it possible for instructors and learners to communicate with each other through VR HMD built-in microphones and Photon Voice in non-contact situations.

A Study on the Digital Holographic Image Acquisition Method using Chroma Key Composition (크로마키 합성을 이용한 디지털 홀로그래피 이미지 획득 방법 연구)

  • Kim, Ho-sik;Kwon, Soon-chul;Lee, Seung-hyun
    • The Journal of the Convergence on Culture Technology
    • /
    • 제8권3호
    • /
    • pp.313-321
    • /
    • 2022
  • As 5G is getting developed, people are getting interested in immersive content. Some predicts that immersive content may be implemented in real life such as holograms, which were only possible in movies. Holograms, which has been studied for a long time since Dennis Gabor published the basic theory in 1948, are constantly developing in a new direction with digital technology. It is developing from a traditional optical hologram, which is produced by recording the interference pattern of light to a computer generated hologram (CGH) and a digital hologram printer. In order to produce a hologram using a digital hologram printer, holographic element (Hogel) image must first be created using multi-view images. There are a method of directly photographing an actual image and a method of modeling an object using 3D graphic production tool and rendering the motion of a virtual camera to acquire a series of multi-view images. In this paper, we propose a new method of getting image, which is one of the visual effect, VFX, producing multi-view images using chroma key composition. We shoot on the green screen of actual object, suggest the overall workflow of composition with 3D computer graphic(CG) and explain the role of each step. We expected that it will be helpful in researching a new method of image acquisition in the future if all or part of the proposed workflow to be applied.

Analysis of the Effects of Positive and Negative VR Game Contents on Enhancing Environmental Awareness Based on Self-Reliant and Team-Based Play Styles (개인 플레이와 협동 플레이 방식에서 긍정적 및 부정적 VR 콘텐츠가 환경 인식 개선에 미치는 영향)

  • Jihun Chae;Seungeun Yoo;Youngsung Lee;Yunsub Kim;Hyeonjin Kim;Daseong Han
    • Journal of the Korea Computer Graphics Society
    • /
    • 제29권3호
    • /
    • pp.137-147
    • /
    • 2023
  • This paper presents a motion-capture-based projection VR system to explore the effectiveness of gamification in improving environmental awareness. We examine the key components of positive and negative VR game content and analyze the impact of individual and cooperative play methods on promoting sustainable behaviors. Our findings are as follows. Firstly, we discovered that the use of positive content in individual play mode was effective in improving awareness of the importance of recycling. Secondly, we confirmed that the use of positive content in cooperative play mode and the use of negative content in individual play mode were each effective in enhancing awareness of the seriousness of environmental pollution. Thirdly, we found that experiencing positive content first, followed by negative content, in individual play mode was effective in increasing interest in the environment. Based on these findings, we determined that adjusting the order of use of positive and negative content is more effective than simply using positive or negative content alone for improving environmental awareness. Moreover, considering the importance of recycling, the seriousness of environmental pollution, and the level of interest in the environment, we confirmed that individual play mode is effective and cooperative play mode can be more effective depending on the measure.

Multi-View 3D Human Pose Estimation Based on Transformer (트랜스포머 기반의 다중 시점 3차원 인체자세추정)

  • Seoung Wook Choi;Jin Young Lee;Gye Young Kim
    • Smart Media Journal
    • /
    • 제12권11호
    • /
    • pp.48-56
    • /
    • 2023
  • The technology of Three-dimensional human posture estimation is used in sports, motion recognition, and special effects of video media. Among various methods for this, multi-view 3D human pose estimation is essential for precise estimation even in complex real-world environments. But Existing models for multi-view 3D human posture estimation have the disadvantage of high order of time complexity as they use 3D feature maps. This paper proposes a method to extend an existing monocular viewpoint multi-frame model based on Transformer with lower time complexity to 3D human posture estimation for multi-viewpoints. To expand to multi-viewpoints our proposed method first generates an 8-dimensional joint coordinate that connects 2-dimensional joint coordinates for 17 joints at 4-vieiwpoints acquired using the 2-dimensional human posture detector, CPN(Cascaded Pyramid Network). This paper then converts them into 17×32 data with patch embedding, and enters the data into a transformer model, finally. Consequently, the MLP(Multi-Layer Perceptron) block that outputs the 3D-human posture simultaneously updates the 3D human posture estimation for 4-viewpoints at every iteration. Compared to Zheng[5]'s method the number of model parameters of the proposed method was 48.9%, MPJPE(Mean Per Joint Position Error) was reduced by 20.6 mm (43.8%) and the average learning time per epoch was more than 20 times faster.

  • PDF

A Study on the Precise Lineament Recovery of Alluvial Deposits Using Satellite Imagery and GIS (충적층의 정밀 선구조 추출을 위한 위성영상과 GIS 기법의 활용에 관한 연구)

  • 이수진;석동우;황종선;이동천;김정우
    • Proceedings of the Korean Association of Geographic Inforamtion Studies Conference
    • /
    • 한국GIS학회 2003년도 공동 춘계학술대회 논문집
    • /
    • pp.363-368
    • /
    • 2003
  • We have successfully developed a more effective algorithm to extract the lineament in the area covered by wide alluvial deposits characterized by a relatively narrow range of brightness in the Landsat TM image, while the currently used algorithm is limited to the mountainous areas. In the new algorithm, flat areas mainly consisting of alluvial deposits were selected using the Local Enhancement from the Digital Elevation Model (DEM). The aspect values were obtained by 3${\times}$3 moving windowing of Zevenbergen & Thorno's Method, and then the slopes of the study area were determined using the aspect values. After the lineament factors in the alluvial deposits were revealed by comparing the threshold values, the first rank lineament under the alluvial deposits were extracted using the Hough transform In order to extract the final lineament, the lowest points under the alluvial deposits in a given topographic section perpendicular to the first rank lineament were determined through the spline interpolation, and then the final lineament were chosen through Hough transform using the lowest points. The algorithm developed in this study enables us to observe a clearer lineament in the areas covered by much larger alluvial deposits compared with the results extracted using the conventional existing algorithm. There exists, however, some differences between the first rank lineament, obtained using the aspect and the slope, and the final lineament. This study shows that the new algorithm more effectively extracts the lineament in the area covered with wide alluvlal deposits than in the areas of converging slope, areas with narrow alluvial deposits or valleys.

  • PDF

Simultaneous Effect between eWOM and Revenues: Korea Movie Industry (온라인 구전과 영화 매출 간 상호영향에 관한 연구: 한국 영화 산업을 중심으로)

  • Bae, Jungho;Shim, Bum Jun;Kim, Byung-Do
    • Asia Marketing Journal
    • /
    • 제12권2호
    • /
    • pp.1-25
    • /
    • 2010
  • Motion pictures are so typical experience goods that consumers tend to look for more credible information. Hence, movie audiences consider movie viewers' reviews more important than the information provided by the film distributor. Recently many portal sites allow consumers to post their reviews and opinions so that other people check the number of consumer reviews and scores before going to the theater. There are a few previous researches studying the electronic word of mouth(eWOM) effect in the movie industry. They found that the volume of eWOM influenced the revenue of the movie significantly but the valence of eWOM did not affect it much (Liu 2006). The goal of our research is also to investigate the eWOM effects in general. But our research is different from the previous studies in several aspects. First, we study the eWOM effect in Korean movie industry. In other words, we would like to check whether we can generalize the results of the previous research across countries. The similar econometric models are applied to Korean movie data that include 746,282 consumer reviews on 439 movies. Our results show that both the valence(RATING) and the volume(LNMSG) of the eWOM influence weekly movie revenues. This result is different from the previous research findings that the volume only influences the revenue. We conjectured that the difference of self construal between Asian and American culture may explain this difference (Kitayama 1991). Asians including Koreans have more interdependent self construal than American, so that they are easily affected by other people's thought and suggestion. Hence, the valence of the eWOM affects Koreans' choice of the movie. Second, we find the critical defect of the previous eWOM models and, hence, attempt to correct it. The previous eWOM model assumes that the volume of eWOM (LNMSG) is an independent variable affecting the movie revenue (LNREV). However, the revenue can influence the volume of the eWOM. We think that treating the volume of eWOM as an independent variable a priori is too restrictive. In order to remedy this problem, we employed a simultaneous equation in which the movie revenue and the volume of the eWOM can affect each other. That is, our eWOM model assumes that the revenue (LNREV) and the volume of eWOM (LNMSG) have endogenous relationship where they influence each other. The results from this simultaneous equation model showed that the movie revenue and the eWOM volume interact each other. The movie revenue influences the eWOM volume for the entire 8 weeks. The reverse effect is more complex. Both the volume and the valence of eWOM affect the revenue in the first week, but only the volume affect the revenue for the rest of the weeks. In the first week, consumers may be curious about the movie and look for various kinds of information they can trust, so that they use the both the quantity and quality of consumer reviews. But from the second week, the quality of the eWOM only affects the movie revenue, implying that the review ratings are more important than the number of reviews. Third, our results show that the ratings by professional critics (CRATING) had negative effect to the weekly movie revenue (LNREV). Professional critics often give low ratings to the blockbuster movies that do not have much cinematic quality. Experienced audiences who watch the movie for fun do not trust the professionals' ratings and, hence, tend to go for the low-rated movies by them. In summary, applied to the Korean movie ratings data and employing a simultaneous model, our results are different from the previous eWOM studies: 1) Koreans (or Asians) care about the others' evaluation quality more than quantity, 2) The volume of eWOM is not the cause but the result of the revenue, 3) Professional reviews can give the negative effect to the movie revenue.

  • PDF

A line study on movement expression in Dragonball of Toriyama Akira (토리야마 아키라의 <드래곤볼>에 나타난 운동표현에 관한 선 연구)

  • Cho, Dai-Ho;Park, Keong-Cheol
    • Cartoon and Animation Studies
    • /
    • 통권31호
    • /
    • pp.153-176
    • /
    • 2013
  • In the early 20th century, the some of futurist painter was attempted to represents the 'fast-paced' and 'dynamism' on a two-dimensional picture. The expression of fast-paced and dynamic for look like move image in the painting have evolved as a variety of visual symbol. Visual symbols that represent these movements were settled as the line of the most movement expression in the comic. The of Toriyama Akira gained worldwide popularity is emphasized speed and dynamism as the action genre in cartoon, is nice a data to research the line of the movement expression of cartoon. There is three terms as the action line, The speed line, the effect line on the movement expression in The glossary of in the dictionary of , but it not easy to Separate them by means similar. This study is willing to says the semantically problem of previous lines on the movement expression and to present a new alternative in order to study the line on the movement expression of . This study Separate the line on movement expression from symbolic the perspective and try to newly define by using, was classified lines of four kinds by add the afterimage line on existing the speed line, the motion line, the effect line. First, the speed line was defined as 'The line expressing the movement expression of a moving target as the concept of speed'. It on the way of expression was subdivided the direct as speed line when it alter the shape of the target and the indirect speed line when it alter the background of the target. Second, the motion line was defined as 'The line simplified the moving form or the moving path of moving target'. Third, the effect line was defined as 'the line emphasizing the movement expression of a moving target by Sensory expression or emotional expression. Fourth, the afterimage lines was defined as 'The line expressing slowly moving or swaying the movement expression of target to the afterimage effect. The terminology presented in this study will be able to help the understanding of the line on the movement expression .