• Journal of Korea Multimedia Society
• /
• v.16 no.5
• /
• pp.539-548
• /
• 2013

Although Motion estimation (ME) plays an important role in digital video compression, it requires a complicated search procedure to find an optimal motion vector. Multi-view video is obtained by capturing one three-dimensional scene with many cameras at different positions. The computational complexity of motion estimation for Multi-view video coding increases in proportion to the number of cameras. To reduce computational complexity and maintain the image quality, a low complexity motion estimation search method is proposed in this paper. The proposed search method consists of four-grid diamond search patten, two-gird diamond search pattern and TZ 2 Point search pattern. These search patterns exploit the characteristics of the distribution of motion vectors to place the search points. Experiment results show that the speedup improvement of the proposed method over TZ search method (JMVC) can be up to 1.8~4.5 times faster by reducing the computational complexity and the image quality degradation is about to 0.01~0.24 (dB).

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2015.07a
• /
• pp.464-465
• /
• 2015

본 논문은 HEVC(High Efficiency Video Coding) 기반의 3차원 비디오 부호기에서 깊이 비디오 부호화의 효율 증대를 위한 디블록킹 필터(deblocking filter)를 제안한다. 디블록킹 필터는 블록 왜곡(blocking artifact)을 보정하기 위한 필터인데 원래 색상 영상의 특성에 맞게 설계되어서 비슷한 목적을 지닌 SAO(Sample Adaptive Offset)와 더불어 기존 방법의 깊이 비디오 부호화에서는 사용되지 않는다. 제안 방법은 디블록킹 필터의 사전 실험 통계에 기반하여 기여도가 낮은 normal 필터를 제외시킨다. 또한, 깊이 비디오의 특성을 고려하여 임펄스 응답(impulse response)를 변형하였다. 이 변형된 디블록킹 필터를 깊이 비디오 부호화에만 적용하고 색상 비디오 부호화에는 기존 디블록킹 필터를 사용하였다. 3D-HTM(HEVC Test Model) 13.0 참조 소프트웨어에 구현하여 실험한 결과, 기존 방법에 비해 깊이 비디오 부호화 성능이 5.2% 향상되었다. 색상-깊이 비디오 간 참조가 있기 때문에 변형된 깊이 비디오 부호화가 색상 비디오 부호화 효율에 영향을 끼칠 수도 있지만 실험 결과 색상 비디오 부호화 성능은 유지되었다. 따라서 제안 방법은 성공적으로 깊이 비디오 부호화의 효율을 증대시켰다.

• Journal of Korea Multimedia Society
• /
• v.23 no.12
• /
• pp.1540-1551
• /
• 2020

Aiming at the problem that the existing human behavior recognition algorithm cannot fully utilize the multi-level spatio-temporal information of the network, a human behavior recognition algorithm based on a dense three-dimensional residual network is proposed. First, the proposed algorithm uses a dense block of three-dimensional residuals as the basic module of the network. The module extracts the hierarchical features of human behavior through densely connected convolutional layers; Secondly, the local feature aggregation adaptive method is used to learn the local dense features of human behavior; Then, the residual connection module is applied to promote the flow of feature information and reduced the difficulty of training; Finally, the multi-layer local feature extraction of the network is realized by cascading multiple three-dimensional residual dense blocks, and use the global feature aggregation adaptive method to learn the features of all network layers to realize human behavior recognition. A large number of experimental results on benchmark datasets KTH show that the recognition rate (top-l accuracy) of the proposed algorithm reaches 93.52%. Compared with the three-dimensional convolutional neural network (C3D) algorithm, it has improved by 3.93 percentage points. The proposed algorithm framework has good robustness and transfer learning ability, and can effectively handle a variety of video behavior recognition tasks.

• Proceedings of the Korean Information Science Society Conference
• /
• 2003.04c
• /
• pp.223-225
• /
• 2003

패턴을 기반으로 딴 AR(Augmented Reality) 시스템은 실시간 동영상 안에 가상 물체들을 정확하게 올리기(registering) 위한 좋은 방법이다. AR 시스템을 구현하기 위해서는 우선 카메라가 보고 있는 영상의 3D 위치 정보를 추출하여야 한다. 본 논문에서는 카메라가 보고 있는 체스판 영상의 3D 위치 정보를 자동적으로 추출하여 그것과 동기적으로 움직이는 가상의 object를 구현하는 시스템을 제안한다. 제안된 방법은 카메라 1 대를 가지고 어떠한 sensor 나 marker 를 사용하지 않고 시간적 정보만을 이용하여 비교적 정확한 3D 위지 정보를 추출할 수 있고, 추출된 3D 위치 정보를 통해 자연스러운 3D 모션 시뮬레이션을 구현할 수 있다.

• Journal of Korea Society of Digital Industry and Information Management
• /
• v.6 no.4
• /
• pp.225-235
• /
• 2010

People are getting more interested in 3D stereoscopic movie, but due to the sudden concern, there is less research how 3D stereoscopic movie influence on people. The present research aims at developing 3D stereoscopic movie measurement. For this, we tested three variables which are perceived functionality, impression, and presence. Perceived functionality is defined as how people perceive functions of 3D stereoscopic movie for instance depth, and impression is defined as how people integrate various information as a total image. Finally, presence is a psychological state that individual's perception fails to accurately acknowledge the role of the technology in the experience. As a result, perceived functionality consists of four factors, impression consists of eight factors, and presence consists of three factors. As an exploratory research, we cannot guarantee the validity of the measurement, but as a seminal research it is worthwhile to pay attention.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2012.07a
• /
• pp.47-50
• /
• 2012

스테레오스코픽 3D 동영상의 콘텐츠 부족을 해결할 수 있는 간단한 방법 중의 하나는 스테레오스코픽 3D 동영상 콘텐츠를 크기 변환 방법을 통해 다양한 3D 디스플레이에서 볼 수 있게 하는 것이다. 이를 위해 본 논문에서는 스테레오스코픽 3D 주의 시각 모델을 바탕으로 관심 영역을 설정하고, 이를 동영상으로 확장시키기 위해 장면 전환을 기준으로 영상을 그룹화한 후, 동일 관심 영역 윈도를 적용시켜 이를 목표 디스플레이에 맞게 크기 변환하는 방법을 제안한다. 실험 결과, 제안한 방법을 이용한 결과 영상이 보다 효율적으로 스테레오스코픽 3D 영상을 목표 디스플레이에서 보여줄 수 있음을 알 수 있다.

• Journal of People, Plants, and Environment
• /
• v.22 no.3
• /
• pp.309-319
• /
• 2019

This study was conducted to investigate the effects of watching a virtual reality (VR) forest video on stress reduction in adults. Experiments were performed in an artificial climate chamber where temperature, humidity and illumination were controlled. To cause stress in subjects, the subjects were asked to multiply two digit numbers by one digit numbers for two minutes. The subjects then watched a VR forest video for five minutes. During the experiment, the heart rate variability (HRV) and heart rate (HR) of subjects were continuously measured for evaluating their physiological state. After measuring the baseline and watching a VR forest video, their psychological state was evaluated using the profile of mood state (POMS), semantic differential (SD) method, and positive affect and negative affect schedule (PANAS). The results of physiological evaluation after watching a VR forest video showed a decrease in the stress index and HR, an increase in the activity of the parasympathetic nervous system, and the standard deviation of normal to normal RR intervals (SDNN). The results of psychological assessment confirmed that watching a VR forest video induced "comfort", "natural", and "soothed" feelings in subjects. In addition, watching a VR forest video decreased "tension-anxiety (T-A)", "depression-dejection (D)", "anger-hostility (A-H)", "fatigue (F)", "total mood disturbance (TMD)", and increased "vigor (V)" compared to the base line, and decreased "negative affect" and increased "positive affect." These results indicate that watching a VR forest video decreases adults' stress index, stabilizes physiological state, and has a positive impact on psychological state. The findings of this study can serve as a basis for providing forest welfare services to people in the blind spots of forest welfare, and can lay a foundation for the adoption of VR, one of the technologies of the fourth industrial revolution in forestry.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.7 no.10
• /
• pp.2479-2496
• /
• 2013

Increasing demand for Full High-Definition (FHD) video and Ultra High-Definition (UHD) video services has led to active research on high speed video processing. Widespread deployment of multi-core systems has accelerated studies on high resolution video processing based on parallelization of multimedia software. Even if parallelization of a specific decoding step may improve decoding performance partially, such partial parallelization may not result in sufficient performance improvement. Particularly, entropy decoding has often been considered separately from other decoding steps since the entropy decoding step could not be parallelized easily. In this paper, we propose a parallelization technique called Integrated Multi-Threaded Parallelization (IMTP) which takes parallelization of the entropy decoding step, with other decoding steps, into consideration in an integrated fashion. We used the Simultaneous Multi-Threading (SMT) technique with appropriate thread scheduling techniques to achieve the best performance for the entire decoding step. The speedup of the proposed IMTP method is up to 3.35 times faster with respect to the entire decoding time over a conventional decoding technique for H.264/AVC videos.

• Journal of KIISE:Computing Practices and Letters
• /
• v.9 no.6
• /
• pp.602-609
• /
• 2003

Emerging high-speed next-generation Internet is enabling immersive media communication systems and applications to realize geographically distributed team collaborations while overcoming the limit of distance and time. Focusing on the reliable real-time delivery of 3D (i.e., stereo) video among corresponding parties, in this paper, key schemes for stereo video processing/display and reliable transport of stereo video packets over high-speed Internet are designed and implemented. The performance of proposed stereo video delivery system is evaluated both by emulating various network situations for quantitative comparison and by transmitting over real-world Internet up to the speed of around 100 Mbps. The results demonstrate the feasibility of the proposed system in supporting the desired immersive communication.

• 한국정보통신설비학회:학술대회논문집
• /
• 2005.08a
• /
• pp.329-332
• /
• 2005

In this paper, we describe implementation of personal media gateway (PMG) for applications over BcN networks. PMG is a TV based set-top terminal, which enables transmission of Full D1 high quality video and audio at the speed of maximum 2Mbps. It supports SIP protocol and QoS for the BcN networks. The hardware of the PMG consists of host module, audio/video codec processing module, DTMF module, and remote control I/O module. H.263 and MPEG4 software are implemented in DSP as codec for hi-directional communication and streaming, respectively. G.711 and Ogg-Vorbis are implemented as audio codec. We examined the quality of video using the Video Quality Test Equpment, which was developed by KT Convergence Lab. The experimental results show the video quality of MOS 4.1 and audio quality of MOS 4.3. We expect that PMG will be prospective business models, and create new customer value.