• Journal of Information Processing Systems
• /
• v.17 no.2
• /
• pp.337-351
• /
• 2021

Automatically recognizing facial expressions in video sequences is a challenging task because there is little direct correlation between facial features and subjective emotions in video. To overcome the problem, a video facial expression recognition method using spatiotemporal recurrent neural network and feature fusion is proposed. Firstly, the video is preprocessed. Then, the double-layer cascade structure is used to detect a face in a video image. In addition, two deep convolutional neural networks are used to extract the time-domain and airspace facial features in the video. The spatial convolutional neural network is used to extract the spatial information features from each frame of the static expression images in the video. The temporal convolutional neural network is used to extract the dynamic information features from the optical flow information from multiple frames of expression images in the video. A multiplication fusion is performed with the spatiotemporal features learned by the two deep convolutional neural networks. Finally, the fused features are input to the support vector machine to realize the facial expression classification task. The experimental results on cNTERFACE, RML, and AFEW6.0 datasets show that the recognition rates obtained by the proposed method are as high as 88.67%, 70.32%, and 63.84%, respectively. Comparative experiments show that the proposed method obtains higher recognition accuracy than other recently reported methods.

• Journal of Broadcast Engineering
• /
• v.18 no.6
• /
• pp.835-849
• /
• 2013

Joint Collaborative Team on Video Coding (JCT-VC), which have founded ISO/IEC MPEG and ITU-T VCEG, has standardized High Efficiency Video Coding (HEVC). Standardization of HEVC has started with purpose of twice or more coding performance compared to H.264/AVC. However, flexible and hierarchical coding block and recursive coding structure are problems to overcome of HEVC standard. Many fast encoding algorithms for reducing computational complexity of HEVC encoder have been proposed. However, it is hard to implement a real-time HEVC encoder only with those fast encoding algorithms. In this paper, for implementation of software-based real-time HEVC encoder, data-level parallelism using SIMD instructions and CPU/GPU multi-threading methods are proposed. And we also proposed appropriate operations and functional modules to apply the proposed methods on HM 10.0 software. Evaluation of the proposed methods implemented on HM 10.0 software showed 20-30fps for $832{\times}480$ sequences and 5-10fps for $1920{\times}1080$ sequences, respectively.

• The Journal of Korean Institute of Electromagnetic Engineering and Science
• /
• v.16 no.7 s.98
• /
• pp.709-719
• /
• 2005

The forward link of the 3 G CDMA system may become limited under the increasing of the number of users. The conventional channelization code, Walsh code, has not enough sizes for much possible non, therefore, the quasi orthogonal function(QOF), which process optimal cross-correlation with Walsh code, is considered. In this paper, we investigate quasi orthogonal function on Jacket matrices, which can lead lower correlations values and better performance in 3 G CDMA system. Moreover, to simple the detector and improve the BER performance, a novel detection for QOF CDMA system is proposed. Finally, the simple recursive generation of the bent sequences for QOF mask function is discussed.

• Journal of the Korea Society of Computer and Information
• /
• v.10 no.6 s.38
• /
• pp.187-194
• /
• 2005

The background subtraction method is mainly used for the real-time extraction and tracking of moving objects from image sequences. In the outdoor environment, there are many changeable environment factors such as gradually changing illumination, swaying trees and suddenly moving objects , which are to be considered for an adaptive processing. Normally, GMM(Gaussian Mixture Model) is used to subtract the background by considering adaptively the various changes in the scenes, and the adaptive GMMs improving the real-time Performance were Proposed and worked. This paper, for on-line background subtraction, employed the improved adaptive GMM, which uses the small constant for learning rate a and is not able to speedily adapt the suddenly movement of objects, So, this paper Proposed and evaluated the dynamic control method of a using the adaptive selection of the number of component distributions and the global variances of pixel values.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• v.9 no.2
• /
• pp.366-369
• /
• 2005

Background subtraction is mainly used for the real-time extraction and tracking of moving objects from image sequences. In the outdoor environment, there are many changeable factor such as gradually changing illumination, swaying trees and suddenly moving objects, which are to be considered for the adaptive processing. Normally, GMM(Gaussian Mixture Model) is used to subtract the background adaptively considering the various changes in the scenes, and the adaptive GMMs improving the real-time performance were worked. This paper, for on-line background subtraction, applied the improved adaptive GMM, which uses the small constant for learning rate ${\alpha}$ and is not able to speedily adapt the suddenly movement of objects, So, this paper proposed and evaluated the dynamic control method of ${\alpha}$ using the adaptive selection of the number of component distributions and the global variances of pixel values.

• Journal of Educational Research in Mathematics
• /
• v.27 no.3
• /
• pp.537-555
• /
• 2017

This paper compared and contrasted Korean and Singaporean textbooks in order to explore the direction and possibility of teaching the big ideas related to the addition and subtraction of fractions with different denominators proposed by Lee & Pang (2016a). Firstly, we examined the teaching sequences related to the addition of fractions with different denominators in a series of elementary mathematics textbooks of Korea and Singapore. We then analyzed what types of representations are used and how the representations are presented for the big ideas related to the addition of fractions with different denominators. The results of the analysis showed that the contents related to fraction addition are addressed more gradually and systematically in Singaporean textbooks compared to Korean counterparts. The graphical representations appeared in the Singaporean textbooks provide specific implications for teaching the big ideas of the addition of fractions with different denominators. Based on such implications, we expect that the big ideas related to the addition of fractions with different denominators will be addressed explicitly and systematically in Korean textbooks.