• Title/Summary/Keyword: Local features

Search Result 1,409, Processing Time 0.035 seconds

A Local Feature-Based Robust Approach for Facial Expression Recognition from Depth Video

  • Uddin, Md. Zia;Kim, Jaehyoun
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.10 no.3
    • /
    • pp.1390-1403
    • /
    • 2016
  • Facial expression recognition (FER) plays a very significant role in computer vision, pattern recognition, and image processing applications such as human computer interaction as it provides sufficient information about emotions of people. For video-based facial expression recognition, depth cameras can be better candidates over RGB cameras as a person's face cannot be easily recognized from distance-based depth videos hence depth cameras also resolve some privacy issues that can arise using RGB faces. A good FER system is very much reliant on the extraction of robust features as well as recognition engine. In this work, an efficient novel approach is proposed to recognize some facial expressions from time-sequential depth videos. First of all, efficient Local Binary Pattern (LBP) features are obtained from the time-sequential depth faces that are further classified by Generalized Discriminant Analysis (GDA) to make the features more robust and finally, the LBP-GDA features are fed into Hidden Markov Models (HMMs) to train and recognize different facial expressions successfully. The depth information-based proposed facial expression recognition approach is compared to the conventional approaches such as Principal Component Analysis (PCA), Independent Component Analysis (ICA), and Linear Discriminant Analysis (LDA) where the proposed one outperforms others by obtaining better recognition rates.

A Multimodal Fusion Method Based on a Rotation Invariant Hierarchical Model for Finger-based Recognition

  • Zhong, Zhen;Gao, Wanlin;Wang, Minjuan
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.15 no.1
    • /
    • pp.131-146
    • /
    • 2021
  • Multimodal biometric-based recognition has been an active topic because of its higher convenience in recent years. Due to high user convenience of finger, finger-based personal identification has been widely used in practice. Hence, taking Finger-Print (FP), Finger-Vein (FV) and Finger-Knuckle-Print (FKP) as the ingredients of characteristic, their feature representation were helpful for improving the universality and reliability in identification. To usefully fuse the multimodal finger-features together, a new robust representation algorithm was proposed based on hierarchical model. Firstly, to obtain more robust features, the feature maps were obtained by Gabor magnitude feature coding and then described by Local Binary Pattern (LBP). Secondly, the LGBP-based feature maps were processed hierarchically in bottom-up mode by variable rectangle and circle granules, respectively. Finally, the intension of each granule was represented by Local-invariant Gray Features (LGFs) and called Hierarchical Local-Gabor-based Gray Invariant Features (HLGGIFs). Experiment results revealed that the proposed algorithm is capable of improving rotation variation of finger-pose, and achieving lower Equal Error Rate (EER) in our homemade database.

Local Environmental Effects on AGN Activities

  • Kim, Jaemin;Yi, Sukyoung K.
    • The Bulletin of The Korean Astronomical Society
    • /
    • v.38 no.2
    • /
    • pp.44.2-44.2
    • /
    • 2013
  • The local environmental effects on the active galactic nucleus(AGN) activity has been studied by many authors, but there is still controversy. We performed statistical analysis for nearby(0.01 < z < 0.05) volume limited(Mr < -19) sample via visual inspection based on Sloan Digital Sky Survey Data Release7. We visually inspect around 50,000 galaxy images to find peculiar objects which show not only ongoing merging features and tidal features, but also post merging features like shell or ring structures. We found that the frequency of AGN host galaxies is at least 2 times higher among peculiar galaxies than non-peculiar galaxies, and this trend is still visible when galaxy properties such as color or stellar mass are fixed. Furthermore, L[OIII] of peculiar galaxies is found to be more increased than those of normal galaxies. The majority of the most luminous AGN hosts show peculiar feature, which indicates that the luminous AGN galaxies may be the result of the local environmental effects. In addition, the enhancement of L[OIII] in peculiar galaxies is more significant for bluer galaxies, which implies that AGN activity is enhanced effectively when gas is available. In order to ensure our results, we also checked it for a smaller subsample with 2 magnitude deeper monochromatic images provided by SDSS Stripe82 database, and found consistent results. Overall, the results of this study tell us that the local environment of galaxies affects the frequency as well as the strength of AGN activity.

  • PDF

General Local Transformer Network in Weakly-supervised Point Cloud Analysis (약간 감독되는 포인트 클라우드 분석에서 일반 로컬 트랜스포머 네트워크)

  • Anh-Thuan Tran;Tae Ho Lee;Hoanh-Su Le;Philjoo Choi;Suk-Hwan Lee;Ki-Ryong Kwon
    • Proceedings of the Korea Information Processing Society Conference
    • /
    • 2023.11a
    • /
    • pp.528-529
    • /
    • 2023
  • Due to vast points and irregular structure, labeling full points in large-scale point clouds is highly tedious and time-consuming. To resolve this issue, we propose a novel point-based transformer network in weakly-supervised semantic segmentation, which only needs 0.1% point annotations. Our network introduces general local features, representing global factors from different neighborhoods based on their order positions. Then, we share query point weights to local features through point attention to reinforce impacts, which are essential in determining sparse point labels. Geometric encoding is introduced to balance query point impact and remind point position during training. As a result, one point in specific local areas can obtain global features from corresponding ones in other neighborhoods and reinforce from its query points. Experimental results on benchmark large-scale point clouds demonstrate our proposed network's state-of-the-art performance.

An Improved Saliency Detection for Different Light Conditions

  • Ren, Yongfeng;Zhou, Jingbo;Wang, Zhijian;Yan, Yunyang
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.9 no.3
    • /
    • pp.1155-1172
    • /
    • 2015
  • In this paper, we propose a novel saliency detection framework based on illumination invariant features to improve the accuracy of the saliency detection under the different light conditions. The proposed algorithm is divided into three steps. First, we extract the illuminant invariant features to reduce the effect of the illumination based on the local sensitive histograms. Second, a preliminary saliency map is obtained in the CIE Lab color space. Last, we use the region growing method to fuse the illuminant invariant features and the preliminary saliency map into a new framework. In addition, we integrate the information of spatial distinctness since the saliency objects are usually compact. The experiments on the benchmark dataset show that the proposed saliency detection framework outperforms the state-of-the-art algorithms in terms of different illuminants in the images.

A Multiple Features Video Copy Detection Algorithm Based on a SURF Descriptor

  • Hou, Yanyan;Wang, Xiuzhen;Liu, Sanrong
    • Journal of Information Processing Systems
    • /
    • v.12 no.3
    • /
    • pp.502-510
    • /
    • 2016
  • Considering video copy transform diversity, a multi-feature video copy detection algorithm based on a Speeded-Up Robust Features (SURF) local descriptor is proposed in this paper. Video copy coarse detection is done by an ordinal measure (OM) algorithm after the video is preprocessed. If the matching result is greater than the specified threshold, the video copy fine detection is done based on a SURF descriptor and a box filter is used to extract integral video. In order to improve video copy detection speed, the Hessian matrix trace of the SURF descriptor is used to pre-match, and dimension reduction is done to the traditional SURF feature vector for video matching. Our experimental results indicate that video copy detection precision and recall are greatly improved compared with traditional algorithms, and that our proposed multiple features algorithm has good robustness and discrimination accuracy, as it demonstrated that video detection speed was also improved.

A Study on the Characteristics of the Establishment of a Small Town Landscape Guideline - Focused on Local Governments in Jeollanam-do Establishing the Basic Landscape Plan - (소도시 경관 가이드라인 설정 특성에 관한 연구 - 전라남도 기본경관계획 수립 지자체 사례를 대상으로 -)

  • Kim, Yun-Hag;Park, Sung-Jin
    • Journal of the Korean Institute of Rural Architecture
    • /
    • v.16 no.1
    • /
    • pp.1-8
    • /
    • 2014
  • This study investigated the characteristics of the establishment of an architectural guideline which is an important element of a urbanscape plan in basic landscape plans established by four local governments(a county level) in Jeollanam-do since the enactment of the landscape law. The results were as follows. The guideline for landscape plan elements was closely associated with shapes, materials, harmony, and coherence. For the detailed guideline for landscape plan elements, an architectural guideline on the arrangement, height, facade, and roof shapes of buildings, which is one of important elements related to urbanscape, was similar in local governments, showing a standard and uniform tendency. It indicates the limitation of forming urbanscape to enhance local identity and unique features and complementary contents are needed. The color guideline was classified into base color, sub color, and accent color in consideration of local features. In particular, natural material color was commonly used for base and sub color in all local governments. Therefore, it is necessary to develop unique material color and distinctive local color for each region.

Face Detection Using Pixel Direction Code and Look-Up Table Classifier (픽셀 방향코드와 룩업테이블 분류기를 이용한 얼굴 검출)

  • Lim, Kil-Taek;Kang, Hyunwoo;Han, Byung-Gil;Lee, Jong Taek
    • IEMEK Journal of Embedded Systems and Applications
    • /
    • v.9 no.5
    • /
    • pp.261-268
    • /
    • 2014
  • Face detection is essential to the full automation of face image processing application system such as face recognition, facial expression recognition, age estimation and gender identification. It is found that local image features which includes Haar-like, LBP, and MCT and the Adaboost algorithm for classifier combination are very effective for real time face detection. In this paper, we present a face detection method using local pixel direction code(PDC) feature and lookup table classifiers. The proposed PDC feature is much more effective to dectect the faces than the existing local binary structural features such as MCT and LBP. We found that our method's classification rate as well as detection rate under equal false positive rate are higher than conventional one.

Intra-class Local Descriptor-based Prototypical Network for Few-Shot Learning

  • Huang, Xi-Lang;Choi, Seon Han
    • Journal of Korea Multimedia Society
    • /
    • v.25 no.1
    • /
    • pp.52-60
    • /
    • 2022
  • Few-shot learning is a sub-area of machine learning problems, which aims to classify target images that only contain a few labeled samples for training. As a representative few-shot learning method, the Prototypical network has been received much attention due to its simplicity and promising results. However, the Prototypical network uses the sample mean of samples from the same class as the prototypes of that class, which easily results in learning uncharacteristic features in the low-data scenery. In this study, we propose to use local descriptors (i.e., patches along the channel within feature maps) from the same class to explicitly obtain more representative prototypes for Prototypical Network so that significant intra-class feature information can be maintained and thus improving the classification performance on few-shot learning tasks. Experimental results on various benchmark datasets including mini-ImageNet, CUB-200-2011, and tiered-ImageNet show that the proposed method can learn more discriminative intra-class features by the local descriptors and obtain more generic prototype representations under the few-shot setting.

Hybrid vibration-impedance monitoring in prestressed concrete structure with local strand breakage

  • Dang, Ngoc-Loi;Pham, Quang-Quang;Kim, Jeong-Tae
    • Smart Structures and Systems
    • /
    • v.30 no.5
    • /
    • pp.463-477
    • /
    • 2022
  • In this paper, a hybrid vibration-impedance-based damage monitoring approach is experimentally evaluated for prestressed concrete (PSC) structures with local strand breakage. Firstly, the hybrid monitoring scheme is designed to alert damage occurrence from changes in vibration characteristics and to localize strand breakage from changes in impedance signatures. Secondly, a full-scale PSC anchorage is experimented to measure global vibration responses and local impedance responses under a sequence of simulated strand-breakage events. Finally, the measured data are analyzed using the hybrid monitoring framework. The change of structural condition (i.e., damage extent) induced by the local strand breakage is estimated by changes in a few natural frequencies obtained from a few accelerometers in the structure. The damaged strand is locally identified by tomography analysis of impedance features measured via an array of PZT (lead-zirconate-titanate) sensors mounted on the anchorage. Experimental results demonstrate that the strand breakage in the PSC structure can be accurately assessed by using the combined vibration and impedance features.