• Title/Summary/Keyword: Local Descriptors

Search Result 63, Processing Time 0.031 seconds

Face Detection using Orientation(In-Plane Rotation) Invariant Facial Region Segmentation and Local Binary Patterns(LBP) (방향 회전에 불변한 얼굴 영역 분할과 LBP를 이용한 얼굴 검출)

  • Lee, Hee-Jae;Kim, Ha-Young;Lee, David;Lee, Sang-Goog
    • Journal of KIISE
    • /
    • v.44 no.7
    • /
    • pp.692-702
    • /
    • 2017
  • Face detection using the LBP based feature descriptor has issues in that it can not represent spatial information between facial shape and facial components such as eyes, nose and mouth. To address these issues, in previous research, a facial image was divided into a number of square sub-regions. However, since the sub-regions are divided into different numbers and sizes, the division criteria of the sub-region suitable for the database used in the experiment is ambiguous, the dimension of the LBP histogram increases in proportion to the number of sub-regions and as the number of sub-regions increases, the sensitivity to facial orientation rotation increases significantly. In this paper, we present a novel facial region segmentation method that can solve in-plane rotation issues associated with LBP based feature descriptors and the number of dimensions of feature descriptors. As a result, the proposed method showed detection accuracy of 99.0278% from a single facial image rotated in orientation.

Affine Invariant Local Descriptors for Face Recognition (얼굴인식을 위한 어파인 불변 지역 서술자)

  • Gao, Yongbin;Lee, Hyo Jong
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.3 no.9
    • /
    • pp.375-380
    • /
    • 2014
  • Under controlled environment, such as fixed viewpoints or consistent illumination, the performance of face recognition is usually high enough to be acceptable nowadays. Face recognition is, however, a still challenging task in real world. SIFT(Scale Invariant Feature Transformation) algorithm is scale and rotation invariant, which is powerful only in the case of small viewpoint changes. However, it often fails when viewpoint of faces changes in wide range. In this paper, we use Affine SIFT (Scale Invariant Feature Transformation; ASIFT) to detect affine invariant local descriptors for face recognition under wide viewpoint changes. The ASIFT is an extension of SIFT algorithm to solve this weakness. In our scheme, ASIFT is applied only to gallery face, while SIFT algorithm is applied to probe face. ASIFT generates a series of different viewpoints using affine transformation. Therefore, the ASIFT allows viewpoint differences between gallery face and probe face. Experiment results showed our framework achieved higher recognition accuracy than the original SIFT algorithm on FERET database.

Action Recognition with deep network features and dimension reduction

  • Li, Lijun;Dai, Shuling
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.13 no.2
    • /
    • pp.832-854
    • /
    • 2019
  • Action recognition has been studied in computer vision field for years. We present an effective approach to recognize actions using a dimension reduction method, which is applied as a crucial step to reduce the dimensionality of feature descriptors after extracting features. We propose to use sparse matrix and randomized kd-tree to modify it and then propose modified Local Fisher Discriminant Analysis (mLFDA) method which greatly reduces the required memory and accelerate the standard Local Fisher Discriminant Analysis. For feature encoding, we propose a useful encoding method called mix encoding which combines Fisher vector encoding and locality-constrained linear coding to get the final video representations. In order to add more meaningful features to the process of action recognition, the convolutional neural network is utilized and combined with mix encoding to produce the deep network feature. Experimental results show that our algorithm is a competitive method on KTH dataset, HMDB51 dataset and UCF101 dataset when combining all these methods.

Elimination of Grapevine leafroll associated virus-3, Grapevine rupestris stem pitting associated virus and Grapevine virus A from a Tunisian Cultivar by Somatic Embryogenesis and Characterization of the Somaclones Using Ampelographic Descriptors

  • Bouamama-Gzara, Badra;Selmi, Ilhem;Chebil, Samir;Melki, Imene;Mliki, Ahmed;Ghorbel, Abdelwahed;Carra, Angela;Carimi, Francesco;Mahfoudhi, Naima
    • The Plant Pathology Journal
    • /
    • v.33 no.6
    • /
    • pp.561-571
    • /
    • 2017
  • Prospecting of local grapevine (Vitis vinifera L.) germplasm revealed that Tunisia possesses a rich patrimony which presents diversified organoleptic characteristics. However, viral diseases seriously affect all local grapevine cultivars which risk a complete extinction. Sanitation programs need to be established to preserve and exploit, as a gene pool, the Tunisian vineyards areas. The presence of the Grapevine leafroll associated virus-3 (GLRaV-3), Grapevine stem pitting associated virus (GRSPaV) and Grapevine virus A (GVA), were confirmed in a Tunisian grapevine cultivar using serological and molecular analyses. The association between GRSPaV and GVA viruses induces more rugose wood symptoms and damages. For this reason the cleansing of the infected cultivar is highly advisable. Direct and recurrent somatic embryos of cv. 'Hencha' were successfully induced from filament, when cultured on $Ch{\acute{e}}e$and Pool (1987). based-medium, enriched with $2mg1^{-1}$ of 2,4-dichlorophenoxyacetic acid and $2.5mg1^{-1}$ of Thidiazuron, after 36 weeks of culture. After six months of acclimatization, RT-PCR carried on 50 somaplants confirmed the absence of GVA, GRSPaV as well as GLRaV-3 viruses in all somaplants. Ampelographic analysis, based on eight OIV descriptors, was carried out on two years acclimated somaplants, compared to the mother plant. Results demonstrated that the shape and contours of 46 somaclones leaves are identical to mother plant leaves and four phenotypically off-type plants were observed. The healthy state of 100% 'Hencha' somaclones and the high percentage of phenotypically true-to-type plants demonstrate that somatic embryogenesis is a promising technique to adopt for grapevine viruses elimination.

Image Identifier based on Local Feature's Histogram and Acceleration Technique using GPU (지역 특징 히스토그램 기반 영상식별자와 GPU 가속화)

  • Jeon, Hyeok-June;Seo, Yong-Seok;Hwang, Chi-Jung
    • Journal of KIISE:Computing Practices and Letters
    • /
    • v.16 no.9
    • /
    • pp.889-897
    • /
    • 2010
  • Recently, a cutting-edge large-scale image database system has demanded these attributes: search with alarming speed, performs with high accuracy, archives efficiently and much more. An image identifier (descriptor) is for measuring the similarity of two images which plays an important role in this system. The extraction method of an image identifier can be roughly classified into two methods: a local and global method. In this paper, the proposed image identifier, LFH(Local Feature's Histogram), is obtained by a histogram of robust and distinctive local descriptors (features) constrained by a district sub-division of a local region. Furthermore, LFH has not only the properties of a local and global descriptor, but also can perform calculations at a magnificent clip to determine distance with pinpoint accuracy. Additionally, we suggested a way to extract LFH via GPU (OpenGL and GLSL). In this experiment, we have compared the LFH with SIFT (local method) and EHD (global method) via storage capacity, extraction and retrieval time along with accuracy.

Image Retrieval Using Spatial Color Correlation and Texture Characteristics Based on Local Fourier Transform (색상의 공간적인 상관관계와 국부적인 푸리에 변환에 기반한 질감 특성을 이용한 영상 검색)

  • Park, Ki-Tae;Moon, Young-Shik
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.44 no.1
    • /
    • pp.10-16
    • /
    • 2007
  • In this paper, we propose a technique for retrieving images using spatial color correlation and texture characteristics based on local fourier transform. In order to retrieve images, two new descriptors are proposed. One is a color descriptor which represents spatial color correlation. The other is a descriptor combining the proposed color descriptor with texture descriptor. Since most of existing color descriptors including color correlogram which represent spatial color correlation considered just color distribution between neighborhood pixels, the structural information of neighborhood pixels is not considered. Therefore, a novel color descriptor which simultaneously represents spatial color distribution and structural information is proposed. The proposed color descriptor represents color distribution of Min-Max color pairs calculating color distance between center pixel and neighborhood pixels in a block with 3x3 size. Also, the structural information which indicates directional difference between minimum color and maximum color is simultaneously considered. Then new color descriptor(min-max color correlation descriptor, MMCCD) containing mean and variance values of each directional difference is generated. While the proposed color descriptor includes by far smaller feature vector over color correlogram, the proposed color descriptor improves 2.5 % ${\sim}$ 13.21% precision rate, compared with color correlogram. In addition, we propose a another descriptor which combines the proposed color descriptor and texture characteristics based on local fourier transform. The combined method reduces size of feature vector as well as shows improved results over existing methods.

Robust Facial Expression Recognition Based on Local Directional Pattern

  • Jabid, Taskeed;Kabir, Md. Hasanul;Chae, Oksam
    • ETRI Journal
    • /
    • v.32 no.5
    • /
    • pp.784-794
    • /
    • 2010
  • Automatic facial expression recognition has many potential applications in different areas of human computer interaction. However, they are not yet fully realized due to the lack of an effective facial feature descriptor. In this paper, we present a new appearance-based feature descriptor, the local directional pattern (LDP), to represent facial geometry and analyze its performance in expression recognition. An LDP feature is obtained by computing the edge response values in 8 directions at each pixel and encoding them into an 8 bit binary number using the relative strength of these edge responses. The LDP descriptor, a distribution of LDP codes within an image or image patch, is used to describe each expression image. The effectiveness of dimensionality reduction techniques, such as principal component analysis and AdaBoost, is also analyzed in terms of computational cost saving and classification accuracy. Two well-known machine learning methods, template matching and support vector machine, are used for classification using the Cohn-Kanade and Japanese female facial expression databases. Better classification accuracy shows the superiority of LDP descriptor against other appearance-based feature descriptors.

An Edge Histogram Descriptor for MPEG-7 (MPEG-7을 위한 에지 히스토그램 서술자)

  • 박동권;전윤석;박수준;원치선
    • Journal of Broadcast Engineering
    • /
    • v.5 no.1
    • /
    • pp.31-40
    • /
    • 2000
  • In this paper, we propose an edge histogram to efficiently represent the edge distribution in the image for MPEG-7. To this end, we adopt global, semi-global, and local edge histogram bins. Also, we extract the edge information from the image in terms of image blocks rather than pixels, which reduces the extraction complexity and is also applicable to the block-based compression standards such as MPEG-1, and 2. Experimental results show that the proposed method yields better retrieval accuracy and feature extraction speed comparing to other non-homogeneous texture descriptors of MPEG-7 including the wavelet-based descriptor and local edge-based descriptor.

  • PDF

Robust Features and Accurate Inliers Detection Framework: Application to Stereo Ego-motion Estimation

  • MIN, Haigen;ZHAO, Xiangmo;XU, Zhigang;ZHANG, Licheng
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.11 no.1
    • /
    • pp.302-320
    • /
    • 2017
  • In this paper, an innovative robust feature detection and matching strategy for visual odometry based on stereo image sequence is proposed. First, a sparse multiscale 2D local invariant feature detection and description algorithm AKAZE is adopted to extract the interest points. A robust feature matching strategy is introduced to match AKAZE descriptors. In order to remove the outliers which are mismatched features or on dynamic objects, an improved random sample consensus outlier rejection scheme is presented. Thus the proposed method can be applied to dynamic environment. Then, geometric constraints are incorporated into the motion estimation without time-consuming 3-dimensional scene reconstruction. Last, an iterated sigma point Kalman Filter is adopted to refine the motion results. The presented ego-motion scheme is applied to benchmark datasets and compared with state-of-the-art approaches with data captured on campus in a considerably cluttered environment, where the superiorities are proved.

Shape Description and Retrieval Using Included-Angular Ternary Pattern

  • Xu, Guoqing;Xiao, Ke;Li, Chen
    • Journal of Information Processing Systems
    • /
    • v.15 no.4
    • /
    • pp.737-747
    • /
    • 2019
  • Shape description is an important and fundamental issue in content-based image retrieval (CBIR), and a number of shape description methods have been reported in the literature. For shape description, both global information and local contour variations play important roles. In this paper a new included-angular ternary pattern (IATP) based shape descriptor is proposed for shape image retrieval. For each point on the shape contour, IATP is derived from its neighbor points, and IATP has good properties for shape description. IATP is intrinsically invariant to rotation, translation and scaling. To enhance the description capability, multiscale IATP histogram is presented to describe both local and global information of shape. Then multiscale IATP histogram is combined with included-angular histogram for efficient shape retrieval. In the matching stage, cosine distance is used to measure shape features' similarity. Image retrieval experiments are conducted on the standard MPEG-7 shape database and Swedish leaf database. And the shape image retrieval performance of the proposed method is compared with other shape descriptors using the standard evaluation method. The experimental results of shape retrieval indicate that the proposed method reaches higher precision at the same recall value compared with other description method.