• Title/Summary/Keyword: 3-D Shape Recognition

Search Result 135, Processing Time 0.03 seconds

Three-Dimensional Shape Recognition and Classification Using Local Features of Model Views and Sparse Representation of Shape Descriptors

  • Kanaan, Hussein;Behrad, Alireza
    • Journal of Information Processing Systems
    • /
    • v.16 no.2
    • /
    • pp.343-359
    • /
    • 2020
  • In this paper, a new algorithm is proposed for three-dimensional (3D) shape recognition using local features of model views and its sparse representation. The algorithm starts with the normalization of 3D models and the extraction of 2D views from uniformly distributed viewpoints. Consequently, the 2D views are stacked over each other to from view cubes. The algorithm employs the descriptors of 3D local features in the view cubes after applying Gabor filters in various directions as the initial features for 3D shape recognition. In the training stage, we store some 3D local features to build the prototype dictionary of local features. To extract an intermediate feature vector, we measure the similarity between the local descriptors of a shape model and the local features of the prototype dictionary. We represent the intermediate feature vectors of 3D models in the sparse domain to obtain the final descriptors of the models. Finally, support vector machine classifiers are used to recognize the 3D models. Experimental results using the Princeton Shape Benchmark database showed the average recognition rate of 89.7% using 20 views. We compared the proposed approach with state-of-the-art approaches and the results showed the effectiveness of the proposed algorithm.

A study on the lip shape recognition algorithm using 3-D Model (3차원 모델을 이용한 입모양 인식 알고리즘에 관한 연구)

  • 남기환;배철수
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.6 no.5
    • /
    • pp.783-788
    • /
    • 2002
  • Recently, research and developmental direction of communication system is concurrent adopting voice data and face image in speaking to provide more higher recognition rate then in the case of only voice data. Therefore, we present a method of lipreading in speech image sequence by using the 3-D facial shape model. The method use a feature information of the face image such as the opening-level of lip, the movement of jaw, and the projection height of lip. At first, we adjust the 3-D face model to speeching face Image sequence. Then, to get a feature information we compute variance quantity from adjusted 3-D shape model of image sequence and use the variance quality of the adjusted 3-D model as recognition parameters. We use the intensity inclination values which obtaining from the variance in 3-D feature points as the separation of recognition units from the sequential image. After then, we use discrete HMM algorithm at recognition process, depending on multiple observation sequence which considers the variance of 3-D feature point fully. As a result of recognition experiment with the 8 Korean vowels and 2 Korean consonants, we have about 80% of recognition rate for the plosives md vowels.

A study on the lip shape recognition algorithm using 3-D Model (3차원 모델을 이용한 입모양 인식 알고리즘에 관한 연구)

  • 김동수;남기환;한준희;배철수;나상동
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 1998.11a
    • /
    • pp.181-185
    • /
    • 1998
  • Recently, research and developmental direction of communication system is concurrent adopting voice data and face image in speaking to provide more higher recognition rate then in the case of only voice data. Therefore, we present a method of lipreading in speech image sequence by using the 3-D facial shape model. The method use a feature information of the face image such as the opening-level of lip, the movement of jaw, and the projection height of lip. At first, we adjust the 3-D face model to speeching face image sequence. Then, to get a feature information we compute variance quantity from adjusted 3-D shape model of image sequence and use the variance quality of the adjusted 3-D model as recognition parameters. We use the intensity inclination values which obtaining from the variance in 3-D feature points as the separation of recognition units from the sequential image. After then, we use discrete HMM algorithm at recognition process, depending on multiple observation sequence which considers the variance of 3-D feature point fully. As a result of recognition experiment with the 8 Korean vowels and 2 Korean consonants, we have about 80% of recognition rate for the plosives and vowels.

  • PDF

An Hardware Error Analysis of 3D Automatic Face Recognition Apparatus(3D-AFRA) : Surface Reconstruction (3차원 안면자동인식기(3D-AFRA)의 Hardware 정밀도 검사 : 형상복원 오차분석)

  • Seok, Jae-Hwa;Song, Jung-Hoon;Kim, Hyun-Jin;Yoo, Jung-Hee;Kwak, Chang-Kyu;Lee, Jun-Hee;Kho, Byung-Hee;Kim, Jong-Won;Lee, Eui-Ju
    • Journal of Sasang Constitutional Medicine
    • /
    • v.19 no.2
    • /
    • pp.30-39
    • /
    • 2007
  • 1. Objectives The Face is an important standard for the classification of Sasang Constitution. We are developing 3D Automatic Face Recognition Apparatus(3D-AFRA) to analyse the facial characteristics. This apparatus show us 3D image and data of man's face and measure facial figure data. So we should examine the figure restoration error of 3D Automatic Fare Recognition Apparatus(3D-AFRA) in hardware Error Analysis. 2. Methods We scanned Face status by using 3D Automatic Face Recognition Apparatus(3D-AFRA). And also we scanned Face status by using laser scanner(vivid 9i). We compared facial shape data be restored by 3D Automatic Face Recognition Apparatus(3D-AFRA) with facial shape data that be restorated by 3D laser scanner. And we analysed the average error and the maximum error of two data. 3. Results and Conclusions In frontal face, the average error was 0.48mm. and the maximum error was 4.60mm. In whole face, the average error of was 0.99mm. And the maximum error was 6.64mm. In conclusion, We assessed that accuracy of 3D Automatic Face Recognition Apparatus(3D-AFRA) is considerably good.

  • PDF

OBJECT RECOGNITION ALGORITHM (물체 인지 알고리즘)

  • Shon, Howoong;Cho, Hyun C;Kim, Youngkyung
    • Journal of the Korean Geophysical Society
    • /
    • v.7 no.4
    • /
    • pp.247-253
    • /
    • 2004
  • In this paper, 3D recognizing algorithm which is based on the external shape feature is presented. Since many objects have the regular shape, if we posses the database of pattern and we recognize the object using the database of the object's pattern, it is possible to inspect and/or recognize the objects of many fields. This paper handles on the 3D object recognition algorithm using the geometrical pattern matching by 3D database.

  • PDF

Shape Recognition of a BGA Ball using Ring Illumination (링 조명에 의한 BGA 볼의 3차원 형상 인식)

  • Kim, Jong Hyeong;Nguyen, Chanh D.Tr.
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.19 no.11
    • /
    • pp.960-967
    • /
    • 2013
  • Shape recognition of solder ball bumps in a BGA (Ball Grid Array) is an important issue in flip chip bonding technology. In particular, the semiconductor industry has required faster and more accurate inspection of micron-size solder bumps in flip chip bonding as the density of balls has increased dramatically. The difficulty of this issue comes from specular reflection on the metal ball. Shape recognition of a metal ball is a very realproblem for computer vision systems. Specular reflection of the metal ball appears, disappears, or changes its image abruptly due to tiny movementson behalf of the viewer. This paper presents a practical shape recognition method for three dimensional (3-D) inspection of a BGA using a 5-step ring illumination device. When the ring light illuminates the balls, distinctive specularity images of the balls, which are referred to as "iso-slope contours" in this paper, are shown. By using a mathematical reflectance model, we can drive the 3-D shape information of the ball in aquantitative manner. The experimental results show the usefulness of the method for industrial application in terms of time and accuracy.

An Error Examination of 3D Face Automatic Recognition (3차원 안면자동인식기의 형상복원 오차검사)

  • Suk, Jae-Hwa;Cho, Kyung-Rae;Cho, Yong-Beum;Yoo, Jung-Hee;Kwak, Chang-Kyu;Lee, Soo-Kyung;Kho, Byung-Hee;Kim, Jong-Won;Kim, Kyu-Kon;Lee, Eui-Ju
    • Journal of Sasang Constitutional Medicine
    • /
    • v.18 no.2
    • /
    • pp.41-49
    • /
    • 2006
  • 1. Objectives The Face is an important standard for the classification of Sasang Contitutions. We are developing 3D Face Automatic Recognition Apparatus to analyse the facial characteristics. So We should examine a shape demobilization error of 3D Face Automatic Recognition Apparatus. 2. Methods We compared facial shape data be demobilized by 3D Face Automatic Recognition Apparatus with facial shape data that be demobilized by 3D laser scanner. The subject was two korean men. And We analysed the average error and the maximum error of two data. In this process, We used one datum point(the peak of nose) and two datum line(vertical section and horizontal section). 3. Results and Conclusions In each this comparison, the average error of vertical section was 1.962574mm and 2.703814mm. and the maximum error of vertical section was 16.968249mm and 18.61464mm. the average error of horizontal section was 4.173203mm and 21.487479mm. and the maximum error of horizontal section was 3.571210mm and 17.13255mm. Also We complemented this apparatus a little and We reexamined a shape demobilization error of 3D Face Automatic Recognition Apparatus again. Accuracy of a shape demobilization was improved a little. From now on We complement accuracy of a shape demobilization in 3D Face Recognition Apparatus.

  • PDF

A New Shape-Based Object Category Recognition Technique using Affine Category Shape Model (Affine Category Shape Model을 이용한 형태 기반 범주 물체 인식 기법)

  • Kim, Dong-Hwan;Choi, Yu-Kyung;Park, Sung-Kee
    • The Journal of Korea Robotics Society
    • /
    • v.4 no.3
    • /
    • pp.185-191
    • /
    • 2009
  • This paper presents a new shape-based algorithm using affine category shape model for object category recognition and model learning. Affine category shape model is a graph of interconnected nodes whose geometric interactions are modeled using pairwise potentials. In its learning phase, it can efficiently handle large pose variations of objects in training images by estimating 2-D homography transformation between the model and the training images. Since the pairwise potentials are defined on only relative geometric relationship betweenfeatures, the proposed matching algorithm is translation and in-plane rotation invariant and robust to affine transformation. We apply spectral matching algorithm to find feature correspondences, which are then used as initial correspondences for RANSAC algorithm. The 2-D homography transformation and the inlier correspondences which are consistent with this estimate can be efficiently estimated through RANSAC, and new correspondences also can be detected by using the estimated 2-D homography transformation. Experimental results on object category database show that the proposed algorithm is robust to pose variation of objects and provides good recognition performance.

  • PDF

Efficient 3D Model based Face Representation and Recognition Algorithmusing Pixel-to-Vertex Map (PVM)

  • Jeong, Kang-Hun;Moon, Hyeon-Joon
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.5 no.1
    • /
    • pp.228-246
    • /
    • 2011
  • A 3D model based approach for a face representation and recognition algorithm has been investigated as a robust solution for pose and illumination variation. Since a generative 3D face model consists of a large number of vertices, a 3D model based face recognition system is generally inefficient in computation time and complexity. In this paper, we propose a novel 3D face representation algorithm based on a pixel to vertex map (PVM) to optimize the number of vertices. We explore shape and texture coefficient vectors of the 3D model by fitting it to an input face using inverse compositional image alignment (ICIA) to evaluate face recognition performance. Experimental results show that the proposed face representation and recognition algorithm is efficient in computation time while maintaining reasonable accuracy.

HSFE Network and Fusion Model based Dynamic Hand Gesture Recognition

  • Tai, Do Nhu;Na, In Seop;Kim, Soo Hyung
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.14 no.9
    • /
    • pp.3924-3940
    • /
    • 2020
  • Dynamic hand gesture recognition(d-HGR) plays an important role in human-computer interaction(HCI) system. With the growth of hand-pose estimation as well as 3D depth sensors, depth, and the hand-skeleton dataset is proposed to bring much research in depth and 3D hand skeleton approaches. However, it is still a challenging problem due to the low resolution, higher complexity, and self-occlusion. In this paper, we propose a hand-shape feature extraction(HSFE) network to produce robust hand-shapes. We build a hand-shape model, and hand-skeleton based on LSTM to exploit the temporal information from hand-shape and motion changes. Fusion between two models brings the best accuracy in dynamic hand gesture (DHG) dataset.