• Title/Summary/Keyword: Non-linear Classification

Search Result 108, Processing Time 0.023 seconds

Food Powder Classification Using a Portable Visible-Near-Infrared Spectrometer

  • You, Hanjong;Kim, Youngsik;Lee, Jae-Hyung;Jang, Byung-Jun;Choi, Sunwoong
    • Journal of electromagnetic engineering and science
    • /
    • v.17 no.4
    • /
    • pp.186-190
    • /
    • 2017
  • Visible-near-infrared (VIS-NIR) spectroscopy is a fast and non-destructive method for analyzing materials. However, most commercial VIS-NIR spectrometers are inappropriate for use in various locations such as in homes or offices because of their size and cost. In this paper, we classified eight food powders using a portable VIS-NIR spectrometer with a wavelength range of 450-1,000 nm. We developed three machine learning models using the spectral data for the eight food powders. The proposed three machine learning models (random forest, k-nearest neighbors, and support vector machine) achieved an accuracy of 87%, 98%, and 100%, respectively. Our experimental results showed that the support vector machine model is the most suitable for classifying non-linear spectral data. We demonstrated the potential of material analysis using a portable VIS-NIR spectrometer.

A Multi-Class Classifier of Modified Convolution Neural Network by Dynamic Hyperplane of Support Vector Machine

  • Nur Suhailayani Suhaimi;Zalinda Othman;Mohd Ridzwan Yaakub
    • International Journal of Computer Science & Network Security
    • /
    • v.23 no.11
    • /
    • pp.21-31
    • /
    • 2023
  • In this paper, we focused on the problem of evaluating multi-class classification accuracy and simulation of multiple classifier performance metrics. Multi-class classifiers for sentiment analysis involved many challenges, whereas previous research narrowed to the binary classification model since it provides higher accuracy when dealing with text data. Thus, we take inspiration from the non-linear Support Vector Machine to modify the algorithm by embedding dynamic hyperplanes representing multiple class labels. Then we analyzed the performance of multi-class classifiers using macro-accuracy, micro-accuracy and several other metrics to justify the significance of our algorithm enhancement. Furthermore, we hybridized Enhanced Convolution Neural Network (ECNN) with Dynamic Support Vector Machine (DSVM) to demonstrate the effectiveness and efficiency of the classifier towards multi-class text data. We performed experiments on three hybrid classifiers, which are ECNN with Binary SVM (ECNN-BSVM), and ECNN with linear Multi-Class SVM (ECNN-MCSVM) and our proposed algorithm (ECNNDSVM). Comparative experiments of hybrid algorithms yielded 85.12 % for single metric accuracy; 86.95 % for multiple metrics on average. As for our modified algorithm of the ECNN-DSVM classifier, we reached 98.29 % micro-accuracy results with an f-score value of 98 % at most. For the future direction of this research, we are aiming for hyperplane optimization analysis.

Analysis of Novelty Detection Properties of Autoassociative MLP (자기연상 다층퍼셉트론의 이상 탐지 성질 분석)

  • Lee, Hyoung-joo;Hwang, Byung-ho;Cho, Sungzoon
    • Journal of Korean Institute of Industrial Engineers
    • /
    • v.28 no.2
    • /
    • pp.147-161
    • /
    • 2002
  • In novelty detection, one attempts to discriminate abnormal patterns from normal ones. Novelty detection is quite difficult since, unlike usual two class classification problems, only normal patterns are available for training. Auto-Associative Multi-Layer Perceptron (AAMLP) has been shown to provide a good performance based upon the property that novel patterns usually have larger auto-associative errors. In this paper, we give a mathematical analysis of 2-layer AAMLP's output characteristics and empirical results of 2-layer and 4-layer AAMLPs. Various activation functions such as linear, saturated linear and sigmoid are compared. The 2-layer AAMLPs cannot identify non-linear boundaries while the 4-layer ones can. When the data distribution is multi-modal, then an ensemble of AAMLPs, each of which is trained with pre-clustered data is required. This paper contributes to understanding of AAMLP networks and leads to practical recommendations regarding its use.

Selection of Kernels and its Parameters in Applying SVM to ASV (온라인 서명 검증을 위한 SVM의 커널 함수와 결정 계수 선택)

  • Fan, Yunhe;Woo, Young-Woon;Kim, Seong-Hoon
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • 2015.10a
    • /
    • pp.1045-1046
    • /
    • 2015
  • When using the Support Vector Machine in the online signature verification, SVM kernel function should be chosen to use non-linear SVM and the constant parameters in the kernel functions should be adjusted to appropriate values to reduce the error rate of signature verification. Non-linear SVM which is built on a strong mathematical basis shows better performance of classification with the higher discrimination power. However, choosing the kernel function and adjusting constant parameter values depend on the heuristics of the problem domain. In the signature verification, this paper deals with the problems of selecting the correct kernel function and constant parameters' values, and shows the kernel function and coefficient parameter's values with the minimum error rate. As a result of this research, we expect the average error rate to be less than 1%.

  • PDF

Homogeneous and Non-homogeneous Polynomial Based Eigenspaces to Extract the Features on Facial Images

  • Muntasa, Arif
    • Journal of Information Processing Systems
    • /
    • v.12 no.4
    • /
    • pp.591-611
    • /
    • 2016
  • High dimensional space is the biggest problem when classification process is carried out, because it takes longer time for computation, so that the costs involved are also expensive. In this research, the facial space generated from homogeneous and non-homogeneous polynomial was proposed to extract the facial image features. The homogeneous and non-homogeneous polynomial-based eigenspaces are the second opinion of the feature extraction of an appearance method to solve non-linear features. The kernel trick has been used to complete the matrix computation on the homogeneous and non-homogeneous polynomial. The weight and projection of the new feature space of the proposed method have been evaluated by using the three face image databases, i.e., the YALE, the ORL, and the UoB. The experimental results have produced the highest recognition rate 94.44%, 97.5%, and 94% for the YALE, ORL, and UoB, respectively. The results explain that the proposed method has produced the higher recognition than the other methods, such as the Eigenface, Fisherface, Laplacianfaces, and O-Laplacianfaces.

Disassembly and Classification for Recovery of EOL Products

  • Min, Sun-Dong;Matsuoka, Shinobu;Muraki, Masaaki
    • Industrial Engineering and Management Systems
    • /
    • v.2 no.1
    • /
    • pp.35-44
    • /
    • 2003
  • Recovery of end-of-life (EOL) products is an environmentally and economically sound way to achieve many of the goals of sustainable development. Many product recovery systems are dependent upon destructive disassembly such as shredding, which undesirably causes a large volume of shredder dust and makes parts reuse impossible. Although non-destructive disassembly has been considered as an alternative for solving the problems, the classification of disassembled items has not been sufficiently investigated. In this paper, we propose a model that mathematically optimizes the disassembly and classification of EOL products. Based on the AND/OR graph that illustrates all possible disassembly sequences of a given product, we identify the physical properties that are considered as constraints in the model. As a result of the solution procedure, the recovery problem can be transformed into a mixed integer linear programming (MILP) model. We show an example that illustrates the concept of our model.

A Diagnosis Method of Basal Cell Carcinoma by Raman Spectra of Skin Tissue using NMF Algorithm (피부 조직의 라만 스펙트럼에서 NMF 알고리즘을 통한 기저 세포암 진단 방법)

  • Park, Aaron;Baek, Sung-June
    • Journal of the Institute of Electronics and Information Engineers
    • /
    • v.50 no.8
    • /
    • pp.196-202
    • /
    • 2013
  • Basal cell carcinoma (BCC) is the most common skin cancer and its incidence is increasing rapidly. In this paper, we propose a diagnosis method of basal cell carcinoma by Raman spectra of skin tissue using the NMF(non-negative matrix factorization) algorithm. After preprocessing steps, measured Raman spectra is used classification experiments. The weight and the basis can be obtained in a simple matrix operation and a column vector of the matrix decompsed by the NMF. Linear combination of bases and weights, it is possible to approximate the average of Raman spectra. The classification method is to select the class which to minimize the root mean square of the difference of the linear combination and the objective spectrum. According to the experimental results, the proposed method shows the promising results to diagnosis BCC. In addition, it confirmed that the proposed method compared with the previous research result could be effectively applied in the analysis of the Raman spectra.

An investigation of subband decomposition and feature-dimension reduction for musical genre classification (음악 장르 분류를 위한 부밴드 분해와 특징 차수 축소에 관한 연구)

  • Seo, Jin Soo;Kim, Junghyun;Park, Jihyun
    • The Journal of the Acoustical Society of Korea
    • /
    • v.36 no.2
    • /
    • pp.144-150
    • /
    • 2017
  • Musical genre is indispensible in constructing music information retrieval system, such as music search and classification. In general, the spectral characteristics of a music signal are obtained based on a subband decomposition to represent the relative distribution of the harmonic and the non-harmonic components. In this paper, we investigate the subband decomposition parameters in extracting features, which improves musical genre classification accuracy. In addition, the linear projection methods are studied to reduce the resulting feature dimension. Experiments on the widely used music datasets confirmed that the subband decomposition finer than the widely-adopted octave scale is conducive in improving genre-classification accuracy and showed that the feature-dimension reduction is effective reducing a classifier's computational complexity.

Experiments on the Novelty Detection Capability of Auto-Associative Multi-Layer Perceptron (자기연상 다층퍼셉트론의 이상 탐지 성능에 대한 실험)

  • Lee Hyeong Ju;Hwang Byeong Ho;Jo Seong Jun
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2002.05a
    • /
    • pp.632-638
    • /
    • 2002
  • In novelty detection, one attempts to discriminate abnormal patterns from normal ones. Novelty detection is quite difficult since, unlike usual two class classification problems, only normal patterns are available for training. Auto-Associative Multi-Layer Perceptron (AAMLP) has been shown to provide a good performance based upon the property that novel patterns usually have larger auto-associative errors. In this paper, we give a mathematical analysis of 2-layer AAMLP's output characteristics and empirical results of 2-layer and 4-layer AAMLPs. Various activation functions such as linear, saturated linear and sigmoid are compared. The 2-layer AAMLPs cannot identify non-linear boundaries while the 4-layer ones can. When the data distribution is multi-modal, then an ensemble of AAMLPs, each of which is trained with pre-clustered data is required. This paper contributes to understanding of AAMLP networks and leads to practical recommendations regarding its use.

  • PDF

Modified complex mode superposition design response spectrum method and parameters optimization for linear seismic base-isolation structures

  • Huang, Dong-Mei;Ren, Wei-Xin;Mao, Yun
    • Earthquakes and Structures
    • /
    • v.4 no.4
    • /
    • pp.341-363
    • /
    • 2013
  • Earthquake response calculation, parametric analysis and seismic parameter optimization of base-isolated structures are some critical issues for seismic design of base-isolated structures. To calculate the earthquake responses for such non-symmetric and non-classical damping linear systems and to implement the earthquake resistant design codes, a modified complex mode superposition design response spectrum method is put forward. Furthermore, to do parameter optimization for base-isolation structures, a graphical approach is proposed by analyzing the relationship between the base shear ratio of a seismic base-isolation floor to non-seismic base-isolation one and frequency ratio-damping ratio, as well as the relationship between the seismic base-isolation floor displacement and frequency ratio-damping ratio. In addition, the influences of mode number and site classification on the seismic base-isolation structure and corresponding optimum parameters are investigated. It is demonstrated that the modified complex mode superposition design response spectrum method is more precise and more convenient to engineering applications for utilizing the damping reduction factors and the design response spectrum, and the proposed graphical approach for parameter optimization of seismic base-isolation structures is compendious and feasible.