• Title/Summary/Keyword: vector optimization

Search Result 471, Processing Time 0.024 seconds

Semi-supervised regression based on support vector machine

  • Seok, Kyungha
    • Journal of the Korean Data and Information Science Society
    • /
    • v.25 no.2
    • /
    • pp.447-454
    • /
    • 2014
  • In many practical machine learning and data mining applications, unlabeled training examples are readily available but labeled ones are fairly expensive to obtain. Therefore semi-supervised learning algorithms have attracted much attentions. However, previous research mainly focuses on classication problems. In this paper, a semi-supervised regression method based on support vector regression (SVR) formulation that is proposed. The estimator is easily obtained via the dual formulation of the optimization problem. The experimental results with simulated and real data suggest superior performance of the our proposed method compared with standard SVR.

On vector variational inequality

  • Lee, Gue-Myung;Kim, Do-Sang;Lee, Byung-Soo;Cho, Sung-Jin
    • Bulletin of the Korean Mathematical Society
    • /
    • v.33 no.4
    • /
    • pp.553-564
    • /
    • 1996
  • Since Giannessi [5] introduced the vector variational inequality in a finite dimensional Euclidean space with further application, Chang et al. [17], Chen et al. [1-4] and Lee et al. [10-16] have considered several kinds of vector variational inequalities in abstract spaces and have obtained existence theorems for their inequalities.

  • PDF

Using Support Vector Regression for Optimization of Black-box Objective Functions (서포트 벡터 회귀를 이용한 블랙-박스 함수의 최적화)

  • Kwak, Min-Jung;Yoon, Min
    • Communications for Statistical Applications and Methods
    • /
    • v.15 no.1
    • /
    • pp.125-136
    • /
    • 2008
  • In many practical engineering design problems, the form of objective functions is not given explicitly in terms of design variables. Given the value of design variables, under this circumstance, the value of objective functions is obtained by real/computational experiments such as structural analysis, fluid mechanic analysis, thermodynamic analysis, and so on. These experiments are, in general, considerably expensive. In order to make the number of these experiments as few as possible, optimization is performed in parallel with predicting the form of objective functions. Response Surface Methods (RSM) are well known along this approach. This paper suggests to apply Support Vector Machines (SVM) for predicting the objective functions. One of most important tasks in this approach is to allocate sample data moderately in order to make the number of experiments as small as possible. It will be shown that the information of support vector can be used effectively to this aim. The effectiveness of our suggested method will be shown through numerical example which is well known in design of engineering.

Real-Time Implementation of the EHSX Speech Coder Using a Floating Point DSP (부동 소수점 DSP를 이용한 4kbps EHSX 음성 부호화기의 실시간 구현)

  • 이인성;박동원;김정호
    • The Journal of the Acoustical Society of Korea
    • /
    • v.23 no.5
    • /
    • pp.420-427
    • /
    • 2004
  • This paper presents real time implementation of 4kbps EHSX (Enhanced Harmonic Stochastic Excitation) speech coder that combines the harmonic vector excitation coding with time-separated transition coding. The harmonic vector excitation coding uses the harmonic excitation coding for voiced frames and used the vector excitation coding with the structure of analysis-by-synthesis for unvoiced frames, respectively. For transition frames mixed with voiced and unvoiced signal, we use the time-separated transition coding. In this paper. we present the optimization methods of implementation speech coder on the EMS320C6701/sup (R)/ DSP. To reduce the complex for real-time implementation. we perform the optimization method in algorithm by replacing the complex sinusoidal synthesis method with IFFT. and we apply fully pipelines hand assembly coding after converting it from floating source to fixed source. To generate a more efficient code. we also make use or the available EMS320C6701/sup (R)/ resources such as Fastest67x library and memory organization.

Investigations on the Optimal Support Vector Machine Classifiers for Predicting Design Feasibility in Analog Circuit Optimization

  • Lee, Jiho;Kim, Jaeha
    • JSTS:Journal of Semiconductor Technology and Science
    • /
    • v.15 no.5
    • /
    • pp.437-444
    • /
    • 2015
  • In simulation-based circuit optimization, many simulation runs may be wasted while evaluating infeasible designs, i.e. the designs that do not meet the constraints. To avoid such a waste, this paper investigates the use of support vector machine (SVM) classifiers in predicting the design's feasibility prior to simulation and the optimal selection of the SVM parameters, namely, the Gaussian kernel shape parameter ${\gamma}$ and the misclassification penalty parameter C. These parameters affect the complexity as well as the accuracy of the model that SVM represents. For instance, the higher ${\gamma}$ is good for detailed modeling and the higher C is good for rejecting noise in the training set. However, our empirical study shows that a low ${\gamma}$ value is preferable due to the high spatial correlation among the circuit design candidates while C has negligible impacts due to the smooth and clean constraint boundaries of most circuit designs. The experimental results with an LC-tank oscillator example show that an optimal selection of these parameters can improve the prediction accuracy from 80 to 98% and model complexity by $10{\times}$.

Prediction of Remaining Useful Life of Lithium-ion Battery based on Multi-kernel Support Vector Machine with Particle Swarm Optimization

  • Gao, Dong;Huang, Miaohua
    • Journal of Power Electronics
    • /
    • v.17 no.5
    • /
    • pp.1288-1297
    • /
    • 2017
  • The estimation of the remaining useful life (RUL) of lithium-ion (Li-ion) batteries is important for intelligent battery management system (BMS). Data mining technology is becoming increasingly mature, and the RUL estimation of Li-ion batteries based on data-driven prognostics is more accurate with the arrival of the era of big data. However, the support vector machine (SVM), which is applied to predict the RUL of Li-ion batteries, uses the traditional single-radial basis kernel function. This type of classifier has weak generalization ability, and it easily shows the problem of data migration, which results in inaccurate prediction of the RUL of Li-ion batteries. In this study, a novel multi-kernel SVM (MSVM) based on polynomial kernel and radial basis kernel function is proposed. Moreover, the particle swarm optimization algorithm is used to search the kernel parameters, penalty factor, and weight coefficient of the MSVM model. Finally, this paper utilizes the NASA battery dataset to form the observed data sequence for regression prediction. Results show that the improved algorithm not only has better prediction accuracy and stronger generalization ability but also decreases training time and computational complexity.

Support vector machine for prediction of the compressive strength of no-slump concrete

  • Sobhani, J.;Khanzadi, M.;Movahedian, A.H.
    • Computers and Concrete
    • /
    • v.11 no.4
    • /
    • pp.337-350
    • /
    • 2013
  • The sensitivity of compressive strength of no-slump concrete to its ingredient materials and proportions, necessitate the use of robust models to guarantee both estimation and generalization features. It was known that the problem of compressive strength prediction owes high degree of complexity and uncertainty due to the variable nature of materials, workmanship quality, etc. Moreover, using the chemical and mineral additives, superimposes the problem's complexity. Traditionally this property of concrete is predicted by conventional linear or nonlinear regression models. In general, these models comprise lower accuracy and in most cases they fail to meet the extrapolation accuracy and generalization requirements. Recently, artificial intelligence-based robust systems have been successfully implemented in this area. In this regard, this paper aims to investigate the use of optimized support vector machine (SVM) to predict the compressive strength of no-slump concrete and compare with optimized neural network (ANN). The results showed that after optimization process, both models are applicable for prediction purposes with similar high-qualities of estimation and generalization norms; however, it was indicated that optimization and modeling with SVM is very rapid than ANN models.

Application of Response Surface Methodology and Plackett Burman Design assisted with Support Vector Machine for the Optimization of Nitrilase Production by Bacillus subtilis AGAB-2

  • Ashish Bhatt;Darshankumar Prajapati;Akshaya Gupte
    • Microbiology and Biotechnology Letters
    • /
    • v.51 no.1
    • /
    • pp.69-82
    • /
    • 2023
  • Nitrilases are a hydrolase group of enzymes that catalyzes nitrile compounds and produce industrially important organic acids. The current objective is to optimize nitrilase production using statistical methods assisted with artificial intelligence (AI) tool from novel nitrile degrading isolate. A nitrile hydrolyzing bacteria Bacillus subtilis AGAB-2 (GenBank Ascension number- MW857547) was isolated from industrial effluent waste through an enrichment culture technique. The culture conditions were optimized by creating an orthogonal design with 7 variables to investigate the effect of the significant factors on nitrilase activity. On the basis of obtained data, an AI-driven support vector machine was used for the fitted regression, which yielded new sets of predicted responses with zero mean error and reduced root mean square error. The results of the above global optimization were regarded as the theoretical optimal function conditions. Nitrilase activity of 9832 ± 15.3 U/ml was obtained under optimized conditions, which is a 5.3-fold increase in compared to unoptimized (1822 ± 18.42 U/ml). The statistical optimization method involving Plackett Burman Design and Response surface methodology in combination with an AI tool created a better response prediction model with a significant improvement in enzyme production.

Vector Quantization for Optimum Quadrature Amplitude Modulated Signals in Rayleigh Fading Channel (레일리 감쇄 채널에서 최적 직교 진폭 변조 신호 전송을 고려한 벡터 양자화)

  • 배진수;한종기;박애경
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.27 no.6B
    • /
    • pp.610-615
    • /
    • 2002
  • This paper considers a communication system consisting of a vector quantizer with selected code vectors with mapped into points in the modulated signal space. The modulated signal is transmitted over a Rayleigh flat fading channel. We optimize the modulated signal constellation to minimize the overall distortion of the system with the fixed vector quantization codebook. The optimization is obtained by partitioning the modulated signal space. Simulation results show that the signal constellation based on the proposed optimization scheme outperforms the conventional methods.

Quantification and location damage detection of plane and space truss using residual force method and teaching-learning based optimization algorithm

  • Shallan, Osman;Hamdy, Osman
    • Structural Engineering and Mechanics
    • /
    • v.81 no.2
    • /
    • pp.195-203
    • /
    • 2022
  • This paper presents the quantification and location damage detection of plane and space truss structures in a two-phase method to reduce the computations efforts significantly. In the first phase, a proposed damage indicator based on the residual force vector concept is used to get the suspected damaged members. In the second phase, using damage quantification as a variable, a teaching-learning based optimization algorithm (TLBO) is used to obtain the damage quantification value of the suspected members obtained in the first phase. TLBO is a relatively modern algorithm that has proved distinguished in solving optimization problems. For more verification of TLBO effeciency, the classical particle swarm optimization (PSO) is used in the second phase to make a comparison between TLBO and PSO algorithms. As it is clear, the first phase reduces the search space in the second phase, leading to considerable reduction in computations efforts. The method is applied on three examples, including plane and space trusses. Results have proved the capability of the proposed method to precisely detect the quantification and location of damage easily with low computational efforts, and the efficiency of TLBO in comparison to the classical PSO.