• Title/Summary/Keyword: Learning capability

Search Result 688, Processing Time 0.028 seconds

Self-Organizing Polynomial Neural Networks Based on Genetically Optimized Multi-Layer Perceptron Architecture

  • Park, Ho-Sung;Park, Byoung-Jun;Kim, Hyun-Ki;Oh, Sung-Kwun
    • International Journal of Control, Automation, and Systems
    • /
    • v.2 no.4
    • /
    • pp.423-434
    • /
    • 2004
  • In this paper, we introduce a new topology of Self-Organizing Polynomial Neural Networks (SOPNN) based on genetically optimized Multi-Layer Perceptron (MLP) and discuss its comprehensive design methodology involving mechanisms of genetic optimization. Let us recall that the design of the 'conventional' SOPNN uses the extended Group Method of Data Handling (GMDH) technique to exploit polynomials as well as to consider a fixed number of input nodes at polynomial neurons (or nodes) located in each layer. However, this design process does not guarantee that the conventional SOPNN generated through learning results in optimal network architecture. The design procedure applied in the construction of each layer of the SOPNN deals with its structural optimization involving the selection of preferred nodes (or PNs) with specific local characteristics (such as the number of input variables, the order of the polynomials, and input variables) and addresses specific aspects of parametric optimization. An aggregate performance index with a weighting factor is proposed in order to achieve a sound balance between the approximation and generalization (predictive) abilities of the model. To evaluate the performance of the GA-based SOPNN, the model is experimented using pH neutralization process data as well as sewage treatment process data. A comparative analysis indicates that the proposed SOPNN is the model having higher accuracy as well as more superb predictive capability than other intelligent models presented previously.reviously.

A self-organizing algorithm for multi-layer neural networks (다층 신경회로망을 위한 자기 구성 알고리즘)

  • 이종석;김재영;정승범;박철훈
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.41 no.3
    • /
    • pp.55-65
    • /
    • 2004
  • When a neural network is used to solve a given problem it is necessary to match the complexity of the network to that of the problem because the complexity of the network significantly affects its learning capability and generalization performance. Thus, it is desirable to have an algorithm that can find appropriate network structures in a self-organizing way. This paper proposes algorithms which automatically organize feed forward multi-layer neural networks with sigmoid hidden neurons for given problems. Using both constructive procedures and pruning procedures, the proposed algorithms try to find the near optimal network, which is compact and shows good generalization performance. The performances of the proposed algorithms are tested on four function regression problems. The results demonstrate that our algorithms successfully generate near-optimal networks in comparison with the previous method and the neural networks of fixed topology.

Alternative optimization procedure for parameter design using neural network without SN (파라미터 설계에서 신호대 잡음비 사용 없이 신경망을 이용한 최적화 대체방안)

  • Na, Myung-Whan;Kwon, Yong-Man
    • Journal of the Korean Data and Information Science Society
    • /
    • v.21 no.2
    • /
    • pp.211-218
    • /
    • 2010
  • Taguchi has used the signal-to-noise ratio (SN) to achieve the appropriate set of operating conditions where variability around target is low in the Taguchi parameter design. Many Statisticians criticize the Taguchi techniques of analysis, particularly those based on the SN. Moreover, there are difficulties in practical application, such as complexity and nonlinear relationships among quality characteristics and design (control) factors, and interactions occurred among control factors. Neural networks have a learning capability and model free characteristics. There characteristics support neural networks as a competitive tool in processing multivariable input-output implementation. In this paper we propose a substantially simpler optimization procedure for parameter design using neural network without resorting to SN. An example is illustrated to compare the difference between the Taguchi method and neural network method.

Relationships Between the Characteristics of the Business Data Set and Forecasting Accuracy of Prediction models (시계열 데이터의 성격과 예측 모델의 예측력에 관한 연구)

  • 이원하;최종욱
    • Journal of Intelligence and Information Systems
    • /
    • v.4 no.1
    • /
    • pp.133-147
    • /
    • 1998
  • Recently, many researchers have been involved in finding deterministic equations which can accurately predict future event, based on chaotic theory, or fractal theory. The theory says that some events which seem very random but internally deterministic can be accurately predicted by fractal equations. In contrast to the conventional methods, such as AR model, MA, model, or ARIMA model, the fractal equation attempts to discover a deterministic order inherent in time series data set. In discovering deterministic order, researchers have found that neural networks are much more effective than the conventional statistical models. Even though prediction accuracy of the network can be different depending on the topological structure and modification of the algorithms, many researchers asserted that the neural network systems outperforms other systems, because of non-linear behaviour of the network models, mechanisms of massive parallel processing, generalization capability based on adaptive learning. However, recent survey shows that prediction accuracy of the forecasting models can be determined by the model structure and data structures. In the experiments based on actual economic data sets, it was found that the prediction accuracy of the neural network model is similar to the performance level of the conventional forecasting model. Especially, for the data set which is deterministically chaotic, the AR model, a conventional statistical model, was not significantly different from the MLP model, a neural network model. This result shows that the forecasting model. This result shows that the forecasting model a, pp.opriate to a prediction task should be selected based on characteristics of the time series data set. Analysis of the characteristics of the data set was performed by fractal analysis, measurement of Hurst index, and measurement of Lyapunov exponents. As a conclusion, a significant difference was not found in forecasting future events for the time series data which is deterministically chaotic, between a conventional forecasting model and a typical neural network model.

  • PDF

K Nearest Neighbor Joins for Big Data Processing based on Spark (Spark 기반 빅데이터 처리를 위한 K-최근접 이웃 연결)

  • JIAQI, JI;Chung, Yeongjee
    • Journal of the Korea Institute of Information and Communication Engineering
    • /
    • v.21 no.9
    • /
    • pp.1731-1737
    • /
    • 2017
  • K Nearest Neighbor Join (KNN Join) is a simple yet effective method in machine learning. It is widely used in small dataset of the past time. As the number of data increases, it is infeasible to run this model on an actual application by a single machine due to memory and time restrictions. Nowadays a popular batch process model called MapReduce which can run on a cluster with a large number of computers is widely used for large-scale data processing. Hadoop is a framework to implement MapReduce, but its performance can be further improved by a new framework named Spark. In the present study, we will provide a KNN Join implement based on Spark. With the advantage of its in-memory calculation capability, it will be faster and more effective than Hadoop. In our experiments, we study the influence of different factors on running time and demonstrate robustness and efficiency of our approach.

A Software Cost Estimation Using Growth Curve Model (성장곡선을 이용한 소프트웨어 비용 추정 모델)

  • Park, Seok-Gyu;Lee, Sang-Un;Park, Jae-Heung
    • The KIPS Transactions:PartD
    • /
    • v.11D no.3
    • /
    • pp.597-604
    • /
    • 2004
  • Accurate software cost estimation is essential to both developers and customers. Most of the cost estimating models based on the size measure methods, such as LOC and FP, are obtained through size estimation. The accuracy of size estimation directly influences the accuracy of cost estimation. As a result, the overall structure of regression-based cost models applies the power function based on software size. Many growth phenomenon in nature such as the growth in living organism, performance of technology, and learning capability of human show an S-shaped curve. This paper proposes a model which estimates the developing effort by using the growth curve. The presented model assumes that the relation cost and size follows the growth curve. The appropriateness of the growth curve model based on Function Point, Full-Function Point and Use-Case Point, which are the general methods in estimating the software size have been confirmed. The proposed growth curve model shows similar performance with power function model. In conclusion, the growth curve model can be applied in the estimation of the software cost.

3D lattice information space for TV contents based on spatial metaphor : TV interface perspective (공간적 은유를 적용한 3D 격자구조의 TV 콘텐츠 정보공간 제안 : TV 인터페이스 사용성 관점에서)

  • Lee, Jae-Gil;Shin, Donghee
    • Journal of Digital Contents Society
    • /
    • v.15 no.5
    • /
    • pp.651-661
    • /
    • 2014
  • The complexity to search a specific content over TV platform is drastically increasing. Based on previous studies from computer data management system, we propose a new method that helps users to search and select content effectively. In general, contents over computers are represented by spatial metaphor, which replicates our physical environment and value systems about space. We suggest 3D lattice structure to construct information space for TV platform. Users can infer relevance between contents via special clue in information space, so as to select content more easily. Also, they can search contents through its temporal property that also represented in space. We make full use of our natural capability that can reduce additional overload to learning new interface. The results of this study can be significant and heuristic contributions, as they can be applied to diverse service areas utilizing video contents.

Application of support vector machine with firefly algorithm for investigation of the factors affecting the shear strength of angle shear connectors

  • Chahnasir, E. Sadeghipour;Zandi, Y.;Shariati, M.;Dehghani, E.;Toghroli, A.;Mohamad, E. Tonnizam;Shariati, A.;Safa, M.;Wakil, K.;Khorami, M.
    • Smart Structures and Systems
    • /
    • v.22 no.4
    • /
    • pp.413-424
    • /
    • 2018
  • The factors affecting the shear strength of the angle shear connectors in the steel-concrete composite beams can play an important role to estimate the efficacy of a composite beam. Therefore, the current study has aimed to verify the output of shear capacity of angle shear connector according to the input provided by Support Vector Machine (SVM) coupled with Firefly Algorithm (FFA). SVM parameters have been optimized through the use of FFA, while genetic programming (GP) and artificial neural networks (ANN) have been applied to estimate and predict the SVM-FFA models' results. Following these results, GP and ANN have been applied to develop the prediction accuracy and generalization capability of SVM-FFA. Therefore, SVM-FFA could be performed as a novel model with predictive strategy in the shear capacity estimation of angle shear connectors. According to the results, the Firefly algorithm has produced a generalized performance and be learnt faster than the conventional learning algorithms.

A Study on The Effect Business Performance of Convergence Capabilities on Corporate (기업의 융합역량이 경영성과에 미치는 영향)

  • Choi, Seung-Il;Song, Seong-Bin
    • Journal of Digital Convergence
    • /
    • v.13 no.1
    • /
    • pp.177-184
    • /
    • 2015
  • Modern society is rapidly going digital as blowing hot air about it Convergence castration. Iran fusion product management, technology, and services such as free from black-and-white logic of various activities such as management of alternative recognition by further series of management innovation in the way of trying to fill the other gaps win-win. In addition, the company is to survive through the creation and unceasing. Performance of firms in contemporary globalization, which is still more sensitive. In this study, based on the fusion needs of the enterprise and explores how this convergence competencies affect to business performance. Results showed that the fusion capacity is affecting the financial performance and non-financial performance. That fusion technology education learning capability and convergence capabilities appeared to affect the financial performance and non-financial performance.

A Control Method using the modified Elman Neural Network (변형된 Elman 신경회로망을 이용한 제어방식)

  • 최우승;김주동
    • Journal of the Korea Society of Computer and Information
    • /
    • v.4 no.3
    • /
    • pp.67-72
    • /
    • 1999
  • The neural network is a static network that consists of a number of layer: input layer, output layer and one or more hidden layer connected in a feed forward way. The popularity of neural network appear to be its ability of learning and approximation capability. The Elman Neural Network proposed the J. Elman. is a type of recurrent network. Is has the feedback links from hidden layer to context layer. So Elman Neural Network is the better performance than the neural network. In this paper. we propose the Modified Elman Neural Network. The structure of a MENN is based on the basic ENN. The recurrency of the network is due to the feedback links from the output layer and the hidden layer to the context layer. In order to certify the usefulness or the proposed method. the MENN apply to the multi target system. Simulation shows that the proposed MENN method is better performance than the multi layer neural network and ENN.