• Title/Summary/Keyword: Gradient Descent Learning

Search Result 152, Processing Time 0.029 seconds

Prediction System of Facebook's popular post using Opinion Mining and Machine Learning (오피니언 마이닝과 머신러닝을 이용한 페이스북 인기 게시물 예측 시스템)

  • An, Hyeon-woo;Moon, Nammee
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2017.11a
    • /
    • pp.70-73
    • /
    • 2017
  • 페이스북 SNS 플랫폼에서 제공하는 데이터 수집 프로토콜을 이용해 콘텐츠들의 인기 점수와 사용자 의견들을 수집하고 수집된 정보를 가공하여 기계학습을 진행한다. 오피니언 데이터를 학습함으로 인해 인간의 관점을 모방하게 되며 결과적으로 콘텐츠의 질을 판단하는 요소로써 작용하도록 한다. 데이터의 수집은 페이스북 측에서 제공하는 Graph API 와 Python 을 이용하여 진행한다. Graph API 는 HTTP GET 방식의 프로토콜을 이용하여 요청 하고 JSON 형식으로 결과를 반환한다. 학습은 Multiple Linear Regression 과 Gradient Descent Algorithm(GDA)을 사용하여 진행한다. 이후 학습이 진행된 프로그램에 사용자 의견 데이터를 건네주면 최종인기 점수를 예측하는 시스템을 설명한다.

  • PDF

Learning Fuzzy Rules for Pattern Classification and High-Level Computer Vision

  • Rhee, Chung-Hoon
    • The Journal of the Acoustical Society of Korea
    • /
    • v.16 no.1E
    • /
    • pp.64-74
    • /
    • 1997
  • In many decision making systems, rule-based approaches are used to solve complex problems in the areas of pattern analysis and computer vision. In this paper, we present methods for generating fuzzy IF-THEN rules automatically from training data for pattern classification and high-level computer vision. The rules are generated by construction minimal approximate fuzzy aggregation networks and then training the networks using gradient descent methods. The training data that represent features are treated as linguistic variables that appear in the antecedent clauses of the rules. Methods to generate the corresponding linguistic labels(values) and their membership functions are presented. In addition, an inference procedure is employed to deduce conclusions from information presented to our rule-base. Two experimental results involving synthetic and real are given.

  • PDF

Fuzzy-Sliding Mode Control of Polishing Robot Based on Genetic Algorithm

  • Go, Seok-Jo;Lee, Min-Cheol;Park, Min-Kyu
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 1999.10a
    • /
    • pp.173-176
    • /
    • 1999
  • This paper shows a self tuning fuzzy inference method by the genetic algorithm in the fuzzy-sliding mode control for a Polishing robot. Using this method, the number of inference rules and the shape of membership functions are determined by the genetic algorithm. The fuzzy outputs of the consequent part are derived by the gradient descent method. Also, it is guaranteed that .the selected solution become the global optimal solution by optimizing the Akaike's information criterion expressing the quality of the inference rules. It is shown by simulations that the method of fuzzy inference by the genetic algorithm provides better learning capability than the trial and error method.

  • PDF

Crack Identification Using Neuro-Fuzzy-Evolutionary Technique

  • Shim, Mun-Bo;Suh, Myung-Won
    • Journal of Mechanical Science and Technology
    • /
    • v.16 no.4
    • /
    • pp.454-467
    • /
    • 2002
  • It has been established that a crack has an important effect on the dynamic behavior of a structure. This effect depends mainly on the location and depth of the crack. Toidentifythelocation and depth of a crack in a structure, a method is presented in this paper which uses neuro-fuzzy-evolutionary technique, that is, Adaptive-Network-based Fuzzy Inference System (ANFIS) solved via hybrid learning algorithm (the back-propagation gradient descent and the least-squares method) and Continuous Evolutionary Algorithms (CEAs) solving sir ale objective optimization problems with a continuous function and continuous search space efficiently are unified. With this ANFIS and CEAs, it is possible to formulate the inverse problem. ANFIS is used to obtain the input(the location and depth of a crack) - output(the structural Eigenfrequencies) relation of the structural system. CEAs are used to identify the crack location and depth by minimizing the difference from the measured frequencies. We have tried this new idea on beam structures and the results are promising.

Design of RBF Neural Network Controller Based on Fuzzy Control Rules (퍼지 제어규칙을 기반으로한 RBF 신경회로망 제어기 설계)

  • Choi, Jong-Soo;Kwon, Oh-Shin
    • Proceedings of the KIEE Conference
    • /
    • 1997.07b
    • /
    • pp.394-396
    • /
    • 1997
  • This paper describes RBF network controller based on fuzzy control rules for intelligent control of nonlinear systems. The proposed scheme is derived from the functional equivalence between RBF networks and fuzzy inference systems. The design procedure of the proposed scheme is realized by first transforming the fuzzy control rules into the parameters of RBF networks. The optimized RBF network controller is then performed through the gradient descent learning mechanism to an error function. The proposed method is rigorously tested using a nonlinear and unstable nonlinear system. Simulation is performed to demonstrate the feasibility and effectiveness of the proposed scheme.

  • PDF

On-line Estimation of DNB Protection Limit via a Fuzzy Neural Network

  • Na, Man-Gyun
    • Nuclear Engineering and Technology
    • /
    • v.30 no.3
    • /
    • pp.222-234
    • /
    • 1998
  • The Westinghouse OT$\Delta$T DNB protection logic heavily restricts the operation region by applying the same logic for a full range of operating pressure in order to maintain its simplicity. In this work, a fuzzy neural network method is used to estimate the DNB protection limit using the measured average temperature and pressure of a reactor core. Fuzzy system parameters are optimized by a hybrid learning method. This algorithm uses a gradient descent algorithm to optimize the antecedent parameters and a least-squares algorithm to solve the consequent parameters. The proposed method is applied to Yonggwang 3&4 nuclear power plants and the proposed method has 5.99 percent larger thermal margin than the conventional OT$\Delta$T trip logic. This simple algorithm provides a good information for the nuclear power plant operation and diagnosis by estimating the DNB protection limit each time step.

  • PDF

Constructive Methods of Fuzzy Rules for Function Approximation

  • Maeda, Michiharu;Miyajima, Hiromi
    • Proceedings of the IEEK Conference
    • /
    • 2002.07c
    • /
    • pp.1626-1629
    • /
    • 2002
  • This paper describes novel methods to construct fuzzy inference rules with gradient descent. The present methods have a constructive mechanism of the rule unit that is applicable in two parameters: the central value and the width of the membership function in the antecedent part. The first approach is to create the rule unit at the nearest position from the input space, for the central value of the membership function in the antecedent part. The second is to create the rule unit which has the minimum width, for the width of the membership function in the antecedent part. Experimental results are presented in order to show that the proposed methods are effective in difference on the inference error and the number of learning iterations.

  • PDF

On-line Modeling for Nonlinear Process Systems using the Adaptive Fuzzy-Neural Network (적응 퍼지-뉴럴 네트워크를 이용한 비선형 공정의 On-line 모델링)

  • Park, Chun-Seong;Oh, Sung-Kwun;Kim, Hyun-Ki
    • Proceedings of the KIEE Conference
    • /
    • 1998.11b
    • /
    • pp.537-539
    • /
    • 1998
  • In this paper, we construct the on-line model structure for the nonlinear process systems using the adaptive fuzzy-neural network. Adaptive fuzzy-neural network usually consists of two distinct modifiable structure, with both, the premise and the consequent part. These two parts can be adapted by different optimization methods, which are the hybrid learning procedure combining gradient descent method and least square method. To achieve the on-line model structure, we use the recursive least square method for the consequent parameter identification of nonlinear process. We design the interface between PLC and main computer, and construct the monitoring and control simulator for the nonlinear process. The proposed on-line modeling to real process is carried out to obtain the effective and accurate results.

  • PDF

Modeling of Chaotic Systems Using a DNA Coding Based Wavelet Neural Network (DNA 코딩 기반 웨이블릿 신경 회로망을 이용한 혼돈 시스템의 모델링)

  • You, Sung-Jin;Choi, Yoon-Ho;Park, Jin-Bae
    • Proceedings of the KIEE Conference
    • /
    • 2003.07d
    • /
    • pp.2176-2178
    • /
    • 2003
  • This paper presents the intelligent modeling method of chaotic systems using a DNA coding based wavelet neural network(WNN). Generally the mathematical teaming method such as gradient descent method is used to adjust the parameters of WNN, which has much computational cost. To overcome this kind of problem, we use the DNA coding method as the learning method of WNN, and then combine it with the WNN. Finally, to verify the efficiency of our method, we apply the proposed DNA coding based wavelet neural network for modeling of Duffing system, which is a representative continuous-time chaotic system.

  • PDF

A Trust-Region ICA algorithm (Trust-Region ICA 알고리듬)

  • Park, Heeyoul;Kim, Sookjeong;Park, Seungjin
    • Proceedings of the Korean Information Science Society Conference
    • /
    • 2004.04b
    • /
    • pp.721-723
    • /
    • 2004
  • A trust-region method is a quite attractive optimization technique. It is, in general, faster than the steepest descent method and is free of a learning rate unlike the gradient-based methods. In addition to its convergence property (between linear and quadratic convergence), ifs stability is always guaranteed, in contrast to the Newton's method. In this paper, we present an efficient implementation of the maximum likelihood independent component analysis (ICA) using the trust-region method, which leads to trust-region-based ICA (TR-ICA) algorithms. The useful behavior of our TR-ICA algorithms is confimed through numerical experimental results.

  • PDF