• Title/Summary/Keyword: sum rule

Search Result 94, Processing Time 0.029 seconds

Multi-layer Neural Network with Hybrid Learning Rules for Improved Robust Capability (Robustness를 형성시키기 위한 Hybrid 학습법칙을 갖는 다층구조 신경회로망)

  • 정동규;이수영
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.31B no.8
    • /
    • pp.211-218
    • /
    • 1994
  • In this paper we develope a hybrid learning rule to improve the robustness of multi-layer Perceptions. In most neural networks the activation of a neuron is deternined by a nonlinear transformation of the weighted sum of inputs to the neurons. Investigating the behaviour of activations of hidden layer neurons a new learning algorithm is developed for improved robustness for multi-layer Perceptrons. Unlike other methods which reduce the network complexity by putting restrictions on synaptic weights our method based on error-backpropagation increases the complexity of the underlying proplem by imposing it saturation requirement on hidden layer neurons. We also found that the additional gradient-descent term for the requirement corresponds to the Hebbian rule and our algorithm incorporates the Hebbian learning rule into the error back-propagation rule. Computer simulation demonstrates fast learning convergence as well as improved robustness for classification and hetero-association of patterns.

  • PDF

A Study of Parallel Reservoir Integrated Operation considering Storage (저류량을 고려한 병렬저수지 연계운영)

  • Park, Ki-Bum;Lee, Soon-Tak
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2006.05a
    • /
    • pp.1176-1181
    • /
    • 2006
  • The purpose of this study was to estimate water supply analysis and reliability indicators by using allocation rule(AR) about Andong Dam and Imha Dam which have parallel reservoirs system. According to the analysis results of allocation rule, for Rule(A) and Rule(B), the contribution of water supply in Andong Dam was 60% more than in Imha Dam, and for Rule(C), the contributions in Andong Dam and Imha Dam were almost equal. In Rule(C), supply is allocated by the ratio which divides the sum of storage and inflow by the mean storage according to the storage state and supply capability state of Andong Dam and Imha Dam. This Rule(C) showed good results in the water supply capability analysis and reliability analysis of parallel reservoirs. In the analysis criteria of water supply in parallel reservoirs system, monthly water change quantity showed better results than monthly constant water quantity in water supply analysis. On the basis of this study, the new technique for water supply analysis was developed to be applied to parallel reservoirs, and this operation rule will establish the efficient operation measures in the application to several kinds of parallel reservoirs system.

  • PDF

Pruning and Learning Fuzzy Rule-Based Classifier

  • Kim, Do-Wan;Park, Jin-Bae;Joo, Young-Hoon
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2004.08a
    • /
    • pp.663-667
    • /
    • 2004
  • This paper presents new pruning and learning methods for the fuzzy rule-based classifier. The structure of the proposed classifier is framed from the fuzzy sets in the premise part of the rule and the Bayesian classifier in the consequent part. For the simplicity of the model structure, the unnecessary features for each fuzzy rule are eliminated through the iterative pruning algorithm. The quality of the feature is measured by the proposed correctness method, which is defined as the ratio of the fuzzy values for a set of the feature values on the decision region to one for all feature values. For the improvement of the classification performance, the parameters of the proposed classifier are finely adjusted by using the gradient descent method so that the misclassified feature vectors are correctly re-categorized. The cost function is determined as the squared-error between the classifier output for the correct class and the sum of the maximum output for the rest and a positive scalar. Then, the learning rules are derived from forming the gradient. Finally, the fuzzy rule-based classifier is tested on two data sets and is found to demonstrate an excellent performance.

  • PDF

On Combining Chase-2 and Sum-Product Algorithms for LDPC Codes

  • Tong, Sheng;Zheng, Huijuan
    • ETRI Journal
    • /
    • v.34 no.4
    • /
    • pp.629-632
    • /
    • 2012
  • This letter investigates the combination of the Chase-2 and sum-product (SP) algorithms for low-density parity-check (LDPC) codes. A simple modification of the tanh rule for check node update is given, which incorporates test error patterns (TEPs) used in the Chase algorithm into SP decoding of LDPC codes. Moreover, a simple yet effective approach is proposed to construct TEPs for dealing with decoding failures with low-weight syndromes. Simulation results show that the proposed algorithm is effective in improving both the waterfall and error floor performance of LDPC codes.

Lindley Type Estimators with the Known Norm

  • Baek, Hoh-Yoo
    • Journal of the Korean Data and Information Science Society
    • /
    • v.11 no.1
    • /
    • pp.37-45
    • /
    • 2000
  • Consider the problem of estimating a $p{\times}1$ mean vector ${\underline{\theta}}(p{\geq}4)$ under the quadratic loss, based on a sample ${\underline{x}_{1}},\;{\cdots}{\underline{x}_{n}}$. We find an optimal decision rule within the class of Lindley type decision rules which shrink the usual one toward the mean of observations when the underlying distribution is that of a variance mixture of normals and when the norm ${\parallel}\;{\underline{\theta}}\;-\;{\bar{\theta}}{\underline{1}}\;{\parallel}$ is known, where ${\bar{\theta}}=(1/p){\sum_{i=1}^p}{\theta}_i$ and $\underline{1}$ is the column vector of ones.

  • PDF

A Study on the Implementation of Modified Hybrid Learning Rule (변형하이브리드 학습규칙의 구현에 관한 연구)

  • 송도선;김석동;이행세
    • Journal of the Korean Institute of Telematics and Electronics B
    • /
    • v.31B no.12
    • /
    • pp.116-123
    • /
    • 1994
  • A modified Hybrid learning rule(MHLR) is proposed, which is derived from combining the Back Propagation algorithm that is known as an excellent classifier with modified Hebbian by changing the orginal Hebbian which is a good feature extractor. The network architecture of MHLR is multi-layered neural network. The weights of MHLR are calculated from sum of the weight of BP and the weight of modified Hebbian between input layer and higgen layer and from the weight of BP between gidden layer and output layer. To evaluate the performance, BP, MHLR and the proposed Hybrid learning rule (HLR) are simulated by Monte Carlo method. As the result, MHLR is the best in recognition rate and HLR is the second. In learning speed, HLR and MHLR are much the same, while BP is relatively slow.

  • PDF

A Fuzzy Rule Extraction by EM Algorithm and A Design of Temperature Control System (EM 알고리즘에 의한 퍼지 규칙생성과 온도 제어 시스템의 설계)

  • 오범진;곽근창;유정웅
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.16 no.5
    • /
    • pp.104-111
    • /
    • 2002
  • This paper presents a fuzzy rule extraction method using EM(Expectation-Maximization) algorithm and a design method of adaptive neuro-fuzzy control. EM algorithm is used to estimate a maximum likelihood of a GMM(Gaussian Mixture Model) and cluster centers. The estimated clusters is used to automatically construct the fuzzy rules and membership functions for ANFIS(Adaptive Neuro-Fuzzy Inference System). Finally, we applied the proposed method to the water temperature control system and obtained better results with respect to the number of rules and SAE(Sum of Absolute Error) than previous techniques such as conventional fuzzy controller.

Application of Response Spectrum Method to a Bridge subjected to Multiple Support Excitation (다지점(多支點) 지진하중(地震荷重) 받는 교량(橋梁)에 대한 응답(應答) 스펙트럼법(法)의 적용(適用))

  • Kang, Kee Dong
    • KSCE Journal of Civil and Environmental Engineering Research
    • /
    • v.10 no.3
    • /
    • pp.1-6
    • /
    • 1990
  • The dynamic behaviour of a four-span continuous girder railway bridge subjected to multiple support excitations is investigated using the response spectrum method. Small-amplitude oscillations and linear-elastic material behaviour are assumed. Soil-structure interaction effects are disregarded and only the out-of-plane response of the bridge is considered. The results of the response spectrum analysis are compared with those from a time history analysis. Different combination rules for the superposition of modal maxima as well as supports are employed, such as square-root-of-sum-squares, double sum and p-norm methods.

  • PDF

A study on sequencing of Mixed Model Assembly Line for increasing productivity (혼합모델조립라인의 생산성 제고를 위한 작업순서 결정)

  • 최종열
    • Korean Management Science Review
    • /
    • v.13 no.2
    • /
    • pp.25-48
    • /
    • 1996
  • Mixed Model Assembly Lines (MMALs) are increasingly used to produce differentiated products on a single assembly line without work-in-process storage, Usually, a typical MMAL consists of a number of (1) stations doing exactly the same operation on every job, (2) stations involving operations with different choices, and (3) stations offering operations that are not performed on every job, or that are performed on every job but with many options. For stations of the first type there is no sequencing problem at all. However, for the second type a set-up cost is incurred each time the operation switches from one choice to another. At the third type of stations, different models, requring different amounts and choices of assembly work, creates an uneven flow of work along the line and variations in the work load at these stations. When a subsequence of jobs requires more work load than the station can handle, it is necessary to help the operations at the station or to complete the work elsewhere. Therefore, a schedule which minimize the sum of set-up cost and utility work cost is desired. So this study has developed Fixed Random Ordering Rule (FROR), Fixed Ascending Ordering Rule (FAOR), Fixed Descending Ordering Rule, and Extended NHR (ENHR). ENHR is to choose optimal color ordering of each batch with NHR, and to decide job sequence of the batch with it, too. As the result of experiments, ENHR was the best heuristic algorithm. NHR is a new heuristic rule in which only the minimum addition of violations from both partial sequence and unassigned sequence at every branch could be considered. And this is a heuristic sequencing rule for the third type of stations at MMAL. This study developed one more heuristic algorithm to test the performance of NHR, which is named as Practical Heuristic Rule (PHR).

  • PDF

Low Complexity Multiuser Scheduling in Time-Varying MIMO Broadcast Channels

  • Lee, Seung-Hwan;Lee, Jun-Ho
    • Journal of electromagnetic engineering and science
    • /
    • v.11 no.2
    • /
    • pp.71-75
    • /
    • 2011
  • The sum-rate maximization rule can find an optimal user set that maximizes the sum capacity in multiple input multiple output (MIMO) broadcast channels (BCs), but the search space for finding the optimal user set becomes prohibitively large as the number of users increases. The proposed algorithm selects a user set of the largest effective channel norms based on statistical channel state information (CSI) for reducing the computational complexity, and uses Tomlinson-Harashima precoding (THP) for minimizing the interference between selected users in time-varying MIMO BCs.