• Title/Summary/Keyword: Q-Learning Algorithm

Search Result 155, Processing Time 0.031 seconds

Development of Artificial Neural Networks for Stability Assessment of Tunnel Excavation in Discontinuous Rock Masses and Rock Mass Classification (불연속 암반내 터널굴착의 안정성 평가 및 암반분류를 위한 인공 신경회로망 개발)

  • 문현구;이철욱
    • Tunnel and Underground Space
    • /
    • v.3 no.1
    • /
    • pp.63-79
    • /
    • 1993
  • The design of tunnels in rock masses often demands more informations on geologic features and rock mass properties than acquired by usual field survey and laboratory testings. In practice, the situation that a perfect set of geological and mechanical input data is given to geomechanics design engineer is rare, while the engineers are asked to achieve a high level of reliability in their design products. This study presents an artificial neural network which is developed to resolve the difficulties encountered in conventional design techniques, particulary the problem of deteriorating the confidence of existing numerical techniques such as the finite element, boundary element and distinct element methods due to the incomplete adn vague input data. The neural network has inferring capabilities to identify the possible failure modes, support requirements and its timing for underground openings, from previous case histories. Use of the neural network has resulted in a better estimate of the correlation between systems of rock mass classifications such as the RMR and Q systems. A back propagation learning algorithm together with a multi-layer network structure is adopted to enhance the inferential accuracy and efficiency of the neural network. A series of experiments comparing the results of the neural network with the actual field observations are performed to demonstrate the abilities of the artificial neural network as a new tunnel design assistance system.

  • PDF

A Novel Efficiency Optimization Control of SynRM Considering Iron Loss with Neural Network (신경회로망에 의한 철손을 고려한 SynRM의 새로운 효율 최적화 제어)

  • Kang, Sung-Joon;Ko, Jae-Sub;Choi, Jung-Sik;Baek, Jung-Woo;Jang, Mi-Geum;Chung, Dong-Hwa
    • Proceedings of the KIEE Conference
    • /
    • 2009.07a
    • /
    • pp.776_777
    • /
    • 2009
  • Optimal efficiency control of synchronous reluctance motor(SynRM) is very important in the sense of energy saving and conservation of natural environment because the efficiency of the SynRM is generally lower than that of other types of AC motors. This paper is proposed a novel efficiency optimization control of SynRM considering iron loss using neural network(NN). The optimal current ratio between torque current and exciting current is analytically derived to drive SynRM at maximum efficiency. This paper is proposed an efficiency optimization control for the SynRM which minimizes the copper and iron losses. The design of the speed controller based on adaptive learning mechanism fuzzy-neural networks(ALM-FNN) controller that is implemented using fuzzy control and neural networks. The objective of the efficiency optimization control is to seek a combination of d and q-axis current components, which provides minimum losses at a certain operating point in steady state. The control performance of the proposed controller is evaluated by analysis for various operating conditions. Analysis results are presented to show the validity of the proposed algorithm.

  • PDF

An application of NN on off-line PD diagnosis to stator coil of Traction Motor (견인전동기용 고정자 코일의 off-line 부분방전 진단을 위한 NN의 적용)

  • Jeon, Yong-Sik;Park, Seong-Hee;Jang, Dong-Uk;Park, Hyun-June;Kang, Seong-Hwa;Lim, Kee-Joe
    • Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
    • /
    • 2004.11a
    • /
    • pp.653-657
    • /
    • 2004
  • In this study, PD(partial discharge) signals which occurrs at stator coil of traction Motor are acquired. these data are used for classifying the PD sources. W(Neural Network) has recently applied to classify the PB pattern. The PD data are used for the learning process to classify PD sources. The PD data come from normal specimen and defective specimens such as internal void discharges, slot discharges and surface discharges. PD distribution parameters are calculated from a set of the data, which is used to realize diagnostic algorithm. NN which applies distribution parameters is useful to classify the PD patterns of defective sources generating in stator coil of traction motor.

  • PDF

A Study of Path-Finding Method of Small Unmanned Aerial Vehicles for Collision Avoidance (소형 무인비행체에서의 충돌회피를 위한 비행경로 생성에 관한 연구)

  • Shin, Saebyuk;Kim, Jinbae;Kim, Shin-Dug;Kim, Cheong Ghil
    • Journal of Satellite, Information and Communications
    • /
    • v.12 no.1
    • /
    • pp.76-80
    • /
    • 2017
  • With the fast growing popularity of small UAVs (Unmanned Aerial Vehicles), recent UAV systems have been designed and utilized for the various field with their own specific purposes. UAVs are opening up many new opportunities in the fields of electronics, sensors, camera, and software for pilots. Increase in awareness and mission capabilities of UAVs are driving innovations and new applications driven with the help of low cost and its capability in undertaking high threat task. In particular, small unmanned aerial vehicles should fly in environments with high probability of unexpected sudden change or obstacle appearance in low altitude situations. In this paper, current researches regarding techniques of autonomous flight of smal UAV systems are introduced and we propose a draft idea for planning paths for small unmanned aerial vehicles in adversarial environments to arrive at the given target safely with low cost sensors.

Investigating Dynamic Mutation Process of Issues Using Unstructured Text Analysis (부도예측을 위한 KNN 앙상블 모형의 동시 최적화)

  • Min, Sung-Hwan
    • Journal of Intelligence and Information Systems
    • /
    • v.22 no.1
    • /
    • pp.139-157
    • /
    • 2016
  • Bankruptcy involves considerable costs, so it can have significant effects on a country's economy. Thus, bankruptcy prediction is an important issue. Over the past several decades, many researchers have addressed topics associated with bankruptcy prediction. Early research on bankruptcy prediction employed conventional statistical methods such as univariate analysis, discriminant analysis, multiple regression, and logistic regression. Later on, many studies began utilizing artificial intelligence techniques such as inductive learning, neural networks, and case-based reasoning. Currently, ensemble models are being utilized to enhance the accuracy of bankruptcy prediction. Ensemble classification involves combining multiple classifiers to obtain more accurate predictions than those obtained using individual models. Ensemble learning techniques are known to be very useful for improving the generalization ability of the classifier. Base classifiers in the ensemble must be as accurate and diverse as possible in order to enhance the generalization ability of an ensemble model. Commonly used methods for constructing ensemble classifiers include bagging, boosting, and random subspace. The random subspace method selects a random feature subset for each classifier from the original feature space to diversify the base classifiers of an ensemble. Each ensemble member is trained by a randomly chosen feature subspace from the original feature set, and predictions from each ensemble member are combined by an aggregation method. The k-nearest neighbors (KNN) classifier is robust with respect to variations in the dataset but is very sensitive to changes in the feature space. For this reason, KNN is a good classifier for the random subspace method. The KNN random subspace ensemble model has been shown to be very effective for improving an individual KNN model. The k parameter of KNN base classifiers and selected feature subsets for base classifiers play an important role in determining the performance of the KNN ensemble model. However, few studies have focused on optimizing the k parameter and feature subsets of base classifiers in the ensemble. This study proposed a new ensemble method that improves upon the performance KNN ensemble model by optimizing both k parameters and feature subsets of base classifiers. A genetic algorithm was used to optimize the KNN ensemble model and improve the prediction accuracy of the ensemble model. The proposed model was applied to a bankruptcy prediction problem by using a real dataset from Korean companies. The research data included 1800 externally non-audited firms that filed for bankruptcy (900 cases) or non-bankruptcy (900 cases). Initially, the dataset consisted of 134 financial ratios. Prior to the experiments, 75 financial ratios were selected based on an independent sample t-test of each financial ratio as an input variable and bankruptcy or non-bankruptcy as an output variable. Of these, 24 financial ratios were selected by using a logistic regression backward feature selection method. The complete dataset was separated into two parts: training and validation. The training dataset was further divided into two portions: one for the training model and the other to avoid overfitting. The prediction accuracy against this dataset was used to determine the fitness value in order to avoid overfitting. The validation dataset was used to evaluate the effectiveness of the final model. A 10-fold cross-validation was implemented to compare the performances of the proposed model and other models. To evaluate the effectiveness of the proposed model, the classification accuracy of the proposed model was compared with that of other models. The Q-statistic values and average classification accuracies of base classifiers were investigated. The experimental results showed that the proposed model outperformed other models, such as the single model and random subspace ensemble model.