• Title/Summary/Keyword: Multilayer Perceptron (MLP)

Search Result 130, Processing Time 0.024 seconds

Improvement of Steganalysis Using Multiplication Noise Addition (곱셉 잡음 첨가를 이용한 스테그분석의 성능 개선)

  • Park, Tae-Hee;Eom, Il-Kyu
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.49 no.4
    • /
    • pp.23-30
    • /
    • 2012
  • This paper proposes an improved steganalysis method to detect the existence of secret message. Firstly, we magnify the small stego noise by multiplying the speckle noise to a given image and then we estimate the denoised image by using the soft thresholding method. Because the noises are not perfectly eliminated, some noises exist in the estimated cover image. If the given image is the cover image, then the remained noise will be very small, but if it is the stego image, the remained noise will be relatively large. The parent-child relationship in the wavelet domain will be slighty broken in the stego image. From this characteristic, we extract the joint statistical moments from the difference image between the given image and the denoised image. Additionally, four statistical moments are extracted from the denoised image for the proposed steganalysis method. All extracted features are used as the input of MLP(multilayer perceptron) classifier. Experimental results show that the proposed scheme outperforms previous methods in terms of detection rates and accuracy.

Optimized Feature Selection using Feature Subset IG-MLP Evaluation based Machine Learning Model for Disease Prediction (특징집합 IG-MLP 평가 기반의 최적화된 특징선택 방법을 이용한 질환 예측 머신러닝 모델)

  • Kim, Kyeongryun;Kim, Jaekwon;Lee, Jongsik
    • Journal of the Korea Society for Simulation
    • /
    • v.29 no.1
    • /
    • pp.11-21
    • /
    • 2020
  • Cardio-cerebrovascular diseases (CCD) account for 24% of the causes of death to Koreans and its proportion is the highest except cancer. Currently, the risk of the cardiovascular disease for domestic patients is based on the Framingham risk score (FRS), but accuracy tends to decrease because it is a foreign guideline. Also, it can't score the risk of cerebrovascular disease. CCD is hard to predict, because it is difficult to analyze the features of early symptoms for prevention. Therefore, proper prediction method for Koreans is needed. The purpose of this paper is validating IG-MLP (Information Gain - Multilayer Perceptron) evaluation based feature selection method using CCD data with simulation. The proposed method uses the raw data of the 4th ~ 7th of The Korea National Health and Nutrition Examination Survey (KNHANES). To select the important feature of CCD, analysis on the attributes using IG-MLP are processed, finally CCD prediction ANN model using optimize feature set is provided. Proposed method can find important features of CCD prediction of Koreans, and ANN model could predict more accurate CCD for Koreans.

Design Method for an MLP Neural Network Which Minimizes the Effect by the Quantization of the Weights and the Neuron Outputs (가중치 뉴런 출력의 양자화 영향을 최소화하는 다층퍼셉트론 신경망 설계 방법)

  • Gwon, O-Jun;Bang, Seung-Yang
    • Journal of KIISE:Software and Applications
    • /
    • v.26 no.12
    • /
    • pp.1383-1392
    • /
    • 1999
  • 이미 학습된 다층퍼셉트론 신경망을 디지털 VLSI 기술을 사용하여 하드웨어로 구현할 경우 신경망의 가중치 및 뉴런 출력들을 양자화해야 하는 문제가 발생한다. 이러한 신경망 변수들의 양자화는 결과적으로 주어진 입력에 대한 신경망의 최종 출력에서의 왜곡을 초래한다. 본 논문에서는 먼저 이러한 양자화로 인한 신경망 출력에서의 왜곡을 통계적으로 분석하였다. 분석 결과에 의하면 입력패턴 각 성분의 제곱들의 합과 가중치의 크기들이 양자화 영향에 주로 기여하는 것으로 나타났다. 이러한 분석 결과를 이용하여 양자화를 위한 정밀도가 주어졌을 때, 양자화 영향이 최소화된 다층퍼셉트론 신경망을 설계하는 방법을 제시하였다. 그리고 제안된 방법에 의해 얻은 신경망과 오류역전파 학습방법에 의하여 얻은 신경망의 성능을 비교함으로써 제안된 방법의 효율성을 입증하였다. 실험결과는 낮은 양자화 정밀도에서도 제안된 방법이 더 좋은 성능을 보였다.Abstract When we implement a multilayer perceptron with the digital VLSI technology, we generally have to quantize the weights and the neuron outputs. These quantizations eventually cause distortion in the output of the network for a given input. In this paper first we made a statistical analysis about the effect caused by the quantization on the output of the network. The analysis revealed that the sum of the squared input components and the sizes of the weights are the major factors which contribute to the quantization effect. We present a design method for an MLP which minimizes the quantization effect when the precision of the quantization is given. In order to show the effectiveness of the proposed method, we developed a network by our method and compared it with the one developed by the regular backpropagation. We could confirm that the network developed by our method performs better even with a low precision of the quantization.

A Study on the Implementation of Hybrid Learning Rule for Neural Network (다층신경망에서 하이브리드 학습 규칙의 구현에 관한 연구)

  • Song, Do-Sun;Kim, Suk-Dong;Lee, Haing-Sei
    • The Journal of the Acoustical Society of Korea
    • /
    • v.13 no.4
    • /
    • pp.60-68
    • /
    • 1994
  • In this paper we propose a new Hybrid learning rule applied to multilayer feedforward neural networks, which is constructed by combining Hebbian learning rule that is a good feature extractor and Back-Propagation(BP) learning rule that is an excellent classifier. Unlike the BP rule used in multi-layer perceptron(MLP), the proposed Hybrid learning rule is used for uptate of all connection weights except for output connection weigths becase the Hebbian learning in output layer does not guarantee learning convergence. To evaluate the performance, the proposed hybrid rule is applied to classifier problems in two dimensional space and shows better performance than the one applied only by the BP rule. In terms of learning speed the proposed rule converges faster than the conventional BP. For example, the learning of the proposed Hybrid can be done in 2/10 of the iterations that are required for BP, while the recognition rate of the proposed Hybrid is improved by about $0.778\%$ at the peak.

  • PDF

Fault Classification of a Blade Pitch System in a Floating Wind Turbine Based on a Recurrent Neural Network

  • Cho, Seongpil;Park, Jongseo;Choi, Minjoo
    • Journal of Ocean Engineering and Technology
    • /
    • v.35 no.4
    • /
    • pp.287-295
    • /
    • 2021
  • This paper describes a recurrent neural network (RNN) for the fault classification of a blade pitch system of a spar-type floating wind turbine. An artificial neural network (ANN) can effectively recognize multiple faults of a system and build a training model with training data for decision-making. The ANN comprises an encoder and a decoder. The encoder uses a gated recurrent unit, which is a recurrent neural network, for dimensionality reduction of the input data. The decoder uses a multilayer perceptron (MLP) for diagnosis decision-making. To create data, we use a wind turbine simulator that enables fully coupled nonlinear time-domain numerical simulations of offshore wind turbines considering six fault types including biases and fixed outputs in pitch sensors and excessive friction, slit lock, incorrect voltage, and short circuits in actuators. The input data are time-series data collected by two sensors and two control inputs under the condition that of one fault of the six types occurs. A gated recurrent unit (GRU) that is one of the RNNs classifies the suggested faults of the blade pitch system. The performance of fault classification based on the gate recurrent unit is evaluated by a test procedure, and the results indicate that the proposed scheme works effectively. The proposed ANN shows a 1.4% improvement in its performance compared to an MLP-based approach.

Performance comparison of SVM and neural networks for large-set classification problems (대용량 분류에서 SVM과 신경망의 성능 비교)

  • Lee Jin-Seon;Kim Young-Won;Oh Il-Seok
    • The KIPS Transactions:PartB
    • /
    • v.12B no.1 s.97
    • /
    • pp.25-30
    • /
    • 2005
  • In this paper, we analyzed and compared the performances of modular FFMLP(feedforward multilayer perceptron) and SVUT(Support Vector Machine) for the large-set classification problems. Overall, SVM dominated modular FFMLP in the correct recognition rate and other aspects Additionally, the recognition rate of SVM degraded more slowly than neural network as the number of classes increases. The trend of the recognition rates depending on the rejection rate has been analyzed. The parameter set of SVM(kernel functions and related variables) has been identified for the large-set classification problems.

A Genetic Algorithm and Support Vector Regression based Hybrid Cost Estimation Model for Feature-based Plastic Injection Products (특징기반 플라스틱 사출제품을 위한 유전자 알고리즘과 Support Vector Regression 기반의 하이브리드 비용 평가 모델)

  • Seo, Kwang-Kyu
    • Journal of the Korea Safety Management & Science
    • /
    • v.14 no.3
    • /
    • pp.269-276
    • /
    • 2012
  • 플라스틱 사출 제품은 다양한 가전제품과 하이테크 제품에 널리 사용되고 있다. 그러나 현재의 치열한 경쟁적 비즈니스 환경에서 플라스틱 사출 제품 제조업자들은 고객을 만족시키면서 경쟁력을 얻기 위하여 다른 경쟁자들보다 먼저 새로운 제품을 시장에 출시하고 신제품의 개발기간을 줄이기 위한 노력을 할 여유가 부족하다. 따라서 무한경쟁의 시장에서 살아남기 위해서는 제조업자들은 시장 마켓 점유를 빠르게 올리는 것과 동시에 제품의 가격 경쟁력을 가져야 한다. 특징기반 모델의 구조는 현재 연구에서 3D 제작 도구로서 일반적으로 적용되고 있으며 신제품 개발 엔지니어들이 새로운 제품의 개념을 개발하는 데에도 널리 사용되고 있다. 본 연구에서는 특징기반 플라스틱 사출제품을 위한 유전자 알고리즘과 Support Vector Regression (SVR) 기반의 새로운 하이브리드 비용 평가 모델을 제안한다. 제안하는 하이브리드 모델은 기존의 플라스틱 사출제품의 비용평가절차와 계산을 위해 필요로 하는 변수들을 극적으로 간단하게 하고 줄일 수 있다. 사례연구에서는 제안하는 하이브리드 모델과 기존의 multilayer perceptron networks (MLP) 및 pure SVR과의 비교분석을 통하여 제안모델이 플라스틱 사출 제품의 개발단계에서의 비용평가문제를 해결하는데 효율성과 효과성이 있음을 입증한다.

Statistical RBF Network with Applications to an Expert System for Characterizing Diabetes Mellitus

  • Om, Kyong-Sik;Kim, Hee-Chan;Min, Byoung-Goo;Shin, Chan-So;Lee, Hong-Kyu
    • Journal of Electrical Engineering and information Science
    • /
    • v.3 no.3
    • /
    • pp.355-365
    • /
    • 1998
  • The purposes of this study are to propose a network for the characterizing of the input data and to show how to design predictive neural net재가 expert system which doesn't need previous knowledge base. We derived this network from the radial basis function networks(RBFN), and named it as a statistical EBFN. The proposed network can replace the statistical methods for analyzing dynamic relations between target disease and other parameters in medical studies. We compared statistical RBFN with the probabilistic neural network(PNN) and fuzzy logic(FL). And we testified our method in the diabetes prediction and compared our method with the well-known multilayer perceptron(MLP) neural network one, and showed good performance of our network. At last, we developed the diabetes prediction expert system based on the proposed statistical RBFN without previous knowledge base. Not only the applicability of the characterizing of parameters related to diabetes and construction of the diabetes prediction expert system but also wide applicabilities has the proposed statistical RBFN to other similar problems.

  • PDF

An advanced PRPD Pattern recognition method considering frequency analysis of the PD signals detected in GIS (PD 신호의 주파수 분석이 고려된 GIS 절연 결함 분류를 위한 Advanced PRPD 패턴인식)

  • Park, Jae-Hong;Jung, Seung-Yong;Ryu, Chel-Hwi;Kim, Young-Hong;Lee, Young-Jo;Lim, Yun-Sok;Koo, Ja-Yoon
    • Proceedings of the KIEE Conference
    • /
    • 2007.07a
    • /
    • pp.1443-1444
    • /
    • 2007
  • 지속적으로 증가되는 전기에너지 공급의 신뢰성을 높이기 위하여 전력설비 주요 사고 원인인 부분방전(PD : Partial Discharge)을 검출하고 결함원의 패턴인식 방법의 개발 필요성 날로 증가되고 있다. 본 논문은 부분방전의 패턴인식 확률을 높이기 위하여 검출된 부분방전의 주파수 분석을 이용하여 Conventional PRPD Analysis 방법의 결함 판독확률을 향상시키기 위하여 Advanced PRPD를 제안 한다. 이를 위하여, GIS(Gas Insulated Switchgear)의 주요 사고원인으로 인식되어 있는 결함들을 인위적으로 제작 후 삽입하여 부분방전을 발생시켜 자체 설계 개발된 UHF 내장형 센서를 이용하여 검출하였다. 새로이 제안하는 방법과 기존의 PRPD 방법의 인식률을 상호 비교하기 위하여, 두 가지 그룹을, 즉, 기존의 방법에 의한 것과 부분방전의 주파수 분석이 포함된 방법에 의한 데이터그룹을 구축하고 학습방법은 동일한 인공신경망 MLP (Multilayer Perceptron)를 이용하여 인식률과 학습시간을 동시에 비교하였다. 상호 비교 결과에 의하면, 후자의 방법이 인식확률 뿐만아니라 학습시간도 좋은 결과가 나타났다.

  • PDF

Precise prediction of radiation interaction position in plastic rod scintillators using a fast and simple technique: Artificial neural network

  • Peyvandi, R. Gholipour;rad, S.Z. Islami
    • Nuclear Engineering and Technology
    • /
    • v.50 no.7
    • /
    • pp.1154-1159
    • /
    • 2018
  • Precise prediction of the radiation interaction position in scintillators plays an important role in medical and industrial imaging systems. In this research, the incident position of the gamma rays was predicted precisely in a plastic rod scintillator by using attenuation technique and multilayer perceptron (MLP) neural network, for the first time. Also, this procedure was performed using nonlinear regression (NLR) method. The experimental setup is comprised of a plastic rod scintillator (BC400) coupled with two PMTs at two sides, a $^{60}Co$ gamma source and two counters that record count rates. Using two proposed techniques (ANN and NLR), the radiation interaction position was predicted in a plastic rod scintillator with a mean relative error percentage less than 4.6% and 14.6%, respectively. The mean absolute error was measured less than 2.5 and 5.5. The correlation coefficient was calculated 0.998 and 0.984, respectively. Also, the ANN technique was confirmed by leave-one-out (LOO) method with 1% error. These results presented the superiority of the ANN method in comparison with NLR and the other methods. The technique and set up used are simpler and faster than other the previous position sensitive detectors. Thus, the time, cost and shielding and electronics requirements are minimized and optimized.