• Title/Summary/Keyword: FeedForward Network

Search Result 193, Processing Time 0.032 seconds

Audio Event Classification Using Deep Neural Networks (깊은 신경망을 이용한 오디오 이벤트 분류)

  • Lim, Minkyu;Lee, Donghyun;Kim, Kwang-Ho;Kim, Ji-Hwan
    • Phonetics and Speech Sciences
    • /
    • v.7 no.4
    • /
    • pp.27-33
    • /
    • 2015
  • This paper proposes an audio event classification method using Deep Neural Networks (DNN). The proposed method applies Feed Forward Neural Network (FFNN) to generate event probabilities of ten audio events (dog barks, engine idling, and so on) for each frame. For each frame, mel scale filter bank features of its consecutive frames are used as the input vector of the FFNN. These event probabilities are accumulated for the events and the classification result is determined as the event with the highest accumulated probability. For the same dataset, the best accuracy of previous studies was reported as about 70% when the Support Vector Machine (SVM) was applied. The best accuracy of the proposed method achieves as 79.23% for the UrbanSound8K dataset when 80 mel scale filter bank features each from 7 consecutive frames (in total 560) were implemented as the input vector for the FFNN with two hidden layers and 2,000 neurons per hidden layer. In this configuration, the rectified linear unit was suggested as its activation function.

Precision Position Control of PMSM using Neural Observer and Parameter Compensator

  • Ko, Jong-Sun;Seo, Young-Ger;Kim, Hyun-Sik
    • Journal of Power Electronics
    • /
    • v.8 no.4
    • /
    • pp.354-362
    • /
    • 2008
  • This paper presents neural load torque compensation method which is composed of a deadbeat load torque observer and gains compensation by a parameter estimator. As a result, the response of the PMSM (permanent magnet synchronous motor) obtains better precision position control. To reduce the noise effect, the post-filter is implemented by a MA (moving average) process. The parameter compensator with an RLSM (recursive least square method) parameter estimator is adopted to increase the performance of the load torque observer and main controller. The parameter estimator is combined with a high performance neural load torque observer to resolve problems. The neural network is trained in online phases and it is composed by a feed forward recall and error back-propagation training. During normal operation, the input-output response is sampled and the weighting value is trained multi-times by the error back-propagation method at each sample period to accommodate the possible variations in the parameters or load torque. As a result, the proposed control system has a robust and precise system against load torque and parameter variation. Stability and usefulness are verified by computer simulation and experiment.

A Study on the High-Efficiency. High-Power-Factor AC/DC Boost Converter Using Energy Recovery (에너지 회생 스너버를 적용한 고효률, 고역률 AC/DC Boost 컨버터에 관한 연구)

  • Ryu, Chang-Gyu;Kim, Yong;Bae, Jin-Yong;Baek, Soo-Hyun;Choi, Geun-Soo;Gye, Sang-Bum
    • Proceedings of the KIEE Conference
    • /
    • 2004.10a
    • /
    • pp.160-163
    • /
    • 2004
  • A passive lossless turn-on/turn-off snubber network is proposed for the boost PWM converter. Previous AC/DC PFC Boost Converter perceives feed forward signal of output for average current-mode control. Previous Boost Convertor, the Quantity of input current will be decreased by the decrease of output current in light load, and also Power factor comes to be decreased. Also the efficiency of converter will be decreased by the decrease of power factor. The proposed converter presents the good PFC, low line current harmonic distortions and tight output voltage regulations using energy recovery circuit. All of the semiconductor devices in the converter are turned on under exact or near zero voltage switching(ZVS). No additional voltage and current stresses on the main switch and main diode occur. To show the superiority of this converter is verified through the experiment with a 640W, 100kHz prototype converter.

  • PDF

Enhanced Antibiotic Production by Streptomyces sindenensis Using Artificial Neural Networks Coupled with Genetic Algorithm and Nelder-Mead Downhill Simplex

  • Tripathi, C.K.M.;Khan, Mahvish;Praveen, Vandana;Khan, Saif;Srivastava, Akanksha
    • Journal of Microbiology and Biotechnology
    • /
    • v.22 no.7
    • /
    • pp.939-946
    • /
    • 2012
  • Antibiotic production with Streptomyces sindenensis MTCC 8122 was optimized under submerged fermentation conditions by artificial neural network (ANN) coupled with genetic algorithm (GA) and Nelder-Mead downhill simplex (NMDS). Feed forward back-propagation ANN was trained to establish the mathematical relationship among the medium components and length of incubation period for achieving maximum antibiotic yield. The optimization strategy involved growing the culture with varying concentrations of various medium components for different incubation periods. Under non-optimized condition, antibiotic production was found to be $95{\mu}g/ml$, which nearly doubled ($176{\mu}g/ml$) with the ANN-GA optimization. ANN-NMDS optimization was found to be more efficacious, and maximum antibiotic production ($197{\mu}g/ml$) was obtained by cultivating the cells with (g/l) fructose 2.7602, $MgSO_4$ 1.2369, $(NH_4)_2PO_4$ 0.2742, DL-threonine 3.069%, and soyabean meal 1.952%, for 9.8531 days of incubation, which was roughly 12% higher than the yield obtained by ANN coupled with GA under the same conditions.

Transient State Improvement of Three-Phase ZSI with the Input Feedforward and Fuzzy PI Controller (입력 피드포워드와 퍼지 PI제어기를 갖는 3상 ZSI의 과도상태 개선)

  • WU, Yan-Jun;Jung, Young-Gook;Lim, Young-Cheol
    • Proceedings of the KIPE Conference
    • /
    • 2012.07a
    • /
    • pp.359-360
    • /
    • 2012
  • This paper proposes a scheme of auto-tuning fuzzy PI controller and input voltage feed forward to control the output voltage of a three-phase Z-source inverter (ZSI). The proposed scheme adjusts the ts (Kp and Ki) in real time in order to find the most suitable Kp and Ki for PI controller and to simplify the controller design. The proposed scheme is verified the validity by experiment and co-simulation in PSIM and MATLAB/SIMULINK both load step change and input DC voltage variation in Z-source inverter, and has compared with the conventional PID control scheme. The experiment results involve of three-phase output voltage, Z-network capacitor voltage and dc-link peak voltage value. By those analysis and comparison, the availability of the proposed method in output voltage transient response quality improving has been verified. Compared with conventional PID method, the proposed method showed a more effective and robust control performance for coping with the severe disturbance conditions.

  • PDF

Using a feed forward ANN to model the inelastic behaviour of confined sandwich panels

  • Marante, Maria E.;Barreto, Wilmer J.;Picon, Ricardo A.
    • Structural Engineering and Mechanics
    • /
    • v.71 no.5
    • /
    • pp.545-552
    • /
    • 2019
  • The analysis and design of complex structures like sandwich-panel elements are difficult; the use of finite element method for the analysis is complicated and time consuming when non-linear effects are considered. On the other hand, artificial neural network (ANN) models can capture the non-linear effects and its application requires lesser computational demand. Two ANN models were trained, tested and validated to compute the force for a given displacement of a sandwich-type roof element; 2555 force and element deformation pairs were used for training the ANN models. For the models trained without considering the damping effect, there were two values in the input layer: maximum displacement and current displacement, and for the model considering damping, displacement from the previous step was used as an additional input. Totally, 400 ANN models were trained. Results show that there is a good agreement between the experimental and simulated data, and the models showed a good performance with a mean square error value of 4548.85. Both the ANN models could simulate the inelastic behaviour, loss of rigidity, and evolution of permanent displacements. The models could also interpolate and extrapolate, which enables them to be used as an analysis and design tool for such complex elements.

Prediction of short-term algal bloom using the M5P model-tree and extreme learning machine

  • Yi, Hye-Suk;Lee, Bomi;Park, Sangyoung;Kwak, Keun-Chang;An, Kwang-Guk
    • Environmental Engineering Research
    • /
    • v.24 no.3
    • /
    • pp.404-411
    • /
    • 2019
  • In this study, we designed a data-driven model to predict chlorophyll-a using M5P model tree and extreme learning machine (ELM). The Juksan weir in the Youngsan River has high chlorophyll-a, which is the primary indicator of algal bloom every year. Short-term algal bloom prediction is important for environmental management and ecological assessment. Two models were developed and evaluated for short-term algal bloom prediction. M5P is a classification and regression-analysis-based method, and ELM is a feed-forward neural network with fast learning using the least square estimate for regression. The dataset used in this study includes water temperature, rainfall, solar radiation, total nitrogen, total phosphorus, N/P ratio, and chlorophyll-a, which were collected on a daily basis from January 2013 to December 2016. The M5P model showed that the prediction model after one day had the highest performance power and dropped off rapidly starting with predictions after three days. Comparing the performance power of the ELM model with the M5P model, it was found that the performance power of the 1-7 d chlorophyll-a prediction model was higher. Moreover, in a period of rapidly increasing algal blooms, the ELM model showed higher accuracy than the M5P model.

Improvement of Endoscopic Image using De-Interlacing Technique (De-Interlace 기법을 이용한 내시경 영상의 화질 개선)

  • 신동익;조민수;허수진
    • Journal of Biomedical Engineering Research
    • /
    • v.19 no.5
    • /
    • pp.469-476
    • /
    • 1998
  • In the case of acquisition and displaying medical Images such as ultrasonography and endoscopy on VGA monitor of PC system, image degradation of tear-drop appears through scan conversion. In this study, we compare several methods which can solve this degradation and implement the hardware system that resolves this problem in real-time with PC. It is possible to represent high quality image display and real-time processing and acquisition with specific de-interlacing device and PCI bridge on our hardware system. Image quality is improved remarkably on our hardware system. It is implemented as PC-based system, so acquiring, saving images and describing text comment on those images and PACS networking can be easily implemented.metabolism. All images were spatially normalized to MNI standard PET template and smoothed with 16mm FWHM Gaussian kernel using SPM96. Mean count in cerebral region was normalized. The VOls for 34 cerebral regions were previously defined on the standard template and 17 different counts of mirrored regions to hemispheric midline were extracted from spatially normalized images. A three-layer feed-forward error back-propagation neural network classifier with 7 input nodes and 3 output nodes was used. The network was trained to interpret metabolic patterns and produce identical diagnoses with those of expert viewers. The performance of the neural network was optimized by testing with 5~40 nodes in hidden layer. Randomly selected 40 images from each group were used to train the network and the remainders were used to test the learned network. The optimized neural network gave a maximum agreement rate of 80.3% with expert viewers. It used 20 hidden nodes and was trained for 1508 epochs. Also, neural network gave agreement rates of 75~80% with 10 or 30 nodes in hidden layer. We conclude that artificial neural network performed as well as human experts and could be potentially useful as clinical decision support tool for the localization of epileptogenic zones.

  • PDF

Multi-objective optimization of tapered tubes for crashworthiness by surrogate methodologies

  • Asgari, Masoud;Babaee, Alireza;Jamshidi, Mohammadamin
    • Steel and Composite Structures
    • /
    • v.27 no.4
    • /
    • pp.427-438
    • /
    • 2018
  • In this paper, the single and multi-objective optimization of thin-walled conical tubes with different types of indentations under axial impact has been investigated using surrogate models called metamodels. The geometry of tapered thin-walled tubes has been studied in order to achieve maximum specific energy absorption (SEA) and minimum peak crushing force (PCF). The height, radius, thickness, tapered angle of the tube, and the radius of indentation have been considered as design variables. Based on the design of experiments (DOE) method, the generated sample points are computed using the explicit finite element code. Different surrogate models including Kriging, Feed Forward Neural Network (FNN), Radial Basis Neural Network (RNN), and Response Surface Modelling (RSM) comprised to evaluate the appropriation of such models. The comparison study between surrogate models and the exploration of indentation shapes have been provided. The obtained results show that the RNN method has the minimum mean squared error (MSE) in training points compared to the other methods. Meanwhile, optimization based on surrogate models with lower values of MSE does not provide optimum results. The RNN method demonstrates a lower crashworthiness performance (with a lower value of 125.7% for SEA and a higher value of 56.8% for PCF) in comparison to RSM with an error order of $10^{-3}$. The SEA values can be increased by 17.6% and PCF values can be decreased by 24.63% by different types of indentation. In a specific geometry, higher SEA and lower PCF require triangular and circular shapes of indentation, respectively.

A study on activation functions of Artificial Neural Network model suitable for prediction of the groundwater level in the mid-mountainous area of eastern Jeju island (제주도 동부 중산간지역 지하수위 예측에 적합한 인공신경망 모델의 활성화함수 연구)

  • Mun-Ju Shin;Jeong-Hun Kim;Su-Yeon Kang;Jeong-Han Lee;Kyung Goo Kang
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2023.05a
    • /
    • pp.520-520
    • /
    • 2023
  • 제주도 동부 중산간 지역은 화산암으로 구성된 지하지질로 인해 지하수위의 변동폭이 크고 변동양상이 복잡하여 인공신경망(Artificial Neural Network, ANN) 모델 등을 활용한 지하수위의 예측이 어렵다. ANN에 적용되는 활성화함수에 따라 지하수의 예측성능은 달라질 수 있으므로 활성화함수의 비교분석 후 적절한 활성화함수의 사용이 반드시 필요하다. 본 연구에서는 5개 활성화함수(sigmoid, hyperbolic tangent(tanh), Rectified Linear Unit(ReLU), Leaky Rectified Linear Unit(Leaky ReLU), Exponential Linear Unit(ELU))를 제주도 동부 중산간지역에 위치한 2개 지하수 관정에 대해 비교분석하여 최적 활성화함수 도출을 목표로 한다. 또한 최적 활성화함수를 활용한 ANN의 적용성을 평가하기 위해 최근 널리 사용되고 있는 순환신경망 모델인 Long Short-Term Memory(LSTM) 모델과 비교분석 하였다. 그 결과, 2개 관정 중 지하수위 변동폭이 상대적으로 큰 관정은 ELU 함수, 상대적으로 작은 관정은 Leaky ReLU 함수가 지하수위 예측에 적절하였다. 예측성능이 가장 낮은 활성화함수는 sigmoid 함수로 나타나 첨두 및 최저 지하수위 예측 시 사용을 지양해야 할 것으로 판단된다. 도출된 최적 활성화함수를 사용한 ANN-ELU 모델 및 ANN-Leaky ReLU 모델을 LSTM 모델과 비교분석한 결과 대등한 지하수위 예측성능을 나타내었다. 이것은 feed-forward 방식인 ANN 모델을 사용하더라도 적절한 활성화함수를 사용하면 최신 순환신경망과 대등한 결과를 도출하여 활용 가능성이 충분히 있다는 것을 의미한다. 마지막으로 LSTM 모델은 가장 적절한 예측성능을 나타내어 다양한 인공지능 모델의 예측성능 비교를 위한 기준이 되는 참고모델로 활용 가능하다. 본 연구에서 제시한 방법은 지하수위 예측과 더불어 하천수위 예측 등 다양한 시계열예측 및 분석연구에 유용하게 사용될 수 있다.

  • PDF