• Title/Summary/Keyword: Feedforward Neural Network Model

Search Result 70, Processing Time 0.022 seconds

A novel radioactive particle tracking algorithm based on deep rectifier neural network

  • Dam, Roos Sophia de Freitas;dos Santos, Marcelo Carvalho;do Desterro, Filipe Santana Moreira;Salgado, William Luna;Schirru, Roberto;Salgado, Cesar Marques
    • Nuclear Engineering and Technology
    • /
    • v.53 no.7
    • /
    • pp.2334-2340
    • /
    • 2021
  • Radioactive particle tracking (RPT) is a minimally invasive nuclear technique that tracks a radioactive particle inside a volume of interest by means of a mathematical location algorithm. During the past decades, many algorithms have been developed including ones based on artificial intelligence techniques. In this study, RPT technique is applied in a simulated test section that employs a simplified mixer filled with concrete, six scintillator detectors and a137Cs radioactive particle emitting gamma rays of 662 keV. The test section was developed using MCNPX code, which is a mathematical code based on Monte Carlo simulation, and 3516 different radioactive particle positions (x,y,z) were simulated. Novelty of this paper is the use of a location algorithm based on a deep learning model, more specifically a 6-layers deep rectifier neural network (DRNN), in which hyperparameters were defined using a Bayesian optimization method. DRNN is a type of deep feedforward neural network that substitutes the usual sigmoid based activation functions, traditionally used in vanilla Multilayer Perceptron Networks, for rectified activation functions. Results show the great accuracy of the DRNN in a RPT tracking system. Root mean squared error for x, y and coordinates of the radioactive particle is, respectively, 0.03064, 0.02523 and 0.07653.

Spatial Estimation of soil roughness and moisture from Sentinel-1 backscatter over Yanco sites: Artificial Neural Network, and Fractal

  • Lee, Ju Hyoung
    • Proceedings of the Korea Water Resources Association Conference
    • /
    • 2020.06a
    • /
    • pp.125-125
    • /
    • 2020
  • European Space Agency's Sentinel-1 has an improved spatial and temporal resolution, as compared to previous satellite data such as Envisat Advanced SAR (ASAR) or Advanced Scatterometer (ASCAT). Thus, the assumption used for low-resolution retrieval algorithms used by ENVISAT ASAR or ASCAT is not applicable to Sentinel-1, because a higher degree of land surface heterogeneity should be considered for retrieval. The assumption of homogeneity over land surface is not valid any more. In this study, considering that soil roughness is one of the key parameters sensitive to soil moisture retrievals, various approaches are discussed. First, soil roughness is spatially inverted from Sentinel-1 backscattering over Yanco sites in Australia. Based upon this, Artificial Neural Networks data (feedforward multiplayer perception, MLP, Levenberg-Marquadt algorithm) are compared with Fractal approach (brownian fractal, Hurst exponent of 0.5). When using ANNs, training data are achieved from theoretical forward scattering models, Integral Equation Model (IEM). and Sentinel-1 measurements. The network is trained by 20 neurons and one hidden layer, and one input layer. On the other hand, fractal surface roughness is generated by fitting 1D power spectrum model with roughness spectra. Fractal roughness profile is produced by a stochastic process describing probability between two points, and Hurst exponent, as well as rms heights (a standard deviation of surface height). Main interest of this study is to estimate a spatial variability of roughness without the need of local measurements. This non-local approach is significant, because we operationally have to be independent from local stations, due to its few spatial coverage at the global level. More fundamentally, SAR roughness is much different from local measurements, Remote sensing data are influenced by incidence angle, large scale topography, or a mixing regime of sensors, although probe deployed in the field indicate point data. Finally, demerit and merit of these approaches will be discussed.

  • PDF

A Feasibility Study on Using Neural Network for Dose Calculation in Radiation Treatment (방사선 치료 선량 계산을 위한 신경회로망의 적용 타당성)

  • Lee, Sang Kyung;Kim, Yong Nam;Kim, Soo Kon
    • Journal of Radiation Protection and Research
    • /
    • v.40 no.1
    • /
    • pp.55-64
    • /
    • 2015
  • Dose calculations which are a crucial requirement for radiotherapy treatment planning systems require accuracy and rapid calculations. The conventional radiotherapy treatment planning dose algorithms are rapid but lack precision. Monte Carlo methods are time consuming but the most accurate. The new combined system that Monte Carlo methods calculate part of interesting domain and the rest is calculated by neural can calculate the dose distribution rapidly and accurately. The preliminary study showed that neural networks can map functions which contain discontinuous points and inflection points which the dose distributions in inhomogeneous media also have. Performance results between scaled conjugated gradient algorithm and Levenberg-Marquardt algorithm which are used for training the neural network with a different number of neurons were compared. Finally, the dose distributions of homogeneous phantom calculated by a commercialized treatment planning system were used as training data of the neural network. In the case of homogeneous phantom;the mean squared error of percent depth dose was 0.00214. Further works are programmed to develop the neural network model for 3-dimensinal dose calculations in homogeneous phantoms and inhomogeneous phantoms.

Goal Regulation Mechanism through Reinforcement Learning in a Fractal Manufacturing System (FrMS) (프랙탈 생산시스템에서의 강화학습을 통한 골 보정 방법)

  • Sin Mun-Su;Jeong Mu-Yeong
    • Proceedings of the Korean Operations and Management Science Society Conference
    • /
    • 2006.05a
    • /
    • pp.1235-1239
    • /
    • 2006
  • Fractal manufacturing system (FrMS) distinguishes itself from other manufacturing systems by the fact that there is a fractal repeated at every scale. A fractal is a volatile organization which consists of goal-oriented agents referred to as AIR-units (autonomous and intelligent resource units). AIR-units unrestrictedly reconfigure fractals in accordance with their own goals. Their goals can be dynamically changed along with the environmental status. Since goals of AIR-units are represented as fuzzy models, an AIR-unit itself is a fuzzy logic controller. This paper presents a goal regulation mechanism in the FrMS. In particular, a reinforcement learning method is adopted as a regulating mechanism of the fuzzy goal model, which uses only weak reinforcement signal. Goal regulation is achieved by building a feedforward neural network to estimate compatibility level of current goals, which can then adaptively improve compatibility by using the gradient descent method. Goal-oriented features of AIR-units are also presented.

  • PDF

ANN Rotor Resistance Estimation of Induction Motor Drive using Multi-AFLC (다중 AFLC를 이용한 유도전동기 드라이브의 ANN 회전자저항 추정)

  • Ko, Jae-Sub;Choi, Jung-Sik;Chung, Dong-Hwa
    • Journal of the Korean Institute of Illuminating and Electrical Installation Engineers
    • /
    • v.25 no.4
    • /
    • pp.45-56
    • /
    • 2011
  • This paper is proposed artificial neural network(ANN) rotor resistance estimation of induction motor drive controlled by multi-adaptive fuzzy learning controller(AFLC). A simple double layer feedforward ANN trained by the back-propagation technique is employed in the rotor resistance identification. In this estimator, double models of the state variable estimations are used; one provides the actual induction motor output states and the other gives the ANN model output states. The total error between the desired and actual state variables is then back propagated to adjust the weights of the ANN model, so that the output of this model tracks the actual output. When the training is completed, the weights of the ANN correspond to the parameters in the actual motor. The estimation and control performance of ANN and multi-AFLC is evaluated by analysis for various operating conditions. Also, this paper is proposed the analysis results to verify the effectiveness of this controller.

Analyzing the Impact of Multivariate Inputs on Deep Learning-Based Reservoir Level Prediction and Approaches for Mid to Long-Term Forecasting (다변량 입력이 딥러닝 기반 저수율 예측에 미치는 영향 분석과 중장기 예측 방안)

  • Hyeseung Park;Jongwook Yoon;Hojun Lee;Hyunho Yang
    • The Transactions of the Korea Information Processing Society
    • /
    • v.13 no.4
    • /
    • pp.199-207
    • /
    • 2024
  • Local reservoirs are crucial sources for agricultural water supply, necessitating stable water level management to prepare for extreme climate conditions such as droughts. Water level prediction is significantly influenced by local climate characteristics, such as localized rainfall, as well as seasonal factors including cropping times, making it essential to understand the correlation between input and output data as much as selecting an appropriate prediction model. In this study, extensive multivariate data from over 400 reservoirs in Jeollabuk-do from 1991 to 2022 was utilized to train and validate a water level prediction model that comprehensively reflects the complex hydrological and climatological environmental factors of each reservoir, and to analyze the impact of each input feature on the prediction performance of water levels. Instead of focusing on improvements in water level performance through neural network structures, the study adopts a basic Feedforward Neural Network composed of fully connected layers, batch normalization, dropout, and activation functions, focusing on the correlation between multivariate input data and prediction performance. Additionally, most existing studies only present short-term prediction performance on a daily basis, which is not suitable for practical environments that require medium to long-term predictions, such as 10 days or a month. Therefore, this study measured the water level prediction performance up to one month ahead through a recursive method that uses daily prediction values as the next input. The experiment identified performance changes according to the prediction period and analyzed the impact of each input feature on the overall performance based on an Ablation study.

Comparison of Audio Event Detection Performance using DNN (DNN을 이용한 오디오 이벤트 검출 성능 비교)

  • Chung, Suk-Hwan;Chung, Yong-Joo
    • The Journal of the Korea institute of electronic communication sciences
    • /
    • v.13 no.3
    • /
    • pp.571-578
    • /
    • 2018
  • Recently, deep learning techniques have shown superior performance in various kinds of pattern recognition. However, there have been some arguments whether the DNN performs better than the conventional machine learning techniques when classification experiments are done using a small amount of training data. In this study, we compared the performance of the conventional GMM and SVM with DNN, a kind of deep learning techniques, in audio event detection. When tested on the same data, DNN has shown superior overall performance but SVM was better than DNN in segment-based F-score.

A Study on GA-based Optimized Polynomial Neural Networks and Its Application to Nonlinear Process (유전자 알고리즘 기반 최적 다항식 뉴럴네트워크 연구 및 비선형 공정으로의 응용)

  • Kim Wan-Su;Lee In-Tae;Oh Sung-Kwun;Kim Hyun-Ki
    • Journal of the Korean Institute of Intelligent Systems
    • /
    • v.15 no.7
    • /
    • pp.846-851
    • /
    • 2005
  • In this paper, we propose Genetic Algorithms(GAs)-based Optimized Polynomial Neural Networks(PNN). The proposed algorithm is based on Group Method of Data Handling(GMDH) method and its structure is similar to feedforward Neural Networks. But the structure of PNN is not fixed like in conventional neural networks and can be generated in a dynamic manner. As each node of PNN structure, we use several types of high-order polynomial such as linear, quadratic and modified quadratic, and it is connected as various kinds of multi-variable inputs. The conventional PNN depends on the experience of a designer that select the number of input variables, input variable and polynomial type. Therefore it is very difficult to organize optimized network. The proposed algorithm leads to identify and select the number of input variables, input variable and polynomial type by using Genetic Algorithms(GAs). The aggregate performance index with weighting factor is proposed as well. The study is illustrated with tile NOx omission process data of gas turbine power plant for application to nonlinear process. In the sequel the proposed model shows not only superb predictability but also high accuracy in comparison to the existing intelligent models.

Automatic Classification and Vocabulary Analysis of Political Bias in News Articles by Using Subword Tokenization (부분 단어 토큰화 기법을 이용한 뉴스 기사 정치적 편향성 자동 분류 및 어휘 분석)

  • Cho, Dan Bi;Lee, Hyun Young;Jung, Won Sup;Kang, Seung Shik
    • KIPS Transactions on Software and Data Engineering
    • /
    • v.10 no.1
    • /
    • pp.1-8
    • /
    • 2021
  • In the political field of news articles, there are polarized and biased characteristics such as conservative and liberal, which is called political bias. We constructed keyword-based dataset to classify bias of news articles. Most embedding researches represent a sentence with sequence of morphemes. In our work, we expect that the number of unknown tokens will be reduced if the sentences are constituted by subwords that are segmented by the language model. We propose a document embedding model with subword tokenization and apply this model to SVM and feedforward neural network structure to classify the political bias. As a result of comparing the performance of the document embedding model with morphological analysis, the document embedding model with subwords showed the highest accuracy at 78.22%. It was confirmed that the number of unknown tokens was reduced by subword tokenization. Using the best performance embedding model in our bias classification task, we extract the keywords based on politicians. The bias of keywords was verified by the average similarity with the vector of politicians from each political tendency.

A Study on Analyzing Sentiments on Movie Reviews by Multi-Level Sentiment Classifier (영화 리뷰 감성분석을 위한 텍스트 마이닝 기반 감성 분류기 구축)

  • Kim, Yuyoung;Song, Min
    • Journal of Intelligence and Information Systems
    • /
    • v.22 no.3
    • /
    • pp.71-89
    • /
    • 2016
  • Sentiment analysis is used for identifying emotions or sentiments embedded in the user generated data such as customer reviews from blogs, social network services, and so on. Various research fields such as computer science and business management can take advantage of this feature to analyze customer-generated opinions. In previous studies, the star rating of a review is regarded as the same as sentiment embedded in the text. However, it does not always correspond to the sentiment polarity. Due to this supposition, previous studies have some limitations in their accuracy. To solve this issue, the present study uses a supervised sentiment classification model to measure a more accurate sentiment polarity. This study aims to propose an advanced sentiment classifier and to discover the correlation between movie reviews and box-office success. The advanced sentiment classifier is based on two supervised machine learning techniques, the Support Vector Machines (SVM) and Feedforward Neural Network (FNN). The sentiment scores of the movie reviews are measured by the sentiment classifier and are analyzed by statistical correlations between movie reviews and box-office success. Movie reviews are collected along with a star-rate. The dataset used in this study consists of 1,258,538 reviews from 175 films gathered from Naver Movie website (movie.naver.com). The results show that the proposed sentiment classifier outperforms Naive Bayes (NB) classifier as its accuracy is about 6% higher than NB. Furthermore, the results indicate that there are positive correlations between the star-rate and the number of audiences, which can be regarded as the box-office success of a movie. The study also shows that there is the mild, positive correlation between the sentiment scores estimated by the classifier and the number of audiences. To verify the applicability of the sentiment scores, an independent sample t-test was conducted. For this, the movies were divided into two groups using the average of sentiment scores. The two groups are significantly different in terms of the star-rated scores.