• Title/Summary/Keyword: hidden flow

Search Result 80, Processing Time 0.035 seconds

Comparison of Artificial Neural Network Model Capability for Runoff Estimation about Activation Functions (활성화 함수에 따른 유출량 산정 인공신경망 모형의 성능 비교)

  • Kim, Maga;Choi, Jin-Yong;Bang, Jehong;Yoon, Pureun;Kim, Kwihoon
    • Journal of The Korean Society of Agricultural Engineers
    • /
    • v.63 no.1
    • /
    • pp.103-116
    • /
    • 2021
  • Analysis of runoff is substantial for effective water management in the watershed. Runoff occurs by reaction of a watershed to the rainfall and has non-linearity and uncertainty due to the complex relation of weather and watershed factors. ANN (Artificial Neural Network), which learns from the data, is one of the machine learning technique known as a proper model to interpret non-linear data. The performance of ANN is affected by the ANN's structure, the number of hidden layer nodes, learning rate, and activation function. Especially, the activation function has a role to deliver the information entered and decides the way of making output. Therefore, It is important to apply appropriate activation functions according to the problem to solve. In this paper, ANN models were constructed to estimate runoff with different activation functions and each model was compared and evaluated. Sigmoid, Hyperbolic tangent, ReLU (Rectified Linear Unit), ELU (Exponential Linear Unit) functions were applied to the hidden layer, and Identity, ReLU, Softplus functions applied to the output layer. The statistical parameters including coefficient of determination, NSE (Nash and Sutcliffe Efficiency), NSEln (modified NSE), and PBIAS (Percent BIAS) were utilized to evaluate the ANN models. From the result, applications of Hyperbolic tangent function and ELU function to the hidden layer and Identity function to the output layer show competent performance rather than other functions which demonstrated the function selection in the ANN structure can affect the performance of ANN.

An improved plasma model by optimizing neuron activation gradient (뉴런 활성화 경사 최적화를 이용한 개선된 플라즈마 모델)

  • 김병환;박성진
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 2000.10a
    • /
    • pp.20-20
    • /
    • 2000
  • Back-propagation neural network (BPNN) is the most prevalently used paradigm in modeling semiconductor manufacturing processes, which as a neuron activation function typically employs a bipolar or unipolar sigmoid function in either hidden and output layers. In this study, applicability of another linear function as a neuron activation function is investigated. The linear function was operated in combination with other sigmoid functions. Comparison revealed that a particular combination, the bipolar sigmoid function in hidden layer and the linear function in output layer, is found to be the best combination that yields the highest prediction accuracy. For BPNN with this combination, predictive performance once again optimized by incrementally adjusting the gradients respective to each function. A total of 121 combinations of gradients were examined and out of them one optimal set was determined. Predictive performance of the corresponding model were compared to non-optimized, revealing that optimized models are more accurate over non-optimized counterparts by an improvement of more than 30%. This demonstrates that the proposed gradient-optimized teaming for BPNN with a linear function in output layer is an effective means to construct plasma models. The plasma modeled is a hemispherical inductively coupled plasma, which was characterized by a 24 full factorial design. To validate models, another eight experiments were conducted. process variables that were varied in the design include source polver, pressure, position of chuck holder and chroline flow rate. Plasma attributes measured using Langmuir probe are electron density, electron temperature, and plasma potential.

  • PDF

Using Hidden Markov Model for Stock Flow Forecasting (주식 예측을 위한 은닉 마코프 모델의 이용)

  • Park, Hyoung-Joon;Hong, Da-Hye;Kim, Moon-Hyun
    • Proceedings of the KIEE Conference
    • /
    • 2007.07a
    • /
    • pp.1860-1861
    • /
    • 2007
  • 주식 예측은 주식 시장이 생긴 이래로 투자자들이나, 금융 전문가들 사이에서 매우 중요한 일이 되어 왔다. 그러한 중요성으로 인해 엘리오트 파동이론과 같은 많은 주식 예측 기법이 제시되었고, 또한 이러한 예�G의 자동화를 위해 인공지능분야에서도 많은 연구가 있어왔다. 주가 예측에 패턴인식 방법을 적용한 기존의 연구로는 주로 ANN(Artificial Neural Network)방식과 은닉 마코프 모델(HMM, Hidden Markov Model)이 있었고, 본 논문에서는 HMM을 이용한 방법을 제안한다. HMM은 시간 순차적인 패턴을 가지는 모델의 인식에 좋은 성능을 보여 주로 음성인식 분야에서 많이 이용되고 있다. 주식 변화 역시 시간 순차적 흐름에 따라 기울기의 변화가 어느 정도 일정한 패턴을 가지는 성질이 있고, 이것은 HMM을 이용한 패턴인식으로 주식의 앞으로의 변화를 예측하기에 적합한 요인이 된다. 본 논문에서는 이를 위해 다음과 같은 과정을 걸쳤다. 첫 번째로 실존 회사의 장기간의 주식 테이터를 기반으로 여러 개의 HMM모델을 학습 하였다. 두 번째로 예측하고자 하는 기간 이전의 주식 변화 데이터를 입력으로 하여, 이전에 이와 유사한 패턴이 있었는지를 HMM을 통해 알아냈다. 마지막으로 이렇게 알아낸 패턴을 이용하여 앞으로의 주식 변화를 예측하였다. 실험은 실제 주식 변화와 예측값의 비교를 통해 정확도를 검증하였다.

  • PDF

Evaluation of Performance of Artificial Neural Network based Hardening Model for Titanium Alloy Considering Strain Rate and Temperature (티타늄 합금의 변형률속도 및 온도를 고려한 인공신경망 기반 경화모델 성능평가)

  • M. Kim;S. Lim;Y. Kim
    • Transactions of Materials Processing
    • /
    • v.33 no.2
    • /
    • pp.96-102
    • /
    • 2024
  • This study addresses evaluation of performance of hardening model for a titanium alloy (Ti6Al4V) based on the artificial neural network (ANN) regarding the strain rate and the temperature. Uniaxial compression tests were carried out at different strain rates from 0.001 /s to 10 /s and temperatures from 575 ℃ To 975 ℃. Using the experimental data, ANN models were trained and tested with different hyperparameters, such as size of hidden layer and optimizer. The input features were determined with the equivalent plastic strain, strain rate, and temperature while the output value was set to the equivalent stress. When the number of data is sufficient with a smooth tendency, both the Bayesian regulation (BR) and the Levenberg-Marquardt (LM) show good performance to predict the flow behavior. However, only BR algorithm shows a predictability when the number of data is insufficient. Furthermore, a proper size of the hidden layer must be confirmed to describe the behavior with the limited number of the data.

Endovascular recanalization therapy for patients with acute ischemic stroke with hidden aortic dissection: A case series

  • Hye Seon Jeong;Eun-Oh Jeong;In Young Lee;Hak In Lee;Hyeon-Song Koh;Hyon-Jo Kwon
    • Journal of Cerebrovascular and Endovascular Neurosurgery
    • /
    • v.25 no.3
    • /
    • pp.333-339
    • /
    • 2023
  • Aortic dissection is one of the causes of acute ischemic stroke. Endovascular recanalization therapy (EVT) has emerged as an essential treatment for acute ischemic stroke due to large artery occlusion. However, it is rarely performed in the situation of hidden aortic dissection (AD). Two patients presented to the emergency room with focal neurologic deficits. The first patient was diagnosed with right internal carotid artery (ICA) occlusion. Angiography revealed that the ICA was occluded by the dissection flap. After a stent deployment in the proximal ICA, the antegrade flow was restored. The patient was diagnosed with AD on chest computed tomography (CT) after EVT. For the second patient, intraarterial thrombectomy was performed to treat left middle cerebral artery occlusion. AD was first detected on echocardiography, which was performed after EVT. Herein, we report successful endovascular recanalization therapy performed in two patients with acute ischemic stroke in the situation of undiagnosed aortic dissection. We also reviewed previous case reports and relevant literature.

Data collection strategy for building rainfall-runoff LSTM model predicting daily runoff (강수-일유출량 추정 LSTM 모형의 구축을 위한 자료 수집 방안)

  • Kim, Dongkyun;Kang, Seokkoo
    • Journal of Korea Water Resources Association
    • /
    • v.54 no.10
    • /
    • pp.795-805
    • /
    • 2021
  • In this study, after developing an LSTM-based deep learning model for estimating daily runoff in the Soyang River Dam basin, the accuracy of the model for various combinations of model structure and input data was investigated. A model was built based on the database consisting of average daily precipitation, average daily temperature, average daily wind speed (input up to here), and daily average flow rate (output) during the first 12 years (1997.1.1-2008.12.31). The Nash-Sutcliffe Model Efficiency Coefficient (NSE) and RMSE were examined for validation using the flow discharge data of the later 12 years (2009.1.1-2020.12.31). The combination that showed the highest accuracy was the case in which all possible input data (12 years of daily precipitation, weather temperature, wind speed) were used on the LSTM model structure with 64 hidden units. The NSE and RMSE of the verification period were 0.862 and 76.8 m3/s, respectively. When the number of hidden units of LSTM exceeds 500, the performance degradation of the model due to overfitting begins to appear, and when the number of hidden units exceeds 1000, the overfitting problem becomes prominent. A model with very high performance (NSE=0.8~0.84) could be obtained when only 12 years of daily precipitation was used for model training. A model with reasonably high performance (NSE=0.63-0.85) when only one year of input data was used for model training. In particular, an accurate model (NSE=0.85) could be obtained if the one year of training data contains a wide magnitude of flow events such as extreme flow and droughts as well as normal events. If the training data includes both the normal and extreme flow rates, input data that is longer than 5 years did not significantly improve the model performance.

Flow-based Anomaly Detection Using Access Behavior Profiling and Time-sequenced Relation Mining

  • Liu, Weixin;Zheng, Kangfeng;Wu, Bin;Wu, Chunhua;Niu, Xinxin
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.10 no.6
    • /
    • pp.2781-2800
    • /
    • 2016
  • Emerging attacks aim to access proprietary assets and steal data for business or political motives, such as Operation Aurora and Operation Shady RAT. Skilled Intruders would likely remove their traces on targeted hosts, but their network movements, which are continuously recorded by network devices, cannot be easily eliminated by themselves. However, without complete knowledge about both inbound/outbound and internal traffic, it is difficult for security team to unveil hidden traces of intruders. In this paper, we propose an autonomous anomaly detection system based on behavior profiling and relation mining. The single-hop access profiling model employ a novel linear grouping algorithm PSOLGA to create behavior profiles for each individual server application discovered automatically in historical flow analysis. Besides that, the double-hop access relation model utilizes in-memory graph to mine time-sequenced access relations between different server applications. Using the behavior profiles and relation rules, this approach is able to detect possible anomalies and violations in real-time detection. Finally, the experimental results demonstrate that the designed models are promising in terms of accuracy and computational efficiency.

Occluded Object Motion Estimation System based on Particle Filter with 3D Reconstruction

  • Ko, Kwang-Eun;Park, Jun-Heong;Park, Seung-Min;Kim, Jun-Yeup;Sim, Kwee-Bo
    • International Journal of Fuzzy Logic and Intelligent Systems
    • /
    • v.12 no.1
    • /
    • pp.60-65
    • /
    • 2012
  • This paper presents a method for occluded object based motion estimation and tracking system in dynamic image sequences using particle filter with 3D reconstruction. A unique characteristic of this study is its ability to cope with partial occlusion based continuous motion estimation using particle filter inspired from the mirror neuron system in human brain. To update a prior knowledge about the shape or motion of objects, firstly, fundamental 3D reconstruction based occlusion tracing method is applied and object landmarks are determined. And optical flow based motion vector is estimated from the movement of the landmarks. When arbitrary partial occlusions are occurred, the continuous motion of the hidden parts of object can be estimated by particle filter with optical flow. The resistance of the resulting estimation to partial occlusions enables the more accurate detection and handling of more severe occlusions.

On-line Monitoring and Control of Substrate Concentrations in Biological Processes by Flow Injection Analysis Systems

  • Rhee, Jong-Il;Adnan Ritzka;Thomas Scheper
    • Biotechnology and Bioprocess Engineering:BBE
    • /
    • v.9 no.3
    • /
    • pp.156-165
    • /
    • 2004
  • Concentrations of substrates, glucose, and ammionia in biological processes have been on-line monitored by using glucose-flow injection (FIA) and ammonia-FIA systems. Based on the on-line monitored data the concentrations of substrates have been controlled by an on-off controller, a PID controller, and a neural network (NN) based controller. A simulation program has been developed to test the control quality of each controller and to estimate the control parameters. The on-off controller often produced high oscillations at the set point due to its low robustness. The control quality of a PID controller could have been improved by a high analysis frequency and by a short residence time of sample in a FIA system. A NN-based controller with 3 layers has been developed, and a 3(input)-2(hidden)-1(output) network structure has been found to be optimal for the NN-based controller. The performance of the three controllers has been tested in a simulated process as well as in a cultivation process of Saccharomyces cerevisiae, and the performance has also been compared to simulation results. The NN-based controller with the 3-2-1 network structure was robust and stable against some disturbances, such as a sudden injection of distilled water into a biological process.

Hand Gesture Recognition using Optical Flow Field Segmentation and Boundary Complexity Comparison based on Hidden Markov Models

  • Park, Sang-Yun;Lee, Eung-Joo
    • Journal of Korea Multimedia Society
    • /
    • v.14 no.4
    • /
    • pp.504-516
    • /
    • 2011
  • In this paper, we will present a method to detect human hand and recognize hand gesture. For detecting the hand region, we use the feature of human skin color and hand feature (with boundary complexity) to detect the hand region from the input image; and use algorithm of optical flow to track the hand movement. Hand gesture recognition is composed of two parts: 1. Posture recognition and 2. Motion recognition, for describing the hand posture feature, we employ the Fourier descriptor method because it's rotation invariant. And we employ PCA method to extract the feature among gesture frames sequences. The HMM method will finally be used to recognize these feature to make a final decision of a hand gesture. Through the experiment, we can see that our proposed method can achieve 99% recognition rate at environment with simple background and no face region together, and reduce to 89.5% at the environment with complex background and with face region. These results can illustrate that the proposed algorithm can be applied as a production.