• International Journal of Internet, Broadcasting and Communication
• /
• 제14권1호
• /
• pp.136-141
• /
• 2022

A very complex task in deep learning such as image classification must be solved with the help of neural networks and activation functions. The backpropagation algorithm advances backward from the output layer towards the input layer, the gradients often get smaller and smaller and approach zero which eventually leaves the weights of the initial or lower layers nearly unchanged, as a result, the gradient descent never converges to the optimum. We propose a two-factor non-saturating activation functions known as Bea-Mish for machine learning applications in deep neural networks. Our method uses two factors, beta (𝛽) and alpha (𝛼), to normalize the area below the boundary in the Mish activation function and we regard these elements as Bea. Bea-Mish provide a clear understanding of the behaviors and conditions governing this regularization term can lead to a more principled approach for constructing better performing activation functions. We evaluate Bea-Mish results against Mish and Swish activation functions in various models and data sets. Empirical results show that our approach (Bea-Mish) outperforms native Mish using SqueezeNet backbone with an average precision (AP50val) of 2.51% in CIFAR-10 and top-1accuracy in ResNet-50 on ImageNet-1k. shows an improvement of 1.20%.

• 한국인터넷방송통신학회논문지
• /
• 제19권2호
• /
• pp.135-141
• /
• 2019

최근 강화 학습을 통해 게임을 학습하는 인공지능 에이전트를 만드는 연구가 활발히 진행되고 있다. 게임을 에이전트에게 학습 시킬 때 어떠한 딥러닝 활성화 함수를 사용하는지에 따라 그 학습 성능이 달라진다. 본 논문은 2D 슈팅 게임 환경에서 에이전트가 강화 학습을 통해 게임을 학습할 경우 어떤 활성화 함수가 최적의 결과를 얻는지를 비교 평가 한다. 이를 위해 비교 평가에서 사용할 메트릭을 정의하고 각 활성화 함수에 따른 메트릭 값을 학습 시간에 따라 그래프로 나타내었다. 그 결과 ELU (Exponential Linear Unit) 활성화 함수에 1.0으로 파라미터 값을 설정할 경우 게임의 보상 값이 다른 활성화 함수보다 평균적으로 높은 것을 알 수 있었고, 가장 낮은 보상 값을 가졌던 활성화 함수와의 차이는 23.6%였다.

• 한국인터넷방송통신학회논문지
• /
• 제22권6호
• /
• pp.75-81
• /
• 2022

주차 공간의 부족함을 획기적으로 해결할 수 있는 자율주행 자동차는 심층 강화 학습을 통해 큰 발전을 이루고 있다. 심층 강화 학습에는 활성화 함수가 사용되는데, 그동안 다양한 활성화 함수가 제안되어 왔으나 적용 환경에 따라 그 성능 편차가 심했다. 따라서 환경에 따라 최적의 활성화 함수를 찾는 것이 효과적인 학습을 위해 중요하다. 본 논문은 자율주행 자동차가 주차를 학습하기 위해 심층 강화 학습을 사용할 때 어떤 활성화 함수를 사용하는 것이 가장 효과적인지 비교 평가하기 위해 강화 학습에 주로 사용되는 12개의 함수를 분석하였다. 이를 위해 성능 평가 환경을 구축하고 각 활성화 함수의 평균 보상을 성공률, 에피소드 길이, 자동차 속도와 비교하였다. 그 결과 가장 높은 보상은 GELU를 사용한 경우였고, ELU는 가장 낮았다. 두 활성화 함수의 보상 차이는 35.2%였다.

• 전력전자학회:학술대회논문집
• /
• 전력전자학회 2011년도 추계학술대회
• /
• pp.315-316
• /
• 2011

This paper presents speed control scheme of the PMSM which has torque compensator to reduce the speed error and ripple. The proposed speed controller is based on the conventional PI control scheme. But the additional torque compensator which is different to the conventional differential controller produces a compensation torque to suppress speed ripple. In order to determine the proper compensation, the activation function which has discrete value is used in the proposed control scheme. With the proposed activation function, the compensation torque acts to suppress the speed error increasing. The proposed speed control scheme is verified by the computer simulation and experiments of 400[W] PMSM. In the simulation and experiments, the proposed control scheme has better control performance compare than the conventional PI and PID control schemes.

• 한국지능시스템학회:학술대회논문집
• /
• 한국퍼지및지능시스템학회 1998년도 The Third Asian Fuzzy Systems Symposium
• /
• pp.399-403
• /
• 1998

In this paper, we proposed a new fuzzy supervised learning algorithm. We construct, and train, a new type fuzzy neural net to model the linear activation function. Properties of our fuzzy neural net include : (1) a proposed linear activation function ; and (2) a modified delta rule for learning algorithm. We applied this proposed learning algorithm to exclusive OR,3 bit parity using benchmark in neural network and pattern recognition problems, a kind of image recognition.

• 한국식품영양과학회지
• /
• 제28권2호
• /
• pp.371-377
• /
• 1999

In order to evaluate the antimicrobial function of natural herb extracts as antimicrobial agent or packaging material for the preservation of foods and greenhouse produce, the water extract of chopi (Zanthoxylum piperitum DC.) was prepared and its antimicobial activity was determined. In the paper disk test its antimicrobial activity was increased in proportion to its concentraion. The growth of microorganisms was completely inhibited above 500ppm of its concentration. It showed wide spectrum of thermal(40 to 180oC) and pH(4 to 10) stabilities. In the electronic microscopic observation(TEM and SEM) of microbial morphological change it showed to decrease the activation of physiological enzymes and to lose the function of cell membranes. Even in the activation test of galactosidase, it seemed to weaken the osmotic function of cell membranes remarkably in comparison with chloroform and its activation corresponded to 40~50% of toluene. Zanthoxylum piperitum DC. extract seemed to be an excellent antimicrobial for the inhibition of food borne microorganisms as well as the pre servation of greenhouse produces.

• 한국건축시공학회:학술대회논문집
• /
• 한국건축시공학회 2019년도 추계 학술논문 발표대회
• /
• pp.60-61
• /
• 2019

Concrete carbonation is one of the factors that reduce the durability of concrete. In modern times, due to industrialization, the carbon dioxide concentration in the atmosphere is increasing, and the impact of carbonation is increasing. So, it is important to understand the carbonation resistance according to the concrete compounding to secure the concrete durability life. In this study, we want to predict the concrete carbonation velocity coefficient, which is an indicator of the carbonation resistance of concrete, through the deep learning algorithm, and to find the activation function suitable for the prediction of carbonation rate coefficient as a process to determine the learning accuracy through the deep learning algorithm. In the scope of this study, using the ReLU function showed better accuracy than using other activation functions.

• 한국BIM학회 논문집
• /
• 제12권2호
• /
• pp.40-48
• /
• 2022

It is very important to accurately predict construction costs in the early stages of the construction project. However, it is difficult to accurately predict construction costs with limited information from the initial stage. In recent years, with the development of machine learning technology, it has become possible to predict construction costs more accurately than before only with schematic construction characteristics. Based on machine learning technology, this study aims to analyze plans to more accurately predict construction costs by using only the factors influencing construction costs. To the end of this study, the effect of the error rate according to the activation function and the node configuration of the hidden layer was analyzed.

• 한국전자통신학회논문지
• /
• 제16권2호
• /
• pp.287-292
• /
• 2021

본 논문에서는 유도전동기 고정자 고장 진단에 있어서 활성화 함수가 미치는 영향을 분석하여 효율적인 CNN 활용 방법을 제안하였다. 일반적으로 유도전동기 고정자 고장 진단의 주된 목적은 미세한 턴 단락을 빠르게 진단함으로 고장을 미리 방지함에 있다. 이에 활성화 함수 활용에 있어서 전반적인 고정자 고장에는 ReLu가 우수성을 보임을 알 수 있었으나, 미세한 턴 단락인 2턴 단락에 있어서는 Sigmoid 함수가 ReLu 함수보다 진단의 정확도에 있어서 23.23% 유용함을 실험을 통해 확인할 수 있었다.

• 호남수학학술지
• /
• 제28권1호
• /
• pp.125-133
• /
• 2006

We investigate the approximation order to a function in $L_p$[-1, 1] for $0{\leq}p<{\infty}$ by generalized translation networks. In most papers related to neural network approximation, sigmoidal functions are adapted as an activation function. In our research, we choose an infinitely many times continuously differentiable function as an activation function. Using the integral modulus of continuity and the divided difference formula, we get the approximation order to a function in $L_p$[-1, 1].