• 제목/요약/키워드: Activation function

검색결과 1,479건 처리시간 0.029초

Design of a Pseudo Gaussian Function Network Using Asymmetric Activation Functions

  • Kim, Byung-Man;Cho, Hyung-Suck
    • 제어로봇시스템학회:학술대회논문집
    • /
    • 제어로봇시스템학회 2001년도 ICCAS
    • /
    • pp.43.3-43
    • /
    • 2001
  • In conventional RBF network, the activation functions of hidden layers generally are symmetric functions like gaussian function. This has been considered to be one of the limiting factors for the network to speed up learning of actuately describing a given function. To avoid this criticism, we propose a pseudo gaussian function (PGF) whose deviation is changed according to the direction of incoming pattern. This property helps to estimate the given function more effectively with a minimal number of centers because of its flexibility of functional representation. A level set method is used to describe the asymmetric shape of deviation of the pseudo gaussian function. To demonstrate the performance of the proposed network ...

  • PDF

콘크리트 강도예측을 위한 적산온도 함수의 활성화에너지에 관한 연구 (A Study on the Activation Energy of Maturity Function for Prediction of Concrete Strength)

  • 장종호;강용식;김용로;길배수;남재현;김무한
    • 한국콘크리트학회:학술대회논문집
    • /
    • 한국콘크리트학회 2002년도 가을 학술발표회 논문집
    • /
    • pp.81-84
    • /
    • 2002
  • Activation energy value is different according to cement, admixture and water-cement ratio also the relation of age-temperature is as non-linear as activation energy value is large. So to make accurate explanation for the effect of temperature on concrete strength development property, it is necessary to investigation for activation energy value. This study compares activation energy value recommended by Freiesleben and ASTM with activation energy value obtained by consequence of mortar examination according to ASTM C 1074-93. As the result of this study, activation energy value obtained by the study is 37.19KJ/mol, and in case of activation energy value obtained by the study explain temperature's influence about concrete strength development more accurate than activation energy value recommend by Freiesleben and ASTM.

  • PDF

활성함수 변화에 따른 초해상화 모델 성능 비교 (A Performance Comparison of Super Resolution Model with Different Activation Functions)

  • 유영준;김대희;이재구
    • 정보처리학회논문지:소프트웨어 및 데이터공학
    • /
    • 제9권10호
    • /
    • pp.303-308
    • /
    • 2020
  • ReLU(Rectified Linear Unit) 함수는 제안된 이후로 대부분의 깊은 인공신경망 모델들에서 표준 활성함수로써 지배적으로 사용되었다. 이후에 ReLU를 대체하기 위해 Leaky ReLU, Swish, Mish 활성함수가 제시되었는데, 이들은 영상 분류 과업에서 기존 ReLU 함수 보다 향상된 성능을 보였다. 따라서 초해상화(Super Resolution) 과업에서도 ReLU를 다른 활성함수들로 대체하여 성능 향상을 얻을 수 있는지 실험해볼 필요성을 인지하였다. 본 연구에서는 초해상화 과업에서 안정적인 성능을 보이는 EDSR(Enhanced Deep Super-Resolution Network) 모델에 활성함수들을 변경하면서 성능을 비교하였다. 결과적으로 EDSR의 활성함수를 변경하면서 진행한 실험에서 해상도를 2배로 변환하는 경우, 기존 활성함수인 ReLU가 실험에 사용된 다른 활성함수들 보다 비슷하거나 높은 성능을 보였다. 해상도를 4배로 변환하는 경우에서는 Leaky ReLU와 Swish 함수가 기존 ReLU 함수 대비 다소 향상된 성능을 보임을 확인하였다. Leaky ReLU를 사용했을 때 기존 ReLU보다 영상의 품질을 정량적으로 평가할 수 있는 PSNR과 SSIM 평가지표가 평균 0.06%, 0.05%, Swish를 사용했을 때는 평균 0.06%, 0.03%의 성능 향상을 확인할 수 있었다. 또한 해상도를 8배로 변환하는 경우에서는 Mish 함수가 기존 ReLU 함수 대비 다소 향상된 성능을 보임을 확인하였다. Mish를 사용했을 때 기존 ReLU보다 PSNR과 SSIM 평가지표가 평균 0.06%, 0.02%의 성능 향상을 확인할 수 있었다. 결론적으로 해상도를 4배로 변환하는 초해상화의 경우는 Leaky ReLU와 Swish가, 해상도를 8배로 변환하는 초해상화의 경우는 Mish가 ReLU 대비 향상된 성능을 보였다. 향후 연구에서는 다른 초해상화 모델에서도 성능 향상을 위해 활성함수를 Leaky ReLU, Swish, Mish로 대체하는 비교실험을 수행하는 것도 필요하다고 판단된다.

Factors associated with Patient Activation for Self-management among Community Residents with Osteoarthritis in Korea

  • Ahn, Yang Heui;Kim, Bong Jeong;Ham, Ok Kyung;Kim, Seong Hoon
    • 지역사회간호학회지
    • /
    • 제26권3호
    • /
    • pp.303-311
    • /
    • 2015
  • Purpose: The purpose of this study was to survey patient activation for self-management and to identify factors associated with patient activation for self-management among community residents with osteoarthritis in Korea. Methods: Cross-sectional study design was used. Survey data were collected from 270 community residents with osteoarthritis through direct interviews. Studied factors included patient activation, joint pain, physical function, depression, and general characteristics. Data were analyzed using chi-squared test, t-test and multivariate logistic regression analysis. Results: The participants' mean score of patient activation was $56.0{\pm}16.61$. The mean score of each factor was $10.6{\pm}5.89$ for joint pain, $5.5{\pm}3.56$ for physical function, and $19.3{\pm}10.01$ for depression. The patient activation level was significantly associated with depression and general characteristics such as education, religion, comorbid hypertension, and use of medical clinics (p<.05). Conclusion: The findings suggest that depression, education, religion, comorbid hypertension, and use of medical clinics may be important factors to be considered when developing programs of patient activation for self-management. This is the first study that measured patient activation, and further studies are suggested to find factors associated with patient activation for self-management among community residents with other chronic diseases.

TAGLN2-mediated actin stabilization at the immunological synapse: implication for cytotoxic T cell control of target cells

  • Na, Bo-Ra;Jun, Chang-Duk
    • BMB Reports
    • /
    • 제48권7호
    • /
    • pp.369-370
    • /
    • 2015
  • Actin dynamics is critical for the formation and sustainment of the immunological synapse (IS) during T cell interaction with antigen-presenting cells (APC). Thus, many actin regulating proteins are involved in spatial and temporal actin remodeling at the IS. However, little is known whether or how actin stabilizing protein controls IS and the consequent T cell functions. TAGLN2 − an actin-binding protein predominantly expressed in T cells − displays a novel function to stabilize cortical F-actin, thereby augmenting F-actin contents at the IS, and acquiring leukocyte function-associated antigen-1 activation following T cell activation. TAGLN2 also competes with cofilin to protect F-actin in vitro and in vivo. During cytotoxic T cell interaction with cancer cells, the expression level of TAGLN2 at the IS correlates with the T cell adhesion to target cancer cells and production of lytic granules such as granzyme B and perforin, thus expressing cytotoxic T cell function. These findings identify a novel function for TAGLN2 as an actin stabilizing protein that is essential for stable immunological synapse formation, thereby regulating T cell immunity. [BMB Reports 2015; 48(7): 369-370]

일반화된 캐스케이드 코릴레이션 알고리즘과 일반화된 순환 캐스케이드 코릴레이션 알고리즘의 결합을 통한 학습 능력 향상 (Improvement of Learning Capability with Combination of the Generalized Cascade Correlation and Generalized Recurrent Cascade Correlation Algorithms)

  • 이상화;송해상
    • 한국콘텐츠학회논문지
    • /
    • 제9권2호
    • /
    • pp.97-105
    • /
    • 2009
  • 본 논문에서는 일반화된 캐스케이드 코릴레이션 학습 알고리즘과 일반화된 순환 캐스케이드 코릴레이션 학습 알고리즘의 결합을 통한 새로운 알고리즘을 소개한다. 이 새로운 알고리즘은 패턴분류문제(pattern classification problem)의 신속한 해결을 위하여 비순환 뉴런이 유리한지 순환 뉴런이 유리한지 또는 수직성장이 유리한지 수평성장이 유리한지 고민할 필요 없이 후보뉴런의 학습 중에 네트워크의 구성을 스스로 결정한다. 이 알고리즘의 성능평가를 위하여 학습 알고리즘에서 중요한 기준 문제(benchmark problem) 중의 하나인 콘택트렌즈 문제(Contact lens problem)와 밸런스 스케일 문제 (Balance scale problem)에 대하여 실험하였고 기존의 캐스케이드 코릴레이션 알고리즘 및 순환 캐스케이드 코릴레이션 알고리즘과 성능을 비교 하였다. 이 실험에서 활성화 함수는 일반적으로 많이 사용하는 시그모이드 함수(sigmoidal function) 와 하이퍼볼릭탄젠트 함수(hyperbolic tangent function)를 사용하였다. 이 새로운 알고리즘은 학습을 통하여 기존의 알고리즘보다 적은 수의 은닉뉴런을 생성하여 보다 빠른 학습 속도를 보여주었다.

활성화 함수의 근사화를 통한 MLP 가속기 구현 (MLP accelerator implementation by approximation of activation function)

  • 이상일;최세진;이광엽
    • 전기전자학회논문지
    • /
    • 제22권1호
    • /
    • pp.197-200
    • /
    • 2018
  • 본 논문에서는 하드웨어레벨로 구현이 어렵고 속도가 느린 sigmoid 함수를 PLAN을 이용하여 근사치로 출력하였다. 이를 MLP 구조의 활성화 함수로 사용하여 자원소모를 줄이고 속도를 개선하고자 하였다. 본 논문에서 제안하는 방법은 $5{\times}5$크기의 숫자 인식에 약 95%의 정확도를 유지하면서 GPGPU보다 약 1.83배의 빠른 속도를 보였다. 또한 MLPA가속기와 비슷한 자원을 사용함에도 더 많은 뉴런을 사용하여 높은 정확도에 빠른 속도로 수렴하는 것을 확인하였다.

비선형, 비정상 시계열 예측을 위한 RBF(Radial Basis Function) 회로망 구조 (RBF Network Structure for Prediction of Non-linear, Non-stationary Time Series)

  • 김상환;이종호
    • 대한전기학회논문지:전력기술부문A
    • /
    • 제48권2호
    • /
    • pp.168-175
    • /
    • 1999
  • In this paper, a modified RBF(Radial Basis Function) network structure is suggested for the prediction of a time-series with non-linear, non-stationary characteristics. Coventional RBF network predicting time series by using past outputs sense the trajectory of the time series and react when there exists strong relation between input and hidden activation function's RBF center. But this response is highly sensitive to level and trend of time serieses. In order to overcome such dependencies, hidden activation functions are modified to react to the increments of input variable and multiplied by increment(or dectement) for prediction. When the suggested structure is applied to prediction of Macyey-Glass chaotic time series, Lorenz equation, and Rossler equation, improved performances are obtained.

  • PDF

Regulation of NFAT Activation: a Potential Therapeutic Target for Immunosuppression

  • Lee, Mina;Park, Jungchan
    • Molecules and Cells
    • /
    • 제22권1호
    • /
    • pp.1-7
    • /
    • 2006
  • The NFAT family of transcription factors plays pivotal roles in the development and function of the immune system. Their activation process is tightly regulated by calcium-dependent phosphatase calcineurin and has been a target of the immunosuppressive drugs cyclosporin A and FK-506. Although the clinical use of these drugs has dramatically increased the success of organ transplantation, their therapeutic use is limited by severe side effects. Recent studies for the calcineurin/NFAT signaling pathway have identified a number of cellular proteins that inhibit calcineurin function. Specific peptide sequences that interfere with the interaction between calcineurin and NFAT have also been characterized. Moreover, diverse approaches to identify small organic molecules that modulate NFAT function have been performed. This review focuses on the recent advances in our understanding of the inhibitory modulation of NFAT function, which may open up the additional avenues for immunosuppressive therapy.

Study of nonlinear hysteretic modelling and performance evaluation for piezoelectric actuators based on activation functions

  • Xingyang Xie;Yuguo Cui;Yang Yu
    • Smart Structures and Systems
    • /
    • 제33권2호
    • /
    • pp.133-143
    • /
    • 2024
  • Piezoelectric (PZT) actuators have been widely used in precision positioning fields for their excellent displacement resolution. However, due to the inherent characteristics of piezoelectric actuators, hysteresis has been proven to greatly reduce positioning performance. In this paper, five mathematical hysteretic models based on activation function are proposed to characterize the nonlinear hysteresis characteristics of piezoelectric actuators. Then the performance of the proposed models is verified by particle swarm optimization (PSO) algorithm and the experiment data. Thirdly, the fitting performance of the proposed models is compared with the classical Bouc-Wen model. Finally, the performance of the five proposed models in modelling hysteresis nonlinearity of piezoelectric drivers is compared, in terms of RMSE, MAPE, SAPE and operation efficiency, and relevant suggestions are given.