• 제목/요약/키워드: gradient descent optimization

검색결과 82건 처리시간 0.024초

Estimating People's Position Using Matrix Decomposition

  • Dao, Thi-Nga;Yoon, Seokhoon
    • International journal of advanced smart convergence
    • /
    • 제8권2호
    • /
    • pp.39-46
    • /
    • 2019
  • Human mobility estimation plays a key factor in a lot of promising applications including location-based recommendation systems, urban planning, and disease outbreak control. We study the human mobility estimation problem in the case where recent locations of a person-of-interest are unknown. Since matrix decomposition is used to perform latent semantic analysis of multi-dimensional data, we propose a human location estimation algorithm based on matrix factorization to reconstruct the human movement patterns through the use of information of persons with correlated movements. Specifically, the optimization problem which minimizes the difference between the reconstructed and actual movement data is first formulated. Then, the gradient descent algorithm is applied to adjust parameters which contribute to reconstructed mobility data. The experiment results show that the proposed framework can be used for the prediction of human location and achieves higher predictive accuracy than a baseline model.

궤도민감도 분석에 기반하여 복입력 전력시스템 안정화 장치(Dual-Input PSS)의 비선형 파라미터 최적화 기법 (Optimal Tuning of Nonlinear Parameters of a Dual-Input Power System Stabilizer Based on Analysis of Trajectory Sensitivities)

  • 백승묵;박정욱
    • 전기학회논문지
    • /
    • 제57권6호
    • /
    • pp.915-923
    • /
    • 2008
  • This paper focuses on optimal tuning of nonlinear parameters of a dual-input power system stabilizer(dual-input PSS), which can improve the system damping performance immediately following a large disturbance. Until recently, various PSS models have developed to bring stability and reliability to power systems, and some of these models are used in industry applications. However, due to non-smooth nonlinearities from the interaction between linear parameters(gains and time constants of linear controllers) and nonlinear parameters(saturation output limits), the output limit parameters cannot be determined by the conventional tuning methods based on linear analysis. Only ad hoc tuning procedures('trial and error' approach) have been used. Therefore, the steepest descent method is applied to implement the optimal tuning of the nonlinear parameters of the dual-input PSS. The gradient required in this optimization technique can be computed from trajectory sensitivities in hybrid system modeling with the differential-algebraic-impulsive-switched(DAIS) structure. The optimal output limits of the dual-input PSS are evaluated by time-domain simulation in both a single machine infinite bus(SMIB) system and a multi-machine power system in comparison with those of a single-input PSS.

태양광 컨버터 시스템의 과도응답 개선을 위한 비선형 적응제어 및 안정성 해석 (Nonlinear Adaptive Control and Stability Analysis for Improving Transient Response of Photovoltaic Converter Systems)

  • 조현철;유수복;이권순
    • 제어로봇시스템학회논문지
    • /
    • 제15권12호
    • /
    • pp.1175-1183
    • /
    • 2009
  • In photovoltaic(PV) generator systems, DC-DC converters are significantly considered for control system performance in power quality point of view. This paper presents a novel adaptive control method for DC-DC converters applied in PV generator systems. First, we derive a state-space average model of the converter system and then propose a reset control methodology to enhance transient response performance for time-varying PV systems. For estimating parameters of a reset control, a gradient descent optimization is utilized and an adjustment rule of them are derived respectively. An objective of the optimization is that characteristic equation of an augmented system model which is formed with an converter system model and an reset control is to trace a predefined polynomial given as a reference characteristic model. Next, we accomplish stability analysis by means of a well-known Lyapunov theory for nonlinear converter systems including time-varying voltage excitation from a PV generator. Numerical simulation demonstrates reliability of our control methodology and its superiority by comparison to a traditional control strategy.

전복 방지를 위한 소형 무인주행로봇의 자세 안정화 알고리즘 (Posture Stabilization Algorithm of A Small Unmanned Ground Vehicle for Turnover Prevention)

  • 고두열;김영국;이상훈;지태영;김경수;김수현
    • 한국군사과학기술학회지
    • /
    • 제14권6호
    • /
    • pp.965-973
    • /
    • 2011
  • Small unmanned ground vehicles(SUGVs) are typically operational on unstructured environments such as crashed building, mountain area, caves, and so on. On those terrains, driving control can suffer from the unexpected ground disturbances which occasionally lead turnover situation. In this paper, we have proposed an algorithm which sustains driving stability of a SUGV as preventing from turnover. The algorithm exploits potential field method in order to determine the stability of the robot. Then, the flipper and manipulator posture of the SUGV is optimized from local optimization algorithm known as gradient descent method. The proposed algorithm is verified using 3D dynamic simulation, and results showed that the proposed algorithm contributes to driving stability of SUGV.

Minimum Disturbance 기법을 적용한 AM-SCS-MMA 적응 등화 알고리즘의 성능 해석 (A Performance Analysis of AM-SCS-MMA Adaptive Equalization Algorithm based on the Minimum Disturbance Technique)

  • 임승각
    • 한국인터넷방송통신학회논문지
    • /
    • 제16권3호
    • /
    • pp.81-87
    • /
    • 2016
  • 본 논문에서는 기존 MMA 적응 등화 알고리즘의 안정성과 낮은 신호대 잡음비에서 robustness를 개선하기 위해 adaptive modulus와 miniumum-disturbance 기법을 적용한 AM-SCS-MMA (Adaptive Modulus-Soft Constraint Satisfaction-MMA) 알고리즘의 성능을 해석하였다. AM-SCS-MMA는 적응 등화를 비용 함수를 최소화하기 위해 adaptive modulus와 기존의 LMS 나 gradient descent algorithm 대신 deterministic optimization problem의 minimum-disturbance 기법을 적용하여 탭 계수를 갱신하므로서 채널에서 발생되는 진폭과 위상 찌그러짐에 의한 부호간 간섭을 동시에 줄이면서 등화 필터의 안정성 및 다양한 잡음에 대한 roburstness를 개선시킬 수 있다. 이의 개선 성능을 확인하기 위해 시뮬레이션을 수행하였으며 등화기 출력 성상도, 잔류 isi, MSE와 채널 추적 능력을 나타내는 EMSE (Excess MSE) 및 SER을 적용하였다. 컴퓨터 시뮬레이션의 결과 AM-SCS-MMA는 MMA보다 잔류 isi와 MSE에서는 수렴 속도는 늦지만 정상 상태 이후 잔여량이 감소되고 열악한 신호대 잡음비에서 robustness가 있었지만, 채널 추적 능력에서는 열화됨을 확인하였다.

Sparse and low-rank feature selection for multi-label learning

  • Lim, Hyunki
    • 한국컴퓨터정보학회논문지
    • /
    • 제26권7호
    • /
    • pp.1-7
    • /
    • 2021
  • 본 논문에서는 다중 레이블 분류를 위한 특징 선별 기법을 제안한다. 기존 많은 특징 선별 기법들은 상호정보척도 등을 이용하여 특징과 레이블 사이의 연관성을 계산하여 특징을 선별하였다. 하지만 상호정보척도는 결합 확률을 요구하기 때문에 실제 전제 특징 집합에서 결합 확률을 계산하는 것은 어렵다. 따라서 소수의 특징만 계산이 가능하여 지역적 최적화만 가능하다는 단점을 가진다. 이런 지역적 최적화 문제를 피해, 주어진 특징 전체 공간에서 저랭크 공간을 구성하고, 희소성을 가진 특징들을 선별할 수 있는 특징 선별 기법을 제안한다. 이를 위해 뉴클리어 노름을 이용해 회귀 기반의 목적함수를 설계하였고, 이 목적 함수의 최적화 문제를 풀기 위한 경사하강법 방식의 알고리즘을 제안하였다. 4가지의 데이터와 3가지 다중 레이블 분류 성능을 기준으로 다중 레이블 분류 실험 결과를 통해 제안하는 방법론이 기존 특징 선별 기법보다 좋은 성능을 나타내는 것을 보였다. 또한 제안하는 목적함수의 파라미터 값 변화에도 성능 변화가 둔감한 것을 실험적인 결과로 확인하였다.

A Novel Road Segmentation Technique from Orthophotos Using Deep Convolutional Autoencoders

  • Sameen, Maher Ibrahim;Pradhan, Biswajeet
    • 대한원격탐사학회지
    • /
    • 제33권4호
    • /
    • pp.423-436
    • /
    • 2017
  • This paper presents a deep learning-based road segmentation framework from very high-resolution orthophotos. The proposed method uses Deep Convolutional Autoencoders for end-to-end mapping of orthophotos to road segmentations. In addition, a set of post-processing steps were applied to make the model outputs GIS-ready data that could be useful for various applications. The optimization of the model's parameters is explained which was conducted via grid search method. The model was trained and implemented in Keras, a high-level deep learning framework run on top of Tensorflow. The results show that the proposed model with the best-obtained hyperparameters could segment road objects from orthophotos at an average accuracy of 88.5%. The results of optimization revealed that the best optimization algorithm and activation function for the studied task are Stochastic Gradient Descent (SGD) and Exponential Linear Unit (ELU), respectively. In addition, the best numbers of convolutional filters were found to be 8 for the first and second layers and 128 for the third and fourth layers of the proposed network architecture. Moreover, the analysis on the time complexity of the model showed that the model could be trained in 4 hours and 50 minutes on 1024 high-resolution images of size $106{\times}106pixels$, and segment road objects from similar size and resolution images in around 14 minutes. The results show that the deep learning models such as Convolutional Autoencoders could be a best alternative to traditional machine learning models for road segmentation from aerial photographs.

광대역 전자파를 이용한 역산란 해석 연구 (Analysis of Microwave Inverse Scattering Using the Broadband Electromagnetic waves)

  • 이정훈;정용식
    • 한국전자파학회:학술대회논문집
    • /
    • 한국전자파학회 2005년도 종합학술발표회 논문집 Vol.15 No.1
    • /
    • pp.169-174
    • /
    • 2005
  • 본 논문에서는 시간영역 유한차분법(FDTD: Finite-Difference Time-Domain Method)과 설계민감도법(Design Sensitivity Analysis)을 이용하여 유전체 산란체(Dielectric Scatterer)를 복원하기 위한 역산란문제(Inverse Scattering의 새로운 해석기법을 제안하였다. 이때 복원의 빠른 수렴을 위하여 도함수를 이용한 설계민감도법을 도입하였고 본 연구에서는 시간영역 유한차분법으로부터 직접 설계민감도 수식을 도출하였다. 계산의 효율성을 위하여 보조변수법(Adjoint Variable Method)을 도입하여 보조변수 방정식을 도출하고 최적화 알고리듬으로 최대경사도법을 이용하여 반복적인 추정을 통하여 유전체를 복원하였다. 본 연구의 타당성의 보이기 위하여 2차원 $TM^2$에서의 유전체 복원 사례를 제시한다.

  • PDF

통합적 인공지능 기법을 이용한 결함인식 (Crack Identification Based on Synthetic Artificial Intelligent Technique)

  • 심문보;서명원
    • 대한기계학회논문집A
    • /
    • 제25권12호
    • /
    • pp.2062-2069
    • /
    • 2001
  • It has been established that a crack has an important effect on the dynamic behavior of a structure. This effect depends mainly on the location and depth of the crack. To identify the location and depth of a crack in a structure, a method is presented in this paper which uses synthetic artificial intelligent technique, that is, Adaptive-Network-based Fuzzy Inference System(ANFIS) solved via hybrid learning algorithm(the back-propagation gradient descent and the least-squares method) are used to learn the input(the location and depth of a crack)-output(the structural eigenfrequencies) relation of the structural system. With this ANFIS and a continuous evolutionary algorithm(CEA), it is possible to formulate the inverse problem. CEAs based on genetic algorithms work efficiently for continuous search space optimization problems like a parameter identification problem. With this ANFIS, CEAs are used to identify the crack location and depth minimizing the difference from the measured frequencies. We have tried this new idea on a simple beam structure and the results are promising.

통합적 인공지능 기법을 이용한 결함인식 (Crack identification based on synthetic artificial intelligent technique)

  • 심문보;서명원
    • 대한기계학회:학술대회논문집
    • /
    • 대한기계학회 2001년도 춘계학술대회논문집C
    • /
    • pp.182-188
    • /
    • 2001
  • It has been established that a crack has an important effect on the dynamic behavior of a structure. This effect depends mainly on the location and depth of the crack. To identify the location and depth of a crack in a structure, a method is presented in this paper which uses synthetic artificial intelligent technique, that is, Adaptive-Network-based Fuzzy Inference System(ANFIS) solved via hybrid learning algorithm(the back-propagation gradient descent and the least-squares method) are used to learn the input(the location and depth of a crack)-output(the structural eigenfrequencies) relation of the structural system. With this ANFIS and a continuous evolutionary algorithm(CEA), it is possible to formulate the inverse problem. CEAs based on genetic algorithms work efficiently for continuous search space optimization problems like a parameter identification problem. With this ANFIS, CEAs are used to identify the crack location and depth minimizing the difference from the measured frequencies. We have tried this new idea on a simple beam structure and the results are promising.

  • PDF