• 제목/요약/키워드: grid-search

검색결과 274건 처리시간 0.025초

Q-value Initialization을 이용한 Reinforcement Learning Speedup Method (Reinforcement learning Speedup method using Q-value Initialization)

  • 최정환
    • 대한전자공학회:학술대회논문집
    • /
    • 대한전자공학회 2001년도 하계종합학술대회 논문집(3)
    • /
    • pp.13-16
    • /
    • 2001
  • In reinforcement teaming, Q-learning converges quite slowly to a good policy. Its because searching for the goal state takes very long time in a large stochastic domain. So I propose the speedup method using the Q-value initialization for model-free reinforcement learning. In the speedup method, it learns a naive model of a domain and makes boundaries around the goal state. By using these boundaries, it assigns the initial Q-values to the state-action pairs and does Q-learning with the initial Q-values. The initial Q-values guide the agent to the goal state in the early states of learning, so that Q-teaming updates Q-values efficiently. Therefore it saves exploration time to search for the goal state and has better performance than Q-learning. 1 present Speedup Q-learning algorithm to implement the speedup method. This algorithm is evaluated. in a grid-world domain and compared to Q-teaming.

  • PDF

비정상 Euler 방정식을 이용한 Chimera 기법의 병렬처리에 관한 연구 (A Study of Parallel Implementations of the Chimera Method using Unsteady Euler Equations)

  • 조금원;권장혁;이승수
    • 한국전산유체공학회지
    • /
    • 제4권3호
    • /
    • pp.52-62
    • /
    • 1999
  • The development of a parallelized aerodynamic simulation process involving moving bodies is presented. The implementation of this process is demonstrated using a fully systemized Chimera methodology for steady and unsteady problems. This methodology consists of a Chimera hole-cutting, a new cut-paste algorithm for optimal mesh interface generation and a two-step search method for donor cell identification. It is fully automated and requires minimal user input. All procedures of the Chimera technique are parallelized on the Cray T3E using the MPI library. Two and three-dimensional examples are chosen to demonstrate the effectiveness and parallel performance of this procedure.

  • PDF

카메라를 이용한 BGA 소자의 2차원 결함검출 알고리즘 개발 (The Development of 2-Dimensional Inspection Algorithm using Camera for BGA device)

  • 김기순;김준식;주효남
    • 한국조명전기설비학회:학술대회논문집
    • /
    • 한국조명전기설비학회 2005년도 춘계학술대회논문집
    • /
    • pp.437-442
    • /
    • 2005
  • In this paper, we proposed the 2-dimensional inspection algorithm for micro-BGA(Ball Grid Array) device using a vision system. The proposed method uses the subpixel algorithm for high precision. The proposed algorithm preferentially extracts the package area of device in the input image. After the extraction of package area, each ball areas are extracted by ball search window method. The parameters for inspection are calculated for the extracted ball area. In the simulation results, we have the average error within $17{\mu}m$.

  • PDF

인공 신경망 모형을 이용한 한국프로야구 관중 수요 예측 (A Prediction of Demand for Korean Baseball League using Artificial Neural Network)

  • 박진욱;박상현
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2017년도 춘계학술발표대회
    • /
    • pp.920-923
    • /
    • 2017
  • 본 연구는 기존의 수요 예측 등의 시계열 분석에서 주로 사용되는 ARIMA 모형의 어려움을 극복하고자 인공신경망(Artificial Neural Network) 모형을 이용하여 한국 프로 야구 관중 수를 예측하였다. 인공신경망의 가장 기본적인 종류인 전방향 신경망(Feedforward Neural Network)의 초모수(Hyperparameter) 선정에 그리드 탐색(Grid Search)을 적용하여 최적의 모형을 찾고자 하였다. 훈련 자료로는 2015년 3월부터 8월까지의 일별 KBO 관중 수 자료를 대상으로 하였고, 예측력 검증을 위해 2015년 9월 관중 수를 예측하여 실제 관측값과 비교하였다. 그 결과, 그리드 탐색법에서 최적 모형이라고 판단한 모형의 예측력은, 평균 절대 백분율 오차(MAPE) 기준으로 평균 27.14% 였다. 또한, 앙상블 기법에서 착안하여 오차율이 낮은 모형 5개의 예측값 평균의 MAPE는 평균 28.58% 였다. 이는 다중회귀와 비교해보았을 때, 평균적으로 각각 14%, 13.6% 높은 예측력을 보이고 있다.

이차원 비정상 점성 유동 해석을 위한 비정렬 중첩격자기법 개발 (DEVELOPMENT OF AN UNSTRUCTURED OVERSET MESH METHOD FOR 2-D UNSTEADY VISCOUS FLOW ANALYSIS)

  • 정문승;권오준
    • 한국전산유체공학회:학술대회논문집
    • /
    • 한국전산유체공학회 2005년도 추계 학술대회논문집
    • /
    • pp.135-139
    • /
    • 2005
  • An unstructured overset mesh method has been developed for the simulation of unsteady viscous flow fields around multiple bodies in relative motion. For this purpose, a robust and fast search technique is proposed for both triangle and high-aspect quadrilateral cell elements. The interpolation boundary is defined for data communication between grid systems and an interpolation method is suggested for viscous and inviscid cell elements. This method has been applied to calculate the flow fields around 2-D airfoil including relative motion. Validation were made by comparing the predicted results with those of experiments or other researcher's numerical results. It was demonstrated that the present method is efficient and robust for the prediction of unsteady time-accurate flow fields involving multiple bodies in relative motion.

  • PDF

Analytical and sensitivity approaches for the sizing and placement of single DG in radial system

  • Bindumol, E.K.;Babu, C.A.
    • Advances in Energy Research
    • /
    • 제4권2호
    • /
    • pp.163-176
    • /
    • 2016
  • Rapid depletion of fossil based oil, coal and gas reserves and its greater demand day by day necessitates the search for other alternatives. Severe environmental impacts caused by the fossil fire based power plants and the escalating fuel costs are the major challenges faced by the electricity supply industry. Integration of Distributed Generators (DG) especially, wind and solar systems to the grid has been steadily increasing due to the concern of clean environment. This paper focuses on a new simple and fast load flow algorithm named Backward Forward Sweep Algorithm (BFSA) for finding the voltage profile and power losses with the integration of various sizes of DG at different locations. Genetic Algorithm (GA) based BFSA is adopted in finding the optimal location and sizing of DG to attain an improved voltage profile and considerable reduced power loss. Simulation results show that the proposed algorithm is more efficient in finding the optimal location and sizing of DG in 15-bus radial distribution system (RDS).The authenticity of the placement of optimized DG is assured with other DG placement techniques.

Data Mining Approach Using Practical Swarm Optimization (PSO) to Predicting Going Concern: Evidence from Iranian Companies

  • Salehi, Mahdi;Fard, Fezeh Zahedi
    • 유통과학연구
    • /
    • 제11권3호
    • /
    • pp.5-11
    • /
    • 2013
  • Purpose - Going concern is one of fundamental concepts in accounting and auditing and sometimes the assessment of a company's going concern status that is a tough process. Various going concern prediction models' based on statistical and data mining methods help auditors and stakeholders suggested in the previous literature. Research design - This paper employs a data mining approach to prediction of going concern status of Iranian firms listed in Tehran Stock Exchange using Particle Swarm Optimization. To reach this goal, at the first step, we used the stepwise discriminant analysis it is selected the final variables from among of 42 variables and in the second stage; we applied a grid-search technique using 10-fold cross-validation to find out the optimal model. Results - The empirical tests show that the particle swarm optimization (PSO) model reached 99.92% and 99.28% accuracy rates for training and holdout data. Conclusions - The authors conclude that PSO model is applicable for prediction going concern of Iranian listed companies.

  • PDF

H.264 의 실시간 부호화를 위한 정수 단위 화소 움직임 예측 모듈 구조 (Hardware Module for Real-time Integer Pel Motion Estimation of H.264)

  • 신지용;이인직;김신덕
    • 한국정보처리학회:학술대회논문집
    • /
    • 한국정보처리학회 2007년도 춘계학술발표대회
    • /
    • pp.330-332
    • /
    • 2007
  • 본 논문에서는 정수 단위 화소 움직임 예측(ME: Motion Estimation)을 위한 Unsymmetrical-cross Multi-Hexagon-grid Search (UMHexagonS) 알고리즘을 기반으로, CIF 크기의 영상을 실시간으로 부호화 하기 위한 정수 단위 화소 움직임 예측 모듈을 제안한다. 제안하는 정수 단위 화소 움직임 예측 모듈은 32 개의 1 차원 연산유닛(PE: Processing Element) 배열, 데이터 선택/재배열 유닛, 내부버퍼, 그리고 트리 구조의 덧셈기로 구성되며, CIF 크기의 영상 100 프레임을 부호화 하기 위한 클럭 사이클을 계산하여 실험결과로 제시하였다. 그 결과 제안하는 구조는 400MHz 의 클럭 속도에서 CIF 크기의 영상을 실시간으로 부호화 할 수 있다.

  • PDF

상대운동이 있는 이차원 비정상 점성 유동 해석을 위한 비정렬 중첩격자기법 개발 (DEVELOPMENT OF AN UNSTRUCTURED OVERSET MESH METHOD FOR 2-D UNSTEADY VISCOUS FLOW SIMULATION WITH RELATIVE MOTION)

  • 정문승;권오준
    • 한국전산유체공학회지
    • /
    • 제11권2호
    • /
    • pp.1-7
    • /
    • 2006
  • An unstructured overset mesh method has been developed for the simulation of unsteady viscous flow fields around multiple bodies in relative motion. For this purpose, a robust and fast search technique is proposed for both triangle and high-aspect ratio quadrilateral cell elements. The interpolation boundary is defined for data communication between grid systems and an interpolation method is suggested for viscous and inviscid cell elements. This method has been applied to calculate the flow fields around 2-D airfoils involving relative motion. Validations were made by comparing the predicted results with those of experiments or other numerical results. It was demonstrated that the present method is efficient and robust for the prediction of unsteady time-accurate flow fields involving multiple bodies in relative motion.

Y-채널 마이크로믹서의 혼합 증대에 관한 연구 (Study on Mixing Enhancement of a Y-channel Micromixer with Obstacles)

  • 최장욱;최형일;이동호;이도형
    • 대한기계학회논문집B
    • /
    • 제29권12호
    • /
    • pp.1369-1376
    • /
    • 2005
  • Effective mixing gives strong advantageous impact on microfluidic applications since mixing is in general very slow process motivated by molecular diffusion transport only on the micro-scale. In this work, the mixing characteristics are analyzed in a Y-channel micromixer with obstacles. For the through analysis, our laboratory in-house unstructured grid CFD code is validated through solving a concentration transport in a uniform microchannel. The solutions well correspond to both exact solutions and those from MemCFD. Mixing in a Y-channel micromixer with obstacles is numerically investigated by the in-house code to search the optimal radius and layout of obstacles. From the simulations, the mixing efficiency appears to be proportional to the magnitude of the formation of lateral velocity component. It is also shown that the asymmetric layout and radius enlargement of obstacles greatly improves mixing efficiency.