• Title/Summary/Keyword: Deep Q-Network

Search Result 63, Processing Time 0.021 seconds

Smart AGV based on Object Recognition and Task Scheduling (객체인식과 작업 스케줄링 기반 스마트 AGV)

  • Lee, Se-Hoon;Bak, Tae-Yeong;Choi, Kyu-Hyun;So, Won-Bin
    • Proceedings of the Korean Society of Computer Information Conference
    • /
    • 2019.07a
    • /
    • pp.251-252
    • /
    • 2019
  • 본 논문에서는 기존의 AGV보다 높은 안전성과 Task Scheduling을 바탕으로 한 효율적인 AGV를 제안하였다. AGV는 객체인식 알고리즘인 YOLO로 다른 AGV를 인식하여 자동으로 피난처로 들어간다. 또한 마커인식 알고리즘인 ar_markers를 이용하여 그 위치가 적재소인지 생산 공정인지를 판단하여 각 마커마다 멈추고 피난처에 해당하는 Marker가 인식되고 다른 AGV가 인식되면 피난처로 들어가는 동작을 한다. 이 모든 로그는 Mobius를 이용해 Spring기반의 웹 홈페이지로 확인할 수 있으며, 작업스케줄 명령 또한 웹 홈페이지에서 내리게 된다. 위 작업스케줄은 외판원, 벨만-포드 알고리즘을 적용한 뒤 강화학습알고리즘 중 하나인 DQN을 이용해 최적 값을 도출해 내고 그 값을 DB에 저장해 AGV가 움직일 수 있도록 한다. 본 논문에서는 YOLO와 Marker 그리고 웹을 사용하는 AGV가 기존의 AGV에 비해 더욱 가볍고 큰 시설이 필요하지 않다는 점에서 우수함을 보인다.

  • PDF

Development of Prediction Model of Chloride Diffusion Coefficient using Machine Learning (기계학습을 이용한 염화물 확산계수 예측모델 개발)

  • Kim, Hyun-Su
    • Journal of Korean Association for Spatial Structures
    • /
    • v.23 no.3
    • /
    • pp.87-94
    • /
    • 2023
  • Chloride is one of the most common threats to reinforced concrete (RC) durability. Alkaline environment of concrete makes a passive layer on the surface of reinforcement bars that prevents the bar from corrosion. However, when the chloride concentration amount at the reinforcement bar reaches a certain level, deterioration of the passive protection layer occurs, causing corrosion and ultimately reducing the structure's safety and durability. Therefore, understanding the chloride diffusion and its prediction are important to evaluate the safety and durability of RC structure. In this study, the chloride diffusion coefficient is predicted by machine learning techniques. Various machine learning techniques such as multiple linear regression, decision tree, random forest, support vector machine, artificial neural networks, extreme gradient boosting annd k-nearest neighbor were used and accuracy of there models were compared. In order to evaluate the accuracy, root mean square error (RMSE), mean square error (MSE), mean absolute error (MAE) and coefficient of determination (R2) were used as prediction performance indices. The k-fold cross-validation procedure was used to estimate the performance of machine learning models when making predictions on data not used during training. Grid search was applied to hyperparameter optimization. It has been shown from numerical simulation that ensemble learning methods such as random forest and extreme gradient boosting successfully predicted the chloride diffusion coefficient and artificial neural networks also provided accurate result.

Estimation of site amplification and S-wave velocity profiles in metropolitan Manila, the Philippines, from earthquake ground motion records (지진 관측 기록을 이용한 필리핀 마닐라의 현장 증폭 특성 및 S파 속도구조 추정)

  • Yamanaka, Hiroaki;Ohtawara, Kaoru;Grutas, Rhommel;Tiglao, Robert B.;Lasala, Melchor;Narag, Ishmael C.;Bautista, Bartlome C.
    • Geophysics and Geophysical Exploration
    • /
    • v.14 no.1
    • /
    • pp.69-79
    • /
    • 2011
  • In this study, empirical site amplifications and S-wave velocity profiles for shallow and deep soils are estimated using earthquake ground motion records in metropolitan Manila, the Philippines. We first apply a spectral inversion technique to the earthquake records to estimate effects of source, path, and local site amplification. The earthquake data used were obtained during 36 moderate earthquakes at 10 strong-motion stations of an earthquake observation network in Manila. The estimated Q value of the propagation path is modelled as $54.6f^{1.1}$. Most of the source spectra can be approximated with the omega-square model. The site amplifications show characteristic features according to surface geological conditions. The amplifications at the sites in the coastal lowland and Marikina Valley shows predominant peaks at frequencies from 1 to 5 Hz, while those in the central plateau are characterised by no dominant peaks. These site amplifications are inverted to subsurface S-wave velocity. We, next, discuss the relationship between the amplifications and average S-wave velocity in the top 30m of the S-wave velocity profiles. The amplifications at low frequencies are well correlated with the averaged S-wave velocity. However, high-frequency amplifications cannot be sufficiently explained by the averaged S-wave velocity in the top 30 m. They are correlated more with the average of S-wave velocity over depths less than 30 m.