• Structural Engineering and Mechanics
• /
• 제76권1호
• /
• pp.101-114
• /
• 2020

In this paper, an improved experience-based learning algorithm (EBL), termed as IEBL, is proposed to solve the nonlinear hysteretic parameter identification problem with Bouc-Wen model. A quasi-opposition-based learning mechanism and new updating equations are introduced to improve both the exploration and exploitation abilities of the algorithm. Numerical studies on a single-degree-of-freedom system without/with viscous damping are conducted to investigate the efficiency and robustness of the proposed algorithm. A laboratory test of seven lead-filled steel tube dampers is presented and their hysteretic parameters are also successfully identified with normalized mean square error values less than 2.97%. Both numerical and laboratory results confirm that, in comparison with EBL, CMFOA, SSA, and Jaya, the IEBL is superior in nonlinear hysteretic parameter identification in terms of convergence and accuracy even under measurement noise.

• Steel and Composite Structures
• /
• 제42권5호
• /
• pp.685-697
• /
• 2022

In this paper, a vibration-based method using the change ratios of modal data and the experience-based learning algorithm is presented for quantifying the position, size, and interface layer of delamination in laminated composites. Three types of objective functions are examined and compared, including the ones using frequency changes only, mode shape changes only, and their combination. A fine three-dimensional FE model with constraint equations is utilized to extract modal data. A series of numerical experiments is carried out on an eight-layer quasi-isotropic symmetric (0/-45/45/90)s composited beam for investigating the influence of the objective function, the number of modal data, the noise level, and the optimization algorithms. Numerical results confirm that the frequency-and-mode-shape-changes-based technique yields excellent results in all the three delamination variables of the composites and the addition of mode shape information greatly improves the accuracy of interface layer prediction. Moreover, the EBL outperforms the other three state-of-the-art optimization algorithms for vibration-based delamination detection of composites. A laboratory test on six CFRP beams validates the frequency-and-mode-shape-changes-based technique and confirms again its superiority for delamination detection of composites.

• Journal of Platform Technology
• /
• 제11권6호
• /
• pp.21-27
• /
• 2023

In this paper, we introduce a reinforcement learning-based algorithm for personalized tourist path recommendations. The algorithm employs a reinforcement learning agent to explore tourist regions and identify optimal paths that are expected to enhance tourism experiences. The concept of tourism experience is defined through points of interest (POI) located along tourist paths within the tourist area. These metrics are quantified through aggregated evaluation scores derived from reviews submitted by past visitors. In the experimental setup, the foundational learning model used to find tour paths is the Deep Q-Network (DQN). Despite the limited availability of historical tourist behavior data, the agent adeptly learns travel paths by incorporating preference scores of tourist POIs and spatial information of the travel area.

• 대한임베디드공학회논문지
• /
• 제17권5호
• /
• pp.297-307
• /
• 2022

The simple procedural segment selection algorithm commonly used in Dynamic Adaptive Streaming over HTTP (DASH) reveals severe weakness to provide high-quality streaming services in the integrated mobile networks of various wired and wireless links. A major issue could be how to properly cope with dynamically changing underlying network conditions. The key to meet it should be to make the segment selection algorithm much more adaptive to fluctuation of network traffics. This paper presents a system architecture that replaces the existing procedural segment selection algorithm with a deep reinforcement learning algorithm based on the Asynchronous Advantage Actor-Critic (A3C). The distributed A3C-based deep learning server is designed and implemented to allow multiple clients in different network conditions to stream videos simultaneously, collect learning data quickly, and learn asynchronously, resulting in greatly improved learning speed as the number of video clients increases. The performance analysis shows that the proposed algorithm outperforms both the conventional DASH algorithm and the Deep Q-Network algorithm in terms of the user's quality of experience and the speed of deep learning.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• 제13권5호
• /
• pp.2277-2298
• /
• 2019

Adaptive learning in e-learning has garnered researchers' interest. In it, learning resources could be recommended automatically to achieve a personalized learning experience. There are various ways to realize it. One of the realistic ways is adaptive learning path recommendation, in which learning resources are provided according to learners' requirements. This paper summarizes existing works and proposes an innovative approach. Firstly, a learner-centred concept map is created using graph theory based on the features of the learners and concepts. Then, the approach generates a linear concept sequence from the concept map using the proposed traversal algorithm. Finally, Learning Objects (LOs), which are the smallest concrete units that make up a learning path, are organized based on the concept sequences. In order to realize this step, we model it as a multi-objective combinatorial optimization problem, and an improved immune algorithm (IIA) is proposed to solve it. In the experimental stage, a series of simulated experiments are conducted on nine datasets with different levels of complexity. The results show that the proposed algorithm increases the computational efficiency and effectiveness. Moreover, an empirical study is carried out to validate the proposed approach from a pedagogical view. Compared with a self-selection based approach and the other evolutionary algorithm based approaches, the proposed approach produces better outcomes in terms of learners' homework, final exam grades and satisfaction.

• 한국컴퓨터정보학회논문지
• /
• 제20권5호
• /
• pp.151-159
• /
• 2015

알고리즘은 문제를 효과적이고 효율적으로 해결하기 위해 필요한 문제 해결 과정을 설계하는 기법을 다루기 때문에 컴퓨터 과학을 배우는 사람이라면 반드시 학습해야 하는 영역이다. 알고리즘 교육은 학습자들이 알고리즘을 설계하는 기법을 익히는 것 뿐 아니라 학습한 알고리즘 기법을 문제를 해결하는 데 적절히 활용할 수 있는 능력을 함께 익힐 때 효과적이다. 특히 사회적으로 커다란 영향을 미칠 가능성을 가진 정보 영재 학생들을 대상으로 하는 교육 활성화에 대한 인식이 확산되기 시작하면서 이들을 어떻게 가르칠 것인가에 대한 관심이 고조되고 있다. 따라서 본 연구에서는 정보 영재 학습자들이 알고리즘 설계 기법을 보다 쉽게 학습하고 문제를 해결하는 데 활용하는 방법을 익힐 수 있도록 하기 위하여 퍼즐을 도입하였다. 연구 결과 퍼즐 기반의 알고리즘 학습이 전통적인 알고리즘 학습 방법에 비해 학습자들에게 긍정적인 영향을 준 것을 확인할 수 있었다. 이러한 결과는 학습자들이 퍼즐 기반 알고리즘 학습을 통해 알고리즘 설계 기법을 적용하는 다양한 문제 해결 경험을 함으로써 흥미와 학습의 전이가 향상된 것이라 해석할 수 있다.

• 제어로봇시스템학회:학술대회논문집
• /
• 제어로봇시스템학회 1992년도 한국자동제어학술회의논문집(국내학술편); KOEX, Seoul; 19-21 Oct. 1992
• /
• pp.1072-1077
• /
• 1992

In ths paper a new active assembly algorithm for chamferless precision parts mating, is considered. The successful assembly task requires an extremely high position accuracy and a good knowledge of mating parts. However, conventional assembly mehtod alone makes it difficult to achieve satisfactory assembly performance because of the complexity and the uncertainties of the process and its environments such as imperfect knowledge of the parts being assembled as well as the limitation of the devices performing the assebled as well as the limitation of the devices performing the assembly. To cope with these problems, a self-learning rule-based assembly algorithm is proposed by intergaring fuzzy set theory and neural network. In this algortihm, fuzzy set theory copes with the complexity and the uncertainties of the assembly process, while neural network enhances the assembly schemen so as to learn fuzzy rules form experience and adapt to changes in environment of uncertainty and imprecision. The performance of the proposed assembly algorithm is evaluated through a series of experiments. The results show that the self-learning fuzzy assembly scheme can be effecitively applied to chamferless precision parts mating.

• Clinical Endoscopy
• /
• 제57권3호
• /
• pp.283-292
• /
• 2024

We developed three e-learning systems for endoscopists to acquire the necessary skills to improve the diagnosis of early gastric cancer (EGC) and demonstrated their usefulness using randomized controlled trials. The subjects of the three e-learning systems were "detection", "characterization", and "preoperative assessment". The contents of each e-learning system included "technique", "knowledge", and "obtaining experience". All e-learning systems proved useful for endoscopists to learn how to diagnose EGC. Lecture videos describing "the technique" and "the knowledge" can be beneficial. In addition, repeating 100 self-study cases allows learners to gain "experience" and improve their diagnostic skills further. Web-based e-learning systems have more advantages than other teaching methods because the number of participants is unlimited. Histopathological diagnosis is the gold standard for the diagnosis of gastric cancer. Therefore, we developed a comprehensive diagnostic algorithm to standardize the histopathological diagnosis of gastric cancer. Once we have successfully shown that this algorithm is helpful for the accurate histopathological diagnosis of cancer, we will complete a series of e-learning systems designed to assess EGC accurately.

• 전기전자학회논문지
• /
• 제25권2호
• /
• pp.337-343
• /
• 2021

심층 강화학습은 학습자가 가공되지 않은 고차원의 입력 데이터를 기반으로 최적의 행동을 선택할 수 있게 하는 인공지능 알고리즘이며, 이를 이용하여 장애물들이 존재하는 환경에서 모바일 로봇의 최적 이동 경로를 생성하는 연구가 많이 진행되었다. 본 논문에서는 복잡한 주변 환경의 이미지로부터 모바일 로봇의 이동 경로를 생성하기 위하여 우선 순위 경험 재사용(Prioritized Experience Replay)을 사용하는 Dueling Double DQN(D3QN) 알고리즘을 선택하였다. 가상의 환경은 로봇 시뮬레이터인 Webots를 사용하여 구현하였고, 시뮬레이션을 통해 모바일 로봇이 실시간으로 장애물의 위치를 파악하고 회피하여 목표 지점에 도달하는 것을 확인하였다.

• 대한임베디드공학회논문지
• /
• 제19권3호
• /
• pp.151-158
• /
• 2024

Although on-device artificial intelligence (AI) has gained attention to diagnosing machine faults in real time, most previous studies did not consider the model retraining and redeployment processes that must be performed in real-world industrial environments. Our study addresses this challenge by proposing an on-device AI-based real-time machine fault diagnosis system that utilizes continual learning. Our proposed system includes a lightweight convolutional neural network (CNN) model, a continual learning algorithm, and a real-time monitoring service. First, we developed a lightweight 1D CNN model to reduce the cost of model deployment and enable real-time inference on the target edge device with limited computing resources. We then compared the performance of five continual learning algorithms with three public bearing fault datasets and selected the most effective algorithm for our system. Finally, we implemented a real-time monitoring service using an open-source data visualization framework. In the performance comparison results between continual learning algorithms, we found that the replay-based algorithms outperformed the regularization-based algorithms, and the experience replay (ER) algorithm had the best diagnostic accuracy. We further tuned the number and length of data samples used for a memory buffer of the ER algorithm to maximize its performance. We confirmed that the performance of the ER algorithm becomes higher when a longer data length is used. Consequently, the proposed system showed an accuracy of 98.7%, while only 16.5% of the previous data was stored in memory buffer. Our lightweight CNN model was also able to diagnose a fault type of one data sample within 3.76 ms on the Raspberry Pi 4B device.