• International journal of advanced smart convergence
• /
• v.11 no.2
• /
• pp.22-29
• /
• 2022

In this paper, for the purpose of designing an real-time unmanned monitoring system, the YOLOv5s (small) object detection model was applied on the NVIDIA TX2^TM AI (Artificial Intelligence) edge computing platform in order to design the fundamental function of an unmanned monitoring system that can detect objects in real time. YOLOv5s was applied to the our real-time unmanned monitoring system based on the performance evaluation of object detection algorithms (for example, R-CNN, SSD, RetinaNet, and YOLOv5). In addition, the performance of the four YOLOv5 models (small, medium, large, and xlarge) was compared and evaluated. Furthermore, based on these results, the YOLOv5s model suitable for the design purpose of this paper was ported to the NVIDIA TX2^TM AI edge computing system and it was confirmed that it operates normally. The real-time unmanned monitoring system designed as a result of the research can be applied to various application fields such as an security or monitoring system. Future research is to apply NMS (Non-Maximum Suppression) modification, model reconstruction, and parallel processing programming techniques using CUDA (Compute Unified Device Architecture) for the improvement of object detection speed and performance.

• Broadcasting and Media Magazine
• /
• v.25 no.2
• /
• pp.36-43
• /
• 2020

AI 시스템은 우리 생활 전반에서 다양한 예측을 도와주는 장치로써 그 중요성이 크다. AI 시스템의 활용도는 AI 장치가 얼마나 우리 생활 전반에 다각도로 이용되어야 하는지에 달려있다. 현재 AI 시스템은 높은 정확도를 위해 학습과 추론에 고성능 컴퓨팅 장비를 필요로 한다. 고성능 장치를 우리 생활 저변에서 쉽게 설치하고 사용할 수 없기 때문에, AI 시스템을 우리 생활에 사용하기 위해서 크게 두 가지의 접근법을 사용하고 있다. 첫째, 고성능 네트워크와 고성능 컴퓨팅 서버를 사용하여 end-user 장치의 계산 복잡도를 최소화하는 시스템을 설계할 수 있다. 둘째, AI 시스템의 학습 및 추론 효율성을 높여, 서버와 네트워크 없이도 end-user 장치에서 최선의 성능을 내는 시스템을 설계할 수 있다. 첫번째 접근법은 고성능 네트워크의 발전을 수반하고, 네트워크의 항상성을 전제로 하기 때문에, 실현하는데 많은 시간과 자원이 요구된다. 두번째 접근법은 비용-효율적이긴 하나 첫번째 접근법에 비해 AI 시스템의 성능이 다소 떨어질 수 있다. 이 글에서는 두번째 접근법의 AI 시스템, 특히 시각 인식 시스템을 응용으로 하는 기술들을 살펴보도록 하겠다.

• IEMEK Journal of Embedded Systems and Applications
• /
• v.19 no.3
• /
• pp.151-158
• /
• 2024

Although on-device artificial intelligence (AI) has gained attention to diagnosing machine faults in real time, most previous studies did not consider the model retraining and redeployment processes that must be performed in real-world industrial environments. Our study addresses this challenge by proposing an on-device AI-based real-time machine fault diagnosis system that utilizes continual learning. Our proposed system includes a lightweight convolutional neural network (CNN) model, a continual learning algorithm, and a real-time monitoring service. First, we developed a lightweight 1D CNN model to reduce the cost of model deployment and enable real-time inference on the target edge device with limited computing resources. We then compared the performance of five continual learning algorithms with three public bearing fault datasets and selected the most effective algorithm for our system. Finally, we implemented a real-time monitoring service using an open-source data visualization framework. In the performance comparison results between continual learning algorithms, we found that the replay-based algorithms outperformed the regularization-based algorithms, and the experience replay (ER) algorithm had the best diagnostic accuracy. We further tuned the number and length of data samples used for a memory buffer of the ER algorithm to maximize its performance. We confirmed that the performance of the ER algorithm becomes higher when a longer data length is used. Consequently, the proposed system showed an accuracy of 98.7%, while only 16.5% of the previous data was stored in memory buffer. Our lightweight CNN model was also able to diagnose a fault type of one data sample within 3.76 ms on the Raspberry Pi 4B device.

• Journal of Drive and Control
• /
• v.18 no.1
• /
• pp.24-30
• /
• 2021

There is an increasing interest in condition-based maintenance for the prevention of economic loss due to failure. Moreover, immense research is being carried out in related technologies in the field of construction machinery. In particular, data-based failure diagnosis methods that employ AI (machine & deep learning) algorithms are in the spotlight. In this study, we have focused on the failure diagnosis and mode classification of reduction gear of excavator's travel device by using the AI algorithm. In addition, a remote monitoring system has been developed that can monitor the status of the reduction gear by using the developed diagnosis algorithm. The failure diagnosis algorithm was performed in the process of data acquisition of normal and abnormal under various operating conditions, data processing and analysis by the wavelet transformation, and learning. The developed algorithm was verified based on three-evaluation conditions. Finally, we have built a system that can check the status of the reduction gear of travel devices on the web using the Edge platform, which is embedded with the failure diagnosis algorithm and cloud.

• Journal of the Korea Society of Computer and Information
• /
• v.25 no.4
• /
• pp.165-172
• /
• 2020

In this paper we propose an uses on-device-based edge computing technology and big data analysis methods through the use of on-device-based edge computing technology and analysis of big data, which are distributed computing paradigms that introduce computations and storage devices where necessary to solve problems such as transmission delays that occur when data is transmitted to central centers and processed in current general smart factories. However, even if edge computing-based technology is applied in practice, the increase in devices on the network edge will result in large amounts of data being transferred to the data center, resulting in the network band reaching its limits, which, despite the improvement of network technology, does not guarantee acceptable transfer speeds and response times, which are critical requirements for many applications. It provides the basis for developing into an AI-based facility prediction conservation analysis tool that can apply deep learning suitable for big data in the future by supporting intelligent facility management that can support productivity growth through research that can be applied to the field of facility preservation and smart factory industry with integrated hardware technology that can accommodate these requirements and factory management and control technology.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2022.11a
• /
• pp.881-883
• /
• 2022

고객사에 납품하는 웨이퍼의 안정적인 공급을 위한 웨이퍼 엣지의 결함 검출 장비다. 본 연구에서는 OpenCV와 임베디드 시스템, 머신러닝, 전자 회로 그리고 센서/카메라 기술을 핵심 기술로 R&D 한다. 고객사에서 불량 웨이퍼 발생에 대응하기 위한 장비의 데이터를 생산하여 고객과의 신뢰도 향상 및 유지를 할 수 있다. 그리고 결함이 특정 공정 지점에서 발생하는지 탐색할 수 있다.

• Electronics and Telecommunications Trends
• /
• v.39 no.3
• /
• pp.98-106
• /
• 2024

Advanced packaging is emerging as a core technology owing to the increasing demand for multifunctional and highly integrated semiconductors to achieve low power and high performance following digital transformation. It may allow to overcome current limitations of semiconductor process miniaturization and enables single packaging of individual devices. The introduction of advanced packaging facilitates the integration of various chips into one device, and it is emerging as a competitive edge in the industry with high added value, possibly replacing traditional packaging that focuses on electrical connections and the protection of semiconductor devices.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.19 no.1
• /
• pp.189-196
• /
• 2024

Frequent false positives alarm from the Intelligent Selective Control System have raised significant concerns. These persistent issues have led to declines in operational efficiency and market credibility among agents. Developing a new model or replacing the existing one to mitigate false positives alarm entails substantial opportunity costs; hence, improving the quality of the training dataset is pragmatic. However, smaller organizations face challenges with inadequate capabilities in dataset collection and refinement. This paper proposes an automatic human pose data collection system centered around a human pose estimation model, utilizing camera-based sensor fusion techniques and edge devices. The system facilitates the direct collection and real-time processing of field data at the network periphery, distributing the computational load that typically centralizes. Additionally, by directly labeling field data, it aids in constructing new training datasets.

• KIPS Transactions on Computer and Communication Systems
• /
• v.11 no.2
• /
• pp.67-72
• /
• 2022

Recently, various intelligent application services using artificial intelligence are being actively developed. In particular, research on artificial intelligence-based real-time prediction services is being actively conducted in the manufacturing industry, and the demand for artificial intelligence services that can detect and predict fire and odors is very high. However, most of the existing detection and prediction systems do not predict the occurrence of fires and odors, but rather provide detection services after occurrence. This is because AI-based prediction service technology is not applied in existing systems. In addition, fire prediction, odor detection and odor level prediction services are services with ultra-low delay characteristics. Therefore, in order to provide ultra-low-latency prediction service, edge computing technology is combined with artificial intelligence models, so that faster inference results can be applied to the field faster than the cloud is being developed. Therefore, in this paper, we propose an LSTM algorithm-based learning model that can be used for fire prediction and odor detection/prediction, which are most required in the manufacturing industry. In addition, the proposed learning model is designed to be implemented in edge devices, and it is proposed to receive real-time sensor data from the IoT terminal and apply this data to the inference model to predict fire and odor conditions in real time. The proposed model evaluated the prediction accuracy of the learning model through three performance indicators, and the evaluation result showed an average performance of over 90%.

• Journal of Internet Computing and Services
• /
• v.25 no.1
• /
• pp.99-107
• /
• 2024

Along with economic growth and industrial development, there is an increasing demand for various electronic components and device production of semiconductor, SMT component, and electrical battery products. However, these products may contain foreign substances coming from manufacturing process such as iron, aluminum, plastic and so on, which could lead to serious problems or malfunctioning of the product, and fire on the electric vehicle. To solve these problems, it is necessary to determine whether there are foreign materials inside the product, and may tests have been done by means of non-destructive testing methodology such as ultrasound ot X-ray. Nevertheless, there are technical challenges and limitation in acquiring X-ray images and determining the presence of foreign materials. In particular Small-sized or low-density foreign materials may not be visible even when X-ray equipment is used, and noise can also make it difficult to detect foreign objects. Moreover, in order to meet the manufacturing speed requirement, the x-ray acquisition time should be reduced, which can result in the very low signal- to-noise ratio(SNR) lowering the foreign material detection accuracy. Therefore, in this paper, we propose a five-step approach to overcome the limitations of low resolution, which make it challenging to detect foreign substances. Firstly, global contrast of X-ray images are increased through histogram stretching methodology. Second, to strengthen the high frequency signal and local contrast, we applied local contrast enhancement technique. Third, to improve the edge clearness, Unsharp masking is applied to enhance edges, making objects more visible. Forth, the super-resolution method of the Residual Dense Block (RDB) is used for noise reduction and image enhancement. Last, the Yolov5 algorithm is employed to train and detect foreign objects after learning. Using the proposed method in this study, experimental results show an improvement of more than 10% in performance metrics such as precision compared to low-density images.