• Smart Media Journal
• /
• v.11 no.11
• /
• pp.40-48
• /
• 2022

In this paper, an educational kit that can be used in AI education was developed to solve the difficulties of AI education. Through this, object detection and person detection in computer vision using CNN and OpenCV to learn practical-oriented experiences from theory-centered and user image recognition (Your Own) that learns and recognizes specific objects Image Recognition), user object classification (Segmentation) and segmentation (Classification Datasets), IoT hardware control that attacks the learned target, and Jetson Nano GPIO, an AI board, are developed and utilized to develop and utilize textbooks that help effective AI learning made it possible.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2023.11a
• /
• pp.154-155
• /
• 2023

오픈 소스인 YOLO(You Only Look Once) 객체 탐지 알고리즘이 공개된 이후, 산업 현장에서는 고성능 컴퓨터에서 벗어나 효율과 특수한 환경에 사용하기 위해 임베디드 시스템에 도입하고 있다. 그러나, NVIDIA의 Jetson nano의 경우, Pytorch의 YOLOv7 딥러닝 모델에 대한 추론이 진행되지 않는다. 따라서 제한적인 전력과 메모리, 연산능력 최적화 과정은 필수적이다. 본 논문은 NVIDIA의 임베디드 플랫폼 Jetson 계열의 Xavier NX, Orin AGX, Nano에서 딥러닝 모델을 적용하기 위한 최적화 과정과 플랫폼에서 다양한 크기의 YOLOv7의 PyTorch 모델들을 Tensor RT로 변환하여 FPS(Frames Per Second)를 측정 및 비교한다. 측정 결과를 통해, 각 임베디드 플랫폼에서 YOLOv7 모델의 추론은 Tensor RT는 Pytorch에서 약 4.1배 적은 FPS 변동성과 약 2.25배 정도의 FPS 속도향상을 보였다.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2022.10a
• /
• pp.556-558
• /
• 2022

This paper proposes a CanSat system with a vehicle tracking function based on Jetson Nano, a high-performance small computer capable of operating artificial intelligence algorithms. The CanSat system consists of a CanSat and a ground station. The CanSat falls in the atmosphere and transmits the data obtained through the installed sensors to the ground station using wireless communication. The existing CanSat is limited to the mission of simply transmitting the collected information to the ground station, and there is a limit to efficiently performing the mission due to the limited fall time and bandwidth limitation of wireless communication. The Jetson Nano based CanSat proposed in this paper uses a pre-trained neural network model to detect the location of a vehicle in each image taken from the air in real time, and then uses a 2-axis motor to move the camera to track the vehicle.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2021.01a
• /
• pp.211-212
• /
• 2021

본 논문에서는 싱글보드 컴퓨터 Jetson nano 기반 음성 라이브러리 Snowboy를 활용하여 음성인식 시스템을 구현하여 Turtlebot의 동작을 제어하였다. Turtlebot은 ROS(Robot Operating System) 기반으로 동작하며 ROS core를 통해 Jetson nano와 데이터전송이 가능하다. 사용자에 의해 실시간으로 Snowboy에 저장된 특정 음성을 인식하고 지정된 좌표로 변환한다. 변환된 좌표에 따라 Turtlebot이 지정된 위치로 이동한다. Lidar센서를 활용하여 장애물을 감지하고 다른 경로를 생성해 지정된 위치로 이동한다.

• Korean Journal of Agricultural Science
• /
• v.50 no.3
• /
• pp.373-382
• /
• 2023

The task of sorting and excluding blemished apples and others that lack commercial appeal is currently performed manually by human eye sorting, which not only causes musculoskeletal disorders in workers but also requires a significant amount of time and labor. In this study, an automated apple-sorting machine was developed to prevent musculoskeletal disorders in apple production workers and to streamline the process of sorting blemished and non-marketable apples from the better quality fruit. The apple-sorting machine is composed of an arm-rest, a main body, and a height-adjustable part, and uses object detection through a machine learning technology called 'You Only Look Once (YOLO)' to sort the apples. The machine was initially trained using apple image data, RoboFlow, and Google Colab, and the resulting images were analyzed using Jetson Nano. An algorithm was developed to link the Jetson Nano outputs and the conveyor belt to classify the analyzed apple images. This apple-sorting machine can immediately sort and exclude apples with surface defects, thereby reducing the time needed to sort the fruit and, accordingly, achieving cuts in labor costs. Furthermore, the apple-sorting machine can produce uniform quality sorting with a high level of accuracy compared with the subjective judgment of manual sorting by eye. This is expected to improve the productivity of apple growing operations and increase profitability.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2020.07a
• /
• pp.701-702
• /
• 2020

본 논문에서는 Jetson-Nano와 데스크탑에서 OpenCV와 YOLOv3 실시간 객체 인식 알고리즘을 이용하여 웹캠을 통해 주차장 등의 출입 차량 인식 통계 시스템을 개발하였다. 최근 에지컴퓨팅에 관심이 증가하고 있는 시점에서 Nvidia사에서 개발하여 보급하고 있는 Jetson-Nano에 YOLOv3 tiny와 OpenCV를 이용하여 차량인식을 수행하고, 구글에서 개발한 오픈 소스 Tesseract-OCR을 이용해 차량번호인식하여 입출차 혹은 주차시 차량정보를 확인할 수 있다. 딥러닝 학습 알고리즘에서 전기차 번호판의 특징점을 인식하여 전기차를 판별하여 일반차량이 전기차 주차구역에 불법주차하는 것을 모니터링할 수도 있다. 출입한 차량 데이터 베이스에서 입출차 시각, 차량번호, 전기차여부등이 확인 가능하다.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2021.10a
• /
• pp.382-384
• /
• 2021

In this study, we implement a system that automatically classifies types of plastics using YOLO (You Only Look Once), a real-time object recognition algorithm. The system consists of Nvidia jetson nano, a small computer for deep learning and computer vision, with model trained to recognize plastic separation emission marks using YOLO. Using a webcam, recycling marks of plastic waste were recognized as PET, HDPE, and PP, and motors were adjusted to be classified according to the type. By implementing this automatic classifier, it is convenient in that it can reduce the labor of separating and discharging plastic separation marks by humans and increase the efficiency of recycling through accurate recycling.

• Korean Journal of Artificial Intelligence
• /
• v.11 no.4
• /
• pp.1-8
• /
• 2023

In this paper, we propose a black ice detection platform framework using Convolutional Neural Networks (CNNs). To overcome black ice problem, we introduce a real-time based early warning platform using CNN-based architecture, and furthermore, in order to enhance the accuracy of black ice detection, we apply a multi-scale dilation convolution feature fusion (MsDC-FF) technique. Then, we establish a specialized experimental platform by using a comprehensive dataset of thermal road black ice images for a training and evaluation purpose. Experimental results of a real-time black ice detection platform show the better performance of our proposed network model compared to conventional image segmentation models. Our proposed platform have achieved real-time segmentation of road black ice areas by deploying a road black ice area segmentation network on the edge device Jetson Nano devices. This approach in parallel using multi-scale dilated convolutions with different dilation rates had faster segmentation speeds due to its smaller model parameters. The proposed MsCD-FF Net(2) model had the fastest segmentation speed at 5.53 frame per second (FPS). Thereby encouraging safe driving for motorists and providing decision support for road surface management in the road traffic monitoring department.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.24 no.4
• /
• pp.467-473
• /
• 2020

Recently, the number of traffic accidents has also increased with the increase in the penetration rate of cars in Korea. In particular, not only inter-vehicle accidents but also human accidents near crosswalks are increasing, so that more attention to traffic safety around crosswalks are required. In this paper, we propose a system for predicting the safety level around the crosswalk by recognizing an approaching vehicle and estimating the speed of the vehicle using NVIDIA Jetson Nano-class edge devices. To this end, various machine learning models are trained with the information obtained from deep learning-based vehicle detection to predict the degree of risk according to the speed of an approaching vehicle. Finally, based on experiments using actual driving images and web simulation, the performance and the feasibility of the proposed system are validated.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.26 no.5
• /
• pp.668-674
• /
• 2022

Machine learning techniques using visual data have high usability in fields of industry and service such as scene recognition, fault detection, security and user analysis. Among these, user analysis through the videos from CCTV is one of the practical way of using vision data. Also, many studies about lightweight artificial neural network have been published to increase high usability for mobile and embedded environment so far. In this study, we propose the network combining the object detection and classification for mobile graphic processing unit. This network detects pedestrian and face, classifies age and gender from detected face. Proposed network is constructed based on MobileNet, YOLOv2 and skip connection. Both detection and classification models are trained individually and combined as 2-stage structure. Also, attention mechanism is used to improve detection and classification ability. Nvidia Jetson Nano is used to run and evaluate the proposed system.