• Journal of Korea Society of Industrial Information Systems
• /
• v.29 no.1
• /
• pp.77-89
• /
• 2024

This paper presents an unmanned store management system that can provide inventory management and theft prevention for displayed products using a small camera that can monitor the shelves of sold products in small and medium-sized stores. This system is a service solution that integrates object recognition, real-time communication, security management, access management, and mobile authentication. The proposed system uses a custom YOLOv5-x model to recognize objects on the display, measure quantities in real time, and support real-time data communication with servers through Raspberry Pie. In addition, the number of objects in the database and the object recognition results are compared to detect suspected theft situations and provide burial images at the time of theft. The proposed unmanned store solution is expected to improve the efficiency of small and medium-sized unmanned store operations and contribute to responding to theft.

• Journal of the Korea Academia-Industrial cooperation Society
• /
• v.21 no.7
• /
• pp.262-269
• /
• 2020

Recently, many attempts have been made to reduce the time required for payment in various shopping environments. In addition, for the Fourth Industrial Revolution era, artificial intelligence is advancing, and Internet of Things (IoT) devices are becoming more compact and cheaper. So, by integrating these two technologies, access to building an unmanned environment to save people time has become easier. In this paper, we propose a smart shopping cart system based on low-cost IoT equipment and deep-learning object-detection technology. The proposed smart cart system consists of a camera for real-time product detection, an ultrasonic sensor that acts as a trigger, a weight sensor to determine whether a product is put into or taken out of the shopping cart, an application for smartphones that provides a user interface for a virtual shopping cart, and a deep learning server where learned product data are stored. Communication between each module is through Transmission Control Protocol/Internet Protocol, a Hypertext Transmission Protocol network, a You Only Look Once darknet library, and an object detection system used by the server to recognize products. The user can check a list of items put into the smart cart via the smartphone app, and can automatically pay for them. The smart cart system proposed in this paper can be applied to unmanned stores with high cost-effectiveness.

• Proceedings of the Korean Institute of Information and Commucation Sciences Conference
• /
• 2022.10a
• /
• pp.562-565
• /
• 2022

Recently, the increasing number of overloaded vehicles on the road poses a risk to traffic safety, such as falling objects, road damage, and chain collisions due to the abnormal weight distribution, and can cause great damage once an accident occurs. However, this irregular weight distribution is not possible to be recognized with the current weight measurement system for vehicles on roads. To address this limitation, we propose to build an object detection-based AI model to identify overloaded vehicles that cause such social problems. In addition, we present a simple yet effective method to construct an object detection model for the large-scale vehicle images. In particular, we utilize the large-scale of vehicle image sets provided by open AI-Hub, which include the overloaded vehicles from the CCTV, black box, and hand-held camera point of view. We inspected the specific features of sizes of vehicles and types of image sources, and pre-processed these images to train a deep learning-based object detection model. Finally, we demonstrated that the detection performance of the overloaded vehicle was improved by about 23% compared to the one using raw data. From the result, we believe that public big data can be utilized more efficiently and applied to the development of an object detection-based overloaded vehicle detection model.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2023.07a
• /
• pp.15-18
• /
• 2023

UAV는 군사용을 처음 시작으로 근래에 취미용 드론의 급격한 성장과 더불어 최근 기후변화, 교통혼잡, 범죄 예방 등 여러 사회 문제 해결을 위한 드론의 필요성이 증가함에 따라 건설, 교통, 농업, 에너지, 엔터테인먼트 등 다양한 산업과 여러 사회 서비스로 그 필요성이 확대되고 있다. 본 연구는 이러한 사회적 흐름에 따라 인공지능 기술을 통한 드론의 활용성을 확대하고 GPS 수신이 안 되는 환경에서 딥러닝 객체 탐지 모델을 활용한 자율 착륙을 연구를 목표로 한다. GPS 신호는 실내와 같은 환경 혹은 지하, 교량 아래, 산속 등과 같은 곳에서는 수신이 어렵다. 이를 극복하고자 GPS 신호수신이 어려운 지역에서 GPS 수신기를 통해 받는 위치 정보 대신 드론에 장착된 카메라를 통해 전달받는 영상에서 착륙할 지점을 인식하고 카메라를 통해 받는 영상 정보만 이용하여 목표지점으로 하강하는 방식으로 자율 착륙을 유도한다. 딥러닝 중 경량화 모델을 활용하여 소형 드론에서 실시간으로 착륙 지점을 감지하기 위해 최적화 과정을 진행해 실시간 자율 착륙이 가능하게 하였다. 본 연구를 통해 드론의 착륙에 있어 GPS 수신기와 사람의 조종에 대한 의존도를 낮출 수 있을 것으로 기대한다.

• Journal of Broadcast Engineering
• /
• v.27 no.3
• /
• pp.391-401
• /
• 2022

As deep learning-based object detection and recognition research have been developed recently, the scope of application to industry and real life is expanding. But deep learning-based systems in the construction system are still much less studied. Calculating materials in the construction system is still manual, so it is a reality that transactions of wrong volumn calculation are generated due to a lot of time required and difficulty in accurate accumulation. A fast and accurate automatic drawing recognition system is required to solve this problem. Therefore, we propose an AI-based automatic drawing recognition accumulation system that detects and recognizes steel materials in construction drawings. To accurately detect steel materials in construction drawings, we propose data augmentation techniques and spatial attention modules for improving small object detection performance based on YOLOv4. The detected steel material area is recognized by text, and the number of steel materials is integrated based on the predicted characters. Experimental results show that the proposed method increases the accuracy and precision by 1.8% and 16%, respectively, compared with the conventional YOLOv4. As for the proposed method, Precision performance was 0.938. The recall was 1. Average Precision AP_0.5 was 99.4% and AP_0.5:0.95 was 67%. Accuracy for character recognition obtained 99.9.% by configuring and learning a suitable dataset that contains fonts used in construction drawings compared to the 75.6% using the existing dataset. The average time required per image was 0.013 seconds in the detection, 0.65 seconds in character recognition, and 0.16 seconds in the accumulation, resulting in 0.84 seconds.