Browse > Article
http://dx.doi.org/10.5762/KAIS.2020.21.7.262

Implementation of Smart Shopping Cart using Object Detection Method based on Deep Learning  

Oh, Jin-Seon (Computer Science and Engineering, Soonchunhyang University)
Chun, In-Gook (Computer Science and Engineering, Soonchunhyang University)
Publication Information
Journal of the Korea Academia-Industrial cooperation Society / v.21, no.7, 2020 , pp. 262-269 More about this Journal
Abstract
Recently, many attempts have been made to reduce the time required for payment in various shopping environments. In addition, for the Fourth Industrial Revolution era, artificial intelligence is advancing, and Internet of Things (IoT) devices are becoming more compact and cheaper. So, by integrating these two technologies, access to building an unmanned environment to save people time has become easier. In this paper, we propose a smart shopping cart system based on low-cost IoT equipment and deep-learning object-detection technology. The proposed smart cart system consists of a camera for real-time product detection, an ultrasonic sensor that acts as a trigger, a weight sensor to determine whether a product is put into or taken out of the shopping cart, an application for smartphones that provides a user interface for a virtual shopping cart, and a deep learning server where learned product data are stored. Communication between each module is through Transmission Control Protocol/Internet Protocol, a Hypertext Transmission Protocol network, a You Only Look Once darknet library, and an object detection system used by the server to recognize products. The user can check a list of items put into the smart cart via the smartphone app, and can automatically pay for them. The smart cart system proposed in this paper can be applied to unmanned stores with high cost-effectiveness.
Keywords
Deep Learning; Real-time Object Detection; YOLO; Internet of Things; Smart Shopping Cart;
Citations & Related Records
연도 인용수 순위
  • Reference
1 T.K. Wankhede, B. Wukkadada and V. Nadar, "Just Walk-Out Technology and its Challenges: A Case of Amazon Go," 2018 International Conference on Inventive Research in Computing Applications (ICIRCA), Coimbatore, 2018, pp. 254-257. DOI: https://doi.org/10.1109/icirca.2018.8597403
2 Chiang.,Hsin-Han, et al., "Development of smart shopping carts with customer-oriented service", 2016 International Conference on System Science and Engineering (ICSSE), Taiwan, July 7-9, pp.1-2. DOI: https://doi.org/10.1109/ICSSE.2016.7551618
3 V. V., P. K. P. and C. R. S., "Smart Shopping Cart," 2018 International Conference on Circuits and Systems in Digital Enterprise Technology (ICCSDET), Kottayam, India, 2018, pp. 1-4. DOI: https://doi.org/10.1109/ICCSDET.2018.8821103.
4 Srinidhi Karjol, Anusha K. Holla, C. B. Abhilash, "An IOT Based Smart Shopping Cart for Smart Shopping", International Conference on Cognitive Computing and Information Processing, 2017, pp. 373-385. DOI: https://doi.org/10.1007/978-981-10-9059-2_33.
5 JJ. Redmon, S. Divvala, R. Girshick and A. Farhadi, "You Only Look Once: Unified, Real-Time Object Detection," 2016 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, NV, 2016, pp. 779-788. DOI: https://doi.org/10.1109/CVPR.2016.91
6 MShaoqing Ren, Kaiming He, Ross Girshick, Jian Sun, "Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networks", Neural Information Processing Systems 2015, Advances in Neural Information Processing Systems 28, montreal, Canada, Dec 2015, pp. 91-99. DOI: https://doi.org/10.1109/TPAMI.2016.2577031
7 Wei Liu, Dragomir Anguelov, Dumitru Erhan, Christian Szegedy, Scott Reed, Cheng-Yang Fu, Alexander C. Berg, "SSD: Single Shot MultiBox Detector", Computer Vision - ECCV 2016, European Conference on Computer Vision, Amsterdam, Netherlands, pp.21-37, Oct 2016. DOI: https://doi.org/10.1007/978-3-319-46448-0_2