Browse > Article
http://dx.doi.org/10.9708/jksci.2022.27.12.059

Deep Learning Similarity-based 1:1 Matching Method for Real Product Image and Drawing Image  

Han, Gi-Tae (Dept. of Computer Engineering, Gachon University)
Publication Information
Journal of the Korea Society of Computer and Information / v.27, no.12, 2022 , pp. 59-68 More about this Journal
Abstract
This paper presents a method for 1:1 verification by comparing the similarity between the given real product image and the drawing image. The proposed method combines two existing CNN-based deep learning models to construct a Siamese Network. After extracting the feature vector of the image through the FC (Fully Connected) Layer of each network and comparing the similarity, if the real product image and the drawing image (front view, left and right side view, top view, etc) are the same product, the similarity is set to 1 for learning and, if it is a different product, the similarity is set to 0. The test (inference) model is a deep learning model that queries the real product image and the drawing image in pairs to determine whether the pair is the same product or not. In the proposed model, through a comparison of the similarity between the real product image and the drawing image, if the similarity is greater than or equal to a threshold value (Threshold: 0.5), it is determined that the product is the same, and if it is less than or equal to, it is determined that the product is a different product. The proposed model showed an accuracy of about 71.8% for a query to a product (positive: positive) with the same drawing as the real product, and an accuracy of about 83.1% for a query to a different product (positive: negative). In the future, we plan to conduct a study to improve the matching accuracy between the real product image and the drawing image by combining the parameter optimization study with the proposed model and adding processes such as data purification.
Keywords
Deep Learning; CNN(Convolutional Neural Network); Drawing Image; Real Product Image; Siamese Network; 1:1 Verification;
Citations & Related Records
연도 인용수 순위
  • Reference
1 Karen Simonyan, Andrew Zisserman, "Very Deep Convolutional Networks for large-scale image recognition'(VGGNet)", Computer Vision and Pattern Recognition, cs.CV in Sep. 2014, ICLR 2015. arXiv:1409.1556
2 Gao Huang, Zhuang Liu, Laurens van der Maaten, Kilian Q. Weinberger, "Densely Connected Convolutional Networks", Computer Vision and Pattern Recognition, cs.CV in Aug. 2016, CVPR 2017. arXiv:1608.06993
3 Mingxing Tan, Quoc V. Le, "EfficientNet: Rethinking Model Scaling for Convolutional Neural Networks" Machine Learning, cs.LG in May 2019, ICML 2019. arXiv:1905.11946
4 Zhuang Liu, Hanzi Mao, Chao-Yuan Wu, Christoph Feichtenhofer, Trevor Darrell, Saining Xie, "A ConvNet for the 2020s," Computer Vision and Pattern Recognition, cs.CV in Jan. 2022, CVPR 2022. arXiv:2201.03545
5 Andrew G. Howard, Menglong Zhu, Bo Chen, Dmitry Kalenichenko, Weijun Wang, Tobias Weyand, Marco Andreetto, Hartwig Adam, "MobileNets: Efficient Convolutional Neural Networks for Mobile Vision Applications" Computer Vision and Pattern Recognition, cs.CV in Apr. 2017, CVPR 2017. arXiv:1704.04861
6 Gregory Koch, Richard Zemel, "Ruslan Salakhutdinov, "Siamese Neural Networks for One-shot Image Recognition", Proceedings of the 32nd International Conference on Machine Learning, Lille, France, 2015. JMLR: W&CP volume 37
7 Grigori Sidorov, Alexander Gelbukh, Helena Gomez-Adorno, and David Pinto, "Soft Similarity and Soft Cosine Measure: Similarity of Features in Vector Space Model", Computacionary Sistemas Vol. 18, No. 3, pp. 491-504, Sep. 2014.
8 Weijian Deng, Liang Zheng, Qixiang Ye, Guoliang Kang, Yi Yang, Jianbin Jiao, "Image-Image Domain Adaptation with Preserved Self-Similarity and Domain-Dissimilarity for Person Re-identification", Computer Vision and Pattern Recognition, cs.CV in Jul. 2017, CVPR 2018. arXiv:1711.07027
9 Florian Schroff, Dmitry Kalenichenko, James Philbin, "FaceNet: A Unified Embedding for Face Recognition and Clustering", Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, Jun. 2015. DOI:10.1109/CVPR.2015.7298682   DOI
10 Conghui Hu, Gim Hee Lee, "Feature Representation Learning for Unsupervised Cross-domain Image Retrieval", Computer Vision and Pattern Recognition, cs.CV in Jul. 2022. ECCV 2022. arXiv:2207.09721
11 Xiaoping Zhou, Xiangyu Han, Haoran Li, Jia Wang, Xun Liang, "Cross-domain image retrieval: methods and applications", International Journal of Multimedia Information Retrieval, Vol 11, pp 199-218, Jul. 2022.   DOI
12 Qingjie Meng, Daniel Rueckert, Bernhard Kainz "Unsupervised Cross-domain Image Classification by Distance Metric Guided Feature Alignment", Machine Learning, cs.LG in Aug. 2020, arXiv:2008.08433
13 Kaiming He, Xiangyu Zhang, Shaoqing Ren, Jian Sun Microsoft Research "Deep Residual Learning for Image Recognition," Computer Vision and Pattern Recognition, Tech report pp770-778, 2015.
14 Seong-Hoon Kim, Zong Woo Geem, Gi-Tae Han, "Hyperparameter optimization method based on harmony search algorithm to improve performance of 1D CNN human respiration pattern recognition system", Sensors 2020, 20, 3697(Published: 1 July 2020). DOI:10.3390/s20133697   DOI
15 Raia Hadsell, Sumit Chopra, Yann LeCun, "Dimensionality Reduction by Learning an Invariant Mapping", 2006 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'06), Jun. 2006. DOI:10.1109/CVPR.2006.100   DOI