Journal of the Korea Institute of Information and Communication Engineering (한국정보통신학회논문지)

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

ROI Extraction for Automatic Placard Recognition

플래카드 자동 인식을 위한 관심 영역 추출

  • Received : 2019.01.08
  • Accepted : 2019.02.23
  • Published : 2019.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

Containers are fitted with various placards on the surface to indicate the risk of cargo. If the containers are loaded with dangerous goods, care should be taken in handling the containers. Therefore, as part of the port automation system, there is a demand for automatic placard recognition. In this paper, proposed is a method to extract placard areas from a container image, which is the first part of the placard recognition system. The fact that placards are of various types but all have a diamond shape can be an advantage in recognition. However, it is a disadvantage in recognition that the placards can be distorted in various ways because the container surface is not flat. When the proposed method was applied to actual images, type I error did not occur. In addition, since the shape feature of the object and basic image operations are used to extract regions of interest, it can be applied to various shape-based region extraction problems.

컨테이너 표면에는 화물의 위험성을 표시하기 위해 다양한 플래카드를 부착한다. 위험물이 적재된 컨테이너의 경우 일반 컨테이너와 별도로 관리되는 등 그 처리에 주의가 필요하므로 항만 자동화 시스템의 일부로 플래카드 자동 인식에 대한 수요가 생겨나고 있다. 이 논문에서는 플래카드 자동 인식의 전단계로 컨테이너 영상에서 플래카드 영역을 추출하는 방법을 제안한다. 플래카드는 종류가 다양하지만 모두 다이아몬드 형태를 가지고 있다는 점은 인식에서 장점이 될 수 있지만, 컨테이너 표면이 평면이 아니어서 플래카드 영상이 다양하게 변형될 수 있다는 점은 인식에서 단점이라고 할 수 있다. 제안하는 방법을 실제 영상에 적용하였을 때 유형 2 오류(false negative error)는 발생하지 않았다. 또한, 관심 영역 추출을 위해 추출하고자 하는 대상의 형태적인 특징과 기본적인 이미지 연산만을 사용하였으므로 다양한 형태 기반의 관심 영역 추출에 적용될 수 있다.

Keywords

HOJBC0_2019_v23n4_374_f0001.png 이미지

Fig. 1 Information on a placard

HOJBC0_2019_v23n4_374_f0002.png 이미지

Fig. 2 Different placards of the same class

HOJBC0_2019_v23n4_374_f0003.png 이미지

Fig. 3 Placard image deformation

HOJBC0_2019_v23n4_374_f0004.png 이미지

Fig. 4 ROI extraction process

HOJBC0_2019_v23n4_374_f0005.png 이미지

Fig. 5 Candidate region detection

HOJBC0_2019_v23n4_374_f0006.png 이미지

Fig. 6 Region separation

HOJBC0_2019_v23n4_374_f0007.png 이미지

Fig. 7 ROI marking

HOJBC0_2019_v23n4_374_f0008.png 이미지

Fig. 8 Type II error in ROI extraction

Table. 1 Container placards

HOJBC0_2019_v23n4_374_t0001.png 이미지

References

  1. IMDG Code, International Maritime Organization [Internet]. Available: http://www.imo.org/en/Publications/IMDGCode/Pages/Default.aspx.
  2. Z. Zhu, D. Liang, S. Zhang, X, Huang, B. Li, and S. Hu, "Traffic-Sign Detection and Classification in the Wild," in Proceedings of the 2016 IEEE Conference on Computer Vision and Pattern Recognition, Las Vegas, NV, USA, pp. 2110-2118, 2016.
  3. A. A. Sheikh, A. Kole, and T. Maity, "Traffic sign detection and classification using colour feature and neural network," in Proceedings of the 2016 International Conference on Intelligent Control Power and Instrumentation, Kolkata, India, pp. 307-311, 2016.
  4. H. Oh, and E. Rhee, "Enhancement of Car License Plate Recognition Rate and Security with Rotation Algorithm," Journal of Security Engineering, vol. 13, no. 2, pp. 83-90, April 2016. https://doi.org/10.14257/jse.2016.04.01
  5. Y. J. Kim, and E. G. Kim, "Image based fire detection using convolutional neural network," Journal of the Korea Institute of Information and Communication Engineering, vol. 20, no. 9, pp. 1649-1656, Sep. 2016. https://doi.org/10.6109/jkiice.2016.20.9.1649
  6. H. S. Lee, and K. Kim, "Simultaneous Traffic Sign Detection and Boundary Estimation Using Convolutional Neural Network," IEEE Transactions on Intelligent Transportation Systems, vol. 19, no. 5, pp. 1652-1663, May 2018. https://doi.org/10.1109/TITS.2018.2801560
  7. R. C. Gonzalez, and R. E. Woods, Digital Image Processing, 4th ed. Pearson, 2017.
  8. G. Heo, I. Lee, and Y. W. Woo, "ROI Extraction for Container Placard Recognition," in Proceedings of the 2018 Fall Conference of Korea Institute of Information and Communication Engineering, Jeju, Korea, pp. 629-630, 2018.
  9. W. J. Lee, "An Empirical Approach to Evaluate College Image Perception," Asia-pacific Journal of Multimedia Services Convergent with Art, Humanities, and Sociology, vol. 5, no. 1, pp. 57-66, Feb. 2015. https://doi.org/10.14257/AJMAHS.2015.02.08