DOI QR코드

DOI QR Code

General Local Transformer Network in Weakly-supervised Point Cloud Analysis

약간 감독되는 포인트 클라우드 분석에서 일반 로컬 트랜스포머 네트워크

  • Anh-Thuan Tran (Department of Artifical Intelligence Convergence, Pukyong National University) ;
  • Tae Ho Lee (Department of Artifical Intelligence Convergence, Pukyong National University) ;
  • Hoanh-Su Le (Faculty of Information Systems, University of Economics and Law, Vietnam National University) ;
  • Philjoo Choi (Department of Artifical Intelligence Convergence, Pukyong National University) ;
  • Suk-Hwan Lee (Department of Computer Engineering, Dong-A University) ;
  • Ki-Ryong Kwon (Department of Artifical Intelligence Convergence, Pukyong National University)
  • ;
  • 이태호 (부경대학교 인공지능융합학과) ;
  • ;
  • 최필주 (부경대학교 인공지능융합학과) ;
  • 이석환 (동아대학교 컴퓨터공학과) ;
  • 권기룡 (부경대학교 인공지능융합학과)
  • Published : 2023.11.02

Abstract

Due to vast points and irregular structure, labeling full points in large-scale point clouds is highly tedious and time-consuming. To resolve this issue, we propose a novel point-based transformer network in weakly-supervised semantic segmentation, which only needs 0.1% point annotations. Our network introduces general local features, representing global factors from different neighborhoods based on their order positions. Then, we share query point weights to local features through point attention to reinforce impacts, which are essential in determining sparse point labels. Geometric encoding is introduced to balance query point impact and remind point position during training. As a result, one point in specific local areas can obtain global features from corresponding ones in other neighborhoods and reinforce from its query points. Experimental results on benchmark large-scale point clouds demonstrate our proposed network's state-of-the-art performance.

Keywords

Acknowledgement

This research was supported by the MSIT (Ministry of Science and ICT), Korea, under the ITRC (Information Technology Research Center) support program (IITP-2023-2020-0-01797) supervised by the IITP (Institute for Information & Communications Technology Planning & Evaluation) and the Pukyong National University Industry-university Cooperation Research Fund in 2023(202312400001).